W0706 04:51:26.684000 1886854 site-packages/torch/distributed/run.py:766] 
W0706 04:51:26.684000 1886854 site-packages/torch/distributed/run.py:766] *****************************************
W0706 04:51:26.684000 1886854 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0706 04:51:26.684000 1886854 site-packages/torch/distributed/run.py:766] *****************************************
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
[INFO] Running in WANDB offline mode
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-06 04:51:35,958] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
df: /home/dungpq6/.triton/autotune: No such file or directory
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-06 04:51:36,156] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-06 04:51:36,264] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-06 04:51:36,366] [INFO] [comm.py:658:init_distributed] cdb=None
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
Trainer._get_train_sampler replaced with custom implementation.
Trainer._get_train_sampler replaced with custom implementation.
[2026-07-06 04:51:36,474] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-06 04:51:36,486] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-06 04:51:36,514] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-06 04:51:36,514] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-06 04:51:36,517] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Trainer._get_train_sampler replaced with custom implementation.
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
[2026-07-06 04:51:36,581] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2026-07-06 04:51:36,585] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-06 04:51:36,820] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-06 04:51:36,828] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-06 04:51:36,829] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-06 04:51:36,829] [INFO] [comm.py:689:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl
[2026-07-06 04:51:36,835] [INFO] [comm.py:658:init_distributed] cdb=None
[2026-07-06 04:51:36,897] [INFO] [comm.py:658:init_distributed] cdb=None

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11539.34it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 13191.99it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 13110.54it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 12887.56it/s]

Loading weights: 100%|██████████| 723/723 [00:00<00:00, 10571.18it/s]

Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11196.13it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11572.64it/s]

Loading weights:   0%|          | 0/723 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 723/723 [00:00<00:00, 11331.51it/s]
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
[VGGTEncoder] eval KV-cache window: start=8 recent=48 (total=56 frames)
[FeatureFusion] geometry fusion delta scaled by 0.5
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Loading weights from local directory
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Vision Module - Attention Blocks:
Trainable Block Indices: None
Non-Trainable Block Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23]
Merger Module Trainable: True
LLM Module - Embed Tokens Trainable: True
LLM Module - Trainable Layer Indices: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31]
LLM Module - Non-Trainable Layer Indices: None
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Qwen3_5Config {
  "architectures": [
    "Qwen3_5ForConditionalGeneration"
  ],
  "dtype": "bfloat16",
  "feature_fusion_method": "deepstack_language_add",
  "fusion_num_layers": 1,
  "geometry_encoder_layers": [
    11,
    17,
    23
  ],
  "geometry_encoder_path": "/mnt/data/vmo-ai-task/dungpq6/model-checkpoint/VGGT-1B",
  "geometry_encoder_streaming": true,
  "geometry_encoder_type": "vggt",
  "geometry_frame_strict": true,
  "geometry_fusion_layers": [
    0,
    1,
    2
  ],
  "geometry_fusion_scale": 0.5,
  "geometry_merger_type": "mlp",
  "image_token_id": 248056,
  "include_camera_token": false,
  "model_type": "qwen3_5",
  "pos_encoding_type": "none",
  "reference_frame": "first",
  "text_config": {
    "attention_bias": false,
    "attention_dropout": 0.0,
    "attn_output_gate": true,
    "bos_token_id": null,
    "dtype": "bfloat16",
    "eos_token_id": 248044,
    "full_attention_interval": 4,
    "head_dim": 256,
    "hidden_act": "silu",
    "hidden_size": 2560,
    "initializer_range": 0.02,
    "intermediate_size": 9216,
    "layer_types": [
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention",
      "linear_attention",
      "linear_attention",
      "linear_attention",
      "full_attention"
    ],
    "linear_conv_kernel_dim": 4,
    "linear_key_head_dim": 128,
    "linear_num_key_heads": 16,
    "linear_num_value_heads": 32,
    "linear_value_head_dim": 128,
    "mamba_ssm_dtype": "float32",
    "max_position_embeddings": 262144,
    "mlp_only_layers": [],
    "model_type": "qwen3_5_text",
    "mtp_num_hidden_layers": 1,
    "mtp_use_dedicated_embeddings": false,
    "num_attention_heads": 16,
    "num_hidden_layers": 32,
    "num_key_value_heads": 4,
    "pad_token_id": null,
    "partial_rotary_factor": 0.25,
    "rms_norm_eps": 1e-06,
    "rope_parameters": {
      "mrope_interleaved": true,
      "mrope_section": [
        11,
        11,
        10
      ],
      "partial_rotary_factor": 0.25,
      "rope_theta": 10000000,
      "rope_type": "default"
    },
    "tie_word_embeddings": true,
    "use_cache": true,
    "vocab_size": 248320
  },
  "tie_word_embeddings": true,
  "transformers_version": "5.3.0",
  "use_cache": false,
  "use_geometry_encoder": true,
  "video_token_id": 248057,
  "vision_config": {
    "deepstack_visual_indexes": [],
    "depth": 24,
    "dtype": "bfloat16",
    "hidden_act": "gelu_pytorch_tanh",
    "hidden_size": 1024,
    "in_channels": 3,
    "initializer_range": 0.02,
    "intermediate_size": 4096,
    "model_type": "qwen3_5",
    "num_heads": 16,
    "num_position_embeddings": 2304,
    "out_hidden_size": 2560,
    "patch_size": 16,
    "spatial_merge_size": 2,
    "temporal_patch_size": 2
  },
  "vision_end_token_id": 248054,
  "vision_language_fusion_layers": null,
  "vision_start_token_id": 248053
}

Loading datasets: [{'annotation_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN/train_r2r_rxr.json', 'data_path': '/mnt/data/vmo-ai-task/anhdh35/JanusVLN', 'tag': '3d', 'sampling_rate': 1.0, 'dataset_name': 'train_r2r_rxr'}]
Total training samples: 2429620
Total training samples: 2429620
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Total training samples: 2429620
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
Total training samples: 2429620
Total training samples: 2429620
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
Total training samples: 2429620
Total training samples: 2429620
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
Formatting inputs...Skip in lazy mode
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 248046, 'pad_token_id': 248044}.
NCCL version 2.26.2+cuda12.2
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 0/37963 [00:00<?, ?it/s]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 1/37963 [01:59<1255:38:44, 119.07s/it]/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  0%|          | 2/37963 [02:06<566:07:44, 53.69s/it]  
  0%|          | 3/37963 [02:14<344:12:26, 32.64s/it]
  0%|          | 4/37963 [02:22<239:16:54, 22.69s/it]
  0%|          | 5/37963 [02:38<213:42:47, 20.27s/it]
  0%|          | 6/37963 [02:46<171:30:10, 16.27s/it]
  0%|          | 7/37963 [02:54<142:23:35, 13.51s/it]
  0%|          | 8/37963 [03:02<123:16:19, 11.69s/it]
  0%|          | 9/37963 [03:10<112:39:55, 10.69s/it]
  0%|          | 10/37963 [03:18<102:33:25,  9.73s/it]
                                                      
{'loss': '2.342', 'grad_norm': '1217', 'learning_rate': '1.58e-07', 'epoch': '0.0002634'}

  0%|          | 10/37963 [03:18<102:33:25,  9.73s/it]
  0%|          | 11/37963 [03:34<124:22:03, 11.80s/it]
  0%|          | 12/37963 [03:42<112:58:47, 10.72s/it]
  0%|          | 13/37963 [03:51<105:55:41, 10.05s/it]
  0%|          | 14/37963 [03:59<98:25:24,  9.34s/it] 
  0%|          | 15/37963 [04:06<92:22:39,  8.76s/it]
  0%|          | 16/37963 [04:15<91:25:24,  8.67s/it]
  0%|          | 17/37963 [04:22<87:22:21,  8.29s/it]
  0%|          | 18/37963 [04:29<84:50:56,  8.05s/it]
  0%|          | 19/37963 [04:37<83:40:13,  7.94s/it]
  0%|          | 20/37963 [04:44<81:46:20,  7.76s/it]
                                                     
{'loss': '0.6632', 'grad_norm': '55.98', 'learning_rate': '3.336e-07', 'epoch': '0.0005268'}

  0%|          | 20/37963 [04:44<81:46:20,  7.76s/it]
  0%|          | 21/37963 [04:53<83:43:57,  7.94s/it]
  0%|          | 22/37963 [05:01<84:29:19,  8.02s/it]
  0%|          | 23/37963 [05:09<83:12:08,  7.89s/it]
  0%|          | 24/37963 [05:16<81:33:43,  7.74s/it]
  0%|          | 25/37963 [05:24<81:07:08,  7.70s/it]
  0%|          | 26/37963 [05:31<81:43:52,  7.76s/it]
  0%|          | 27/37963 [05:39<81:22:16,  7.72s/it]
  0%|          | 28/37963 [05:47<80:50:06,  7.67s/it]
  0%|          | 29/37963 [05:54<80:06:50,  7.60s/it]
  0%|          | 30/37963 [06:02<80:14:03,  7.61s/it]
                                                     
{'loss': '0.2981', 'grad_norm': '32.83', 'learning_rate': '5.092e-07', 'epoch': '0.0007902'}

  0%|          | 30/37963 [06:02<80:14:03,  7.61s/it]
  0%|          | 31/37963 [06:10<81:33:26,  7.74s/it]
  0%|          | 32/37963 [06:17<80:19:55,  7.62s/it]
  0%|          | 33/37963 [06:25<80:04:41,  7.60s/it]
  0%|          | 34/37963 [06:32<80:23:28,  7.63s/it]
  0%|          | 35/37963 [06:40<80:19:14,  7.62s/it]
  0%|          | 36/37963 [06:48<80:51:25,  7.67s/it]
  0%|          | 37/37963 [06:55<79:46:13,  7.57s/it]
  0%|          | 38/37963 [07:10<103:13:08,  9.80s/it]
  0%|          | 39/37963 [07:18<96:07:37,  9.13s/it] 
  0%|          | 40/37963 [07:25<91:28:24,  8.68s/it]
                                                     
{'loss': '0.2498', 'grad_norm': '14.34', 'learning_rate': '6.848e-07', 'epoch': '0.001054'}

  0%|          | 40/37963 [07:25<91:28:24,  8.68s/it]
  0%|          | 41/37963 [07:39<108:08:22, 10.27s/it]
  0%|          | 42/37963 [07:54<121:47:53, 11.56s/it]
  0%|          | 43/37963 [08:17<157:49:14, 14.98s/it]
  0%|          | 44/37963 [08:38<177:24:27, 16.84s/it]
  0%|          | 45/37963 [08:53<170:08:58, 16.15s/it]
  0%|          | 46/37963 [09:09<171:20:25, 16.27s/it]
  0%|          | 47/37963 [09:17<143:40:18, 13.64s/it]
  0%|          | 48/37963 [09:24<124:21:35, 11.81s/it]
  0%|          | 49/37963 [09:32<111:13:41, 10.56s/it]
  0%|          | 50/37963 [09:40<103:38:00,  9.84s/it]
                                                      
{'loss': '0.2567', 'grad_norm': '21.13', 'learning_rate': '8.604e-07', 'epoch': '0.001317'}

  0%|          | 50/37963 [09:40<103:38:00,  9.84s/it]
  0%|          | 51/37963 [09:47<96:17:14,  9.14s/it] 
  0%|          | 52/37963 [09:55<91:16:37,  8.67s/it]
  0%|          | 53/37963 [10:02<87:15:43,  8.29s/it]
  0%|          | 54/37963 [10:10<85:09:21,  8.09s/it]
  0%|          | 55/37963 [10:18<85:31:48,  8.12s/it]
  0%|          | 56/37963 [10:26<83:00:10,  7.88s/it]
  0%|          | 57/37963 [10:33<82:08:40,  7.80s/it]
  0%|          | 58/37963 [10:41<80:55:18,  7.69s/it]
  0%|          | 59/37963 [10:48<80:54:12,  7.68s/it]
  0%|          | 60/37963 [10:56<81:38:01,  7.75s/it]
                                                     
{'loss': '0.2368', 'grad_norm': '14.96', 'learning_rate': '1.036e-06', 'epoch': '0.00158'}

  0%|          | 60/37963 [10:56<81:38:01,  7.75s/it]
  0%|          | 61/37963 [11:04<80:52:16,  7.68s/it]
  0%|          | 62/37963 [11:11<79:47:49,  7.58s/it]
  0%|          | 63/37963 [11:19<79:51:24,  7.59s/it]
  0%|          | 64/37963 [11:26<79:26:34,  7.55s/it]
  0%|          | 65/37963 [11:34<81:07:06,  7.71s/it]
  0%|          | 66/37963 [11:42<79:59:01,  7.60s/it]
  0%|          | 67/37963 [11:50<82:02:27,  7.79s/it]
  0%|          | 68/37963 [11:57<80:40:11,  7.66s/it]
  0%|          | 69/37963 [12:04<79:05:06,  7.51s/it]
  0%|          | 70/37963 [12:12<79:07:51,  7.52s/it]
                                                     
{'loss': '0.2211', 'grad_norm': '11.26', 'learning_rate': '1.212e-06', 'epoch': '0.001844'}

  0%|          | 70/37963 [12:12<79:07:51,  7.52s/it]
  0%|          | 71/37963 [12:19<78:48:31,  7.49s/it]
  0%|          | 72/37963 [12:27<79:01:22,  7.51s/it]
  0%|          | 73/37963 [12:34<79:01:24,  7.51s/it]
  0%|          | 74/37963 [12:42<79:16:06,  7.53s/it]
  0%|          | 75/37963 [12:49<78:52:27,  7.49s/it]
  0%|          | 76/37963 [12:57<78:58:09,  7.50s/it]
  0%|          | 77/37963 [13:04<79:03:13,  7.51s/it]
  0%|          | 78/37963 [13:12<79:30:35,  7.56s/it]
  0%|          | 79/37963 [13:20<79:19:07,  7.54s/it]
  0%|          | 80/37963 [13:27<79:18:57,  7.54s/it]
                                                     
{'loss': '0.2326', 'grad_norm': '9.797', 'learning_rate': '1.387e-06', 'epoch': '0.002107'}

  0%|          | 80/37963 [13:27<79:18:57,  7.54s/it]
  0%|          | 81/37963 [13:35<79:19:06,  7.54s/it]
  0%|          | 82/37963 [13:42<79:23:15,  7.54s/it]
  0%|          | 83/37963 [13:50<79:46:27,  7.58s/it]
  0%|          | 84/37963 [13:57<79:44:22,  7.58s/it]
  0%|          | 85/37963 [14:05<79:19:12,  7.54s/it]
  0%|          | 86/37963 [14:12<79:06:22,  7.52s/it]
  0%|          | 87/37963 [14:20<79:25:38,  7.55s/it]
  0%|          | 88/37963 [14:35<101:41:06,  9.67s/it]
  0%|          | 89/37963 [14:42<94:57:35,  9.03s/it] 
  0%|          | 90/37963 [14:49<89:19:06,  8.49s/it]
                                                     
{'loss': '0.2157', 'grad_norm': '13.79', 'learning_rate': '1.563e-06', 'epoch': '0.002371'}

  0%|          | 90/37963 [14:49<89:19:06,  8.49s/it]
  0%|          | 91/37963 [14:57<86:16:23,  8.20s/it]
  0%|          | 92/37963 [15:23<144:07:39, 13.70s/it]
  0%|          | 93/37963 [15:31<123:46:06, 11.77s/it]
  0%|          | 94/37963 [15:38<110:34:48, 10.51s/it]
  0%|          | 95/37963 [15:58<140:51:11, 13.39s/it]
  0%|          | 96/37963 [16:12<142:30:09, 13.55s/it]
  0%|          | 97/37963 [16:19<122:41:46, 11.66s/it]
  0%|          | 98/37963 [16:27<109:39:46, 10.43s/it]
  0%|          | 99/37963 [16:35<100:38:06,  9.57s/it]
  0%|          | 100/37963 [16:42<94:04:26,  8.94s/it]
                                                      
{'loss': '0.2141', 'grad_norm': '12.8', 'learning_rate': '1.738e-06', 'epoch': '0.002634'}

  0%|          | 100/37963 [16:42<94:04:26,  8.94s/it]
  0%|          | 101/37963 [16:50<89:23:45,  8.50s/it]
  0%|          | 102/37963 [16:57<86:06:58,  8.19s/it]
  0%|          | 103/37963 [17:05<84:18:04,  8.02s/it]
  0%|          | 104/37963 [17:12<82:28:17,  7.84s/it]
  0%|          | 105/37963 [17:20<83:05:15,  7.90s/it]
  0%|          | 106/37963 [17:28<84:27:24,  8.03s/it]
  0%|          | 107/37963 [17:37<86:10:19,  8.19s/it]
  0%|          | 108/37963 [17:46<87:53:00,  8.36s/it]
  0%|          | 109/37963 [17:53<85:53:18,  8.17s/it]
  0%|          | 110/37963 [18:01<83:45:52,  7.97s/it]
                                                      
{'loss': '0.2172', 'grad_norm': '10.93', 'learning_rate': '1.914e-06', 'epoch': '0.002898'}

  0%|          | 110/37963 [18:01<83:45:52,  7.97s/it]
  0%|          | 111/37963 [18:08<82:14:09,  7.82s/it]
  0%|          | 112/37963 [18:16<81:16:33,  7.73s/it]
  0%|          | 113/37963 [18:24<81:24:11,  7.74s/it]
  0%|          | 114/37963 [18:31<80:51:50,  7.69s/it]
  0%|          | 115/37963 [18:39<80:29:01,  7.66s/it]
  0%|          | 116/37963 [18:46<80:05:20,  7.62s/it]
  0%|          | 117/37963 [18:54<79:32:10,  7.57s/it]
  0%|          | 118/37963 [19:01<79:35:11,  7.57s/it]
  0%|          | 119/37963 [19:09<79:21:14,  7.55s/it]
  0%|          | 120/37963 [19:16<79:09:07,  7.53s/it]
                                                      
{'loss': '0.2328', 'grad_norm': '18.31', 'learning_rate': '2.09e-06', 'epoch': '0.003161'}

  0%|          | 120/37963 [19:16<79:09:07,  7.53s/it]
  0%|          | 121/37963 [19:24<78:17:14,  7.45s/it]
  0%|          | 122/37963 [19:31<78:46:19,  7.49s/it]
  0%|          | 123/37963 [19:39<78:45:12,  7.49s/it]
  0%|          | 124/37963 [19:46<78:14:14,  7.44s/it]
  0%|          | 125/37963 [19:53<77:53:39,  7.41s/it]
  0%|          | 126/37963 [20:01<78:21:30,  7.46s/it]
  0%|          | 127/37963 [20:09<78:53:22,  7.51s/it]
  0%|          | 128/37963 [20:16<79:08:43,  7.53s/it]
  0%|          | 129/37963 [20:24<78:31:59,  7.47s/it]
  0%|          | 130/37963 [20:31<78:34:19,  7.48s/it]
                                                      
{'loss': '0.2017', 'grad_norm': '10.72', 'learning_rate': '2.265e-06', 'epoch': '0.003424'}

  0%|          | 130/37963 [20:31<78:34:19,  7.48s/it]
  0%|          | 131/37963 [20:39<79:16:15,  7.54s/it]
  0%|          | 132/37963 [20:46<79:11:51,  7.54s/it]
  0%|          | 133/37963 [20:53<78:10:21,  7.44s/it]
  0%|          | 134/37963 [21:01<78:41:55,  7.49s/it]
  0%|          | 135/37963 [21:09<78:53:06,  7.51s/it]
  0%|          | 136/37963 [21:16<78:57:18,  7.51s/it]
  0%|          | 137/37963 [21:30<99:30:13,  9.47s/it]
  0%|          | 138/37963 [21:44<113:33:37, 10.81s/it]
  0%|          | 139/37963 [21:58<123:29:59, 11.75s/it]
  0%|          | 140/37963 [22:18<150:48:01, 14.35s/it]
                                                       
{'loss': '0.2146', 'grad_norm': '14.49', 'learning_rate': '2.441e-06', 'epoch': '0.003688'}

  0%|          | 140/37963 [22:18<150:48:01, 14.35s/it]
  0%|          | 141/37963 [22:32<149:22:09, 14.22s/it]
  0%|          | 142/37963 [22:46<148:18:32, 14.12s/it]
  0%|          | 143/37963 [23:00<147:44:49, 14.06s/it]
  0%|          | 144/37963 [23:08<127:52:30, 12.17s/it]
  0%|          | 145/37963 [23:16<113:19:42, 10.79s/it]
  0%|          | 146/37963 [23:23<102:42:13,  9.78s/it]
  0%|          | 147/37963 [23:30<95:41:20,  9.11s/it] 
  0%|          | 148/37963 [23:38<90:58:12,  8.66s/it]
  0%|          | 149/37963 [23:46<87:23:56,  8.32s/it]
  0%|          | 150/37963 [23:53<84:37:21,  8.06s/it]
                                                      
{'loss': '0.2172', 'grad_norm': '10.45', 'learning_rate': '2.616e-06', 'epoch': '0.003951'}

  0%|          | 150/37963 [23:53<84:37:21,  8.06s/it]
  0%|          | 151/37963 [24:01<82:55:03,  7.89s/it]
  0%|          | 152/37963 [24:08<81:53:42,  7.80s/it]
  0%|          | 153/37963 [24:16<80:31:34,  7.67s/it]
  0%|          | 154/37963 [24:23<80:37:40,  7.68s/it]
  0%|          | 155/37963 [24:31<80:31:31,  7.67s/it]
  0%|          | 156/37963 [24:38<80:00:55,  7.62s/it]
  0%|          | 157/37963 [24:46<79:35:35,  7.58s/it]
  0%|          | 158/37963 [24:54<79:47:22,  7.60s/it]
  0%|          | 159/37963 [25:01<79:00:01,  7.52s/it]
  0%|          | 160/37963 [25:08<79:02:29,  7.53s/it]
                                                      
{'loss': '0.2332', 'grad_norm': '17.62', 'learning_rate': '2.792e-06', 'epoch': '0.004215'}

  0%|          | 160/37963 [25:08<79:02:29,  7.53s/it]
  0%|          | 161/37963 [25:16<78:34:43,  7.48s/it]
  0%|          | 162/37963 [25:23<78:43:09,  7.50s/it]
  0%|          | 163/37963 [25:31<77:48:42,  7.41s/it]
  0%|          | 164/37963 [25:38<78:12:35,  7.45s/it]
  0%|          | 165/37963 [25:46<78:16:47,  7.46s/it]
  0%|          | 166/37963 [25:53<78:35:14,  7.49s/it]
  0%|          | 167/37963 [26:00<78:11:28,  7.45s/it]
  0%|          | 168/37963 [26:08<78:43:17,  7.50s/it]
  0%|          | 169/37963 [26:16<78:53:55,  7.52s/it]
  0%|          | 170/37963 [26:23<79:03:50,  7.53s/it]
                                                      
{'loss': '0.2324', 'grad_norm': '11.79', 'learning_rate': '2.968e-06', 'epoch': '0.004478'}

  0%|          | 170/37963 [26:23<79:03:50,  7.53s/it]
  0%|          | 171/37963 [26:31<78:30:11,  7.48s/it]
  0%|          | 172/37963 [26:38<78:38:50,  7.49s/it]
  0%|          | 173/37963 [26:46<78:38:15,  7.49s/it]
  0%|          | 174/37963 [26:53<79:07:26,  7.54s/it]
  0%|          | 175/37963 [27:00<78:20:42,  7.46s/it]
  0%|          | 176/37963 [27:08<77:15:10,  7.36s/it]
  0%|          | 177/37963 [27:15<77:47:09,  7.41s/it]
  0%|          | 178/37963 [27:23<78:13:18,  7.45s/it]
  0%|          | 179/37963 [27:30<78:13:54,  7.45s/it]
  0%|          | 180/37963 [27:38<78:34:40,  7.49s/it]
                                                      
{'loss': '0.2302', 'grad_norm': '10.5', 'learning_rate': '3.143e-06', 'epoch': '0.004741'}

  0%|          | 180/37963 [27:38<78:34:40,  7.49s/it]
  0%|          | 181/37963 [27:45<79:04:14,  7.53s/it]
  0%|          | 182/37963 [27:53<79:18:37,  7.56s/it]
  0%|          | 183/37963 [28:00<79:09:36,  7.54s/it]
  0%|          | 184/37963 [28:08<79:06:59,  7.54s/it]
  0%|          | 185/37963 [28:22<99:13:10,  9.45s/it]
  0%|          | 186/37963 [28:36<113:39:12, 10.83s/it]
  0%|          | 187/37963 [28:44<103:23:44,  9.85s/it]
  0%|          | 188/37963 [28:58<116:33:37, 11.11s/it]
  0%|          | 189/37963 [29:12<126:29:18, 12.05s/it]
  1%|          | 190/37963 [29:19<112:20:15, 10.71s/it]
                                                       
{'loss': '0.2124', 'grad_norm': '7.195', 'learning_rate': '3.319e-06', 'epoch': '0.005005'}

  1%|          | 190/37963 [29:19<112:20:15, 10.71s/it]
  1%|          | 191/37963 [29:34<123:27:02, 11.77s/it]
  1%|          | 192/37963 [29:48<131:25:20, 12.53s/it]
  1%|          | 193/37963 [29:55<115:20:56, 10.99s/it]
  1%|          | 194/37963 [30:16<144:44:43, 13.80s/it]
  1%|          | 195/37963 [30:23<125:24:47, 11.95s/it]
  1%|          | 196/37963 [30:31<111:25:55, 10.62s/it]
  1%|          | 197/37963 [30:38<101:08:58,  9.64s/it]
  1%|          | 198/37963 [30:46<94:29:35,  9.01s/it] 
  1%|          | 199/37963 [30:53<90:06:34,  8.59s/it]
  1%|          | 200/37963 [31:01<86:10:28,  8.22s/it]
                                                      
{'loss': '0.2247', 'grad_norm': '12.45', 'learning_rate': '3.494e-06', 'epoch': '0.005268'}

  1%|          | 200/37963 [31:01<86:10:28,  8.22s/it]
  1%|          | 201/37963 [31:08<84:06:22,  8.02s/it]
  1%|          | 202/37963 [31:16<82:15:46,  7.84s/it]
  1%|          | 203/37963 [31:23<81:12:53,  7.74s/it]
  1%|          | 204/37963 [31:31<80:40:52,  7.69s/it]
  1%|          | 205/37963 [31:38<80:32:38,  7.68s/it]
  1%|          | 206/37963 [31:46<80:14:41,  7.65s/it]
  1%|          | 207/37963 [31:54<79:48:59,  7.61s/it]
  1%|          | 208/37963 [32:01<79:34:57,  7.59s/it]
  1%|          | 209/37963 [32:09<79:29:47,  7.58s/it]
  1%|          | 210/37963 [32:16<79:01:42,  7.54s/it]
                                                      
{'loss': '0.2129', 'grad_norm': '13.43', 'learning_rate': '3.67e-06', 'epoch': '0.005532'}

  1%|          | 210/37963 [32:16<79:01:42,  7.54s/it]
  1%|          | 211/37963 [32:24<79:05:51,  7.54s/it]
  1%|          | 212/37963 [32:31<79:00:03,  7.53s/it]
  1%|          | 213/37963 [32:39<79:10:53,  7.55s/it]
  1%|          | 214/37963 [32:46<78:59:47,  7.53s/it]
  1%|          | 215/37963 [32:54<78:57:00,  7.53s/it]
  1%|          | 216/37963 [33:01<79:05:20,  7.54s/it]
  1%|          | 217/37963 [33:09<79:24:34,  7.57s/it]
  1%|          | 218/37963 [33:17<79:30:35,  7.58s/it]
  1%|          | 219/37963 [33:24<79:39:37,  7.60s/it]
  1%|          | 220/37963 [33:32<79:38:26,  7.60s/it]
                                                      
{'loss': '0.2042', 'grad_norm': '19.55', 'learning_rate': '3.845e-06', 'epoch': '0.005795'}

  1%|          | 220/37963 [33:32<79:38:26,  7.60s/it]
  1%|          | 221/37963 [33:39<78:44:01,  7.51s/it]
  1%|          | 222/37963 [33:47<78:52:38,  7.52s/it]
  1%|          | 223/37963 [33:54<79:06:32,  7.55s/it]
  1%|          | 224/37963 [34:02<79:10:14,  7.55s/it]
  1%|          | 225/37963 [34:10<79:40:50,  7.60s/it]
  1%|          | 226/37963 [34:17<78:51:15,  7.52s/it]
  1%|          | 227/37963 [34:25<79:14:57,  7.56s/it]
  1%|          | 228/37963 [34:32<79:36:32,  7.59s/it]
  1%|          | 229/37963 [34:40<79:07:34,  7.55s/it]
  1%|          | 230/37963 [34:47<79:07:41,  7.55s/it]
                                                      
{'loss': '0.2137', 'grad_norm': '11.29', 'learning_rate': '4.021e-06', 'epoch': '0.006059'}

  1%|          | 230/37963 [34:47<79:07:41,  7.55s/it]
  1%|          | 231/37963 [34:55<79:04:46,  7.54s/it]
  1%|          | 232/37963 [35:02<78:38:20,  7.50s/it]
  1%|          | 233/37963 [35:16<99:03:49,  9.45s/it]
  1%|          | 234/37963 [35:30<113:38:22, 10.84s/it]
  1%|          | 235/37963 [35:38<103:20:31,  9.86s/it]
  1%|          | 236/37963 [35:45<96:11:34,  9.18s/it] 
  1%|          | 237/37963 [35:53<91:14:40,  8.71s/it]
  1%|          | 238/37963 [36:13<127:11:20, 12.14s/it]
  1%|          | 239/37963 [36:21<112:41:54, 10.75s/it]
  1%|          | 240/37963 [36:28<100:45:38,  9.62s/it]
                                                       
{'loss': '0.2219', 'grad_norm': '13.07', 'learning_rate': '4.197e-06', 'epoch': '0.006322'}

  1%|          | 240/37963 [36:28<100:45:38,  9.62s/it]
  1%|          | 241/37963 [36:41<113:07:22, 10.80s/it]
  1%|          | 242/37963 [36:49<102:25:46,  9.78s/it]
  1%|          | 243/37963 [37:09<136:44:27, 13.05s/it]
  1%|          | 244/37963 [37:23<139:42:39, 13.33s/it]
  1%|          | 245/37963 [37:31<122:22:39, 11.68s/it]
  1%|          | 246/37963 [37:39<109:39:31, 10.47s/it]
  1%|          | 247/37963 [37:46<100:18:19,  9.57s/it]
  1%|          | 248/37963 [37:54<93:58:34,  8.97s/it] 
  1%|          | 249/37963 [38:01<88:20:09,  8.43s/it]
  1%|          | 250/37963 [38:08<85:31:20,  8.16s/it]
                                                      
{'loss': '0.1773', 'grad_norm': '15.07', 'learning_rate': '4.372e-06', 'epoch': '0.006585'}

  1%|          | 250/37963 [38:08<85:31:20,  8.16s/it]
  1%|          | 251/37963 [38:16<83:38:16,  7.98s/it]
  1%|          | 252/37963 [38:23<81:47:11,  7.81s/it]
  1%|          | 253/37963 [38:31<80:51:02,  7.72s/it]
  1%|          | 254/37963 [38:38<80:09:57,  7.65s/it]
  1%|          | 255/37963 [38:46<79:59:45,  7.64s/it]
  1%|          | 256/37963 [38:54<79:31:22,  7.59s/it]
  1%|          | 257/37963 [39:01<79:32:58,  7.60s/it]
  1%|          | 258/37963 [39:09<79:03:32,  7.55s/it]
  1%|          | 259/37963 [39:16<79:16:24,  7.57s/it]
  1%|          | 260/37963 [39:24<79:05:53,  7.55s/it]
                                                      
{'loss': '0.2154', 'grad_norm': '14.86', 'learning_rate': '4.548e-06', 'epoch': '0.006849'}

  1%|          | 260/37963 [39:24<79:05:53,  7.55s/it]
  1%|          | 261/37963 [39:31<79:19:39,  7.57s/it]
  1%|          | 262/37963 [39:39<79:01:19,  7.55s/it]
  1%|          | 263/37963 [39:46<79:12:48,  7.56s/it]
  1%|          | 264/37963 [39:54<79:11:40,  7.56s/it]
  1%|          | 265/37963 [40:02<80:00:29,  7.64s/it]
  1%|          | 266/37963 [40:09<79:40:13,  7.61s/it]
  1%|          | 267/37963 [40:17<79:43:46,  7.61s/it]
  1%|          | 268/37963 [40:24<79:24:30,  7.58s/it]
  1%|          | 269/37963 [40:32<79:09:11,  7.56s/it]
  1%|          | 270/37963 [40:40<79:09:39,  7.56s/it]
                                                      
{'loss': '0.1934', 'grad_norm': '6.254', 'learning_rate': '4.723e-06', 'epoch': '0.007112'}

  1%|          | 270/37963 [40:40<79:09:39,  7.56s/it]
  1%|          | 271/37963 [40:47<78:45:26,  7.52s/it]
  1%|          | 272/37963 [40:54<78:29:10,  7.50s/it]
  1%|          | 273/37963 [41:02<78:38:03,  7.51s/it]
  1%|          | 274/37963 [41:09<78:43:05,  7.52s/it]
  1%|          | 275/37963 [41:17<78:45:31,  7.52s/it]
  1%|          | 276/37963 [41:25<78:46:56,  7.53s/it]
  1%|          | 277/37963 [41:32<78:36:44,  7.51s/it]
  1%|          | 278/37963 [41:40<78:53:01,  7.54s/it]
  1%|          | 279/37963 [41:47<79:00:20,  7.55s/it]
  1%|          | 280/37963 [41:55<79:15:03,  7.57s/it]
                                                      
{'loss': '0.1988', 'grad_norm': '12.63', 'learning_rate': '4.899e-06', 'epoch': '0.007376'}

  1%|          | 280/37963 [41:55<79:15:03,  7.57s/it]
  1%|          | 281/37963 [42:02<79:04:14,  7.55s/it]
  1%|          | 282/37963 [42:16<99:28:56,  9.50s/it]
  1%|          | 283/37963 [42:24<93:43:59,  8.96s/it]
  1%|          | 284/37963 [42:38<109:18:46, 10.44s/it]
  1%|          | 285/37963 [42:52<120:15:31, 11.49s/it]
  1%|          | 286/37963 [43:06<128:31:17, 12.28s/it]
  1%|          | 287/37963 [43:14<113:42:41, 10.87s/it]
  1%|          | 288/37963 [43:21<103:20:09,  9.87s/it]
  1%|          | 289/37963 [43:36<117:27:39, 11.22s/it]
  1%|          | 290/37963 [43:43<105:14:51, 10.06s/it]
                                                       
{'loss': '0.1908', 'grad_norm': '8.809', 'learning_rate': '5.075e-06', 'epoch': '0.007639'}

  1%|          | 290/37963 [43:43<105:14:51, 10.06s/it]
  1%|          | 291/37963 [43:50<97:09:45,  9.29s/it] 
  1%|          | 292/37963 [44:04<111:06:36, 10.62s/it]
  1%|          | 293/37963 [44:18<122:33:13, 11.71s/it]
  1%|          | 294/37963 [44:26<109:10:41, 10.43s/it]
  1%|          | 295/37963 [44:33<100:23:54,  9.60s/it]
  1%|          | 296/37963 [44:41<94:19:39,  9.02s/it] 
  1%|          | 297/37963 [44:49<90:00:52,  8.60s/it]
  1%|          | 298/37963 [44:56<86:33:03,  8.27s/it]
  1%|          | 299/37963 [45:04<84:18:32,  8.06s/it]
  1%|          | 300/37963 [45:11<82:39:03,  7.90s/it]
                                                      
{'loss': '0.1985', 'grad_norm': '10.26', 'learning_rate': '5.25e-06', 'epoch': '0.007902'}

  1%|          | 300/37963 [45:11<82:39:03,  7.90s/it]
  1%|          | 301/37963 [45:19<81:24:13,  7.78s/it]
  1%|          | 302/37963 [45:27<81:09:04,  7.76s/it]
  1%|          | 303/37963 [45:34<80:22:37,  7.68s/it]
  1%|          | 304/37963 [45:42<79:48:35,  7.63s/it]
  1%|          | 305/37963 [45:49<79:39:03,  7.61s/it]
  1%|          | 306/37963 [45:57<79:32:06,  7.60s/it]
  1%|          | 307/37963 [46:04<79:17:28,  7.58s/it]
  1%|          | 308/37963 [46:12<79:24:48,  7.59s/it]
  1%|          | 309/37963 [46:19<78:46:15,  7.53s/it]
  1%|          | 310/37963 [46:26<77:54:02,  7.45s/it]
                                                      
{'loss': '0.1916', 'grad_norm': '9.456', 'learning_rate': '5.426e-06', 'epoch': '0.008166'}

  1%|          | 310/37963 [46:26<77:54:02,  7.45s/it]
  1%|          | 311/37963 [46:34<76:52:56,  7.35s/it]
  1%|          | 312/37963 [46:41<77:01:11,  7.36s/it]
  1%|          | 313/37963 [46:49<77:46:51,  7.44s/it]
  1%|          | 314/37963 [46:56<78:48:53,  7.54s/it]
  1%|          | 315/37963 [47:04<78:48:57,  7.54s/it]
  1%|          | 316/37963 [47:12<79:04:01,  7.56s/it]
  1%|          | 317/37963 [47:19<79:00:32,  7.56s/it]
  1%|          | 318/37963 [47:27<79:10:07,  7.57s/it]
  1%|          | 319/37963 [47:34<79:09:03,  7.57s/it]
  1%|          | 320/37963 [47:42<79:22:33,  7.59s/it]
                                                      
{'loss': '0.1991', 'grad_norm': '11.97', 'learning_rate': '5.601e-06', 'epoch': '0.008429'}

  1%|          | 320/37963 [47:42<79:22:33,  7.59s/it]
  1%|          | 321/37963 [47:50<79:55:06,  7.64s/it]
  1%|          | 322/37963 [47:57<79:08:35,  7.57s/it]
  1%|          | 323/37963 [48:05<79:07:00,  7.57s/it]
  1%|          | 324/37963 [48:12<78:53:13,  7.55s/it]
  1%|          | 325/37963 [48:20<78:46:31,  7.53s/it]
  1%|          | 326/37963 [48:27<78:25:07,  7.50s/it]
  1%|          | 327/37963 [48:35<78:22:22,  7.50s/it]
  1%|          | 328/37963 [48:42<78:29:08,  7.51s/it]
  1%|          | 329/37963 [48:50<78:35:57,  7.52s/it]
  1%|          | 330/37963 [49:03<98:12:03,  9.39s/it]
                                                      
{'loss': '0.2063', 'grad_norm': '7.186', 'learning_rate': '5.777e-06', 'epoch': '0.008693'}

  1%|          | 330/37963 [49:03<98:12:03,  9.39s/it]
  1%|          | 331/37963 [49:11<92:52:02,  8.88s/it]
  1%|          | 332/37963 [49:19<88:47:18,  8.49s/it]
  1%|          | 333/37963 [49:33<106:21:53, 10.18s/it]
  1%|          | 334/37963 [49:40<98:32:59,  9.43s/it] 
  1%|          | 335/37963 [49:48<92:40:23,  8.87s/it]
  1%|          | 336/37963 [50:02<108:18:02, 10.36s/it]
  1%|          | 337/37963 [50:10<99:53:37,  9.56s/it] 
  1%|          | 338/37963 [50:30<134:32:59, 12.87s/it]
  1%|          | 339/37963 [50:38<117:49:37, 11.27s/it]
  1%|          | 340/37963 [50:45<105:10:57, 10.06s/it]
                                                       
{'loss': '0.1919', 'grad_norm': '13.48', 'learning_rate': '5.953e-06', 'epoch': '0.008956'}

  1%|          | 340/37963 [50:45<105:10:57, 10.06s/it]
  1%|          | 341/37963 [50:59<117:42:52, 11.26s/it]
  1%|          | 342/37963 [51:13<126:31:59, 12.11s/it]
  1%|          | 343/37963 [51:27<132:46:04, 12.71s/it]
  1%|          | 344/37963 [51:35<116:28:10, 11.15s/it]
  1%|          | 345/37963 [51:42<104:27:51, 10.00s/it]
  1%|          | 346/37963 [51:50<96:55:21,  9.28s/it] 
  1%|          | 347/37963 [51:57<91:18:47,  8.74s/it]
  1%|          | 348/37963 [52:05<87:28:07,  8.37s/it]
  1%|          | 349/37963 [52:12<84:58:06,  8.13s/it]
  1%|          | 350/37963 [52:20<83:21:12,  7.98s/it]
                                                      
{'loss': '0.2152', 'grad_norm': '10.28', 'learning_rate': '6.128e-06', 'epoch': '0.00922'}

  1%|          | 350/37963 [52:20<83:21:12,  7.98s/it]
  1%|          | 351/37963 [52:27<81:03:14,  7.76s/it]
  1%|          | 352/37963 [52:35<80:18:14,  7.69s/it]
  1%|          | 353/37963 [52:42<79:44:44,  7.63s/it]
  1%|          | 354/37963 [52:49<78:58:55,  7.56s/it]
  1%|          | 355/37963 [52:57<78:43:34,  7.54s/it]
  1%|          | 356/37963 [53:04<78:38:54,  7.53s/it]
  1%|          | 357/37963 [53:12<78:39:54,  7.53s/it]
  1%|          | 358/37963 [53:20<78:53:42,  7.55s/it]
  1%|          | 359/37963 [53:27<78:03:33,  7.47s/it]
  1%|          | 360/37963 [53:35<78:48:40,  7.55s/it]
                                                      
{'loss': '0.1996', 'grad_norm': '9.922', 'learning_rate': '6.304e-06', 'epoch': '0.009483'}

  1%|          | 360/37963 [53:35<78:48:40,  7.55s/it]
  1%|          | 361/37963 [53:42<78:44:54,  7.54s/it]
  1%|          | 362/37963 [53:50<78:57:00,  7.56s/it]
  1%|          | 363/37963 [53:57<78:52:12,  7.55s/it]
  1%|          | 364/37963 [54:05<78:37:22,  7.53s/it]
  1%|          | 365/37963 [54:12<78:33:06,  7.52s/it]
  1%|          | 366/37963 [54:20<78:35:46,  7.53s/it]
  1%|          | 367/37963 [54:27<78:34:07,  7.52s/it]
  1%|          | 368/37963 [54:35<78:22:27,  7.50s/it]
  1%|          | 369/37963 [54:42<78:34:51,  7.52s/it]
  1%|          | 370/37963 [54:50<78:42:27,  7.54s/it]
                                                      
{'loss': '0.2058', 'grad_norm': '7.34', 'learning_rate': '6.479e-06', 'epoch': '0.009746'}

  1%|          | 370/37963 [54:50<78:42:27,  7.54s/it]
  1%|          | 371/37963 [54:57<78:40:56,  7.54s/it]
  1%|          | 372/37963 [55:05<78:40:09,  7.53s/it]
  1%|          | 373/37963 [55:12<78:32:38,  7.52s/it]
  1%|          | 374/37963 [55:20<77:29:57,  7.42s/it]
  1%|          | 375/37963 [55:27<77:43:12,  7.44s/it]
  1%|          | 376/37963 [55:35<78:07:35,  7.48s/it]
  1%|          | 377/37963 [55:42<78:25:33,  7.51s/it]
  1%|          | 378/37963 [55:50<78:08:17,  7.48s/it]
  1%|          | 379/37963 [55:57<78:18:04,  7.50s/it]
  1%|          | 380/37963 [56:11<99:26:14,  9.52s/it]
                                                      
{'loss': '0.2038', 'grad_norm': '5.753', 'learning_rate': '6.655e-06', 'epoch': '0.01001'}

  1%|          | 380/37963 [56:11<99:26:14,  9.52s/it]
  1%|          | 381/37963 [56:26<113:53:22, 10.91s/it]
  1%|          | 382/37963 [56:33<103:24:02,  9.91s/it]
  1%|          | 383/37963 [56:41<98:02:28,  9.39s/it] 
  1%|          | 384/37963 [56:49<93:01:31,  8.91s/it]
  1%|          | 385/37963 [56:57<88:55:18,  8.52s/it]
  1%|          | 386/37963 [57:11<105:28:42, 10.11s/it]
  1%|          | 387/37963 [57:18<98:10:09,  9.41s/it] 
  1%|          | 388/37963 [57:33<113:11:20, 10.84s/it]
  1%|          | 389/37963 [57:40<102:36:43,  9.83s/it]
  1%|          | 390/37963 [58:01<136:23:02, 13.07s/it]
                                                       
{'loss': '0.1977', 'grad_norm': '12.98', 'learning_rate': '6.831e-06', 'epoch': '0.01027'}

  1%|          | 390/37963 [58:01<136:23:02, 13.07s/it]
  1%|          | 391/37963 [58:21<157:58:02, 15.14s/it]
  1%|          | 392/37963 [58:28<134:09:28, 12.85s/it]
  1%|          | 393/37963 [58:36<119:32:16, 11.45s/it]
  1%|          | 394/37963 [58:43<105:22:59, 10.10s/it]
  1%|          | 395/37963 [58:51<97:18:35,  9.32s/it] 
  1%|          | 396/37963 [58:58<91:19:30,  8.75s/it]
  1%|          | 397/37963 [59:06<87:28:28,  8.38s/it]
  1%|          | 398/37963 [59:14<86:22:14,  8.28s/it]
  1%|          | 399/37963 [59:21<83:43:44,  8.02s/it]
  1%|          | 400/37963 [59:29<82:29:06,  7.91s/it]
                                                      
{'loss': '0.1936', 'grad_norm': '8.034', 'learning_rate': '7.006e-06', 'epoch': '0.01054'}

  1%|          | 400/37963 [59:29<82:29:06,  7.91s/it]
  1%|          | 401/37963 [59:36<81:14:04,  7.79s/it]
  1%|          | 402/37963 [59:44<79:41:13,  7.64s/it]
  1%|          | 403/37963 [59:51<79:47:21,  7.65s/it]
  1%|          | 404/37963 [59:59<79:16:59,  7.60s/it]
  1%|          | 405/37963 [1:00:06<78:14:59,  7.50s/it]
  1%|          | 406/37963 [1:00:14<78:57:47,  7.57s/it]
  1%|          | 407/37963 [1:00:21<79:22:07,  7.61s/it]
  1%|          | 408/37963 [1:00:29<79:51:17,  7.65s/it]
  1%|          | 409/37963 [1:00:37<79:44:29,  7.64s/it]
  1%|          | 410/37963 [1:00:44<78:46:18,  7.55s/it]
                                                        
{'loss': '0.193', 'grad_norm': '5.049', 'learning_rate': '7.182e-06', 'epoch': '0.0108'}

  1%|          | 410/37963 [1:00:44<78:46:18,  7.55s/it]
  1%|          | 411/37963 [1:00:52<78:44:36,  7.55s/it]
  1%|          | 412/37963 [1:00:59<78:45:26,  7.55s/it]
  1%|          | 413/37963 [1:01:08<81:53:04,  7.85s/it]
  1%|          | 414/37963 [1:01:15<81:13:40,  7.79s/it]
  1%|          | 415/37963 [1:01:23<80:48:33,  7.75s/it]
  1%|          | 416/37963 [1:01:31<80:32:52,  7.72s/it]
  1%|          | 417/37963 [1:01:38<79:13:18,  7.60s/it]
  1%|          | 418/37963 [1:01:46<80:07:46,  7.68s/it]
  1%|          | 419/37963 [1:01:53<79:40:09,  7.64s/it]
  1%|          | 420/37963 [1:02:01<79:04:01,  7.58s/it]
                                                        
{'loss': '0.1979', 'grad_norm': '5.919', 'learning_rate': '7.357e-06', 'epoch': '0.01106'}

  1%|          | 420/37963 [1:02:01<79:04:01,  7.58s/it]
  1%|          | 421/37963 [1:02:08<78:43:19,  7.55s/it]
  1%|          | 422/37963 [1:02:16<77:32:06,  7.44s/it]
  1%|          | 423/37963 [1:02:24<79:37:15,  7.64s/it]
  1%|          | 424/37963 [1:02:31<79:26:44,  7.62s/it]
  1%|          | 425/37963 [1:02:45<99:18:21,  9.52s/it]
  1%|          | 426/37963 [1:02:59<112:37:03, 10.80s/it]
  1%|          | 427/37963 [1:03:07<103:26:27,  9.92s/it]
  1%|          | 428/37963 [1:03:15<98:23:13,  9.44s/it] 
  1%|          | 429/37963 [1:03:23<92:41:29,  8.89s/it]
  1%|          | 430/37963 [1:03:30<88:09:17,  8.46s/it]
                                                        
{'loss': '0.1787', 'grad_norm': '12.29', 'learning_rate': '7.533e-06', 'epoch': '0.01133'}

  1%|          | 430/37963 [1:03:30<88:09:17,  8.46s/it]
  1%|          | 431/37963 [1:03:38<85:19:27,  8.18s/it]
  1%|          | 432/37963 [1:03:45<83:49:28,  8.04s/it]
  1%|          | 433/37963 [1:03:53<82:42:26,  7.93s/it]
  1%|          | 434/37963 [1:04:01<81:21:10,  7.80s/it]
  1%|          | 435/37963 [1:04:08<80:32:42,  7.73s/it]
  1%|          | 436/37963 [1:04:22<99:33:59,  9.55s/it]
  1%|          | 437/37963 [1:04:44<137:24:18, 13.18s/it]
  1%|          | 438/37963 [1:04:58<139:41:29, 13.40s/it]
  1%|          | 439/37963 [1:05:12<141:59:56, 13.62s/it]
  1%|          | 440/37963 [1:05:19<123:06:52, 11.81s/it]
                                                         
{'loss': '0.1883', 'grad_norm': '4.807', 'learning_rate': '7.709e-06', 'epoch': '0.01159'}

  1%|          | 440/37963 [1:05:19<123:06:52, 11.81s/it]
  1%|          | 441/37963 [1:05:27<109:38:34, 10.52s/it]
  1%|          | 442/37963 [1:05:35<102:38:22,  9.85s/it]
  1%|          | 443/37963 [1:05:43<96:42:49,  9.28s/it] 
  1%|          | 444/37963 [1:05:57<111:46:02, 10.72s/it]
  1%|          | 445/37963 [1:06:05<101:44:02,  9.76s/it]
  1%|          | 446/37963 [1:06:12<95:08:08,  9.13s/it] 
  1%|          | 447/37963 [1:06:21<92:13:24,  8.85s/it]
  1%|          | 448/37963 [1:06:28<88:22:23,  8.48s/it]
  1%|          | 449/37963 [1:06:36<85:39:41,  8.22s/it]
  1%|          | 450/37963 [1:06:43<83:44:19,  8.04s/it]
                                                        
{'loss': '0.1959', 'grad_norm': '6.599', 'learning_rate': '7.884e-06', 'epoch': '0.01185'}

  1%|          | 450/37963 [1:06:43<83:44:19,  8.04s/it]
  1%|          | 451/37963 [1:06:51<82:01:01,  7.87s/it]
  1%|          | 452/37963 [1:06:59<82:54:04,  7.96s/it]
  1%|          | 453/37963 [1:07:07<82:32:00,  7.92s/it]
  1%|          | 454/37963 [1:07:14<81:12:01,  7.79s/it]
  1%|          | 455/37963 [1:07:22<80:25:26,  7.72s/it]
  1%|          | 456/37963 [1:07:30<80:40:44,  7.74s/it]
  1%|          | 457/37963 [1:07:37<80:04:30,  7.69s/it]
  1%|          | 458/37963 [1:07:45<80:58:10,  7.77s/it]
  1%|          | 459/37963 [1:07:52<79:08:51,  7.60s/it]
  1%|          | 460/37963 [1:08:00<78:39:20,  7.55s/it]
                                                        
{'loss': '0.1924', 'grad_norm': '6.497', 'learning_rate': '8.06e-06', 'epoch': '0.01212'}

  1%|          | 460/37963 [1:08:00<78:39:20,  7.55s/it]
  1%|          | 461/37963 [1:08:07<78:20:34,  7.52s/it]
  1%|          | 462/37963 [1:08:15<78:48:56,  7.57s/it]
  1%|          | 463/37963 [1:08:23<80:05:53,  7.69s/it]
  1%|          | 464/37963 [1:08:30<79:28:27,  7.63s/it]
  1%|          | 465/37963 [1:08:38<79:02:52,  7.59s/it]
  1%|          | 466/37963 [1:08:45<77:52:11,  7.48s/it]
  1%|          | 467/37963 [1:08:53<77:45:25,  7.47s/it]
  1%|          | 468/37963 [1:09:01<81:19:36,  7.81s/it]
  1%|          | 469/37963 [1:09:09<80:07:28,  7.69s/it]
  1%|          | 470/37963 [1:09:16<79:35:16,  7.64s/it]
                                                        
{'loss': '0.1811', 'grad_norm': '5.329', 'learning_rate': '8.235e-06', 'epoch': '0.01238'}

  1%|          | 470/37963 [1:09:16<79:35:16,  7.64s/it]
  1%|          | 471/37963 [1:09:24<79:53:48,  7.67s/it]
  1%|          | 472/37963 [1:09:31<78:56:02,  7.58s/it]
  1%|          | 473/37963 [1:09:46<100:36:26,  9.66s/it]
  1%|          | 474/37963 [1:09:53<94:25:40,  9.07s/it] 
  1%|▏         | 475/37963 [1:10:08<110:18:52, 10.59s/it]
  1%|▏         | 476/37963 [1:10:15<101:16:06,  9.73s/it]
  1%|▏         | 477/37963 [1:10:23<95:23:56,  9.16s/it] 
  1%|▏         | 478/37963 [1:10:31<90:32:37,  8.70s/it]
  1%|▏         | 479/37963 [1:10:38<87:01:03,  8.36s/it]
  1%|▏         | 480/37963 [1:10:46<84:44:01,  8.14s/it]
                                                        
{'loss': '0.1939', 'grad_norm': '5.775', 'learning_rate': '8.411e-06', 'epoch': '0.01264'}

  1%|▏         | 480/37963 [1:10:46<84:44:01,  8.14s/it]
  1%|▏         | 481/37963 [1:10:54<84:27:34,  8.11s/it]
  1%|▏         | 482/37963 [1:11:02<83:19:07,  8.00s/it]
  1%|▏         | 483/37963 [1:11:09<82:31:23,  7.93s/it]
  1%|▏         | 484/37963 [1:11:17<81:24:16,  7.82s/it]
  1%|▏         | 485/37963 [1:11:32<102:19:13,  9.83s/it]
  1%|▏         | 486/37963 [1:11:45<114:42:37, 11.02s/it]
  1%|▏         | 487/37963 [1:11:53<102:50:23,  9.88s/it]
  1%|▏         | 488/37963 [1:12:07<116:44:27, 11.21s/it]
  1%|▏         | 489/37963 [1:12:21<125:15:39, 12.03s/it]
  1%|▏         | 490/37963 [1:12:35<131:38:31, 12.65s/it]
                                                         
{'loss': '0.1929', 'grad_norm': '8.133', 'learning_rate': '8.586e-06', 'epoch': '0.01291'}

  1%|▏         | 490/37963 [1:12:35<131:38:31, 12.65s/it]
  1%|▏         | 491/37963 [1:12:42<114:41:52, 11.02s/it]
  1%|▏         | 492/37963 [1:12:50<104:27:20, 10.04s/it]
  1%|▏         | 493/37963 [1:12:57<96:17:21,  9.25s/it] 
  1%|▏         | 494/37963 [1:13:05<91:03:24,  8.75s/it]
  1%|▏         | 495/37963 [1:13:12<87:17:53,  8.39s/it]
  1%|▏         | 496/37963 [1:13:20<84:34:11,  8.13s/it]
  1%|▏         | 497/37963 [1:13:28<83:22:23,  8.01s/it]
  1%|▏         | 498/37963 [1:13:35<81:58:12,  7.88s/it]
  1%|▏         | 499/37963 [1:13:50<102:00:13,  9.80s/it]
  1%|▏         | 500/37963 [1:13:57<94:56:14,  9.12s/it] 
                                                        
{'loss': '0.2105', 'grad_norm': '14.03', 'learning_rate': '8.762e-06', 'epoch': '0.01317'}

  1%|▏         | 500/37963 [1:13:57<94:56:14,  9.12s/it]
  1%|▏         | 501/37963 [1:14:05<90:22:02,  8.68s/it]
  1%|▏         | 502/37963 [1:14:12<87:22:14,  8.40s/it]
  1%|▏         | 503/37963 [1:14:21<86:52:59,  8.35s/it]
  1%|▏         | 504/37963 [1:14:28<83:53:27,  8.06s/it]
  1%|▏         | 505/37963 [1:14:36<82:13:37,  7.90s/it]
  1%|▏         | 506/37963 [1:14:43<81:21:22,  7.82s/it]
  1%|▏         | 507/37963 [1:14:51<81:06:41,  7.80s/it]
  1%|▏         | 508/37963 [1:14:59<81:12:24,  7.81s/it]
  1%|▏         | 509/37963 [1:15:06<80:16:16,  7.72s/it]
  1%|▏         | 510/37963 [1:15:14<80:12:30,  7.71s/it]
                                                        
{'loss': '0.2096', 'grad_norm': '8.635', 'learning_rate': '8.938e-06', 'epoch': '0.01343'}

  1%|▏         | 510/37963 [1:15:14<80:12:30,  7.71s/it]
  1%|▏         | 511/37963 [1:15:22<80:01:56,  7.69s/it]
  1%|▏         | 512/37963 [1:15:29<80:18:47,  7.72s/it]
  1%|▏         | 513/37963 [1:15:37<80:28:51,  7.74s/it]
  1%|▏         | 514/37963 [1:15:45<80:29:55,  7.74s/it]
  1%|▏         | 515/37963 [1:15:53<79:52:08,  7.68s/it]
  1%|▏         | 516/37963 [1:16:00<79:34:58,  7.65s/it]
  1%|▏         | 517/37963 [1:16:08<81:12:54,  7.81s/it]
  1%|▏         | 518/37963 [1:16:16<80:13:53,  7.71s/it]
  1%|▏         | 519/37963 [1:16:24<80:30:56,  7.74s/it]
  1%|▏         | 520/37963 [1:16:31<79:52:00,  7.68s/it]
                                                        
{'loss': '0.2049', 'grad_norm': '9.856', 'learning_rate': '9.113e-06', 'epoch': '0.0137'}

  1%|▏         | 520/37963 [1:16:31<79:52:00,  7.68s/it]
  1%|▏         | 521/37963 [1:16:39<79:24:03,  7.63s/it]
  1%|▏         | 522/37963 [1:16:47<80:45:29,  7.76s/it]
  1%|▏         | 523/37963 [1:17:00<98:54:32,  9.51s/it]
  1%|▏         | 524/37963 [1:17:08<91:49:36,  8.83s/it]
  1%|▏         | 525/37963 [1:17:22<109:01:31, 10.48s/it]
  1%|▏         | 526/37963 [1:17:30<100:15:33,  9.64s/it]
  1%|▏         | 527/37963 [1:17:37<93:54:35,  9.03s/it] 
  1%|▏         | 528/37963 [1:17:45<89:35:41,  8.62s/it]
  1%|▏         | 529/37963 [1:17:52<86:26:15,  8.31s/it]
  1%|▏         | 530/37963 [1:18:00<85:38:50,  8.24s/it]
                                                        
{'loss': '0.1975', 'grad_norm': '6.679', 'learning_rate': '9.289e-06', 'epoch': '0.01396'}

  1%|▏         | 530/37963 [1:18:00<85:38:50,  8.24s/it]
  1%|▏         | 531/37963 [1:18:08<84:13:26,  8.10s/it]
  1%|▏         | 532/37963 [1:18:22<102:56:24,  9.90s/it]
  1%|▏         | 533/37963 [1:18:30<95:28:47,  9.18s/it] 
  1%|▏         | 534/37963 [1:18:38<93:17:55,  8.97s/it]
  1%|▏         | 535/37963 [1:18:59<130:20:20, 12.54s/it]
  1%|▏         | 536/37963 [1:19:07<114:43:18, 11.03s/it]
  1%|▏         | 537/37963 [1:19:21<125:24:26, 12.06s/it]
  1%|▏         | 538/37963 [1:19:35<131:52:04, 12.68s/it]
  1%|▏         | 539/37963 [1:19:43<114:39:46, 11.03s/it]
  1%|▏         | 540/37963 [1:19:50<104:17:08, 10.03s/it]
                                                         
{'loss': '0.1969', 'grad_norm': '10.5', 'learning_rate': '9.464e-06', 'epoch': '0.01422'}

  1%|▏         | 540/37963 [1:19:50<104:17:08, 10.03s/it]
  1%|▏         | 541/37963 [1:19:58<97:52:02,  9.41s/it] 
  1%|▏         | 542/37963 [1:20:06<91:55:32,  8.84s/it]
  1%|▏         | 543/37963 [1:20:13<87:46:36,  8.44s/it]
  1%|▏         | 544/37963 [1:20:21<84:45:33,  8.15s/it]
  1%|▏         | 545/37963 [1:20:28<83:34:45,  8.04s/it]
  1%|▏         | 546/37963 [1:20:37<84:52:54,  8.17s/it]
  1%|▏         | 547/37963 [1:20:44<83:00:40,  7.99s/it]
  1%|▏         | 548/37963 [1:20:52<81:32:24,  7.85s/it]
  1%|▏         | 549/37963 [1:21:00<80:30:48,  7.75s/it]
  1%|▏         | 550/37963 [1:21:07<80:38:02,  7.76s/it]
                                                        
{'loss': '0.1883', 'grad_norm': '3.559', 'learning_rate': '9.64e-06', 'epoch': '0.01449'}

  1%|▏         | 550/37963 [1:21:07<80:38:02,  7.76s/it]
  1%|▏         | 551/37963 [1:21:21<99:50:00,  9.61s/it]
  1%|▏         | 552/37963 [1:21:29<93:34:00,  9.00s/it]
  1%|▏         | 553/37963 [1:21:36<89:00:57,  8.57s/it]
  1%|▏         | 554/37963 [1:21:44<86:33:23,  8.33s/it]
  1%|▏         | 555/37963 [1:21:52<84:32:26,  8.14s/it]
  1%|▏         | 556/37963 [1:21:59<82:47:25,  7.97s/it]
  1%|▏         | 557/37963 [1:22:07<81:36:00,  7.85s/it]
  1%|▏         | 558/37963 [1:22:15<80:47:38,  7.78s/it]
  1%|▏         | 559/37963 [1:22:23<81:26:33,  7.84s/it]
  1%|▏         | 560/37963 [1:22:31<82:00:19,  7.89s/it]
                                                        
{'loss': '0.1824', 'grad_norm': '6.145', 'learning_rate': '9.816e-06', 'epoch': '0.01475'}

  1%|▏         | 560/37963 [1:22:31<82:00:19,  7.89s/it]
  1%|▏         | 561/37963 [1:22:38<80:58:05,  7.79s/it]
  1%|▏         | 562/37963 [1:22:46<80:52:57,  7.79s/it]
  1%|▏         | 563/37963 [1:22:53<79:43:33,  7.67s/it]
  1%|▏         | 564/37963 [1:23:00<77:36:16,  7.47s/it]
  1%|▏         | 565/37963 [1:23:08<78:55:03,  7.60s/it]
  1%|▏         | 566/37963 [1:23:16<78:53:40,  7.59s/it]
  1%|▏         | 567/37963 [1:23:23<78:15:15,  7.53s/it]
  1%|▏         | 568/37963 [1:23:31<78:07:28,  7.52s/it]
  1%|▏         | 569/37963 [1:23:38<77:27:13,  7.46s/it]
  2%|▏         | 570/37963 [1:23:46<78:43:14,  7.58s/it]
                                                        
{'loss': '0.1945', 'grad_norm': '5.499', 'learning_rate': '9.991e-06', 'epoch': '0.01501'}

  2%|▏         | 570/37963 [1:23:46<78:43:14,  7.58s/it]
  2%|▏         | 571/37963 [1:23:54<79:28:00,  7.65s/it]
  2%|▏         | 572/37963 [1:24:01<79:38:13,  7.67s/it]
  2%|▏         | 573/37963 [1:24:16<100:35:34,  9.69s/it]
  2%|▏         | 574/37963 [1:24:23<93:41:16,  9.02s/it] 
  2%|▏         | 575/37963 [1:24:37<109:26:56, 10.54s/it]
  2%|▏         | 576/37963 [1:24:45<99:58:56,  9.63s/it] 
  2%|▏         | 577/37963 [1:24:53<94:00:30,  9.05s/it]
  2%|▏         | 578/37963 [1:25:00<89:59:30,  8.67s/it]
  2%|▏         | 579/37963 [1:25:08<87:19:45,  8.41s/it]
  2%|▏         | 580/37963 [1:25:16<84:36:24,  8.15s/it]
                                                        
{'loss': '0.1971', 'grad_norm': '6.271', 'learning_rate': '1.017e-05', 'epoch': '0.01528'}

  2%|▏         | 580/37963 [1:25:16<84:36:24,  8.15s/it]
  2%|▏         | 581/37963 [1:25:30<102:40:21,  9.89s/it]
  2%|▏         | 582/37963 [1:25:44<116:31:44, 11.22s/it]
  2%|▏         | 583/37963 [1:25:52<105:21:07, 10.15s/it]
  2%|▏         | 584/37963 [1:26:06<118:32:58, 11.42s/it]
  2%|▏         | 585/37963 [1:26:21<128:59:36, 12.42s/it]
  2%|▏         | 586/37963 [1:26:28<114:05:46, 10.99s/it]
  2%|▏         | 587/37963 [1:26:36<103:20:15,  9.95s/it]
  2%|▏         | 588/37963 [1:26:50<115:13:34, 11.10s/it]
  2%|▏         | 589/37963 [1:26:57<104:19:51, 10.05s/it]
  2%|▏         | 590/37963 [1:27:05<96:10:58,  9.26s/it] 
                                                        
{'loss': '0.1834', 'grad_norm': '7.789', 'learning_rate': '1.034e-05', 'epoch': '0.01554'}

  2%|▏         | 590/37963 [1:27:05<96:10:58,  9.26s/it]
  2%|▏         | 591/37963 [1:27:12<90:52:23,  8.75s/it]
  2%|▏         | 592/37963 [1:27:20<87:14:28,  8.40s/it]
  2%|▏         | 593/37963 [1:27:28<87:33:04,  8.43s/it]
  2%|▏         | 594/37963 [1:27:36<84:25:20,  8.13s/it]
  2%|▏         | 595/37963 [1:27:43<82:29:50,  7.95s/it]
  2%|▏         | 596/37963 [1:27:51<80:46:50,  7.78s/it]
  2%|▏         | 597/37963 [1:27:58<80:18:27,  7.74s/it]
  2%|▏         | 598/37963 [1:28:06<80:53:53,  7.79s/it]
  2%|▏         | 599/37963 [1:28:20<100:33:52,  9.69s/it]
  2%|▏         | 600/37963 [1:28:28<93:31:11,  9.01s/it] 
                                                        
{'loss': '0.1912', 'grad_norm': '10.15', 'learning_rate': '1.052e-05', 'epoch': '0.0158'}

  2%|▏         | 600/37963 [1:28:28<93:31:11,  9.01s/it]
  2%|▏         | 601/37963 [1:28:35<88:47:31,  8.56s/it]
  2%|▏         | 602/37963 [1:28:43<86:53:38,  8.37s/it]
  2%|▏         | 603/37963 [1:28:51<83:59:20,  8.09s/it]
  2%|▏         | 604/37963 [1:28:58<82:15:15,  7.93s/it]
  2%|▏         | 605/37963 [1:29:06<80:41:45,  7.78s/it]
  2%|▏         | 606/37963 [1:29:13<80:39:42,  7.77s/it]
  2%|▏         | 607/37963 [1:29:22<83:18:42,  8.03s/it]
  2%|▏         | 608/37963 [1:29:30<82:00:42,  7.90s/it]
  2%|▏         | 609/37963 [1:29:37<81:07:36,  7.82s/it]
  2%|▏         | 610/37963 [1:29:45<80:00:35,  7.71s/it]
                                                        
{'loss': '0.1951', 'grad_norm': '5.74', 'learning_rate': '1.069e-05', 'epoch': '0.01607'}

  2%|▏         | 610/37963 [1:29:45<80:00:35,  7.71s/it]
  2%|▏         | 611/37963 [1:29:52<79:07:15,  7.63s/it]
  2%|▏         | 612/37963 [1:30:00<80:26:48,  7.75s/it]
  2%|▏         | 613/37963 [1:30:08<78:59:10,  7.61s/it]
  2%|▏         | 614/37963 [1:30:15<78:49:10,  7.60s/it]
  2%|▏         | 615/37963 [1:30:23<78:54:08,  7.61s/it]
  2%|▏         | 616/37963 [1:30:30<78:31:38,  7.57s/it]
  2%|▏         | 617/37963 [1:30:38<79:13:48,  7.64s/it]
  2%|▏         | 618/37963 [1:30:46<78:53:31,  7.61s/it]
  2%|▏         | 619/37963 [1:30:53<78:20:30,  7.55s/it]
  2%|▏         | 620/37963 [1:31:00<77:52:45,  7.51s/it]
                                                        
{'loss': '0.1812', 'grad_norm': '4.783', 'learning_rate': '1.087e-05', 'epoch': '0.01633'}

  2%|▏         | 620/37963 [1:31:00<77:52:45,  7.51s/it]
  2%|▏         | 621/37963 [1:31:08<79:03:03,  7.62s/it]
  2%|▏         | 622/37963 [1:31:22<99:44:29,  9.62s/it]
  2%|▏         | 623/37963 [1:31:37<113:34:53, 10.95s/it]
  2%|▏         | 624/37963 [1:31:44<103:57:07, 10.02s/it]
  2%|▏         | 625/37963 [1:31:53<98:18:16,  9.48s/it] 
  2%|▏         | 626/37963 [1:32:00<92:24:12,  8.91s/it]
  2%|▏         | 627/37963 [1:32:08<88:30:40,  8.53s/it]
  2%|▏         | 628/37963 [1:32:16<85:43:10,  8.27s/it]
  2%|▏         | 629/37963 [1:32:23<83:34:33,  8.06s/it]
  2%|▏         | 630/37963 [1:32:50<143:29:49, 13.84s/it]
                                                         
{'loss': '0.2041', 'grad_norm': '10.2', 'learning_rate': '1.104e-05', 'epoch': '0.0166'}

  2%|▏         | 630/37963 [1:32:50<143:29:49, 13.84s/it]
  2%|▏         | 631/37963 [1:32:58<123:55:43, 11.95s/it]
  2%|▏         | 632/37963 [1:33:12<130:59:57, 12.63s/it]
  2%|▏         | 633/37963 [1:33:20<116:09:21, 11.20s/it]
  2%|▏         | 634/37963 [1:33:28<104:52:38, 10.11s/it]
  2%|▏         | 635/37963 [1:33:42<116:51:18, 11.27s/it]
  2%|▏         | 636/37963 [1:33:49<105:24:56, 10.17s/it]
  2%|▏         | 637/37963 [1:33:57<98:00:08,  9.45s/it] 
  2%|▏         | 638/37963 [1:34:04<91:53:20,  8.86s/it]
  2%|▏         | 639/37963 [1:34:12<87:52:55,  8.48s/it]
  2%|▏         | 640/37963 [1:34:20<86:33:22,  8.35s/it]
                                                        
{'loss': '0.183', 'grad_norm': '7.091', 'learning_rate': '1.122e-05', 'epoch': '0.01686'}

  2%|▏         | 640/37963 [1:34:20<86:33:22,  8.35s/it]
  2%|▏         | 641/37963 [1:34:28<84:48:52,  8.18s/it]
  2%|▏         | 642/37963 [1:34:35<83:04:13,  8.01s/it]
  2%|▏         | 643/37963 [1:34:43<81:39:03,  7.88s/it]
  2%|▏         | 644/37963 [1:34:51<80:33:34,  7.77s/it]
  2%|▏         | 645/37963 [1:34:59<81:36:04,  7.87s/it]
  2%|▏         | 646/37963 [1:35:06<80:58:52,  7.81s/it]
  2%|▏         | 647/37963 [1:35:14<79:56:44,  7.71s/it]
  2%|▏         | 648/37963 [1:35:21<79:13:38,  7.64s/it]
  2%|▏         | 649/37963 [1:35:29<78:40:51,  7.59s/it]
  2%|▏         | 650/37963 [1:35:37<79:23:50,  7.66s/it]
                                                        
{'loss': '0.1865', 'grad_norm': '7.853', 'learning_rate': '1.14e-05', 'epoch': '0.01712'}

  2%|▏         | 650/37963 [1:35:37<79:23:50,  7.66s/it]
  2%|▏         | 651/37963 [1:35:44<79:51:51,  7.71s/it]
  2%|▏         | 652/37963 [1:35:59<100:47:53,  9.73s/it]
  2%|▏         | 653/37963 [1:36:06<93:47:37,  9.05s/it] 
  2%|▏         | 654/37963 [1:36:14<90:14:07,  8.71s/it]
  2%|▏         | 655/37963 [1:36:22<86:40:42,  8.36s/it]
  2%|▏         | 656/37963 [1:36:29<84:15:10,  8.13s/it]
  2%|▏         | 657/37963 [1:36:37<82:25:30,  7.95s/it]
  2%|▏         | 658/37963 [1:36:45<83:24:46,  8.05s/it]
  2%|▏         | 659/37963 [1:36:53<83:09:52,  8.03s/it]
  2%|▏         | 660/37963 [1:37:01<81:42:02,  7.88s/it]
                                                        
{'loss': '0.211', 'grad_norm': '5.164', 'learning_rate': '1.157e-05', 'epoch': '0.01739'}

  2%|▏         | 660/37963 [1:37:01<81:42:02,  7.88s/it]
  2%|▏         | 661/37963 [1:37:08<80:15:08,  7.75s/it]
  2%|▏         | 662/37963 [1:37:16<79:27:36,  7.67s/it]
  2%|▏         | 663/37963 [1:37:24<80:27:19,  7.77s/it]
  2%|▏         | 664/37963 [1:37:31<79:36:48,  7.68s/it]
  2%|▏         | 665/37963 [1:37:39<79:24:52,  7.67s/it]
  2%|▏         | 666/37963 [1:37:46<78:59:50,  7.63s/it]
  2%|▏         | 667/37963 [1:37:54<78:26:53,  7.57s/it]
  2%|▏         | 668/37963 [1:38:08<99:34:10,  9.61s/it]
  2%|▏         | 669/37963 [1:38:16<93:15:55,  9.00s/it]
  2%|▏         | 670/37963 [1:38:30<108:18:39, 10.46s/it]
                                                         
{'loss': '0.2036', 'grad_norm': '5.751', 'learning_rate': '1.175e-05', 'epoch': '0.01765'}

  2%|▏         | 670/37963 [1:38:30<108:18:39, 10.46s/it]
  2%|▏         | 671/37963 [1:38:37<100:36:03,  9.71s/it]
  2%|▏         | 672/37963 [1:38:45<94:26:28,  9.12s/it] 
  2%|▏         | 673/37963 [1:38:53<89:53:37,  8.68s/it]
  2%|▏         | 674/37963 [1:39:00<86:35:29,  8.36s/it]
  2%|▏         | 675/37963 [1:39:08<84:22:04,  8.15s/it]
  2%|▏         | 676/37963 [1:39:16<84:52:32,  8.19s/it]
  2%|▏         | 677/37963 [1:39:24<82:50:58,  8.00s/it]
  2%|▏         | 678/37963 [1:39:38<102:18:45,  9.88s/it]
  2%|▏         | 679/37963 [1:39:46<95:48:53,  9.25s/it] 
  2%|▏         | 680/37963 [1:40:01<113:13:57, 10.93s/it]
                                                         
{'loss': '0.1899', 'grad_norm': '5.682', 'learning_rate': '1.192e-05', 'epoch': '0.01791'}

  2%|▏         | 680/37963 [1:40:01<113:13:57, 10.93s/it]
  2%|▏         | 681/37963 [1:40:15<122:01:23, 11.78s/it]
  2%|▏         | 682/37963 [1:40:29<129:18:09, 12.49s/it]
  2%|▏         | 683/37963 [1:40:37<114:36:14, 11.07s/it]
  2%|▏         | 684/37963 [1:40:44<103:37:46, 10.01s/it]
  2%|▏         | 685/37963 [1:40:58<115:58:05, 11.20s/it]
  2%|▏         | 686/37963 [1:41:06<107:03:57, 10.34s/it]
  2%|▏         | 687/37963 [1:41:14<97:59:26,  9.46s/it] 
  2%|▏         | 688/37963 [1:41:21<92:00:52,  8.89s/it]
  2%|▏         | 689/37963 [1:41:29<87:42:51,  8.47s/it]
  2%|▏         | 690/37963 [1:41:36<84:39:55,  8.18s/it]
                                                        
{'loss': '0.2046', 'grad_norm': '8.723', 'learning_rate': '1.21e-05', 'epoch': '0.01818'}

  2%|▏         | 690/37963 [1:41:36<84:39:55,  8.18s/it]
  2%|▏         | 691/37963 [1:41:45<84:45:40,  8.19s/it]
  2%|▏         | 692/37963 [1:41:52<82:44:01,  7.99s/it]
  2%|▏         | 693/37963 [1:41:59<80:54:24,  7.81s/it]
  2%|▏         | 694/37963 [1:42:07<80:01:18,  7.73s/it]
  2%|▏         | 695/37963 [1:42:15<79:52:05,  7.72s/it]
  2%|▏         | 696/37963 [1:42:23<80:51:27,  7.81s/it]
  2%|▏         | 697/37963 [1:42:30<79:02:53,  7.64s/it]
  2%|▏         | 698/37963 [1:42:37<78:29:33,  7.58s/it]
  2%|▏         | 699/37963 [1:42:45<78:43:09,  7.60s/it]
  2%|▏         | 700/37963 [1:43:00<100:00:38,  9.66s/it]
                                                         
{'loss': '0.1992', 'grad_norm': '6.917', 'learning_rate': '1.227e-05', 'epoch': '0.01844'}

  2%|▏         | 700/37963 [1:43:00<100:00:38,  9.66s/it]
  2%|▏         | 701/37963 [1:43:07<93:50:41,  9.07s/it] 
  2%|▏         | 702/37963 [1:43:15<89:02:26,  8.60s/it]
  2%|▏         | 703/37963 [1:43:22<86:07:09,  8.32s/it]
  2%|▏         | 704/37963 [1:43:30<83:32:05,  8.07s/it]
  2%|▏         | 705/37963 [1:43:38<83:21:54,  8.06s/it]
  2%|▏         | 706/37963 [1:43:45<81:53:07,  7.91s/it]
  2%|▏         | 707/37963 [1:43:53<81:29:38,  7.87s/it]
  2%|▏         | 708/37963 [1:44:01<80:44:44,  7.80s/it]
  2%|▏         | 709/37963 [1:44:09<80:07:11,  7.74s/it]
  2%|▏         | 710/37963 [1:44:16<80:37:27,  7.79s/it]
                                                        
{'loss': '0.1818', 'grad_norm': '8.689', 'learning_rate': '1.245e-05', 'epoch': '0.0187'}

  2%|▏         | 710/37963 [1:44:16<80:37:27,  7.79s/it]
  2%|▏         | 711/37963 [1:44:24<80:15:16,  7.76s/it]
  2%|▏         | 712/37963 [1:44:31<78:37:00,  7.60s/it]
  2%|▏         | 713/37963 [1:44:39<78:22:31,  7.57s/it]
  2%|▏         | 714/37963 [1:44:47<78:45:14,  7.61s/it]
  2%|▏         | 715/37963 [1:45:01<99:37:21,  9.63s/it]
  2%|▏         | 716/37963 [1:45:09<93:48:54,  9.07s/it]
  2%|▏         | 717/37963 [1:45:16<89:15:24,  8.63s/it]
  2%|▏         | 718/37963 [1:45:24<86:28:55,  8.36s/it]
  2%|▏         | 719/37963 [1:45:32<84:20:31,  8.15s/it]
  2%|▏         | 720/37963 [1:45:39<81:39:12,  7.89s/it]
                                                        
{'loss': '0.1907', 'grad_norm': '7.679', 'learning_rate': '1.263e-05', 'epoch': '0.01897'}

  2%|▏         | 720/37963 [1:45:39<81:39:12,  7.89s/it]
  2%|▏         | 721/37963 [1:45:53<100:43:35,  9.74s/it]
  2%|▏         | 722/37963 [1:46:01<94:38:43,  9.15s/it] 
  2%|▏         | 723/37963 [1:46:09<91:57:38,  8.89s/it]
  2%|▏         | 724/37963 [1:46:23<108:37:35, 10.50s/it]
  2%|▏         | 725/37963 [1:46:31<99:32:44,  9.62s/it] 
  2%|▏         | 726/37963 [1:46:45<114:06:38, 11.03s/it]
  2%|▏         | 727/37963 [1:46:53<103:47:21, 10.03s/it]
  2%|▏         | 728/37963 [1:47:00<96:02:20,  9.29s/it] 
  2%|▏         | 729/37963 [1:47:08<90:55:42,  8.79s/it]
  2%|▏         | 730/37963 [1:47:22<108:18:03, 10.47s/it]
                                                         
{'loss': '0.1874', 'grad_norm': '4.781', 'learning_rate': '1.28e-05', 'epoch': '0.01923'}

  2%|▏         | 730/37963 [1:47:22<108:18:03, 10.47s/it]
  2%|▏         | 731/37963 [1:47:30<99:50:58,  9.65s/it] 
  2%|▏         | 732/37963 [1:47:38<93:06:57,  9.00s/it]
  2%|▏         | 733/37963 [1:47:52<109:26:04, 10.58s/it]
  2%|▏         | 734/37963 [1:48:00<101:44:01,  9.84s/it]
  2%|▏         | 735/37963 [1:48:08<95:14:45,  9.21s/it] 
  2%|▏         | 736/37963 [1:48:22<110:23:32, 10.68s/it]
  2%|▏         | 737/37963 [1:48:29<100:43:42,  9.74s/it]
  2%|▏         | 738/37963 [1:48:38<95:45:35,  9.26s/it] 
  2%|▏         | 739/37963 [1:48:45<90:27:51,  8.75s/it]
  2%|▏         | 740/37963 [1:48:53<86:45:14,  8.39s/it]
                                                        
{'loss': '0.1947', 'grad_norm': '7.92', 'learning_rate': '1.298e-05', 'epoch': '0.01949'}

  2%|▏         | 740/37963 [1:48:53<86:45:14,  8.39s/it]
  2%|▏         | 741/37963 [1:49:00<84:31:47,  8.18s/it]
  2%|▏         | 742/37963 [1:49:08<82:47:28,  8.01s/it]
  2%|▏         | 743/37963 [1:49:16<82:23:06,  7.97s/it]
  2%|▏         | 744/37963 [1:49:24<81:28:49,  7.88s/it]
  2%|▏         | 745/37963 [1:49:31<80:27:50,  7.78s/it]
  2%|▏         | 746/37963 [1:49:39<79:54:53,  7.73s/it]
  2%|▏         | 747/37963 [1:49:53<100:55:43,  9.76s/it]
  2%|▏         | 748/37963 [1:50:01<94:04:47,  9.10s/it] 
  2%|▏         | 749/37963 [1:50:08<89:09:14,  8.62s/it]
  2%|▏         | 750/37963 [1:50:16<85:08:41,  8.24s/it]
                                                        
{'loss': '0.2044', 'grad_norm': '6.54', 'learning_rate': '1.315e-05', 'epoch': '0.01976'}

  2%|▏         | 750/37963 [1:50:16<85:08:41,  8.24s/it]
  2%|▏         | 751/37963 [1:50:23<83:58:25,  8.12s/it]
  2%|▏         | 752/37963 [1:50:32<84:52:46,  8.21s/it]
  2%|▏         | 753/37963 [1:50:39<82:57:19,  8.03s/it]
  2%|▏         | 754/37963 [1:50:47<82:00:01,  7.93s/it]
  2%|▏         | 755/37963 [1:50:55<80:49:26,  7.82s/it]
  2%|▏         | 756/37963 [1:51:03<80:39:19,  7.80s/it]
  2%|▏         | 757/37963 [1:51:11<81:22:37,  7.87s/it]
  2%|▏         | 758/37963 [1:51:18<80:23:58,  7.78s/it]
  2%|▏         | 759/37963 [1:51:26<80:43:42,  7.81s/it]
  2%|▏         | 760/37963 [1:51:34<79:57:03,  7.74s/it]
                                                        
{'loss': '0.1939', 'grad_norm': '6.451', 'learning_rate': '1.333e-05', 'epoch': '0.02002'}

  2%|▏         | 760/37963 [1:51:34<79:57:03,  7.74s/it]
  2%|▏         | 761/37963 [1:51:41<79:45:14,  7.72s/it]
  2%|▏         | 762/37963 [1:51:50<81:34:22,  7.89s/it]
  2%|▏         | 763/37963 [1:51:57<80:20:12,  7.77s/it]
  2%|▏         | 764/37963 [1:52:05<80:53:22,  7.83s/it]
  2%|▏         | 765/37963 [1:52:13<80:10:28,  7.76s/it]
  2%|▏         | 766/37963 [1:52:20<79:35:25,  7.70s/it]
  2%|▏         | 767/37963 [1:52:28<80:44:07,  7.81s/it]
  2%|▏         | 768/37963 [1:52:42<99:06:08,  9.59s/it]
  2%|▏         | 769/37963 [1:52:56<113:06:43, 10.95s/it]
  2%|▏         | 770/37963 [1:53:04<104:27:09, 10.11s/it]
                                                         
{'loss': '0.203', 'grad_norm': '7.711', 'learning_rate': '1.35e-05', 'epoch': '0.02028'}

  2%|▏         | 770/37963 [1:53:04<104:27:09, 10.11s/it]
  2%|▏         | 771/37963 [1:53:12<97:14:49,  9.41s/it] 
  2%|▏         | 772/37963 [1:53:26<111:17:08, 10.77s/it]
  2%|▏         | 773/37963 [1:53:34<101:20:48,  9.81s/it]
  2%|▏         | 774/37963 [1:53:42<95:44:00,  9.27s/it] 
  2%|▏         | 775/37963 [1:53:56<110:55:48, 10.74s/it]
  2%|▏         | 776/37963 [1:54:03<101:39:04,  9.84s/it]
  2%|▏         | 777/37963 [1:54:11<94:01:27,  9.10s/it] 
  2%|▏         | 778/37963 [1:54:19<90:21:37,  8.75s/it]
  2%|▏         | 779/37963 [1:54:27<87:19:38,  8.45s/it]
  2%|▏         | 780/37963 [1:54:41<105:10:30, 10.18s/it]
                                                         
{'loss': '0.1937', 'grad_norm': '4.52', 'learning_rate': '1.368e-05', 'epoch': '0.02055'}

  2%|▏         | 780/37963 [1:54:41<105:10:30, 10.18s/it]
  2%|▏         | 781/37963 [1:54:55<117:09:34, 11.34s/it]
  2%|▏         | 782/37963 [1:55:09<127:17:20, 12.32s/it]
  2%|▏         | 783/37963 [1:55:17<112:30:56, 10.89s/it]
  2%|▏         | 784/37963 [1:55:25<102:09:01,  9.89s/it]
  2%|▏         | 785/37963 [1:55:32<94:37:05,  9.16s/it] 
  2%|▏         | 786/37963 [1:55:40<91:52:52,  8.90s/it]
  2%|▏         | 787/37963 [1:55:48<87:47:01,  8.50s/it]
  2%|▏         | 788/37963 [1:55:55<83:45:51,  8.11s/it]
  2%|▏         | 789/37963 [1:56:03<81:46:05,  7.92s/it]
  2%|▏         | 790/37963 [1:56:10<81:35:03,  7.90s/it]
                                                        
{'loss': '0.182', 'grad_norm': '6.808', 'learning_rate': '1.385e-05', 'epoch': '0.02081'}

  2%|▏         | 790/37963 [1:56:10<81:35:03,  7.90s/it]
  2%|▏         | 791/37963 [1:56:18<81:38:47,  7.91s/it]
  2%|▏         | 792/37963 [1:56:26<80:28:31,  7.79s/it]
  2%|▏         | 793/37963 [1:56:33<79:59:46,  7.75s/it]
  2%|▏         | 794/37963 [1:56:41<79:24:50,  7.69s/it]
  2%|▏         | 795/37963 [1:56:48<78:25:40,  7.60s/it]
  2%|▏         | 796/37963 [1:56:56<78:57:56,  7.65s/it]
  2%|▏         | 797/37963 [1:57:04<78:56:42,  7.65s/it]
  2%|▏         | 798/37963 [1:57:18<98:19:26,  9.52s/it]
  2%|▏         | 799/37963 [1:57:25<92:30:02,  8.96s/it]
  2%|▏         | 800/37963 [1:57:33<89:26:35,  8.66s/it]
                                                        
{'loss': '0.2101', 'grad_norm': '14.19', 'learning_rate': '1.403e-05', 'epoch': '0.02107'}

  2%|▏         | 800/37963 [1:57:33<89:26:35,  8.66s/it]
  2%|▏         | 801/37963 [1:57:41<86:20:07,  8.36s/it]
  2%|▏         | 802/37963 [1:57:49<84:05:07,  8.15s/it]
  2%|▏         | 803/37963 [1:57:56<82:25:27,  7.99s/it]
  2%|▏         | 804/37963 [1:58:04<82:03:29,  7.95s/it]
  2%|▏         | 805/37963 [1:58:12<80:48:11,  7.83s/it]
  2%|▏         | 806/37963 [1:58:19<80:17:05,  7.78s/it]
  2%|▏         | 807/37963 [1:58:27<79:40:32,  7.72s/it]
  2%|▏         | 808/37963 [1:58:35<79:38:23,  7.72s/it]
  2%|▏         | 809/37963 [1:58:43<81:07:06,  7.86s/it]
  2%|▏         | 810/37963 [1:58:50<80:11:46,  7.77s/it]
                                                        
{'loss': '0.1867', 'grad_norm': '5.326', 'learning_rate': '1.421e-05', 'epoch': '0.02134'}

  2%|▏         | 810/37963 [1:58:50<80:11:46,  7.77s/it]
  2%|▏         | 811/37963 [1:58:58<80:15:23,  7.78s/it]
  2%|▏         | 812/37963 [1:59:06<79:28:56,  7.70s/it]
  2%|▏         | 813/37963 [1:59:13<79:00:04,  7.66s/it]
  2%|▏         | 814/37963 [1:59:21<79:57:51,  7.75s/it]
  2%|▏         | 815/37963 [1:59:30<81:54:52,  7.94s/it]
  2%|▏         | 816/37963 [1:59:37<80:38:22,  7.81s/it]
  2%|▏         | 817/37963 [1:59:45<79:44:54,  7.73s/it]
  2%|▏         | 818/37963 [1:59:52<78:01:48,  7.56s/it]
  2%|▏         | 819/37963 [2:00:06<98:28:08,  9.54s/it]
  2%|▏         | 820/37963 [2:00:14<92:50:39,  9.00s/it]
                                                        
{'loss': '0.1825', 'grad_norm': '4.451', 'learning_rate': '1.438e-05', 'epoch': '0.0216'}

  2%|▏         | 820/37963 [2:00:14<92:50:39,  9.00s/it]
  2%|▏         | 821/37963 [2:00:21<87:57:28,  8.53s/it]
  2%|▏         | 822/37963 [2:00:35<105:34:05, 10.23s/it]
  2%|▏         | 823/37963 [2:00:50<118:27:15, 11.48s/it]
  2%|▏         | 824/37963 [2:00:57<105:42:18, 10.25s/it]
  2%|▏         | 825/37963 [2:01:04<96:44:58,  9.38s/it] 
  2%|▏         | 826/37963 [2:01:19<111:40:05, 10.82s/it]
  2%|▏         | 827/37963 [2:01:27<103:03:47,  9.99s/it]
  2%|▏         | 828/37963 [2:01:34<94:10:20,  9.13s/it] 
  2%|▏         | 829/37963 [2:01:54<129:12:38, 12.53s/it]
  2%|▏         | 830/37963 [2:02:02<115:47:49, 11.23s/it]
                                                         
{'loss': '0.1888', 'grad_norm': '3.7', 'learning_rate': '1.456e-05', 'epoch': '0.02186'}

  2%|▏         | 830/37963 [2:02:02<115:47:49, 11.23s/it]
  2%|▏         | 831/37963 [2:02:16<124:02:33, 12.03s/it]
  2%|▏         | 832/37963 [2:02:24<111:03:08, 10.77s/it]
  2%|▏         | 833/37963 [2:02:32<101:26:15,  9.84s/it]
  2%|▏         | 834/37963 [2:02:40<96:05:46,  9.32s/it] 
  2%|▏         | 835/37963 [2:02:47<90:25:48,  8.77s/it]
  2%|▏         | 836/37963 [2:02:55<86:28:38,  8.39s/it]
  2%|▏         | 837/37963 [2:03:03<84:49:30,  8.23s/it]
  2%|▏         | 838/37963 [2:03:10<83:00:09,  8.05s/it]
  2%|▏         | 839/37963 [2:03:19<84:43:02,  8.22s/it]
  2%|▏         | 840/37963 [2:03:27<83:00:10,  8.05s/it]
                                                        
{'loss': '0.1908', 'grad_norm': '3.466', 'learning_rate': '1.473e-05', 'epoch': '0.02213'}

  2%|▏         | 840/37963 [2:03:27<83:00:10,  8.05s/it]
  2%|▏         | 841/37963 [2:03:34<82:14:21,  7.98s/it]
  2%|▏         | 842/37963 [2:03:42<81:57:56,  7.95s/it]
  2%|▏         | 843/37963 [2:03:50<81:24:01,  7.89s/it]
  2%|▏         | 844/37963 [2:03:58<81:55:21,  7.95s/it]
  2%|▏         | 845/37963 [2:04:06<80:48:28,  7.84s/it]
  2%|▏         | 846/37963 [2:04:14<80:44:17,  7.83s/it]
  2%|▏         | 847/37963 [2:04:27<98:33:50,  9.56s/it]
  2%|▏         | 848/37963 [2:04:35<93:31:18,  9.07s/it]
  2%|▏         | 849/37963 [2:04:42<87:56:23,  8.53s/it]
  2%|▏         | 850/37963 [2:04:50<85:53:10,  8.33s/it]
                                                        
{'loss': '0.187', 'grad_norm': '5.992', 'learning_rate': '1.491e-05', 'epoch': '0.02239'}

  2%|▏         | 850/37963 [2:04:50<85:53:10,  8.33s/it]
  2%|▏         | 851/37963 [2:04:58<83:23:58,  8.09s/it]
  2%|▏         | 852/37963 [2:05:05<81:32:19,  7.91s/it]
  2%|▏         | 853/37963 [2:05:13<81:27:32,  7.90s/it]
  2%|▏         | 854/37963 [2:05:21<80:20:27,  7.79s/it]
  2%|▏         | 855/37963 [2:05:28<80:04:17,  7.77s/it]
  2%|▏         | 856/37963 [2:05:36<79:59:35,  7.76s/it]
  2%|▏         | 857/37963 [2:05:44<79:17:30,  7.69s/it]
  2%|▏         | 858/37963 [2:05:51<79:26:21,  7.71s/it]
  2%|▏         | 859/37963 [2:05:59<79:55:48,  7.76s/it]
  2%|▏         | 860/37963 [2:06:07<79:13:54,  7.69s/it]
                                                        
{'loss': '0.1813', 'grad_norm': '4.046', 'learning_rate': '1.508e-05', 'epoch': '0.02265'}

  2%|▏         | 860/37963 [2:06:07<79:13:54,  7.69s/it]
  2%|▏         | 861/37963 [2:06:14<78:54:42,  7.66s/it]
  2%|▏         | 862/37963 [2:06:22<79:41:29,  7.73s/it]
  2%|▏         | 863/37963 [2:06:30<80:43:05,  7.83s/it]
  2%|▏         | 864/37963 [2:06:38<80:47:03,  7.84s/it]
  2%|▏         | 865/37963 [2:06:46<80:40:30,  7.83s/it]
  2%|▏         | 866/37963 [2:07:00<98:16:03,  9.54s/it]
  2%|▏         | 867/37963 [2:07:07<92:36:46,  8.99s/it]
  2%|▏         | 868/37963 [2:07:16<91:08:32,  8.85s/it]
  2%|▏         | 869/37963 [2:07:30<106:41:14, 10.35s/it]
  2%|▏         | 870/37963 [2:07:37<97:57:46,  9.51s/it] 
                                                        
{'loss': '0.1899', 'grad_norm': '6.329', 'learning_rate': '1.526e-05', 'epoch': '0.02292'}

  2%|▏         | 870/37963 [2:07:37<97:57:46,  9.51s/it]
  2%|▏         | 871/37963 [2:07:52<115:01:04, 11.16s/it]
  2%|▏         | 872/37963 [2:08:00<104:22:19, 10.13s/it]
  2%|▏         | 873/37963 [2:08:07<96:05:41,  9.33s/it] 
  2%|▏         | 874/37963 [2:08:21<110:29:14, 10.72s/it]
  2%|▏         | 875/37963 [2:08:29<101:57:17,  9.90s/it]
  2%|▏         | 876/37963 [2:08:44<115:11:08, 11.18s/it]
  2%|▏         | 877/37963 [2:08:57<122:44:04, 11.91s/it]
  2%|▏         | 878/37963 [2:09:11<129:38:12, 12.58s/it]
  2%|▏         | 879/37963 [2:09:19<113:51:57, 11.05s/it]
  2%|▏         | 880/37963 [2:09:26<103:27:46, 10.04s/it]
                                                         
{'loss': '0.1971', 'grad_norm': '4.434', 'learning_rate': '1.543e-05', 'epoch': '0.02318'}

  2%|▏         | 880/37963 [2:09:26<103:27:46, 10.04s/it]
  2%|▏         | 881/37963 [2:09:34<95:21:32,  9.26s/it] 
  2%|▏         | 882/37963 [2:09:42<90:37:01,  8.80s/it]
  2%|▏         | 883/37963 [2:09:49<87:24:18,  8.49s/it]
  2%|▏         | 884/37963 [2:09:57<84:29:25,  8.20s/it]
  2%|▏         | 885/37963 [2:10:05<83:06:53,  8.07s/it]
  2%|▏         | 886/37963 [2:10:12<81:47:19,  7.94s/it]
  2%|▏         | 887/37963 [2:10:20<82:00:45,  7.96s/it]
  2%|▏         | 888/37963 [2:10:28<82:07:07,  7.97s/it]
  2%|▏         | 889/37963 [2:10:36<80:02:43,  7.77s/it]
  2%|▏         | 890/37963 [2:10:43<79:30:28,  7.72s/it]
                                                        
{'loss': '0.1856', 'grad_norm': '5.929', 'learning_rate': '1.561e-05', 'epoch': '0.02344'}

  2%|▏         | 890/37963 [2:10:43<79:30:28,  7.72s/it]
  2%|▏         | 891/37963 [2:10:51<79:10:53,  7.69s/it]
  2%|▏         | 892/37963 [2:10:58<78:07:17,  7.59s/it]
  2%|▏         | 893/37963 [2:11:06<79:39:44,  7.74s/it]
  2%|▏         | 894/37963 [2:11:20<99:14:13,  9.64s/it]
  2%|▏         | 895/37963 [2:11:28<93:08:19,  9.05s/it]
  2%|▏         | 896/37963 [2:11:36<88:24:56,  8.59s/it]
  2%|▏         | 897/37963 [2:11:43<86:01:35,  8.36s/it]
  2%|▏         | 898/37963 [2:11:51<84:07:11,  8.17s/it]
  2%|▏         | 899/37963 [2:11:59<81:51:55,  7.95s/it]
  2%|▏         | 900/37963 [2:12:06<80:36:33,  7.83s/it]
                                                        
{'loss': '0.1766', 'grad_norm': '4.944', 'learning_rate': '1.579e-05', 'epoch': '0.02371'}

  2%|▏         | 900/37963 [2:12:06<80:36:33,  7.83s/it]
  2%|▏         | 901/37963 [2:12:13<78:46:01,  7.65s/it]
  2%|▏         | 902/37963 [2:12:21<80:04:16,  7.78s/it]
  2%|▏         | 903/37963 [2:12:29<78:38:16,  7.64s/it]
  2%|▏         | 904/37963 [2:12:36<77:38:33,  7.54s/it]
  2%|▏         | 905/37963 [2:12:43<76:38:59,  7.45s/it]
  2%|▏         | 906/37963 [2:12:51<77:19:53,  7.51s/it]
  2%|▏         | 907/37963 [2:12:59<77:42:56,  7.55s/it]
  2%|▏         | 908/37963 [2:13:06<77:40:25,  7.55s/it]
  2%|▏         | 909/37963 [2:13:13<76:32:09,  7.44s/it]
  2%|▏         | 910/37963 [2:13:21<76:21:40,  7.42s/it]
                                                        
{'loss': '0.1952', 'grad_norm': '2.721', 'learning_rate': '1.596e-05', 'epoch': '0.02397'}

  2%|▏         | 910/37963 [2:13:21<76:21:40,  7.42s/it]
  2%|▏         | 911/37963 [2:13:29<78:00:31,  7.58s/it]
  2%|▏         | 912/37963 [2:13:36<77:29:09,  7.53s/it]
  2%|▏         | 913/37963 [2:13:44<77:26:24,  7.52s/it]
  2%|▏         | 914/37963 [2:13:57<97:15:29,  9.45s/it]
  2%|▏         | 915/37963 [2:14:12<114:05:28, 11.09s/it]
  2%|▏         | 916/37963 [2:14:20<103:36:31, 10.07s/it]
  2%|▏         | 917/37963 [2:14:28<95:41:00,  9.30s/it] 
  2%|▏         | 918/37963 [2:14:42<112:21:18, 10.92s/it]
  2%|▏         | 919/37963 [2:14:50<103:18:36, 10.04s/it]
  2%|▏         | 920/37963 [2:15:04<115:51:22, 11.26s/it]
                                                         
{'loss': '0.1952', 'grad_norm': '11.05', 'learning_rate': '1.614e-05', 'epoch': '0.02423'}

  2%|▏         | 920/37963 [2:15:04<115:51:22, 11.26s/it]
  2%|▏         | 921/37963 [2:15:12<105:10:48, 10.22s/it]
  2%|▏         | 922/37963 [2:15:20<97:20:16,  9.46s/it] 
  2%|▏         | 923/37963 [2:15:34<111:32:01, 10.84s/it]
  2%|▏         | 924/37963 [2:15:42<101:41:33,  9.88s/it]
  2%|▏         | 925/37963 [2:15:56<114:40:34, 11.15s/it]
  2%|▏         | 926/37963 [2:16:03<104:27:03, 10.15s/it]
  2%|▏         | 927/37963 [2:16:18<116:48:54, 11.35s/it]
  2%|▏         | 928/37963 [2:16:25<105:19:36, 10.24s/it]
  2%|▏         | 929/37963 [2:16:33<96:55:59,  9.42s/it] 
  2%|▏         | 930/37963 [2:16:41<91:58:26,  8.94s/it]
                                                        
{'loss': '0.2008', 'grad_norm': '2.688', 'learning_rate': '1.631e-05', 'epoch': '0.0245'}

  2%|▏         | 930/37963 [2:16:41<91:58:26,  8.94s/it]
  2%|▏         | 931/37963 [2:16:48<86:57:49,  8.45s/it]
  2%|▏         | 932/37963 [2:16:56<84:15:13,  8.19s/it]
  2%|▏         | 933/37963 [2:17:03<82:16:05,  8.00s/it]
  2%|▏         | 934/37963 [2:17:11<81:41:00,  7.94s/it]
  2%|▏         | 935/37963 [2:17:19<80:46:14,  7.85s/it]
  2%|▏         | 936/37963 [2:17:26<79:59:11,  7.78s/it]
  2%|▏         | 937/37963 [2:17:34<80:13:20,  7.80s/it]
  2%|▏         | 938/37963 [2:17:42<79:31:22,  7.73s/it]
  2%|▏         | 939/37963 [2:17:50<80:50:18,  7.86s/it]
  2%|▏         | 940/37963 [2:18:04<99:41:19,  9.69s/it]
                                                        
{'loss': '0.1845', 'grad_norm': '3.544', 'learning_rate': '1.649e-05', 'epoch': '0.02476'}

  2%|▏         | 940/37963 [2:18:04<99:41:19,  9.69s/it]
  2%|▏         | 941/37963 [2:18:12<94:09:26,  9.16s/it]
  2%|▏         | 942/37963 [2:18:19<89:04:29,  8.66s/it]
  2%|▏         | 943/37963 [2:18:27<87:31:46,  8.51s/it]
  2%|▏         | 944/37963 [2:18:34<83:39:13,  8.14s/it]
  2%|▏         | 945/37963 [2:18:42<82:16:34,  8.00s/it]
  2%|▏         | 946/37963 [2:18:50<80:57:46,  7.87s/it]
  2%|▏         | 947/37963 [2:18:57<78:59:16,  7.68s/it]
  2%|▏         | 948/37963 [2:19:05<80:14:08,  7.80s/it]
  2%|▏         | 949/37963 [2:19:13<79:24:19,  7.72s/it]
  3%|▎         | 950/37963 [2:19:20<79:02:59,  7.69s/it]
                                                        
{'loss': '0.1752', 'grad_norm': '4.193', 'learning_rate': '1.666e-05', 'epoch': '0.02502'}

  3%|▎         | 950/37963 [2:19:20<79:02:59,  7.69s/it]
  3%|▎         | 951/37963 [2:19:28<78:33:50,  7.64s/it]
  3%|▎         | 952/37963 [2:19:35<78:10:01,  7.60s/it]
  3%|▎         | 953/37963 [2:19:43<79:21:44,  7.72s/it]
  3%|▎         | 954/37963 [2:19:51<79:15:32,  7.71s/it]
  3%|▎         | 955/37963 [2:19:58<78:39:35,  7.65s/it]
  3%|▎         | 956/37963 [2:20:06<78:10:02,  7.60s/it]
  3%|▎         | 957/37963 [2:20:13<77:58:22,  7.59s/it]
  3%|▎         | 958/37963 [2:20:21<79:05:22,  7.69s/it]
  3%|▎         | 959/37963 [2:20:29<79:09:50,  7.70s/it]
  3%|▎         | 960/37963 [2:20:36<77:59:07,  7.59s/it]
                                                        
{'loss': '0.1841', 'grad_norm': '4.998', 'learning_rate': '1.684e-05', 'epoch': '0.02529'}

  3%|▎         | 960/37963 [2:20:36<77:59:07,  7.59s/it]
  3%|▎         | 961/37963 [2:20:50<97:35:11,  9.49s/it]
  3%|▎         | 962/37963 [2:20:58<92:20:56,  8.99s/it]
  3%|▎         | 963/37963 [2:21:13<108:55:08, 10.60s/it]
  3%|▎         | 964/37963 [2:21:20<99:41:38,  9.70s/it] 
  3%|▎         | 965/37963 [2:21:34<113:50:07, 11.08s/it]
  3%|▎         | 966/37963 [2:21:42<103:36:20, 10.08s/it]
  3%|▎         | 967/37963 [2:21:56<115:35:24, 11.25s/it]
  3%|▎         | 968/37963 [2:22:04<104:29:15, 10.17s/it]
  3%|▎         | 969/37963 [2:22:12<97:21:23,  9.47s/it] 
  3%|▎         | 970/37963 [2:22:26<113:18:18, 11.03s/it]
                                                         
{'loss': '0.1788', 'grad_norm': '2.627', 'learning_rate': '1.701e-05', 'epoch': '0.02555'}

  3%|▎         | 970/37963 [2:22:26<113:18:18, 11.03s/it]
  3%|▎         | 971/37963 [2:22:34<102:33:48,  9.98s/it]
  3%|▎         | 972/37963 [2:22:41<95:07:31,  9.26s/it] 
  3%|▎         | 973/37963 [2:22:49<91:12:54,  8.88s/it]
  3%|▎         | 974/37963 [2:22:57<87:21:30,  8.50s/it]
  3%|▎         | 975/37963 [2:23:11<104:42:00, 10.19s/it]
  3%|▎         | 976/37963 [2:23:25<116:38:58, 11.35s/it]
  3%|▎         | 977/37963 [2:23:33<104:52:19, 10.21s/it]
  3%|▎         | 978/37963 [2:23:40<96:52:23,  9.43s/it] 
  3%|▎         | 979/37963 [2:23:48<91:31:55,  8.91s/it]
  3%|▎         | 980/37963 [2:23:56<89:00:45,  8.66s/it]
                                                        
{'loss': '0.2004', 'grad_norm': '8.571', 'learning_rate': '1.719e-05', 'epoch': '0.02581'}

  3%|▎         | 980/37963 [2:23:56<89:00:45,  8.66s/it]
  3%|▎         | 981/37963 [2:24:04<85:28:19,  8.32s/it]
  3%|▎         | 982/37963 [2:24:11<83:07:38,  8.09s/it]
  3%|▎         | 983/37963 [2:24:19<81:22:54,  7.92s/it]
  3%|▎         | 984/37963 [2:24:26<79:58:27,  7.79s/it]
  3%|▎         | 985/37963 [2:24:34<80:46:20,  7.86s/it]
  3%|▎         | 986/37963 [2:24:42<79:52:59,  7.78s/it]
  3%|▎         | 987/37963 [2:24:49<79:01:19,  7.69s/it]
  3%|▎         | 988/37963 [2:25:03<98:19:47,  9.57s/it]
  3%|▎         | 989/37963 [2:25:11<92:30:05,  9.01s/it]
  3%|▎         | 990/37963 [2:25:19<87:56:35,  8.56s/it]
                                                        
{'loss': '0.1834', 'grad_norm': '4.213', 'learning_rate': '1.737e-05', 'epoch': '0.02608'}

  3%|▎         | 990/37963 [2:25:19<87:56:35,  8.56s/it]
  3%|▎         | 991/37963 [2:25:26<84:27:36,  8.22s/it]
  3%|▎         | 992/37963 [2:25:34<82:35:42,  8.04s/it]
  3%|▎         | 993/37963 [2:25:41<81:04:12,  7.89s/it]
  3%|▎         | 994/37963 [2:25:49<81:22:47,  7.92s/it]
  3%|▎         | 995/37963 [2:25:57<80:05:25,  7.80s/it]
  3%|▎         | 996/37963 [2:26:04<79:48:35,  7.77s/it]
  3%|▎         | 997/37963 [2:26:12<79:48:39,  7.77s/it]
  3%|▎         | 998/37963 [2:26:20<79:27:46,  7.74s/it]
  3%|▎         | 999/37963 [2:26:28<80:27:47,  7.84s/it]
  3%|▎         | 1000/37963 [2:26:35<79:43:52,  7.77s/it]
                                                         
{'loss': '0.1905', 'grad_norm': '5.138', 'learning_rate': '1.754e-05', 'epoch': '0.02634'}

  3%|▎         | 1000/37963 [2:26:35<79:43:52,  7.77s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.72s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.73s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  3%|▎         | 1001/37963 [2:27:31<227:44:01, 22.18s/it]
  3%|▎         | 1002/37963 [2:27:39<182:36:54, 17.79s/it]
  3%|▎         | 1003/37963 [2:27:46<151:02:45, 14.71s/it]
  3%|▎         | 1004/37963 [2:27:54<129:05:47, 12.57s/it]
  3%|▎         | 1005/37963 [2:28:02<114:03:06, 11.11s/it]
  3%|▎         | 1006/37963 [2:28:09<102:48:33, 10.01s/it]
  3%|▎         | 1007/37963 [2:28:17<94:54:05,  9.24s/it] 
  3%|▎         | 1008/37963 [2:28:24<89:38:44,  8.73s/it]
  3%|▎         | 1009/37963 [2:28:32<85:50:54,  8.36s/it]
  3%|▎         | 1010/37963 [2:28:46<103:01:47, 10.04s/it]
                                                          
{'loss': '0.1938', 'grad_norm': '3.462', 'learning_rate': '1.772e-05', 'epoch': '0.0266'}

  3%|▎         | 1010/37963 [2:28:46<103:01:47, 10.04s/it]
  3%|▎         | 1011/37963 [2:29:00<115:35:19, 11.26s/it]
  3%|▎         | 1012/37963 [2:29:07<104:27:32, 10.18s/it]
  3%|▎         | 1013/37963 [2:29:15<96:20:29,  9.39s/it] 
  3%|▎         | 1014/37963 [2:29:29<110:20:16, 10.75s/it]
  3%|▎         | 1015/37963 [2:29:43<120:25:00, 11.73s/it]
  3%|▎         | 1016/37963 [2:29:51<108:03:39, 10.53s/it]
  3%|▎         | 1017/37963 [2:30:04<118:13:36, 11.52s/it]
  3%|▎         | 1018/37963 [2:30:12<106:33:15, 10.38s/it]
  3%|▎         | 1019/37963 [2:30:20<97:48:31,  9.53s/it] 
  3%|▎         | 1020/37963 [2:30:27<91:40:04,  8.93s/it]
                                                         
{'loss': '0.1986', 'grad_norm': '5.666', 'learning_rate': '1.789e-05', 'epoch': '0.02687'}

  3%|▎         | 1020/37963 [2:30:27<91:40:04,  8.93s/it]
  3%|▎         | 1021/37963 [2:30:41<107:19:59, 10.46s/it]
  3%|▎         | 1022/37963 [2:30:49<98:19:45,  9.58s/it] 
  3%|▎         | 1023/37963 [2:30:56<92:05:45,  8.98s/it]
  3%|▎         | 1024/37963 [2:31:04<87:07:45,  8.49s/it]
  3%|▎         | 1025/37963 [2:31:11<84:32:27,  8.24s/it]
  3%|▎         | 1026/37963 [2:31:25<101:41:42,  9.91s/it]
  3%|▎         | 1027/37963 [2:31:33<94:30:49,  9.21s/it] 
  3%|▎         | 1028/37963 [2:31:40<88:48:17,  8.66s/it]
  3%|▎         | 1029/37963 [2:31:48<85:20:33,  8.32s/it]
  3%|▎         | 1030/37963 [2:31:55<82:58:21,  8.09s/it]
                                                         
{'loss': '0.1816', 'grad_norm': '3.175', 'learning_rate': '1.807e-05', 'epoch': '0.02713'}

  3%|▎         | 1030/37963 [2:31:55<82:58:21,  8.09s/it]
  3%|▎         | 1031/37963 [2:32:03<81:21:59,  7.93s/it]
  3%|▎         | 1032/37963 [2:32:10<80:14:21,  7.82s/it]
  3%|▎         | 1033/37963 [2:32:17<78:10:11,  7.62s/it]
  3%|▎         | 1034/37963 [2:32:25<77:57:26,  7.60s/it]
  3%|▎         | 1035/37963 [2:32:33<77:53:01,  7.59s/it]
  3%|▎         | 1036/37963 [2:32:40<77:45:54,  7.58s/it]
  3%|▎         | 1037/37963 [2:32:54<98:15:12,  9.58s/it]
  3%|▎         | 1038/37963 [2:33:02<91:07:26,  8.88s/it]
  3%|▎         | 1039/37963 [2:33:09<86:46:12,  8.46s/it]
  3%|▎         | 1040/37963 [2:33:17<84:07:35,  8.20s/it]
                                                         
{'loss': '0.1881', 'grad_norm': '3.104', 'learning_rate': '1.824e-05', 'epoch': '0.0274'}

  3%|▎         | 1040/37963 [2:33:17<84:07:35,  8.20s/it]
  3%|▎         | 1041/37963 [2:33:24<82:09:42,  8.01s/it]
  3%|▎         | 1042/37963 [2:33:32<80:52:33,  7.89s/it]
  3%|▎         | 1043/37963 [2:33:39<79:22:05,  7.74s/it]
  3%|▎         | 1044/37963 [2:33:47<78:40:01,  7.67s/it]
  3%|▎         | 1045/37963 [2:33:54<77:54:57,  7.60s/it]
  3%|▎         | 1046/37963 [2:34:02<77:33:06,  7.56s/it]
  3%|▎         | 1047/37963 [2:34:09<77:40:02,  7.57s/it]
  3%|▎         | 1048/37963 [2:34:17<77:41:19,  7.58s/it]
  3%|▎         | 1049/37963 [2:34:24<77:35:21,  7.57s/it]
  3%|▎         | 1050/37963 [2:34:32<77:19:23,  7.54s/it]
                                                         
{'loss': '0.1796', 'grad_norm': '4.816', 'learning_rate': '1.842e-05', 'epoch': '0.02766'}

  3%|▎         | 1050/37963 [2:34:32<77:19:23,  7.54s/it]
  3%|▎         | 1051/37963 [2:34:39<77:28:33,  7.56s/it]
  3%|▎         | 1052/37963 [2:34:47<77:02:21,  7.51s/it]
  3%|▎         | 1053/37963 [2:34:54<77:09:03,  7.52s/it]
  3%|▎         | 1054/37963 [2:35:02<77:31:55,  7.56s/it]
  3%|▎         | 1055/37963 [2:35:10<77:27:05,  7.55s/it]
  3%|▎         | 1056/37963 [2:35:17<77:33:53,  7.57s/it]
  3%|▎         | 1057/37963 [2:35:25<77:37:15,  7.57s/it]
  3%|▎         | 1058/37963 [2:35:39<97:17:45,  9.49s/it]
  3%|▎         | 1059/37963 [2:35:46<91:28:57,  8.92s/it]
  3%|▎         | 1060/37963 [2:35:54<87:17:08,  8.51s/it]
                                                         
{'loss': '0.1978', 'grad_norm': '4.853', 'learning_rate': '1.86e-05', 'epoch': '0.02792'}

  3%|▎         | 1060/37963 [2:35:54<87:17:08,  8.51s/it]
  3%|▎         | 1061/37963 [2:36:02<84:29:39,  8.24s/it]
  3%|▎         | 1062/37963 [2:36:22<121:49:44, 11.89s/it]
  3%|▎         | 1063/37963 [2:36:29<108:29:05, 10.58s/it]
  3%|▎         | 1064/37963 [2:36:37<99:00:16,  9.66s/it] 
  3%|▎         | 1065/37963 [2:36:44<91:36:58,  8.94s/it]
  3%|▎         | 1066/37963 [2:36:52<87:42:44,  8.56s/it]
  3%|▎         | 1067/37963 [2:36:59<84:19:41,  8.23s/it]
  3%|▎         | 1068/37963 [2:37:13<101:42:39,  9.92s/it]
  3%|▎         | 1069/37963 [2:37:33<133:00:49, 12.98s/it]
  3%|▎         | 1070/37963 [2:37:41<116:01:20, 11.32s/it]
                                                          
{'loss': '0.1785', 'grad_norm': '5.265', 'learning_rate': '1.877e-05', 'epoch': '0.02819'}

  3%|▎         | 1070/37963 [2:37:41<116:01:20, 11.32s/it]
  3%|▎         | 1071/37963 [2:37:48<104:15:58, 10.17s/it]
  3%|▎         | 1072/37963 [2:37:56<96:06:47,  9.38s/it] 
  3%|▎         | 1073/37963 [2:38:03<89:28:04,  8.73s/it]
  3%|▎         | 1074/37963 [2:38:11<86:06:28,  8.40s/it]
  3%|▎         | 1075/37963 [2:38:18<83:11:25,  8.12s/it]
  3%|▎         | 1076/37963 [2:38:26<81:20:41,  7.94s/it]
  3%|▎         | 1077/37963 [2:38:39<99:29:08,  9.71s/it]
  3%|▎         | 1078/37963 [2:38:47<92:22:47,  9.02s/it]
  3%|▎         | 1079/37963 [2:38:54<87:33:25,  8.55s/it]
  3%|▎         | 1080/37963 [2:39:02<84:29:20,  8.25s/it]
                                                         
{'loss': '0.2057', 'grad_norm': '2.228', 'learning_rate': '1.895e-05', 'epoch': '0.02845'}

  3%|▎         | 1080/37963 [2:39:02<84:29:20,  8.25s/it]
  3%|▎         | 1081/37963 [2:39:09<81:20:22,  7.94s/it]
  3%|▎         | 1082/37963 [2:39:17<80:16:49,  7.84s/it]
  3%|▎         | 1083/37963 [2:39:24<79:24:58,  7.75s/it]
  3%|▎         | 1084/37963 [2:39:32<78:25:08,  7.66s/it]
  3%|▎         | 1085/37963 [2:39:39<78:01:40,  7.62s/it]
  3%|▎         | 1086/37963 [2:39:53<97:26:43,  9.51s/it]
  3%|▎         | 1087/37963 [2:40:01<91:21:21,  8.92s/it]
  3%|▎         | 1088/37963 [2:40:08<87:17:47,  8.52s/it]
  3%|▎         | 1089/37963 [2:40:16<84:26:23,  8.24s/it]
  3%|▎         | 1090/37963 [2:40:23<81:02:48,  7.91s/it]
                                                         
{'loss': '0.1997', 'grad_norm': '6.317', 'learning_rate': '1.912e-05', 'epoch': '0.02871'}

  3%|▎         | 1090/37963 [2:40:23<81:02:48,  7.91s/it]
  3%|▎         | 1091/37963 [2:40:30<79:42:35,  7.78s/it]
  3%|▎         | 1092/37963 [2:40:38<79:24:39,  7.75s/it]
  3%|▎         | 1093/37963 [2:40:46<78:44:26,  7.69s/it]
  3%|▎         | 1094/37963 [2:40:53<78:03:39,  7.62s/it]
  3%|▎         | 1095/37963 [2:41:01<77:31:45,  7.57s/it]
  3%|▎         | 1096/37963 [2:41:08<77:19:48,  7.55s/it]
  3%|▎         | 1097/37963 [2:41:16<77:26:16,  7.56s/it]
  3%|▎         | 1098/37963 [2:41:23<77:03:38,  7.53s/it]
  3%|▎         | 1099/37963 [2:41:31<77:27:36,  7.56s/it]
  3%|▎         | 1100/37963 [2:41:38<77:48:38,  7.60s/it]
                                                         
{'loss': '0.1859', 'grad_norm': '3.188', 'learning_rate': '1.93e-05', 'epoch': '0.02898'}

  3%|▎         | 1100/37963 [2:41:38<77:48:38,  7.60s/it]
  3%|▎         | 1101/37963 [2:41:46<77:35:08,  7.58s/it]
  3%|▎         | 1102/37963 [2:41:54<77:21:12,  7.55s/it]
  3%|▎         | 1103/37963 [2:42:01<77:10:43,  7.54s/it]
  3%|▎         | 1104/37963 [2:42:09<77:18:31,  7.55s/it]
  3%|▎         | 1105/37963 [2:42:16<77:16:33,  7.55s/it]
  3%|▎         | 1106/37963 [2:42:24<77:09:31,  7.54s/it]
  3%|▎         | 1107/37963 [2:42:31<76:43:28,  7.49s/it]
  3%|▎         | 1108/37963 [2:42:45<96:46:42,  9.45s/it]
  3%|▎         | 1109/37963 [2:42:59<111:04:42, 10.85s/it]
  3%|▎         | 1110/37963 [2:43:07<100:57:05,  9.86s/it]
                                                          
{'loss': '0.1949', 'grad_norm': '3.259', 'learning_rate': '1.947e-05', 'epoch': '0.02924'}

  3%|▎         | 1110/37963 [2:43:07<100:57:05,  9.86s/it]
  3%|▎         | 1111/37963 [2:43:14<94:04:55,  9.19s/it] 
  3%|▎         | 1112/37963 [2:43:29<109:23:58, 10.69s/it]
  3%|▎         | 1113/37963 [2:43:36<99:43:54,  9.74s/it] 
  3%|▎         | 1114/37963 [2:43:44<95:25:23,  9.32s/it]
  3%|▎         | 1115/37963 [2:43:59<110:34:30, 10.80s/it]
  3%|▎         | 1116/37963 [2:44:13<120:33:57, 11.78s/it]
  3%|▎         | 1117/37963 [2:44:27<127:30:33, 12.46s/it]
  3%|▎         | 1118/37963 [2:44:34<112:37:49, 11.00s/it]
  3%|▎         | 1119/37963 [2:44:42<102:18:39, 10.00s/it]
  3%|▎         | 1120/37963 [2:44:50<95:17:54,  9.31s/it] 
                                                         
{'loss': '0.1768', 'grad_norm': '5.34', 'learning_rate': '1.965e-05', 'epoch': '0.0295'}

  3%|▎         | 1120/37963 [2:44:50<95:17:54,  9.31s/it]
  3%|▎         | 1121/37963 [2:44:57<90:08:59,  8.81s/it]
  3%|▎         | 1122/37963 [2:45:06<88:08:44,  8.61s/it]
  3%|▎         | 1123/37963 [2:45:13<84:56:29,  8.30s/it]
  3%|▎         | 1124/37963 [2:45:21<82:54:29,  8.10s/it]
  3%|▎         | 1125/37963 [2:45:28<80:40:02,  7.88s/it]
  3%|▎         | 1126/37963 [2:45:42<98:49:32,  9.66s/it]
  3%|▎         | 1127/37963 [2:45:49<91:59:58,  8.99s/it]
  3%|▎         | 1128/37963 [2:45:57<87:50:09,  8.58s/it]
  3%|▎         | 1129/37963 [2:46:05<84:41:35,  8.28s/it]
  3%|▎         | 1130/37963 [2:46:12<82:38:55,  8.08s/it]
                                                         
{'loss': '0.1872', 'grad_norm': '5.18', 'learning_rate': '1.982e-05', 'epoch': '0.02977'}

  3%|▎         | 1130/37963 [2:46:12<82:38:55,  8.08s/it]
  3%|▎         | 1131/37963 [2:46:20<82:11:49,  8.03s/it]
  3%|▎         | 1132/37963 [2:46:27<79:42:07,  7.79s/it]
  3%|▎         | 1133/37963 [2:46:35<79:08:34,  7.74s/it]
  3%|▎         | 1134/37963 [2:46:49<98:49:06,  9.66s/it]
  3%|▎         | 1135/37963 [2:46:57<93:54:21,  9.18s/it]
  3%|▎         | 1136/37963 [2:47:05<89:01:53,  8.70s/it]
  3%|▎         | 1137/37963 [2:47:12<85:37:41,  8.37s/it]
  3%|▎         | 1138/37963 [2:47:20<82:51:12,  8.10s/it]
  3%|▎         | 1139/37963 [2:47:27<81:03:30,  7.92s/it]
  3%|▎         | 1140/37963 [2:47:36<82:15:03,  8.04s/it]
                                                         
{'loss': '0.1871', 'grad_norm': '3.103', 'learning_rate': '2e-05', 'epoch': '0.03003'}

  3%|▎         | 1140/37963 [2:47:36<82:15:03,  8.04s/it]
  3%|▎         | 1141/37963 [2:47:44<82:22:11,  8.05s/it]
  3%|▎         | 1142/37963 [2:47:51<81:23:30,  7.96s/it]
  3%|▎         | 1143/37963 [2:47:59<79:53:43,  7.81s/it]
  3%|▎         | 1144/37963 [2:48:06<79:03:47,  7.73s/it]
  3%|▎         | 1145/37963 [2:48:14<77:59:51,  7.63s/it]
  3%|▎         | 1146/37963 [2:48:22<79:44:35,  7.80s/it]
  3%|▎         | 1147/37963 [2:48:30<78:56:21,  7.72s/it]
  3%|▎         | 1148/37963 [2:48:37<78:18:13,  7.66s/it]
  3%|▎         | 1149/37963 [2:48:45<77:38:47,  7.59s/it]
  3%|▎         | 1150/37963 [2:48:52<77:46:11,  7.61s/it]
                                                         
{'loss': '0.1868', 'grad_norm': '7.968', 'learning_rate': '2e-05', 'epoch': '0.03029'}

  3%|▎         | 1150/37963 [2:48:52<77:46:11,  7.61s/it]
  3%|▎         | 1151/37963 [2:49:00<78:17:28,  7.66s/it]
  3%|▎         | 1152/37963 [2:49:07<76:01:55,  7.44s/it]
  3%|▎         | 1153/37963 [2:49:14<76:03:39,  7.44s/it]
  3%|▎         | 1154/37963 [2:49:21<75:11:26,  7.35s/it]
  3%|▎         | 1155/37963 [2:49:29<75:57:56,  7.43s/it]
  3%|▎         | 1156/37963 [2:49:37<76:29:02,  7.48s/it]
  3%|▎         | 1157/37963 [2:49:51<97:41:39,  9.56s/it]
  3%|▎         | 1158/37963 [2:49:59<92:00:30,  9.00s/it]
  3%|▎         | 1159/37963 [2:50:20<128:35:01, 12.58s/it]
  3%|▎         | 1160/37963 [2:50:27<113:17:30, 11.08s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '5.474', 'learning_rate': '2e-05', 'epoch': '0.03056'}

  3%|▎         | 1160/37963 [2:50:27<113:17:30, 11.08s/it]
  3%|▎         | 1161/37963 [2:50:35<101:50:07,  9.96s/it]
  3%|▎         | 1162/37963 [2:50:42<93:50:53,  9.18s/it] 
  3%|▎         | 1163/37963 [2:50:57<110:17:16, 10.79s/it]
  3%|▎         | 1164/37963 [2:51:04<100:17:28,  9.81s/it]
  3%|▎         | 1165/37963 [2:51:18<113:39:16, 11.12s/it]
  3%|▎         | 1166/37963 [2:51:26<102:48:58, 10.06s/it]
  3%|▎         | 1167/37963 [2:51:34<96:55:03,  9.48s/it] 
  3%|▎         | 1168/37963 [2:51:48<111:44:40, 10.93s/it]
  3%|▎         | 1169/37963 [2:51:56<101:23:51,  9.92s/it]
  3%|▎         | 1170/37963 [2:52:04<95:45:57,  9.37s/it] 
                                                         
{'loss': '0.1876', 'grad_norm': '3.095', 'learning_rate': '2e-05', 'epoch': '0.03082'}

  3%|▎         | 1170/37963 [2:52:04<95:45:57,  9.37s/it]
  3%|▎         | 1171/37963 [2:52:12<90:38:28,  8.87s/it]
  3%|▎         | 1172/37963 [2:52:19<86:41:29,  8.48s/it]
  3%|▎         | 1173/37963 [2:52:26<83:00:24,  8.12s/it]
  3%|▎         | 1174/37963 [2:52:34<81:15:10,  7.95s/it]
  3%|▎         | 1175/37963 [2:52:42<81:10:29,  7.94s/it]
  3%|▎         | 1176/37963 [2:52:50<80:06:23,  7.84s/it]
  3%|▎         | 1177/37963 [2:53:04<99:02:10,  9.69s/it]
  3%|▎         | 1178/37963 [2:53:18<113:29:55, 11.11s/it]
  3%|▎         | 1179/37963 [2:53:26<102:55:38, 10.07s/it]
  3%|▎         | 1180/37963 [2:53:33<95:21:54,  9.33s/it] 
                                                         
{'loss': '0.1753', 'grad_norm': '2.613', 'learning_rate': '2e-05', 'epoch': '0.03108'}

  3%|▎         | 1180/37963 [2:53:33<95:21:54,  9.33s/it]
  3%|▎         | 1181/37963 [2:53:41<89:29:08,  8.76s/it]
  3%|▎         | 1182/37963 [2:53:48<85:39:10,  8.38s/it]
  3%|▎         | 1183/37963 [2:53:56<84:14:19,  8.25s/it]
  3%|▎         | 1184/37963 [2:54:03<81:15:24,  7.95s/it]
  3%|▎         | 1185/37963 [2:54:11<79:48:19,  7.81s/it]
  3%|▎         | 1186/37963 [2:54:18<78:36:52,  7.70s/it]
  3%|▎         | 1187/37963 [2:54:26<77:21:19,  7.57s/it]
  3%|▎         | 1188/37963 [2:54:33<77:54:43,  7.63s/it]
  3%|▎         | 1189/37963 [2:54:41<77:54:02,  7.63s/it]
  3%|▎         | 1190/37963 [2:54:48<77:29:19,  7.59s/it]
                                                         
{'loss': '0.1812', 'grad_norm': '3.579', 'learning_rate': '2e-05', 'epoch': '0.03135'}

  3%|▎         | 1190/37963 [2:54:48<77:29:19,  7.59s/it]
  3%|▎         | 1191/37963 [2:54:56<76:17:19,  7.47s/it]
  3%|▎         | 1192/37963 [2:55:03<77:00:13,  7.54s/it]
  3%|▎         | 1193/37963 [2:55:11<78:08:14,  7.65s/it]
  3%|▎         | 1194/37963 [2:55:19<77:47:34,  7.62s/it]
  3%|▎         | 1195/37963 [2:55:26<77:19:03,  7.57s/it]
  3%|▎         | 1196/37963 [2:55:33<76:22:23,  7.48s/it]
  3%|▎         | 1197/37963 [2:55:41<77:39:39,  7.60s/it]
  3%|▎         | 1198/37963 [2:55:49<77:19:39,  7.57s/it]
  3%|▎         | 1199/37963 [2:55:56<77:13:52,  7.56s/it]
  3%|▎         | 1200/37963 [2:56:04<77:01:52,  7.54s/it]
                                                         
{'loss': '0.1744', 'grad_norm': '7.29', 'learning_rate': '2e-05', 'epoch': '0.03161'}

  3%|▎         | 1200/37963 [2:56:04<77:01:52,  7.54s/it]
  3%|▎         | 1201/37963 [2:56:11<76:56:30,  7.53s/it]
  3%|▎         | 1202/37963 [2:56:20<79:11:51,  7.76s/it]
  3%|▎         | 1203/37963 [2:56:27<78:53:14,  7.73s/it]
  3%|▎         | 1204/37963 [2:56:35<78:32:59,  7.69s/it]
  3%|▎         | 1205/37963 [2:56:42<77:25:47,  7.58s/it]
  3%|▎         | 1206/37963 [2:56:50<77:15:08,  7.57s/it]
  3%|▎         | 1207/37963 [2:57:03<95:25:30,  9.35s/it]
  3%|▎         | 1208/37963 [2:57:11<89:27:16,  8.76s/it]
  3%|▎         | 1209/37963 [2:57:25<106:28:45, 10.43s/it]
  3%|▎         | 1210/37963 [2:57:40<120:00:56, 11.76s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '13.07', 'learning_rate': '2e-05', 'epoch': '0.03187'}

  3%|▎         | 1210/37963 [2:57:40<120:00:56, 11.76s/it]
  3%|▎         | 1211/37963 [2:57:47<107:11:29, 10.50s/it]
  3%|▎         | 1212/37963 [2:57:55<97:47:58,  9.58s/it] 
  3%|▎         | 1213/37963 [2:58:09<112:50:38, 11.05s/it]
  3%|▎         | 1214/37963 [2:58:24<122:14:18, 11.97s/it]
  3%|▎         | 1215/37963 [2:58:31<108:35:26, 10.64s/it]
  3%|▎         | 1216/37963 [2:58:38<98:43:55,  9.67s/it] 
  3%|▎         | 1217/37963 [2:58:52<112:00:06, 10.97s/it]
  3%|▎         | 1218/37963 [2:59:00<101:44:27,  9.97s/it]
  3%|▎         | 1219/37963 [2:59:08<94:14:28,  9.23s/it] 
  3%|▎         | 1220/37963 [2:59:15<88:31:03,  8.67s/it]
                                                         
{'loss': '0.1909', 'grad_norm': '7.545', 'learning_rate': '2e-05', 'epoch': '0.03214'}

  3%|▎         | 1220/37963 [2:59:15<88:31:03,  8.67s/it]
  3%|▎         | 1221/37963 [2:59:23<86:12:40,  8.45s/it]
  3%|▎         | 1222/37963 [2:59:30<83:08:12,  8.15s/it]
  3%|▎         | 1223/37963 [2:59:44<101:00:31,  9.90s/it]
  3%|▎         | 1224/37963 [2:59:52<93:56:09,  9.20s/it] 
  3%|▎         | 1225/37963 [3:00:00<90:09:15,  8.83s/it]
  3%|▎         | 1226/37963 [3:00:07<86:17:44,  8.46s/it]
  3%|▎         | 1227/37963 [3:00:21<102:58:37, 10.09s/it]
  3%|▎         | 1228/37963 [3:00:29<95:07:30,  9.32s/it] 
  3%|▎         | 1229/37963 [3:00:37<90:46:15,  8.90s/it]
  3%|▎         | 1230/37963 [3:00:44<86:44:49,  8.50s/it]
                                                         
{'loss': '0.2059', 'grad_norm': '8.276', 'learning_rate': '2e-05', 'epoch': '0.0324'}

  3%|▎         | 1230/37963 [3:00:44<86:44:49,  8.50s/it]
  3%|▎         | 1231/37963 [3:00:52<83:45:58,  8.21s/it]
  3%|▎         | 1232/37963 [3:00:59<81:38:25,  8.00s/it]
  3%|▎         | 1233/37963 [3:01:07<79:34:45,  7.80s/it]
  3%|▎         | 1234/37963 [3:01:15<80:20:51,  7.88s/it]
  3%|▎         | 1235/37963 [3:01:22<79:04:20,  7.75s/it]
  3%|▎         | 1236/37963 [3:01:30<78:18:47,  7.68s/it]
  3%|▎         | 1237/37963 [3:01:37<77:46:59,  7.62s/it]
  3%|▎         | 1238/37963 [3:01:45<77:39:20,  7.61s/it]
  3%|▎         | 1239/37963 [3:01:53<78:56:25,  7.74s/it]
  3%|▎         | 1240/37963 [3:02:00<78:25:10,  7.69s/it]
                                                         
{'loss': '0.1972', 'grad_norm': '12.98', 'learning_rate': '2e-05', 'epoch': '0.03266'}

  3%|▎         | 1240/37963 [3:02:00<78:25:10,  7.69s/it]
  3%|▎         | 1241/37963 [3:02:08<78:23:16,  7.68s/it]
  3%|▎         | 1242/37963 [3:02:16<77:44:36,  7.62s/it]
  3%|▎         | 1243/37963 [3:02:23<77:47:27,  7.63s/it]
  3%|▎         | 1244/37963 [3:02:31<79:19:02,  7.78s/it]
  3%|▎         | 1245/37963 [3:02:39<79:08:10,  7.76s/it]
  3%|▎         | 1246/37963 [3:02:47<78:27:29,  7.69s/it]
  3%|▎         | 1247/37963 [3:02:54<78:06:15,  7.66s/it]
  3%|▎         | 1248/37963 [3:03:02<77:43:11,  7.62s/it]
  3%|▎         | 1249/37963 [3:03:10<79:40:08,  7.81s/it]
  3%|▎         | 1250/37963 [3:03:17<77:59:58,  7.65s/it]
                                                         
{'loss': '0.194', 'grad_norm': '5.883', 'learning_rate': '2e-05', 'epoch': '0.03293'}

  3%|▎         | 1250/37963 [3:03:17<77:59:58,  7.65s/it]
  3%|▎         | 1251/37963 [3:03:25<77:40:20,  7.62s/it]
  3%|▎         | 1252/37963 [3:03:32<76:27:57,  7.50s/it]
  3%|▎         | 1253/37963 [3:03:39<76:06:51,  7.46s/it]
  3%|▎         | 1254/37963 [3:03:47<77:43:01,  7.62s/it]
  3%|▎         | 1255/37963 [3:03:55<77:43:49,  7.62s/it]
  3%|▎         | 1256/37963 [3:04:03<77:31:33,  7.60s/it]
  3%|▎         | 1257/37963 [3:04:17<96:53:48,  9.50s/it]
  3%|▎         | 1258/37963 [3:04:37<131:22:10, 12.88s/it]
  3%|▎         | 1259/37963 [3:04:45<115:05:22, 11.29s/it]
  3%|▎         | 1260/37963 [3:04:52<103:44:01, 10.17s/it]
                                                          
{'loss': '0.1979', 'grad_norm': '5.391', 'learning_rate': '2e-05', 'epoch': '0.03319'}

  3%|▎         | 1260/37963 [3:04:52<103:44:01, 10.17s/it]
  3%|▎         | 1261/37963 [3:05:00<97:08:10,  9.53s/it] 
  3%|▎         | 1262/37963 [3:05:08<91:18:09,  8.96s/it]
  3%|▎         | 1263/37963 [3:05:28<125:58:36, 12.36s/it]
  3%|▎         | 1264/37963 [3:05:43<132:29:51, 13.00s/it]
  3%|▎         | 1265/37963 [3:05:50<116:04:16, 11.39s/it]
  3%|▎         | 1266/37963 [3:05:58<104:10:28, 10.22s/it]
  3%|▎         | 1267/37963 [3:06:05<95:01:57,  9.32s/it] 
  3%|▎         | 1268/37963 [3:06:13<91:27:08,  8.97s/it]
  3%|▎         | 1269/37963 [3:06:21<87:28:26,  8.58s/it]
  3%|▎         | 1270/37963 [3:06:29<84:21:59,  8.28s/it]
                                                         
{'loss': '0.1998', 'grad_norm': '2.229', 'learning_rate': '2e-05', 'epoch': '0.03345'}

  3%|▎         | 1270/37963 [3:06:29<84:21:59,  8.28s/it]
  3%|▎         | 1271/37963 [3:06:42<101:29:54,  9.96s/it]
  3%|▎         | 1272/37963 [3:06:50<93:51:24,  9.21s/it] 
  3%|▎         | 1273/37963 [3:06:58<90:49:01,  8.91s/it]
  3%|▎         | 1274/37963 [3:07:06<86:19:44,  8.47s/it]
  3%|▎         | 1275/37963 [3:07:13<83:31:16,  8.20s/it]
  3%|▎         | 1276/37963 [3:07:21<81:31:36,  8.00s/it]
  3%|▎         | 1277/37963 [3:07:28<80:12:09,  7.87s/it]
  3%|▎         | 1278/37963 [3:07:36<80:57:12,  7.94s/it]
  3%|▎         | 1279/37963 [3:07:50<99:14:15,  9.74s/it]
  3%|▎         | 1280/37963 [3:07:58<92:35:54,  9.09s/it]
                                                         
{'loss': '0.1797', 'grad_norm': '3.38', 'learning_rate': '2e-05', 'epoch': '0.03372'}

  3%|▎         | 1280/37963 [3:07:58<92:35:54,  9.09s/it]
  3%|▎         | 1281/37963 [3:08:06<89:13:56,  8.76s/it]
  3%|▎         | 1282/37963 [3:08:13<85:23:48,  8.38s/it]
  3%|▎         | 1283/37963 [3:08:21<83:09:35,  8.16s/it]
  3%|▎         | 1284/37963 [3:08:29<81:11:07,  7.97s/it]
  3%|▎         | 1285/37963 [3:08:36<81:07:39,  7.96s/it]
  3%|▎         | 1286/37963 [3:08:44<80:21:06,  7.89s/it]
  3%|▎         | 1287/37963 [3:08:52<79:17:06,  7.78s/it]
  3%|▎         | 1288/37963 [3:08:59<78:09:29,  7.67s/it]
  3%|▎         | 1289/37963 [3:09:06<76:54:52,  7.55s/it]
  3%|▎         | 1290/37963 [3:09:15<78:41:13,  7.72s/it]
                                                         
{'loss': '0.1934', 'grad_norm': '1.943', 'learning_rate': '2e-05', 'epoch': '0.03398'}

  3%|▎         | 1290/37963 [3:09:15<78:41:13,  7.72s/it]
  3%|▎         | 1291/37963 [3:09:22<78:16:38,  7.68s/it]
  3%|▎         | 1292/37963 [3:09:30<77:52:23,  7.64s/it]
  3%|▎         | 1293/37963 [3:09:37<77:18:01,  7.59s/it]
  3%|▎         | 1294/37963 [3:09:44<76:27:32,  7.51s/it]
  3%|▎         | 1295/37963 [3:09:53<78:31:00,  7.71s/it]
  3%|▎         | 1296/37963 [3:10:00<76:49:01,  7.54s/it]
  3%|▎         | 1297/37963 [3:10:07<76:43:40,  7.53s/it]
  3%|▎         | 1298/37963 [3:10:14<75:40:39,  7.43s/it]
  3%|▎         | 1299/37963 [3:10:22<76:28:57,  7.51s/it]
  3%|▎         | 1300/37963 [3:10:30<77:04:11,  7.57s/it]
                                                         
{'loss': '0.1797', 'grad_norm': '3.806', 'learning_rate': '2e-05', 'epoch': '0.03424'}

  3%|▎         | 1300/37963 [3:10:30<77:04:11,  7.57s/it]
  3%|▎         | 1301/37963 [3:10:37<77:00:21,  7.56s/it]
  3%|▎         | 1302/37963 [3:10:45<77:11:04,  7.58s/it]
  3%|▎         | 1303/37963 [3:10:53<77:51:41,  7.65s/it]
  3%|▎         | 1304/37963 [3:11:01<78:04:08,  7.67s/it]
  3%|▎         | 1305/37963 [3:11:14<97:09:30,  9.54s/it]
  3%|▎         | 1306/37963 [3:11:29<111:24:24, 10.94s/it]
  3%|▎         | 1307/37963 [3:11:43<123:09:10, 12.09s/it]
  3%|▎         | 1308/37963 [3:11:51<109:36:25, 10.76s/it]
  3%|▎         | 1309/37963 [3:12:06<121:12:49, 11.91s/it]
  3%|▎         | 1310/37963 [3:12:25<145:14:28, 14.27s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '7.664', 'learning_rate': '2e-05', 'epoch': '0.03451'}

  3%|▎         | 1310/37963 [3:12:25<145:14:28, 14.27s/it]
  3%|▎         | 1311/37963 [3:12:33<126:02:41, 12.38s/it]
  3%|▎         | 1312/37963 [3:12:41<111:26:29, 10.95s/it]
  3%|▎         | 1313/37963 [3:12:49<103:27:33, 10.16s/it]
  3%|▎         | 1314/37963 [3:12:57<95:23:21,  9.37s/it] 
  3%|▎         | 1315/37963 [3:13:04<89:52:29,  8.83s/it]
  3%|▎         | 1316/37963 [3:13:12<86:06:40,  8.46s/it]
  3%|▎         | 1317/37963 [3:13:26<103:23:02, 10.16s/it]
  3%|▎         | 1318/37963 [3:13:34<95:50:37,  9.42s/it] 
  3%|▎         | 1319/37963 [3:13:41<90:06:49,  8.85s/it]
  3%|▎         | 1320/37963 [3:13:49<85:02:25,  8.35s/it]
                                                         
{'loss': '0.1826', 'grad_norm': '2.004', 'learning_rate': '2e-05', 'epoch': '0.03477'}

  3%|▎         | 1320/37963 [3:13:49<85:02:25,  8.35s/it]
  3%|▎         | 1321/37963 [3:13:56<81:41:39,  8.03s/it]
  3%|▎         | 1322/37963 [3:14:04<81:58:36,  8.05s/it]
  3%|▎         | 1323/37963 [3:14:11<80:09:27,  7.88s/it]
  3%|▎         | 1324/37963 [3:14:19<79:38:35,  7.83s/it]
  3%|▎         | 1325/37963 [3:14:27<78:58:39,  7.76s/it]
  3%|▎         | 1326/37963 [3:14:34<78:13:49,  7.69s/it]
  3%|▎         | 1327/37963 [3:14:48<97:56:21,  9.62s/it]
  3%|▎         | 1328/37963 [3:14:56<91:09:51,  8.96s/it]
  4%|▎         | 1329/37963 [3:15:03<85:51:50,  8.44s/it]
  4%|▎         | 1330/37963 [3:15:11<83:33:13,  8.21s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '3.285', 'learning_rate': '2e-05', 'epoch': '0.03503'}

  4%|▎         | 1330/37963 [3:15:11<83:33:13,  8.21s/it]
  4%|▎         | 1331/37963 [3:15:19<82:53:25,  8.15s/it]
  4%|▎         | 1332/37963 [3:15:26<80:38:25,  7.93s/it]
  4%|▎         | 1333/37963 [3:15:34<79:41:51,  7.83s/it]
  4%|▎         | 1334/37963 [3:15:41<79:14:28,  7.79s/it]
  4%|▎         | 1335/37963 [3:15:49<78:45:57,  7.74s/it]
  4%|▎         | 1336/37963 [3:15:57<79:44:39,  7.84s/it]
  4%|▎         | 1337/37963 [3:16:05<78:48:22,  7.75s/it]
  4%|▎         | 1338/37963 [3:16:12<78:02:28,  7.67s/it]
  4%|▎         | 1339/37963 [3:16:20<77:44:49,  7.64s/it]
  4%|▎         | 1340/37963 [3:16:27<77:37:36,  7.63s/it]
                                                         
{'loss': '0.1897', 'grad_norm': '5.312', 'learning_rate': '2e-05', 'epoch': '0.0353'}

  4%|▎         | 1340/37963 [3:16:27<77:37:36,  7.63s/it]
  4%|▎         | 1341/37963 [3:16:35<78:49:03,  7.75s/it]
  4%|▎         | 1342/37963 [3:16:43<78:34:09,  7.72s/it]
  4%|▎         | 1343/37963 [3:16:51<78:13:27,  7.69s/it]
  4%|▎         | 1344/37963 [3:16:58<77:35:24,  7.63s/it]
  4%|▎         | 1345/37963 [3:17:06<77:29:32,  7.62s/it]
  4%|▎         | 1346/37963 [3:17:14<78:34:23,  7.72s/it]
  4%|▎         | 1347/37963 [3:17:21<78:23:20,  7.71s/it]
  4%|▎         | 1348/37963 [3:17:29<77:59:24,  7.67s/it]
  4%|▎         | 1349/37963 [3:17:37<77:46:55,  7.65s/it]
  4%|▎         | 1350/37963 [3:17:50<96:51:36,  9.52s/it]
                                                         
{'loss': '0.1876', 'grad_norm': '4.557', 'learning_rate': '2e-05', 'epoch': '0.03556'}

  4%|▎         | 1350/37963 [3:17:50<96:51:36,  9.52s/it]
  4%|▎         | 1351/37963 [3:18:04<110:36:19, 10.88s/it]
  4%|▎         | 1352/37963 [3:18:12<100:45:02,  9.91s/it]
  4%|▎         | 1353/37963 [3:18:20<93:47:44,  9.22s/it] 
  4%|▎         | 1354/37963 [3:18:28<90:16:15,  8.88s/it]
  4%|▎         | 1355/37963 [3:18:35<85:40:06,  8.42s/it]
  4%|▎         | 1356/37963 [3:18:43<83:08:12,  8.18s/it]
  4%|▎         | 1357/37963 [3:18:57<100:18:38,  9.87s/it]
  4%|▎         | 1358/37963 [3:19:05<96:25:25,  9.48s/it] 
  4%|▎         | 1359/37963 [3:19:19<110:36:25, 10.88s/it]
  4%|▎         | 1360/37963 [3:19:33<120:02:50, 11.81s/it]
                                                          
{'loss': '0.1856', 'grad_norm': '10.46', 'learning_rate': '2e-05', 'epoch': '0.03582'}

  4%|▎         | 1360/37963 [3:19:33<120:02:50, 11.81s/it]
  4%|▎         | 1361/37963 [3:19:48<127:41:16, 12.56s/it]
  4%|▎         | 1362/37963 [3:19:55<112:23:51, 11.06s/it]
  4%|▎         | 1363/37963 [3:20:03<102:01:11, 10.03s/it]
  4%|▎         | 1364/37963 [3:20:17<114:35:31, 11.27s/it]
  4%|▎         | 1365/37963 [3:20:25<103:58:34, 10.23s/it]
  4%|▎         | 1366/37963 [3:20:32<95:41:54,  9.41s/it] 
  4%|▎         | 1367/37963 [3:20:40<89:51:35,  8.84s/it]
  4%|▎         | 1368/37963 [3:20:47<86:08:03,  8.47s/it]
  4%|▎         | 1369/37963 [3:20:55<84:48:04,  8.34s/it]
  4%|▎         | 1370/37963 [3:21:03<82:08:55,  8.08s/it]
                                                         
{'loss': '0.1841', 'grad_norm': '5.454', 'learning_rate': '2e-05', 'epoch': '0.03609'}

  4%|▎         | 1370/37963 [3:21:03<82:08:55,  8.08s/it]
  4%|▎         | 1371/37963 [3:21:10<80:26:01,  7.91s/it]
  4%|▎         | 1372/37963 [3:21:18<79:12:38,  7.79s/it]
  4%|▎         | 1373/37963 [3:21:26<78:48:51,  7.75s/it]
  4%|▎         | 1374/37963 [3:21:34<79:35:55,  7.83s/it]
  4%|▎         | 1375/37963 [3:21:48<98:14:25,  9.67s/it]
  4%|▎         | 1376/37963 [3:21:55<91:51:55,  9.04s/it]
  4%|▎         | 1377/37963 [3:22:03<87:10:51,  8.58s/it]
  4%|▎         | 1378/37963 [3:22:11<85:33:12,  8.42s/it]
  4%|▎         | 1379/37963 [3:22:18<83:07:07,  8.18s/it]
  4%|▎         | 1380/37963 [3:22:26<81:00:55,  7.97s/it]
                                                         
{'loss': '0.1772', 'grad_norm': '4.511', 'learning_rate': '2e-05', 'epoch': '0.03635'}

  4%|▎         | 1380/37963 [3:22:26<81:00:55,  7.97s/it]
  4%|▎         | 1381/37963 [3:22:33<79:43:00,  7.84s/it]
  4%|▎         | 1382/37963 [3:22:41<77:56:56,  7.67s/it]
  4%|▎         | 1383/37963 [3:22:49<79:09:14,  7.79s/it]
  4%|▎         | 1384/37963 [3:22:56<78:20:24,  7.71s/it]
  4%|▎         | 1385/37963 [3:23:03<76:34:14,  7.54s/it]
  4%|▎         | 1386/37963 [3:23:11<76:39:58,  7.55s/it]
  4%|▎         | 1387/37963 [3:23:18<76:44:14,  7.55s/it]
  4%|▎         | 1388/37963 [3:23:26<77:26:18,  7.62s/it]
  4%|▎         | 1389/37963 [3:23:34<77:32:47,  7.63s/it]
  4%|▎         | 1390/37963 [3:23:42<77:59:09,  7.68s/it]
                                                         
{'loss': '0.1774', 'grad_norm': '3.334', 'learning_rate': '2e-05', 'epoch': '0.03661'}

  4%|▎         | 1390/37963 [3:23:42<77:59:09,  7.68s/it]
  4%|▎         | 1391/37963 [3:23:49<77:12:39,  7.60s/it]
  4%|▎         | 1392/37963 [3:23:57<77:07:53,  7.59s/it]
  4%|▎         | 1393/37963 [3:24:04<77:48:03,  7.66s/it]
  4%|▎         | 1394/37963 [3:24:12<77:27:18,  7.62s/it]
  4%|▎         | 1395/37963 [3:24:20<77:10:22,  7.60s/it]
  4%|▎         | 1396/37963 [3:24:27<76:56:16,  7.57s/it]
  4%|▎         | 1397/37963 [3:24:42<97:45:31,  9.62s/it]
  4%|▎         | 1398/37963 [3:24:49<90:57:11,  8.95s/it]
  4%|▎         | 1399/37963 [3:24:56<86:12:53,  8.49s/it]
  4%|▎         | 1400/37963 [3:25:10<103:01:37, 10.14s/it]
                                                          
{'loss': '0.168', 'grad_norm': '2.858', 'learning_rate': '2e-05', 'epoch': '0.03688'}

  4%|▎         | 1400/37963 [3:25:10<103:01:37, 10.14s/it]
  4%|▎         | 1401/37963 [3:25:18<96:47:33,  9.53s/it] 
  4%|▎         | 1402/37963 [3:25:26<90:43:31,  8.93s/it]
  4%|▎         | 1403/37963 [3:25:34<86:48:12,  8.55s/it]
  4%|▎         | 1404/37963 [3:25:41<83:42:00,  8.24s/it]
  4%|▎         | 1405/37963 [3:25:56<103:51:26, 10.23s/it]
  4%|▎         | 1406/37963 [3:26:03<94:42:22,  9.33s/it] 
  4%|▎         | 1407/37963 [3:26:17<108:56:21, 10.73s/it]
  4%|▎         | 1408/37963 [3:26:31<119:37:00, 11.78s/it]
  4%|▎         | 1409/37963 [3:26:39<106:19:59, 10.47s/it]
  4%|▎         | 1410/37963 [3:26:53<116:07:45, 11.44s/it]
                                                          
{'loss': '0.1817', 'grad_norm': '4.745', 'learning_rate': '2e-05', 'epoch': '0.03714'}

  4%|▎         | 1410/37963 [3:26:53<116:07:45, 11.44s/it]
  4%|▎         | 1411/37963 [3:27:00<103:40:40, 10.21s/it]
  4%|▎         | 1412/37963 [3:27:15<117:25:04, 11.56s/it]
  4%|▎         | 1413/37963 [3:27:22<105:22:15, 10.38s/it]
  4%|▎         | 1414/37963 [3:27:30<95:58:13,  9.45s/it] 
  4%|▎         | 1415/37963 [3:27:38<91:31:15,  9.01s/it]
  4%|▎         | 1416/37963 [3:27:45<86:52:08,  8.56s/it]
  4%|▎         | 1417/37963 [3:27:53<83:55:47,  8.27s/it]
  4%|▎         | 1418/37963 [3:28:00<82:07:11,  8.09s/it]
  4%|▎         | 1419/37963 [3:28:08<80:13:26,  7.90s/it]
  4%|▎         | 1420/37963 [3:28:16<80:14:52,  7.91s/it]
                                                         
{'loss': '0.1893', 'grad_norm': '1.838', 'learning_rate': '2e-05', 'epoch': '0.0374'}

  4%|▎         | 1420/37963 [3:28:16<80:14:52,  7.91s/it]
  4%|▎         | 1421/37963 [3:28:23<79:36:40,  7.84s/it]
  4%|▎         | 1422/37963 [3:28:31<78:43:01,  7.76s/it]
  4%|▎         | 1423/37963 [3:28:45<98:01:36,  9.66s/it]
  4%|▍         | 1424/37963 [3:28:53<93:04:26,  9.17s/it]
  4%|▍         | 1425/37963 [3:29:01<88:00:25,  8.67s/it]
  4%|▍         | 1426/37963 [3:29:08<84:27:23,  8.32s/it]
  4%|▍         | 1427/37963 [3:29:16<82:06:37,  8.09s/it]
  4%|▍         | 1428/37963 [3:29:23<79:57:44,  7.88s/it]
  4%|▍         | 1429/37963 [3:29:31<80:25:23,  7.92s/it]
  4%|▍         | 1430/37963 [3:29:39<79:23:26,  7.82s/it]
                                                         
{'loss': '0.1772', 'grad_norm': '4.48', 'learning_rate': '2e-05', 'epoch': '0.03767'}

  4%|▍         | 1430/37963 [3:29:39<79:23:26,  7.82s/it]
  4%|▍         | 1431/37963 [3:29:46<78:11:45,  7.71s/it]
  4%|▍         | 1432/37963 [3:29:54<77:42:53,  7.66s/it]
  4%|▍         | 1433/37963 [3:30:01<77:05:57,  7.60s/it]
  4%|▍         | 1434/37963 [3:30:09<78:24:55,  7.73s/it]
  4%|▍         | 1435/37963 [3:30:17<78:17:54,  7.72s/it]
  4%|▍         | 1436/37963 [3:30:24<77:24:42,  7.63s/it]
  4%|▍         | 1437/37963 [3:30:32<77:01:10,  7.59s/it]
  4%|▍         | 1438/37963 [3:30:39<77:23:53,  7.63s/it]
  4%|▍         | 1439/37963 [3:30:47<77:13:31,  7.61s/it]
  4%|▍         | 1440/37963 [3:30:54<76:52:07,  7.58s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '5.885', 'learning_rate': '2e-05', 'epoch': '0.03793'}

  4%|▍         | 1440/37963 [3:30:54<76:52:07,  7.58s/it]
  4%|▍         | 1441/37963 [3:31:02<76:56:24,  7.58s/it]
  4%|▍         | 1442/37963 [3:31:10<76:48:51,  7.57s/it]
  4%|▍         | 1443/37963 [3:31:17<76:44:37,  7.57s/it]
  4%|▍         | 1444/37963 [3:31:25<76:31:57,  7.54s/it]
  4%|▍         | 1445/37963 [3:31:32<75:36:55,  7.45s/it]
  4%|▍         | 1446/37963 [3:31:40<76:07:26,  7.50s/it]
  4%|▍         | 1447/37963 [3:31:54<97:44:02,  9.64s/it]
  4%|▍         | 1448/37963 [3:32:08<110:56:36, 10.94s/it]
  4%|▍         | 1449/37963 [3:32:16<100:59:21,  9.96s/it]
  4%|▍         | 1450/37963 [3:32:30<114:37:30, 11.30s/it]
                                                          
{'loss': '0.1942', 'grad_norm': '3.949', 'learning_rate': '2e-05', 'epoch': '0.0382'}

  4%|▍         | 1450/37963 [3:32:30<114:37:30, 11.30s/it]
  4%|▍         | 1451/37963 [3:32:38<103:14:34, 10.18s/it]
  4%|▍         | 1452/37963 [3:32:52<114:53:34, 11.33s/it]
  4%|▍         | 1453/37963 [3:32:59<102:46:47, 10.13s/it]
  4%|▍         | 1454/37963 [3:33:07<96:51:31,  9.55s/it] 
  4%|▍         | 1455/37963 [3:33:15<90:49:21,  8.96s/it]
  4%|▍         | 1456/37963 [3:33:22<85:47:54,  8.46s/it]
  4%|▍         | 1457/37963 [3:33:30<82:39:28,  8.15s/it]
  4%|▍         | 1458/37963 [3:33:37<80:42:31,  7.96s/it]
  4%|▍         | 1459/37963 [3:33:51<98:25:10,  9.71s/it]
  4%|▍         | 1460/37963 [3:34:06<114:11:42, 11.26s/it]
                                                          
{'loss': '0.1873', 'grad_norm': '2.33', 'learning_rate': '2e-05', 'epoch': '0.03846'}

  4%|▍         | 1460/37963 [3:34:06<114:11:42, 11.26s/it]
  4%|▍         | 1461/37963 [3:34:20<122:27:28, 12.08s/it]
  4%|▍         | 1462/37963 [3:34:27<108:17:17, 10.68s/it]
  4%|▍         | 1463/37963 [3:34:35<98:57:17,  9.76s/it] 
  4%|▍         | 1464/37963 [3:34:42<92:34:51,  9.13s/it]
  4%|▍         | 1465/37963 [3:34:51<89:44:31,  8.85s/it]
  4%|▍         | 1466/37963 [3:34:58<85:38:34,  8.45s/it]
  4%|▍         | 1467/37963 [3:35:06<83:26:24,  8.23s/it]
  4%|▍         | 1468/37963 [3:35:14<81:34:48,  8.05s/it]
  4%|▍         | 1469/37963 [3:35:21<80:17:28,  7.92s/it]
  4%|▍         | 1470/37963 [3:35:29<81:01:49,  7.99s/it]
                                                         
{'loss': '0.1755', 'grad_norm': '3.068', 'learning_rate': '2e-05', 'epoch': '0.03872'}

  4%|▍         | 1470/37963 [3:35:29<81:01:49,  7.99s/it]
  4%|▍         | 1471/37963 [3:35:44<99:50:54,  9.85s/it]
  4%|▍         | 1472/37963 [3:35:51<92:13:46,  9.10s/it]
  4%|▍         | 1473/37963 [3:35:58<87:47:56,  8.66s/it]
  4%|▍         | 1474/37963 [3:36:07<85:58:52,  8.48s/it]
  4%|▍         | 1475/37963 [3:36:14<83:22:35,  8.23s/it]
  4%|▍         | 1476/37963 [3:36:22<81:39:05,  8.06s/it]
  4%|▍         | 1477/37963 [3:36:29<80:06:38,  7.90s/it]
  4%|▍         | 1478/37963 [3:36:37<78:56:13,  7.79s/it]
  4%|▍         | 1479/37963 [3:36:45<79:16:45,  7.82s/it]
  4%|▍         | 1480/37963 [3:36:53<79:01:40,  7.80s/it]
                                                         
{'loss': '0.1823', 'grad_norm': '3.351', 'learning_rate': '2e-05', 'epoch': '0.03899'}

  4%|▍         | 1480/37963 [3:36:53<79:01:40,  7.80s/it]
  4%|▍         | 1481/37963 [3:37:00<78:15:58,  7.72s/it]
  4%|▍         | 1482/37963 [3:37:08<78:04:28,  7.70s/it]
  4%|▍         | 1483/37963 [3:37:15<77:53:45,  7.69s/it]
  4%|▍         | 1484/37963 [3:37:24<80:12:41,  7.92s/it]
  4%|▍         | 1485/37963 [3:37:31<79:12:51,  7.82s/it]
  4%|▍         | 1486/37963 [3:37:39<77:59:22,  7.70s/it]
  4%|▍         | 1487/37963 [3:37:46<77:44:19,  7.67s/it]
  4%|▍         | 1488/37963 [3:37:54<77:33:16,  7.65s/it]
  4%|▍         | 1489/37963 [3:38:02<79:24:53,  7.84s/it]
  4%|▍         | 1490/37963 [3:38:10<78:08:52,  7.71s/it]
                                                         
{'loss': '0.1835', 'grad_norm': '5.149', 'learning_rate': '2e-05', 'epoch': '0.03925'}

  4%|▍         | 1490/37963 [3:38:10<78:08:52,  7.71s/it]
  4%|▍         | 1491/37963 [3:38:17<77:49:07,  7.68s/it]
  4%|▍         | 1492/37963 [3:38:25<77:17:31,  7.63s/it]
  4%|▍         | 1493/37963 [3:38:32<77:00:32,  7.60s/it]
  4%|▍         | 1494/37963 [3:38:40<76:28:02,  7.55s/it]
  4%|▍         | 1495/37963 [3:38:47<76:24:42,  7.54s/it]
  4%|▍         | 1496/37963 [3:39:08<115:41:13, 11.42s/it]
  4%|▍         | 1497/37963 [3:39:16<106:52:32, 10.55s/it]
  4%|▍         | 1498/37963 [3:39:30<116:10:27, 11.47s/it]
  4%|▍         | 1499/37963 [3:39:38<105:02:30, 10.37s/it]
  4%|▍         | 1500/37963 [3:39:45<96:29:11,  9.53s/it] 
                                                         
{'loss': '0.1804', 'grad_norm': '2.417', 'learning_rate': '2e-05', 'epoch': '0.03951'}

  4%|▍         | 1500/37963 [3:39:45<96:29:11,  9.53s/it]
  4%|▍         | 1501/37963 [3:39:54<92:38:09,  9.15s/it]
  4%|▍         | 1502/37963 [3:40:01<88:39:36,  8.75s/it]
  4%|▍         | 1503/37963 [3:40:09<84:30:50,  8.34s/it]
  4%|▍         | 1504/37963 [3:40:16<82:00:47,  8.10s/it]
  4%|▍         | 1505/37963 [3:40:24<80:21:09,  7.93s/it]
  4%|▍         | 1506/37963 [3:40:37<97:17:58,  9.61s/it]
  4%|▍         | 1507/37963 [3:40:58<130:31:55, 12.89s/it]
  4%|▍         | 1508/37963 [3:41:12<133:33:05, 13.19s/it]
  4%|▍         | 1509/37963 [3:41:19<115:44:00, 11.43s/it]
  4%|▍         | 1510/37963 [3:41:27<104:00:56, 10.27s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '4.941', 'learning_rate': '2e-05', 'epoch': '0.03978'}

  4%|▍         | 1510/37963 [3:41:27<104:00:56, 10.27s/it]
  4%|▍         | 1511/37963 [3:41:34<94:59:43,  9.38s/it] 
  4%|▍         | 1512/37963 [3:41:42<91:01:15,  8.99s/it]
  4%|▍         | 1513/37963 [3:41:50<86:15:54,  8.52s/it]
  4%|▍         | 1514/37963 [3:41:57<83:26:37,  8.24s/it]
  4%|▍         | 1515/37963 [3:42:04<80:30:17,  7.95s/it]
  4%|▍         | 1516/37963 [3:42:12<79:24:35,  7.84s/it]
  4%|▍         | 1517/37963 [3:42:20<79:44:56,  7.88s/it]
  4%|▍         | 1518/37963 [3:42:34<98:20:02,  9.71s/it]
  4%|▍         | 1519/37963 [3:42:42<92:06:20,  9.10s/it]
  4%|▍         | 1520/37963 [3:42:49<87:45:14,  8.67s/it]
                                                         
{'loss': '0.1695', 'grad_norm': '2.374', 'learning_rate': '1.999e-05', 'epoch': '0.04004'}

  4%|▍         | 1520/37963 [3:42:49<87:45:14,  8.67s/it]
  4%|▍         | 1521/37963 [3:42:58<86:19:56,  8.53s/it]
  4%|▍         | 1522/37963 [3:43:05<82:26:42,  8.14s/it]
  4%|▍         | 1523/37963 [3:43:12<80:24:43,  7.94s/it]
  4%|▍         | 1524/37963 [3:43:20<79:17:56,  7.83s/it]
  4%|▍         | 1525/37963 [3:43:27<78:32:27,  7.76s/it]
  4%|▍         | 1526/37963 [3:43:35<78:45:03,  7.78s/it]
  4%|▍         | 1527/37963 [3:43:43<78:12:00,  7.73s/it]
  4%|▍         | 1528/37963 [3:43:50<77:31:29,  7.66s/it]
  4%|▍         | 1529/37963 [3:43:58<76:48:51,  7.59s/it]
  4%|▍         | 1530/37963 [3:44:06<77:37:26,  7.67s/it]
                                                         
{'loss': '0.1649', 'grad_norm': '4.366', 'learning_rate': '1.999e-05', 'epoch': '0.0403'}

  4%|▍         | 1530/37963 [3:44:06<77:37:26,  7.67s/it]
  4%|▍         | 1531/37963 [3:44:13<76:51:15,  7.59s/it]
  4%|▍         | 1532/37963 [3:44:21<76:54:05,  7.60s/it]
  4%|▍         | 1533/37963 [3:44:28<77:04:26,  7.62s/it]
  4%|▍         | 1534/37963 [3:44:36<76:42:06,  7.58s/it]
  4%|▍         | 1535/37963 [3:44:44<78:07:47,  7.72s/it]
  4%|▍         | 1536/37963 [3:44:51<77:45:11,  7.68s/it]
  4%|▍         | 1537/37963 [3:44:59<77:12:32,  7.63s/it]
  4%|▍         | 1538/37963 [3:45:07<77:22:45,  7.65s/it]
  4%|▍         | 1539/37963 [3:45:14<76:52:46,  7.60s/it]
  4%|▍         | 1540/37963 [3:45:22<78:35:44,  7.77s/it]
                                                         
{'loss': '0.1969', 'grad_norm': '4.121', 'learning_rate': '1.999e-05', 'epoch': '0.04057'}

  4%|▍         | 1540/37963 [3:45:22<78:35:44,  7.77s/it]
  4%|▍         | 1541/37963 [3:45:30<78:02:35,  7.71s/it]
  4%|▍         | 1542/37963 [3:45:37<76:36:21,  7.57s/it]
  4%|▍         | 1543/37963 [3:45:44<75:33:27,  7.47s/it]
  4%|▍         | 1544/37963 [3:46:05<115:41:19, 11.44s/it]
  4%|▍         | 1545/37963 [3:46:19<123:05:11, 12.17s/it]
  4%|▍         | 1546/37963 [3:46:26<108:57:48, 10.77s/it]
  4%|▍         | 1547/37963 [3:46:34<99:08:51,  9.80s/it] 
  4%|▍         | 1548/37963 [3:46:41<92:12:19,  9.12s/it]
  4%|▍         | 1549/37963 [3:46:49<87:30:16,  8.65s/it]
  4%|▍         | 1550/37963 [3:47:03<103:56:29, 10.28s/it]
                                                          
{'loss': '0.1877', 'grad_norm': '4.041', 'learning_rate': '1.999e-05', 'epoch': '0.04083'}

  4%|▍         | 1550/37963 [3:47:03<103:56:29, 10.28s/it]
  4%|▍         | 1551/37963 [3:47:11<95:39:23,  9.46s/it] 
  4%|▍         | 1552/37963 [3:47:18<89:49:10,  8.88s/it]
  4%|▍         | 1553/37963 [3:47:26<85:47:38,  8.48s/it]
  4%|▍         | 1554/37963 [3:47:33<83:04:51,  8.21s/it]
  4%|▍         | 1555/37963 [3:47:41<80:44:02,  7.98s/it]
  4%|▍         | 1556/37963 [3:47:55<98:50:36,  9.77s/it]
  4%|▍         | 1557/37963 [3:48:02<91:43:11,  9.07s/it]
  4%|▍         | 1558/37963 [3:48:16<106:54:06, 10.57s/it]
  4%|▍         | 1559/37963 [3:48:24<98:01:07,  9.69s/it] 
  4%|▍         | 1560/37963 [3:48:31<91:21:33,  9.03s/it]
                                                         
{'loss': '0.1616', 'grad_norm': '4.828', 'learning_rate': '1.999e-05', 'epoch': '0.04109'}

  4%|▍         | 1560/37963 [3:48:31<91:21:33,  9.03s/it]
  4%|▍         | 1561/37963 [3:48:46<107:38:43, 10.65s/it]
  4%|▍         | 1562/37963 [3:48:53<98:26:28,  9.74s/it] 
  4%|▍         | 1563/37963 [3:49:01<92:08:00,  9.11s/it]
  4%|▍         | 1564/37963 [3:49:09<87:37:35,  8.67s/it]
  4%|▍         | 1565/37963 [3:49:16<84:40:11,  8.37s/it]
  4%|▍         | 1566/37963 [3:49:31<102:14:21, 10.11s/it]
  4%|▍         | 1567/37963 [3:49:38<94:25:20,  9.34s/it] 
  4%|▍         | 1568/37963 [3:49:46<89:06:07,  8.81s/it]
  4%|▍         | 1569/37963 [3:49:53<85:31:01,  8.46s/it]
  4%|▍         | 1570/37963 [3:50:01<81:59:32,  8.11s/it]
                                                         
{'loss': '0.1806', 'grad_norm': '7.383', 'learning_rate': '1.999e-05', 'epoch': '0.04136'}

  4%|▍         | 1570/37963 [3:50:01<81:59:32,  8.11s/it]
  4%|▍         | 1571/37963 [3:50:08<80:07:58,  7.93s/it]
  4%|▍         | 1572/37963 [3:50:16<78:56:21,  7.81s/it]
  4%|▍         | 1573/37963 [3:50:23<78:14:14,  7.74s/it]
  4%|▍         | 1574/37963 [3:50:31<78:06:54,  7.73s/it]
  4%|▍         | 1575/37963 [3:50:38<76:55:59,  7.61s/it]
  4%|▍         | 1576/37963 [3:50:46<76:36:27,  7.58s/it]
  4%|▍         | 1577/37963 [3:50:53<76:21:51,  7.56s/it]
  4%|▍         | 1578/37963 [3:51:01<76:25:54,  7.56s/it]
  4%|▍         | 1579/37963 [3:51:08<76:31:05,  7.57s/it]
  4%|▍         | 1580/37963 [3:51:16<76:28:23,  7.57s/it]
                                                         
{'loss': '0.1776', 'grad_norm': '3.131', 'learning_rate': '1.999e-05', 'epoch': '0.04162'}

  4%|▍         | 1580/37963 [3:51:16<76:28:23,  7.57s/it]
  4%|▍         | 1581/37963 [3:51:23<75:58:38,  7.52s/it]
  4%|▍         | 1582/37963 [3:51:31<75:16:49,  7.45s/it]
  4%|▍         | 1583/37963 [3:51:38<74:41:39,  7.39s/it]
  4%|▍         | 1584/37963 [3:51:45<75:08:09,  7.44s/it]
  4%|▍         | 1585/37963 [3:51:53<74:23:50,  7.36s/it]
  4%|▍         | 1586/37963 [3:52:00<74:48:57,  7.40s/it]
  4%|▍         | 1587/37963 [3:52:08<75:06:58,  7.43s/it]
  4%|▍         | 1588/37963 [3:52:15<75:18:18,  7.45s/it]
  4%|▍         | 1589/37963 [3:52:23<75:27:21,  7.47s/it]
  4%|▍         | 1590/37963 [3:52:37<94:55:02,  9.39s/it]
                                                         
{'loss': '0.1772', 'grad_norm': '2.689', 'learning_rate': '1.999e-05', 'epoch': '0.04188'}

  4%|▍         | 1590/37963 [3:52:37<94:55:02,  9.39s/it]
  4%|▍         | 1591/37963 [3:52:44<89:41:02,  8.88s/it]
  4%|▍         | 1592/37963 [3:52:52<85:51:46,  8.50s/it]
  4%|▍         | 1593/37963 [3:52:59<82:23:31,  8.16s/it]
  4%|▍         | 1594/37963 [3:53:20<120:45:24, 11.95s/it]
  4%|▍         | 1595/37963 [3:53:28<108:24:10, 10.73s/it]
  4%|▍         | 1596/37963 [3:53:36<99:03:13,  9.81s/it] 
  4%|▍         | 1597/37963 [3:53:43<92:05:45,  9.12s/it]
  4%|▍         | 1598/37963 [3:53:57<107:07:30, 10.60s/it]
  4%|▍         | 1599/37963 [3:54:05<97:42:49,  9.67s/it] 
  4%|▍         | 1600/37963 [3:54:12<90:04:45,  8.92s/it]
                                                         
{'loss': '0.1928', 'grad_norm': '2.865', 'learning_rate': '1.999e-05', 'epoch': '0.04215'}

  4%|▍         | 1600/37963 [3:54:12<90:04:45,  8.92s/it]
  4%|▍         | 1601/37963 [3:54:19<85:52:02,  8.50s/it]
  4%|▍         | 1602/37963 [3:54:27<82:59:03,  8.22s/it]
  4%|▍         | 1603/37963 [3:54:34<80:47:50,  8.00s/it]
  4%|▍         | 1604/37963 [3:54:42<79:23:35,  7.86s/it]
  4%|▍         | 1605/37963 [3:54:50<78:47:54,  7.80s/it]
  4%|▍         | 1606/37963 [3:54:57<77:43:09,  7.70s/it]
  4%|▍         | 1607/37963 [3:55:05<77:25:22,  7.67s/it]
  4%|▍         | 1608/37963 [3:55:12<77:19:15,  7.66s/it]
  4%|▍         | 1609/37963 [3:55:32<115:28:12, 11.43s/it]
  4%|▍         | 1610/37963 [3:55:40<103:33:31, 10.26s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '7.82', 'learning_rate': '1.999e-05', 'epoch': '0.04241'}

  4%|▍         | 1610/37963 [3:55:40<103:33:31, 10.26s/it]
  4%|▍         | 1611/37963 [3:55:54<115:39:24, 11.45s/it]
  4%|▍         | 1612/37963 [3:56:02<103:46:53, 10.28s/it]
  4%|▍         | 1613/37963 [3:56:09<95:27:10,  9.45s/it] 
  4%|▍         | 1614/37963 [3:56:23<109:21:41, 10.83s/it]
  4%|▍         | 1615/37963 [3:56:31<99:20:54,  9.84s/it] 
  4%|▍         | 1616/37963 [3:56:38<92:25:11,  9.15s/it]
  4%|▍         | 1617/37963 [3:56:46<87:38:34,  8.68s/it]
  4%|▍         | 1618/37963 [3:56:53<83:27:44,  8.27s/it]
  4%|▍         | 1619/37963 [3:57:01<81:38:07,  8.09s/it]
  4%|▍         | 1620/37963 [3:57:09<80:01:08,  7.93s/it]
                                                         
{'loss': '0.1867', 'grad_norm': '8.171', 'learning_rate': '1.999e-05', 'epoch': '0.04267'}

  4%|▍         | 1620/37963 [3:57:09<80:01:08,  7.93s/it]
  4%|▍         | 1621/37963 [3:57:16<78:52:29,  7.81s/it]
  4%|▍         | 1622/37963 [3:57:24<78:20:12,  7.76s/it]
  4%|▍         | 1623/37963 [3:57:31<77:31:03,  7.68s/it]
  4%|▍         | 1624/37963 [3:57:39<77:04:50,  7.64s/it]
  4%|▍         | 1625/37963 [3:57:46<76:26:15,  7.57s/it]
  4%|▍         | 1626/37963 [3:57:54<76:16:59,  7.56s/it]
  4%|▍         | 1627/37963 [3:58:01<76:32:52,  7.58s/it]
  4%|▍         | 1628/37963 [3:58:09<75:37:55,  7.49s/it]
  4%|▍         | 1629/37963 [3:58:16<76:02:35,  7.53s/it]
  4%|▍         | 1630/37963 [3:58:24<75:37:14,  7.49s/it]
                                                         
{'loss': '0.1734', 'grad_norm': '4.656', 'learning_rate': '1.999e-05', 'epoch': '0.04294'}

  4%|▍         | 1630/37963 [3:58:24<75:37:14,  7.49s/it]
  4%|▍         | 1631/37963 [3:58:31<75:45:25,  7.51s/it]
  4%|▍         | 1632/37963 [3:58:39<75:53:44,  7.52s/it]
  4%|▍         | 1633/37963 [3:58:46<75:54:30,  7.52s/it]
  4%|▍         | 1634/37963 [3:58:54<76:21:32,  7.57s/it]
  4%|▍         | 1635/37963 [3:59:01<75:56:28,  7.53s/it]
  4%|▍         | 1636/37963 [3:59:09<75:54:10,  7.52s/it]
  4%|▍         | 1637/37963 [3:59:16<75:56:53,  7.53s/it]
  4%|▍         | 1638/37963 [3:59:24<75:10:14,  7.45s/it]
  4%|▍         | 1639/37963 [3:59:31<75:34:47,  7.49s/it]
  4%|▍         | 1640/37963 [3:59:45<95:15:03,  9.44s/it]
                                                         
{'loss': '0.1849', 'grad_norm': '7.262', 'learning_rate': '1.999e-05', 'epoch': '0.0432'}

  4%|▍         | 1640/37963 [3:59:45<95:15:03,  9.44s/it]
  4%|▍         | 1641/37963 [4:00:06<128:57:56, 12.78s/it]
  4%|▍         | 1642/37963 [4:00:13<113:04:16, 11.21s/it]
  4%|▍         | 1643/37963 [4:00:21<101:02:13, 10.01s/it]
  4%|▍         | 1644/37963 [4:00:28<93:28:30,  9.27s/it] 
  4%|▍         | 1645/37963 [4:00:36<88:25:38,  8.77s/it]
  4%|▍         | 1646/37963 [4:00:43<84:36:28,  8.39s/it]
  4%|▍         | 1647/37963 [4:00:51<82:14:49,  8.15s/it]
  4%|▍         | 1648/37963 [4:00:58<79:44:45,  7.91s/it]
  4%|▍         | 1649/37963 [4:01:06<78:50:33,  7.82s/it]
  4%|▍         | 1650/37963 [4:01:13<78:04:45,  7.74s/it]
                                                         
{'loss': '0.169', 'grad_norm': '1.921', 'learning_rate': '1.999e-05', 'epoch': '0.04346'}

  4%|▍         | 1650/37963 [4:01:13<78:04:45,  7.74s/it]
  4%|▍         | 1651/37963 [4:01:21<77:26:44,  7.68s/it]
  4%|▍         | 1652/37963 [4:01:35<96:01:02,  9.52s/it]
  4%|▍         | 1653/37963 [4:01:42<90:12:00,  8.94s/it]
  4%|▍         | 1654/37963 [4:01:56<105:49:13, 10.49s/it]
  4%|▍         | 1655/37963 [4:02:04<97:15:52,  9.64s/it] 
  4%|▍         | 1656/37963 [4:02:18<110:27:30, 10.95s/it]
  4%|▍         | 1657/37963 [4:02:26<100:13:53,  9.94s/it]
  4%|▍         | 1658/37963 [4:02:33<93:17:41,  9.25s/it] 
  4%|▍         | 1659/37963 [4:02:41<88:04:53,  8.73s/it]
  4%|▍         | 1660/37963 [4:02:55<104:15:04, 10.34s/it]
                                                          
{'loss': '0.1969', 'grad_norm': '4.647', 'learning_rate': '1.999e-05', 'epoch': '0.04373'}

  4%|▍         | 1660/37963 [4:02:55<104:15:04, 10.34s/it]
  4%|▍         | 1661/37963 [4:03:02<95:50:46,  9.50s/it] 
  4%|▍         | 1662/37963 [4:03:16<108:38:35, 10.77s/it]
  4%|▍         | 1663/37963 [4:03:24<98:55:02,  9.81s/it] 
  4%|▍         | 1664/37963 [4:03:31<91:09:43,  9.04s/it]
  4%|▍         | 1665/37963 [4:03:39<86:50:39,  8.61s/it]
  4%|▍         | 1666/37963 [4:03:46<83:39:38,  8.30s/it]
  4%|▍         | 1667/37963 [4:03:54<81:25:35,  8.08s/it]
  4%|▍         | 1668/37963 [4:04:01<79:25:57,  7.88s/it]
  4%|▍         | 1669/37963 [4:04:09<78:26:36,  7.78s/it]
  4%|▍         | 1670/37963 [4:04:16<77:37:51,  7.70s/it]
                                                         
{'loss': '0.1945', 'grad_norm': '5.263', 'learning_rate': '1.999e-05', 'epoch': '0.04399'}

  4%|▍         | 1670/37963 [4:04:16<77:37:51,  7.70s/it]
  4%|▍         | 1671/37963 [4:04:24<77:23:26,  7.68s/it]
  4%|▍         | 1672/37963 [4:04:31<76:24:28,  7.58s/it]
  4%|▍         | 1673/37963 [4:04:39<76:05:13,  7.55s/it]
  4%|▍         | 1674/37963 [4:04:46<76:03:08,  7.54s/it]
  4%|▍         | 1675/37963 [4:04:54<75:28:36,  7.49s/it]
  4%|▍         | 1676/37963 [4:05:01<75:38:25,  7.50s/it]
  4%|▍         | 1677/37963 [4:05:09<75:57:15,  7.54s/it]
  4%|▍         | 1678/37963 [4:05:16<75:10:20,  7.46s/it]
  4%|▍         | 1679/37963 [4:05:24<75:49:28,  7.52s/it]
  4%|▍         | 1680/37963 [4:05:31<75:51:10,  7.53s/it]
                                                         
{'loss': '0.1714', 'grad_norm': '2.394', 'learning_rate': '1.999e-05', 'epoch': '0.04425'}

  4%|▍         | 1680/37963 [4:05:31<75:51:10,  7.53s/it]
  4%|▍         | 1681/37963 [4:05:39<76:01:52,  7.54s/it]
  4%|▍         | 1682/37963 [4:05:46<76:14:57,  7.57s/it]
  4%|▍         | 1683/37963 [4:06:00<95:50:16,  9.51s/it]
  4%|▍         | 1684/37963 [4:06:08<89:26:54,  8.88s/it]
  4%|▍         | 1685/37963 [4:06:15<85:27:07,  8.48s/it]
  4%|▍         | 1686/37963 [4:06:23<82:33:12,  8.19s/it]
  4%|▍         | 1687/37963 [4:06:30<80:40:49,  8.01s/it]
  4%|▍         | 1688/37963 [4:06:38<79:06:38,  7.85s/it]
  4%|▍         | 1689/37963 [4:06:46<78:17:57,  7.77s/it]
  4%|▍         | 1690/37963 [4:06:53<77:38:59,  7.71s/it]
                                                         
{'loss': '0.1704', 'grad_norm': '2.973', 'learning_rate': '1.999e-05', 'epoch': '0.04452'}

  4%|▍         | 1690/37963 [4:06:53<77:38:59,  7.71s/it]
  4%|▍         | 1691/37963 [4:07:07<95:51:17,  9.51s/it]
  4%|▍         | 1692/37963 [4:07:14<90:00:10,  8.93s/it]
  4%|▍         | 1693/37963 [4:07:22<85:53:47,  8.53s/it]
  4%|▍         | 1694/37963 [4:07:36<101:48:08, 10.10s/it]
  4%|▍         | 1695/37963 [4:07:43<94:24:33,  9.37s/it] 
  4%|▍         | 1696/37963 [4:07:51<88:54:49,  8.83s/it]
  4%|▍         | 1697/37963 [4:07:59<85:20:04,  8.47s/it]
  4%|▍         | 1698/37963 [4:08:12<101:28:05, 10.07s/it]
  4%|▍         | 1699/37963 [4:08:20<94:07:58,  9.34s/it] 
  4%|▍         | 1700/37963 [4:08:34<107:50:26, 10.71s/it]
                                                          
{'loss': '0.192', 'grad_norm': '2.431', 'learning_rate': '1.999e-05', 'epoch': '0.04478'}

  4%|▍         | 1700/37963 [4:08:34<107:50:26, 10.71s/it]
  4%|▍         | 1701/37963 [4:08:41<98:17:05,  9.76s/it] 
  4%|▍         | 1702/37963 [4:08:49<91:21:34,  9.07s/it]
  4%|▍         | 1703/37963 [4:08:57<86:51:49,  8.62s/it]
  4%|▍         | 1704/37963 [4:09:04<83:37:57,  8.30s/it]
  4%|▍         | 1705/37963 [4:09:12<81:04:23,  8.05s/it]
  4%|▍         | 1706/37963 [4:09:19<79:35:28,  7.90s/it]
  4%|▍         | 1707/37963 [4:09:27<79:05:44,  7.85s/it]
  4%|▍         | 1708/37963 [4:09:34<78:01:30,  7.75s/it]
  5%|▍         | 1709/37963 [4:09:42<77:22:58,  7.68s/it]
  5%|▍         | 1710/37963 [4:09:56<96:33:52,  9.59s/it]
                                                         
{'loss': '0.1863', 'grad_norm': '5.325', 'learning_rate': '1.999e-05', 'epoch': '0.04504'}

  5%|▍         | 1710/37963 [4:09:56<96:33:52,  9.59s/it]
  5%|▍         | 1711/37963 [4:10:03<90:27:19,  8.98s/it]
  5%|▍         | 1712/37963 [4:10:18<105:45:42, 10.50s/it]
  5%|▍         | 1713/37963 [4:10:25<96:46:09,  9.61s/it] 
  5%|▍         | 1714/37963 [4:10:33<90:41:22,  9.01s/it]
  5%|▍         | 1715/37963 [4:10:47<105:31:54, 10.48s/it]
  5%|▍         | 1716/37963 [4:10:54<96:42:33,  9.61s/it] 
  5%|▍         | 1717/37963 [4:11:01<89:45:41,  8.92s/it]
  5%|▍         | 1718/37963 [4:11:09<85:40:20,  8.51s/it]
  5%|▍         | 1719/37963 [4:11:17<82:41:37,  8.21s/it]
  5%|▍         | 1720/37963 [4:11:24<80:46:04,  8.02s/it]
                                                         
{'loss': '0.1866', 'grad_norm': '3.038', 'learning_rate': '1.999e-05', 'epoch': '0.04531'}

  5%|▍         | 1720/37963 [4:11:24<80:46:04,  8.02s/it]
  5%|▍         | 1721/37963 [4:11:31<78:31:40,  7.80s/it]
  5%|▍         | 1722/37963 [4:11:39<78:02:13,  7.75s/it]
  5%|▍         | 1723/37963 [4:11:47<77:54:41,  7.74s/it]
  5%|▍         | 1724/37963 [4:11:54<77:05:48,  7.66s/it]
  5%|▍         | 1725/37963 [4:12:02<76:40:38,  7.62s/it]
  5%|▍         | 1726/37963 [4:12:09<75:11:58,  7.47s/it]
  5%|▍         | 1727/37963 [4:12:16<75:26:53,  7.50s/it]
  5%|▍         | 1728/37963 [4:12:24<75:54:49,  7.54s/it]
  5%|▍         | 1729/37963 [4:12:32<75:51:37,  7.54s/it]
  5%|▍         | 1730/37963 [4:12:39<75:56:48,  7.55s/it]
                                                         
{'loss': '0.1898', 'grad_norm': '4.339', 'learning_rate': '1.999e-05', 'epoch': '0.04557'}

  5%|▍         | 1730/37963 [4:12:39<75:56:48,  7.55s/it]
  5%|▍         | 1731/37963 [4:12:53<95:19:39,  9.47s/it]
  5%|▍         | 1732/37963 [4:13:01<90:01:41,  8.95s/it]
  5%|▍         | 1733/37963 [4:13:08<85:47:19,  8.52s/it]
  5%|▍         | 1734/37963 [4:13:16<83:00:10,  8.25s/it]
  5%|▍         | 1735/37963 [4:13:24<80:51:33,  8.04s/it]
  5%|▍         | 1736/37963 [4:13:31<79:40:05,  7.92s/it]
  5%|▍         | 1737/37963 [4:13:39<78:46:14,  7.83s/it]
  5%|▍         | 1738/37963 [4:13:46<77:00:38,  7.65s/it]
  5%|▍         | 1739/37963 [4:13:54<76:57:05,  7.65s/it]
  5%|▍         | 1740/37963 [4:14:01<76:54:37,  7.64s/it]
                                                         
{'loss': '0.1731', 'grad_norm': '5.515', 'learning_rate': '1.999e-05', 'epoch': '0.04583'}

  5%|▍         | 1740/37963 [4:14:01<76:54:37,  7.64s/it]
  5%|▍         | 1741/37963 [4:14:15<95:59:39,  9.54s/it]
  5%|▍         | 1742/37963 [4:14:23<89:47:21,  8.92s/it]
  5%|▍         | 1743/37963 [4:14:30<85:49:18,  8.53s/it]
  5%|▍         | 1744/37963 [4:14:38<82:52:06,  8.24s/it]
  5%|▍         | 1745/37963 [4:14:46<81:19:14,  8.08s/it]
  5%|▍         | 1746/37963 [4:14:53<79:43:12,  7.92s/it]
  5%|▍         | 1747/37963 [4:15:07<97:33:57,  9.70s/it]
  5%|▍         | 1748/37963 [4:15:15<91:11:33,  9.07s/it]
  5%|▍         | 1749/37963 [4:15:29<106:03:41, 10.54s/it]
  5%|▍         | 1750/37963 [4:15:43<116:08:36, 11.55s/it]
                                                          
{'loss': '0.1909', 'grad_norm': '2.14', 'learning_rate': '1.999e-05', 'epoch': '0.0461'}

  5%|▍         | 1750/37963 [4:15:43<116:08:36, 11.55s/it]
  5%|▍         | 1751/37963 [4:15:50<104:07:47, 10.35s/it]
  5%|▍         | 1752/37963 [4:15:58<95:29:23,  9.49s/it] 
  5%|▍         | 1753/37963 [4:16:05<88:33:26,  8.80s/it]
  5%|▍         | 1754/37963 [4:16:12<85:02:35,  8.46s/it]
  5%|▍         | 1755/37963 [4:16:20<82:26:29,  8.20s/it]
  5%|▍         | 1756/37963 [4:16:27<79:49:19,  7.94s/it]
  5%|▍         | 1757/37963 [4:16:35<78:52:31,  7.84s/it]
  5%|▍         | 1758/37963 [4:16:49<97:27:10,  9.69s/it]
  5%|▍         | 1759/37963 [4:16:56<90:55:34,  9.04s/it]
  5%|▍         | 1760/37963 [4:17:04<86:12:37,  8.57s/it]
                                                         
{'loss': '0.1814', 'grad_norm': '3.076', 'learning_rate': '1.999e-05', 'epoch': '0.04636'}

  5%|▍         | 1760/37963 [4:17:04<86:12:37,  8.57s/it]
  5%|▍         | 1761/37963 [4:17:18<102:02:07, 10.15s/it]
  5%|▍         | 1762/37963 [4:17:25<94:25:01,  9.39s/it] 
  5%|▍         | 1763/37963 [4:17:33<88:58:52,  8.85s/it]
  5%|▍         | 1764/37963 [4:17:47<104:24:58, 10.38s/it]
  5%|▍         | 1765/37963 [4:17:55<96:10:42,  9.57s/it] 
  5%|▍         | 1766/37963 [4:18:02<89:34:12,  8.91s/it]
  5%|▍         | 1767/37963 [4:18:09<85:17:29,  8.48s/it]
  5%|▍         | 1768/37963 [4:18:17<82:17:00,  8.18s/it]
  5%|▍         | 1769/37963 [4:18:24<80:21:04,  7.99s/it]
  5%|▍         | 1770/37963 [4:18:32<78:29:08,  7.81s/it]
                                                         
{'loss': '0.1853', 'grad_norm': '1.784', 'learning_rate': '1.999e-05', 'epoch': '0.04662'}

  5%|▍         | 1770/37963 [4:18:32<78:29:08,  7.81s/it]
  5%|▍         | 1771/37963 [4:18:39<76:31:09,  7.61s/it]
  5%|▍         | 1772/37963 [4:18:47<77:57:48,  7.76s/it]
  5%|▍         | 1773/37963 [4:18:55<77:18:04,  7.69s/it]
  5%|▍         | 1774/37963 [4:19:02<76:46:19,  7.64s/it]
  5%|▍         | 1775/37963 [4:19:10<76:36:50,  7.62s/it]
  5%|▍         | 1776/37963 [4:19:17<76:41:42,  7.63s/it]
  5%|▍         | 1777/37963 [4:19:25<75:44:01,  7.53s/it]
  5%|▍         | 1778/37963 [4:19:32<75:33:36,  7.52s/it]
  5%|▍         | 1779/37963 [4:19:40<75:30:54,  7.51s/it]
  5%|▍         | 1780/37963 [4:19:47<75:19:59,  7.50s/it]
                                                         
{'loss': '0.1831', 'grad_norm': '3.13', 'learning_rate': '1.999e-05', 'epoch': '0.04689'}

  5%|▍         | 1780/37963 [4:19:47<75:19:59,  7.50s/it]
  5%|▍         | 1781/37963 [4:19:55<75:33:36,  7.52s/it]
  5%|▍         | 1782/37963 [4:20:02<75:49:20,  7.54s/it]
  5%|▍         | 1783/37963 [4:20:16<95:00:11,  9.45s/it]
  5%|▍         | 1784/37963 [4:20:24<89:13:39,  8.88s/it]
  5%|▍         | 1785/37963 [4:20:31<85:41:38,  8.53s/it]
  5%|▍         | 1786/37963 [4:20:39<81:55:51,  8.15s/it]
  5%|▍         | 1787/37963 [4:20:46<79:25:57,  7.90s/it]
  5%|▍         | 1788/37963 [4:20:53<77:03:56,  7.67s/it]
  5%|▍         | 1789/37963 [4:21:01<76:30:56,  7.61s/it]
  5%|▍         | 1790/37963 [4:21:08<75:43:59,  7.54s/it]
                                                         
{'loss': '0.1723', 'grad_norm': '3.08', 'learning_rate': '1.998e-05', 'epoch': '0.04715'}

  5%|▍         | 1790/37963 [4:21:08<75:43:59,  7.54s/it]
  5%|▍         | 1791/37963 [4:21:16<76:04:43,  7.57s/it]
  5%|▍         | 1792/37963 [4:21:30<95:36:06,  9.51s/it]
  5%|▍         | 1793/37963 [4:21:37<89:51:55,  8.94s/it]
  5%|▍         | 1794/37963 [4:21:52<105:51:28, 10.54s/it]
  5%|▍         | 1795/37963 [4:22:05<115:43:29, 11.52s/it]
  5%|▍         | 1796/37963 [4:22:13<104:17:02, 10.38s/it]
  5%|▍         | 1797/37963 [4:22:21<95:34:44,  9.51s/it] 
  5%|▍         | 1798/37963 [4:22:35<110:27:07, 10.99s/it]
  5%|▍         | 1799/37963 [4:22:43<100:10:42,  9.97s/it]
  5%|▍         | 1800/37963 [4:22:50<92:59:34,  9.26s/it] 
                                                         
{'loss': '0.1858', 'grad_norm': '4.463', 'learning_rate': '1.998e-05', 'epoch': '0.04741'}

  5%|▍         | 1800/37963 [4:22:50<92:59:34,  9.26s/it]
  5%|▍         | 1801/37963 [4:22:59<90:28:17,  9.01s/it]
  5%|▍         | 1802/37963 [4:23:06<86:31:23,  8.61s/it]
  5%|▍         | 1803/37963 [4:23:14<83:24:29,  8.30s/it]
  5%|▍         | 1804/37963 [4:23:21<81:01:32,  8.07s/it]
  5%|▍         | 1805/37963 [4:23:36<100:10:27,  9.97s/it]
  5%|▍         | 1806/37963 [4:23:43<92:53:19,  9.25s/it] 
  5%|▍         | 1807/37963 [4:23:57<107:16:36, 10.68s/it]
  5%|▍         | 1808/37963 [4:24:05<97:50:28,  9.74s/it] 
  5%|▍         | 1809/37963 [4:24:13<93:11:09,  9.28s/it]
  5%|▍         | 1810/37963 [4:24:27<107:35:25, 10.71s/it]
                                                          
{'loss': '0.1885', 'grad_norm': '2.877', 'learning_rate': '1.998e-05', 'epoch': '0.04768'}

  5%|▍         | 1810/37963 [4:24:27<107:35:25, 10.71s/it]
  5%|▍         | 1811/37963 [4:24:35<98:01:12,  9.76s/it] 
  5%|▍         | 1812/37963 [4:24:42<91:19:02,  9.09s/it]
  5%|▍         | 1813/37963 [4:24:50<86:39:47,  8.63s/it]
  5%|▍         | 1814/37963 [4:24:58<84:59:27,  8.46s/it]
  5%|▍         | 1815/37963 [4:25:06<82:14:17,  8.19s/it]
  5%|▍         | 1816/37963 [4:25:13<80:18:06,  8.00s/it]
  5%|▍         | 1817/37963 [4:25:21<79:01:27,  7.87s/it]
  5%|▍         | 1818/37963 [4:25:28<77:40:54,  7.74s/it]
  5%|▍         | 1819/37963 [4:25:37<80:03:17,  7.97s/it]
  5%|▍         | 1820/37963 [4:25:44<78:49:11,  7.85s/it]
                                                         
{'loss': '0.1766', 'grad_norm': '2.963', 'learning_rate': '1.998e-05', 'epoch': '0.04794'}

  5%|▍         | 1820/37963 [4:25:44<78:49:11,  7.85s/it]
  5%|▍         | 1821/37963 [4:25:52<77:54:08,  7.76s/it]
  5%|▍         | 1822/37963 [4:25:59<76:30:59,  7.62s/it]
  5%|▍         | 1823/37963 [4:26:07<76:24:30,  7.61s/it]
  5%|▍         | 1824/37963 [4:26:15<77:48:30,  7.75s/it]
  5%|▍         | 1825/37963 [4:26:22<77:19:58,  7.70s/it]
  5%|▍         | 1826/37963 [4:26:30<76:42:35,  7.64s/it]
  5%|▍         | 1827/37963 [4:26:37<76:17:10,  7.60s/it]
  5%|▍         | 1828/37963 [4:26:45<76:18:40,  7.60s/it]
  5%|▍         | 1829/37963 [4:26:53<77:32:58,  7.73s/it]
  5%|▍         | 1830/37963 [4:27:07<96:01:38,  9.57s/it]
                                                         
{'loss': '0.1779', 'grad_norm': '2.405', 'learning_rate': '1.998e-05', 'epoch': '0.0482'}

  5%|▍         | 1830/37963 [4:27:07<96:01:38,  9.57s/it]
  5%|▍         | 1831/37963 [4:27:14<90:06:20,  8.98s/it]
  5%|▍         | 1832/37963 [4:27:22<85:47:51,  8.55s/it]
  5%|▍         | 1833/37963 [4:27:30<83:52:57,  8.36s/it]
  5%|▍         | 1834/37963 [4:27:37<81:19:04,  8.10s/it]
  5%|▍         | 1835/37963 [4:27:45<79:57:54,  7.97s/it]
  5%|▍         | 1836/37963 [4:27:52<78:25:24,  7.81s/it]
  5%|▍         | 1837/37963 [4:28:00<77:34:43,  7.73s/it]
  5%|▍         | 1838/37963 [4:28:08<78:38:23,  7.84s/it]
  5%|▍         | 1839/37963 [4:28:15<76:58:38,  7.67s/it]
  5%|▍         | 1840/37963 [4:28:23<75:38:34,  7.54s/it]
                                                         
{'loss': '0.1786', 'grad_norm': '2.213', 'learning_rate': '1.998e-05', 'epoch': '0.04847'}

  5%|▍         | 1840/37963 [4:28:23<75:38:34,  7.54s/it]
  5%|▍         | 1841/37963 [4:28:37<95:14:52,  9.49s/it]
  5%|▍         | 1842/37963 [4:28:51<109:42:32, 10.93s/it]
  5%|▍         | 1843/37963 [4:28:58<98:43:15,  9.84s/it] 
  5%|▍         | 1844/37963 [4:29:12<111:45:48, 11.14s/it]
  5%|▍         | 1845/37963 [4:29:21<103:04:07, 10.27s/it]
  5%|▍         | 1846/37963 [4:29:29<96:45:42,  9.64s/it] 
  5%|▍         | 1847/37963 [4:29:43<110:39:01, 11.03s/it]
  5%|▍         | 1848/37963 [4:29:51<100:12:00,  9.99s/it]
  5%|▍         | 1849/37963 [4:29:58<93:16:52,  9.30s/it] 
  5%|▍         | 1850/37963 [4:30:13<110:14:02, 10.99s/it]
                                                          
{'loss': '0.1831', 'grad_norm': '2.462', 'learning_rate': '1.998e-05', 'epoch': '0.04873'}

  5%|▍         | 1850/37963 [4:30:13<110:14:02, 10.99s/it]
  5%|▍         | 1851/37963 [4:30:21<99:54:40,  9.96s/it] 
  5%|▍         | 1852/37963 [4:30:29<93:15:11,  9.30s/it]
  5%|▍         | 1853/37963 [4:30:36<87:45:33,  8.75s/it]
  5%|▍         | 1854/37963 [4:30:44<84:57:27,  8.47s/it]
  5%|▍         | 1855/37963 [4:30:58<101:59:12, 10.17s/it]
  5%|▍         | 1856/37963 [4:31:06<94:53:38,  9.46s/it] 
  5%|▍         | 1857/37963 [4:31:13<88:57:02,  8.87s/it]
  5%|▍         | 1858/37963 [4:31:21<85:36:33,  8.54s/it]
  5%|▍         | 1859/37963 [4:31:28<82:12:10,  8.20s/it]
  5%|▍         | 1860/37963 [4:31:42<99:43:17,  9.94s/it]
                                                         
{'loss': '0.1665', 'grad_norm': '2.411', 'learning_rate': '1.998e-05', 'epoch': '0.049'}

  5%|▍         | 1860/37963 [4:31:42<99:43:17,  9.94s/it]
  5%|▍         | 1861/37963 [4:31:50<92:42:55,  9.25s/it]
  5%|▍         | 1862/37963 [4:31:58<87:57:01,  8.77s/it]
  5%|▍         | 1863/37963 [4:32:05<83:40:55,  8.35s/it]
  5%|▍         | 1864/37963 [4:32:13<82:30:59,  8.23s/it]
  5%|▍         | 1865/37963 [4:32:21<80:33:27,  8.03s/it]
  5%|▍         | 1866/37963 [4:32:29<80:06:29,  7.99s/it]
  5%|▍         | 1867/37963 [4:32:36<78:43:42,  7.85s/it]
  5%|▍         | 1868/37963 [4:32:44<77:56:23,  7.77s/it]
  5%|▍         | 1869/37963 [4:32:51<77:22:24,  7.72s/it]
  5%|▍         | 1870/37963 [4:32:59<76:40:09,  7.65s/it]
                                                         
{'loss': '0.1858', 'grad_norm': '3.75', 'learning_rate': '1.998e-05', 'epoch': '0.04926'}

  5%|▍         | 1870/37963 [4:32:59<76:40:09,  7.65s/it]
  5%|▍         | 1871/37963 [4:33:07<78:21:22,  7.82s/it]
  5%|▍         | 1872/37963 [4:33:14<77:35:55,  7.74s/it]
  5%|▍         | 1873/37963 [4:33:22<77:05:34,  7.69s/it]
  5%|▍         | 1874/37963 [4:33:30<76:35:38,  7.64s/it]
  5%|▍         | 1875/37963 [4:33:37<76:45:15,  7.66s/it]
  5%|▍         | 1876/37963 [4:33:52<97:17:41,  9.71s/it]
  5%|▍         | 1877/37963 [4:33:59<90:39:52,  9.04s/it]
  5%|▍         | 1878/37963 [4:34:07<86:11:47,  8.60s/it]
  5%|▍         | 1879/37963 [4:34:15<83:33:28,  8.34s/it]
  5%|▍         | 1880/37963 [4:34:23<82:49:32,  8.26s/it]
                                                         
{'loss': '0.1706', 'grad_norm': '2.05', 'learning_rate': '1.998e-05', 'epoch': '0.04952'}

  5%|▍         | 1880/37963 [4:34:23<82:49:32,  8.26s/it]
  5%|▍         | 1881/37963 [4:34:30<80:11:27,  8.00s/it]
  5%|▍         | 1882/37963 [4:34:38<78:52:18,  7.87s/it]
  5%|▍         | 1883/37963 [4:34:45<78:28:02,  7.83s/it]
  5%|▍         | 1884/37963 [4:34:53<78:12:37,  7.80s/it]
  5%|▍         | 1885/37963 [4:35:01<78:46:50,  7.86s/it]
  5%|▍         | 1886/37963 [4:35:09<77:53:15,  7.77s/it]
  5%|▍         | 1887/37963 [4:35:23<97:37:24,  9.74s/it]
  5%|▍         | 1888/37963 [4:35:31<91:23:59,  9.12s/it]
  5%|▍         | 1889/37963 [4:35:46<109:17:43, 10.91s/it]
  5%|▍         | 1890/37963 [4:35:53<99:15:43,  9.91s/it] 
                                                         
{'loss': '0.1791', 'grad_norm': '6.057', 'learning_rate': '1.998e-05', 'epoch': '0.04979'}

  5%|▍         | 1890/37963 [4:35:53<99:15:43,  9.91s/it]
  5%|▍         | 1891/37963 [4:36:01<92:29:04,  9.23s/it]
  5%|▍         | 1892/37963 [4:36:08<86:56:08,  8.68s/it]
  5%|▍         | 1893/37963 [4:36:23<103:25:38, 10.32s/it]
  5%|▍         | 1894/37963 [4:36:30<94:56:52,  9.48s/it] 
  5%|▍         | 1895/37963 [4:36:38<89:42:34,  8.95s/it]
  5%|▍         | 1896/37963 [4:36:46<86:08:08,  8.60s/it]
  5%|▍         | 1897/37963 [4:37:07<123:47:38, 12.36s/it]
  5%|▍         | 1898/37963 [4:37:14<109:24:22, 10.92s/it]
  5%|▌         | 1899/37963 [4:37:22<99:06:19,  9.89s/it] 
  5%|▌         | 1900/37963 [4:37:29<92:23:44,  9.22s/it]
                                                         
{'loss': '0.1785', 'grad_norm': '3.287', 'learning_rate': '1.998e-05', 'epoch': '0.05005'}

  5%|▌         | 1900/37963 [4:37:29<92:23:44,  9.22s/it]
  5%|▌         | 1901/37963 [4:37:37<88:11:44,  8.80s/it]
  5%|▌         | 1902/37963 [4:37:45<84:53:20,  8.47s/it]
  5%|▌         | 1903/37963 [4:37:53<82:35:57,  8.25s/it]
  5%|▌         | 1904/37963 [4:38:00<80:21:05,  8.02s/it]
  5%|▌         | 1905/37963 [4:38:08<80:35:23,  8.05s/it]
  5%|▌         | 1906/37963 [4:38:22<98:36:08,  9.84s/it]
  5%|▌         | 1907/37963 [4:38:30<91:05:35,  9.10s/it]
  5%|▌         | 1908/37963 [4:38:37<86:45:18,  8.66s/it]
  5%|▌         | 1909/37963 [4:38:45<83:52:38,  8.38s/it]
  5%|▌         | 1910/37963 [4:38:59<101:00:31, 10.09s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '5.238', 'learning_rate': '1.998e-05', 'epoch': '0.05031'}

  5%|▌         | 1910/37963 [4:38:59<101:00:31, 10.09s/it]
  5%|▌         | 1911/37963 [4:39:07<93:48:11,  9.37s/it] 
  5%|▌         | 1912/37963 [4:39:14<88:27:48,  8.83s/it]
  5%|▌         | 1913/37963 [4:39:23<86:51:56,  8.67s/it]
  5%|▌         | 1914/37963 [4:39:30<83:00:23,  8.29s/it]
  5%|▌         | 1915/37963 [4:39:38<81:03:44,  8.10s/it]
  5%|▌         | 1916/37963 [4:39:45<79:47:13,  7.97s/it]
  5%|▌         | 1917/37963 [4:39:53<78:28:30,  7.84s/it]
  5%|▌         | 1918/37963 [4:40:01<79:02:43,  7.89s/it]
  5%|▌         | 1919/37963 [4:40:09<78:37:08,  7.85s/it]
  5%|▌         | 1920/37963 [4:40:16<77:46:56,  7.77s/it]
                                                         
{'loss': '0.1608', 'grad_norm': '6.35', 'learning_rate': '1.998e-05', 'epoch': '0.05058'}

  5%|▌         | 1920/37963 [4:40:16<77:46:56,  7.77s/it]
  5%|▌         | 1921/37963 [4:40:24<76:56:28,  7.69s/it]
  5%|▌         | 1922/37963 [4:40:38<96:27:25,  9.63s/it]
  5%|▌         | 1923/37963 [4:40:46<90:38:53,  9.05s/it]
  5%|▌         | 1924/37963 [4:40:53<85:44:01,  8.56s/it]
  5%|▌         | 1925/37963 [4:41:01<82:53:35,  8.28s/it]
  5%|▌         | 1926/37963 [4:41:08<80:41:45,  8.06s/it]
  5%|▌         | 1927/37963 [4:41:16<80:39:56,  8.06s/it]
  5%|▌         | 1928/37963 [4:41:24<79:01:34,  7.89s/it]
  5%|▌         | 1929/37963 [4:41:31<77:42:15,  7.76s/it]
  5%|▌         | 1930/37963 [4:41:39<77:03:14,  7.70s/it]
                                                         
{'loss': '0.184', 'grad_norm': '3.366', 'learning_rate': '1.998e-05', 'epoch': '0.05084'}

  5%|▌         | 1930/37963 [4:41:39<77:03:14,  7.70s/it]
  5%|▌         | 1931/37963 [4:41:46<77:04:29,  7.70s/it]
  5%|▌         | 1932/37963 [4:41:54<77:52:35,  7.78s/it]
  5%|▌         | 1933/37963 [4:42:02<77:21:41,  7.73s/it]
  5%|▌         | 1934/37963 [4:42:17<97:37:39,  9.75s/it]
  5%|▌         | 1935/37963 [4:42:24<91:17:19,  9.12s/it]
  5%|▌         | 1936/37963 [4:42:32<87:30:37,  8.74s/it]
  5%|▌         | 1937/37963 [4:42:39<83:14:02,  8.32s/it]
  5%|▌         | 1938/37963 [4:42:47<80:50:27,  8.08s/it]
  5%|▌         | 1939/37963 [4:43:01<98:43:55,  9.87s/it]
  5%|▌         | 1940/37963 [4:43:15<112:44:11, 11.27s/it]
                                                          
{'loss': '0.181', 'grad_norm': '1.978', 'learning_rate': '1.998e-05', 'epoch': '0.0511'}

  5%|▌         | 1940/37963 [4:43:15<112:44:11, 11.27s/it]
  5%|▌         | 1941/37963 [4:43:23<101:45:51, 10.17s/it]
  5%|▌         | 1942/37963 [4:43:30<93:32:46,  9.35s/it] 
  5%|▌         | 1943/37963 [4:43:45<109:15:12, 10.92s/it]
  5%|▌         | 1944/37963 [4:43:53<99:23:26,  9.93s/it] 
  5%|▌         | 1945/37963 [4:44:00<92:25:57,  9.24s/it]
  5%|▌         | 1946/37963 [4:44:14<107:16:36, 10.72s/it]
  5%|▌         | 1947/37963 [4:44:23<99:21:38,  9.93s/it] 
  5%|▌         | 1948/37963 [4:44:30<92:23:14,  9.23s/it]
  5%|▌         | 1949/37963 [4:44:38<87:10:19,  8.71s/it]
  5%|▌         | 1950/37963 [4:44:45<84:08:58,  8.41s/it]
                                                         
{'loss': '0.1759', 'grad_norm': '4.577', 'learning_rate': '1.998e-05', 'epoch': '0.05137'}

  5%|▌         | 1950/37963 [4:44:45<84:08:58,  8.41s/it]
  5%|▌         | 1951/37963 [4:44:53<81:38:37,  8.16s/it]
  5%|▌         | 1952/37963 [4:45:01<82:26:54,  8.24s/it]
  5%|▌         | 1953/37963 [4:45:15<99:31:55,  9.95s/it]
  5%|▌         | 1954/37963 [4:45:23<93:00:03,  9.30s/it]
  5%|▌         | 1955/37963 [4:45:31<87:39:54,  8.76s/it]
  5%|▌         | 1956/37963 [4:45:39<85:49:51,  8.58s/it]
  5%|▌         | 1957/37963 [4:45:53<102:45:05, 10.27s/it]
  5%|▌         | 1958/37963 [4:46:01<94:30:46,  9.45s/it] 
  5%|▌         | 1959/37963 [4:46:08<89:06:02,  8.91s/it]
  5%|▌         | 1960/37963 [4:46:16<84:33:09,  8.45s/it]
                                                         
{'loss': '0.1905', 'grad_norm': '3.612', 'learning_rate': '1.998e-05', 'epoch': '0.05163'}

  5%|▌         | 1960/37963 [4:46:16<84:33:09,  8.45s/it]
  5%|▌         | 1961/37963 [4:46:23<81:52:17,  8.19s/it]
  5%|▌         | 1962/37963 [4:46:31<79:48:39,  7.98s/it]
  5%|▌         | 1963/37963 [4:46:38<78:43:12,  7.87s/it]
  5%|▌         | 1964/37963 [4:46:46<77:44:46,  7.77s/it]
  5%|▌         | 1965/37963 [4:46:53<76:56:11,  7.69s/it]
  5%|▌         | 1966/37963 [4:47:01<76:37:27,  7.66s/it]
  5%|▌         | 1967/37963 [4:47:09<76:53:04,  7.69s/it]
  5%|▌         | 1968/37963 [4:47:17<78:10:02,  7.82s/it]
  5%|▌         | 1969/37963 [4:47:24<77:38:20,  7.77s/it]
  5%|▌         | 1970/37963 [4:47:32<77:03:24,  7.71s/it]
                                                         
{'loss': '0.1726', 'grad_norm': '4.203', 'learning_rate': '1.997e-05', 'epoch': '0.05189'}

  5%|▌         | 1970/37963 [4:47:32<77:03:24,  7.71s/it]
  5%|▌         | 1971/37963 [4:47:46<96:57:21,  9.70s/it]
  5%|▌         | 1972/37963 [4:47:54<91:43:32,  9.17s/it]
  5%|▌         | 1973/37963 [4:48:02<86:53:13,  8.69s/it]
  5%|▌         | 1974/37963 [4:48:09<83:44:57,  8.38s/it]
  5%|▌         | 1975/37963 [4:48:17<81:51:04,  8.19s/it]
  5%|▌         | 1976/37963 [4:48:25<79:57:43,  8.00s/it]
  5%|▌         | 1977/37963 [4:48:33<79:25:03,  7.94s/it]
  5%|▌         | 1978/37963 [4:48:40<78:26:25,  7.85s/it]
  5%|▌         | 1979/37963 [4:48:48<77:20:44,  7.74s/it]
  5%|▌         | 1980/37963 [4:48:55<76:41:21,  7.67s/it]
                                                         
{'loss': '0.1827', 'grad_norm': '2.45', 'learning_rate': '1.997e-05', 'epoch': '0.05216'}

  5%|▌         | 1980/37963 [4:48:55<76:41:21,  7.67s/it]
  5%|▌         | 1981/37963 [4:49:11<100:43:57, 10.08s/it]
  5%|▌         | 1982/37963 [4:49:18<92:17:12,  9.23s/it] 
  5%|▌         | 1983/37963 [4:49:26<87:37:21,  8.77s/it]
  5%|▌         | 1984/37963 [4:49:34<84:28:19,  8.45s/it]
  5%|▌         | 1985/37963 [4:49:41<82:01:04,  8.21s/it]
  5%|▌         | 1986/37963 [4:49:56<100:53:11, 10.10s/it]
  5%|▌         | 1987/37963 [4:50:03<93:20:36,  9.34s/it] 
  5%|▌         | 1988/37963 [4:50:11<87:29:37,  8.76s/it]
  5%|▌         | 1989/37963 [4:50:18<83:38:28,  8.37s/it]
  5%|▌         | 1990/37963 [4:50:26<82:48:17,  8.29s/it]
                                                         
{'loss': '0.1664', 'grad_norm': '1.978', 'learning_rate': '1.997e-05', 'epoch': '0.05242'}

  5%|▌         | 1990/37963 [4:50:26<82:48:17,  8.29s/it]
  5%|▌         | 1991/37963 [4:50:46<118:25:59, 11.85s/it]
  5%|▌         | 1992/37963 [4:51:01<127:13:14, 12.73s/it]
  5%|▌         | 1993/37963 [4:51:09<111:37:27, 11.17s/it]
  5%|▌         | 1994/37963 [4:51:17<101:26:26, 10.15s/it]
  5%|▌         | 1995/37963 [4:51:24<93:43:34,  9.38s/it] 
  5%|▌         | 1996/37963 [4:51:32<88:08:13,  8.82s/it]
  5%|▌         | 1997/37963 [4:51:39<85:14:50,  8.53s/it]
  5%|▌         | 1998/37963 [4:51:53<101:24:46, 10.15s/it]
  5%|▌         | 1999/37963 [4:52:01<93:39:00,  9.37s/it] 
  5%|▌         | 2000/37963 [4:52:08<87:46:55,  8.79s/it]
                                                         
{'loss': '0.1776', 'grad_norm': '6.576', 'learning_rate': '1.997e-05', 'epoch': '0.05268'}

  5%|▌         | 2000/37963 [4:52:08<87:46:55,  8.79s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.55s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.55s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  5%|▌         | 2001/37963 [4:53:06<232:51:40, 23.31s/it]
  5%|▌         | 2002/37963 [4:53:13<185:36:42, 18.58s/it]
  5%|▌         | 2003/37963 [4:53:20<151:23:06, 15.16s/it]
  5%|▌         | 2004/37963 [4:53:28<128:17:38, 12.84s/it]
  5%|▌         | 2005/37963 [4:53:35<112:21:41, 11.25s/it]
  5%|▌         | 2006/37963 [4:53:49<120:46:07, 12.09s/it]
  5%|▌         | 2007/37963 [4:53:57<107:16:40, 10.74s/it]
  5%|▌         | 2008/37963 [4:54:04<97:30:55,  9.76s/it] 
  5%|▌         | 2009/37963 [4:54:12<91:02:31,  9.12s/it]
  5%|▌         | 2010/37963 [4:54:20<86:22:33,  8.65s/it]
                                                         
{'loss': '0.1742', 'grad_norm': '1.436', 'learning_rate': '1.997e-05', 'epoch': '0.05295'}

  5%|▌         | 2010/37963 [4:54:20<86:22:33,  8.65s/it]
  5%|▌         | 2011/37963 [4:54:27<82:29:50,  8.26s/it]
  5%|▌         | 2012/37963 [4:54:34<80:25:49,  8.05s/it]
  5%|▌         | 2013/37963 [4:54:42<79:16:02,  7.94s/it]
  5%|▌         | 2014/37963 [4:54:50<78:06:47,  7.82s/it]
  5%|▌         | 2015/37963 [4:54:57<77:43:48,  7.78s/it]
  5%|▌         | 2016/37963 [4:55:05<76:58:21,  7.71s/it]
  5%|▌         | 2017/37963 [4:55:19<95:27:13,  9.56s/it]
  5%|▌         | 2018/37963 [4:55:26<89:47:25,  8.99s/it]
  5%|▌         | 2019/37963 [4:55:34<85:43:30,  8.59s/it]
  5%|▌         | 2020/37963 [4:55:41<82:07:33,  8.23s/it]
                                                         
{'loss': '0.1833', 'grad_norm': '4.901', 'learning_rate': '1.997e-05', 'epoch': '0.05321'}

  5%|▌         | 2020/37963 [4:55:41<82:07:33,  8.23s/it]
  5%|▌         | 2021/37963 [4:55:49<79:33:10,  7.97s/it]
  5%|▌         | 2022/37963 [4:55:56<77:39:18,  7.78s/it]
  5%|▌         | 2023/37963 [4:56:03<75:48:33,  7.59s/it]
  5%|▌         | 2024/37963 [4:56:11<75:49:30,  7.60s/it]
  5%|▌         | 2025/37963 [4:56:18<75:38:08,  7.58s/it]
  5%|▌         | 2026/37963 [4:56:26<75:31:06,  7.57s/it]
  5%|▌         | 2027/37963 [4:56:34<75:38:53,  7.58s/it]
  5%|▌         | 2028/37963 [4:56:41<75:31:37,  7.57s/it]
  5%|▌         | 2029/37963 [4:56:49<75:24:24,  7.55s/it]
  5%|▌         | 2030/37963 [4:56:56<75:15:52,  7.54s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '3.03', 'learning_rate': '1.997e-05', 'epoch': '0.05347'}

  5%|▌         | 2030/37963 [4:56:56<75:15:52,  7.54s/it]
  5%|▌         | 2031/37963 [4:57:17<114:24:28, 11.46s/it]
  5%|▌         | 2032/37963 [4:57:25<103:34:13, 10.38s/it]
  5%|▌         | 2033/37963 [4:57:32<95:27:45,  9.56s/it] 
  5%|▌         | 2034/37963 [4:57:40<89:36:46,  8.98s/it]
  5%|▌         | 2035/37963 [4:57:48<85:36:23,  8.58s/it]
  5%|▌         | 2036/37963 [4:58:02<102:08:54, 10.24s/it]
  5%|▌         | 2037/37963 [4:58:09<94:29:07,  9.47s/it] 
  5%|▌         | 2038/37963 [4:58:23<107:04:31, 10.73s/it]
  5%|▌         | 2039/37963 [4:58:31<97:24:28,  9.76s/it] 
  5%|▌         | 2040/37963 [4:58:38<90:12:19,  9.04s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '3.39', 'learning_rate': '1.997e-05', 'epoch': '0.05374'}

  5%|▌         | 2040/37963 [4:58:38<90:12:19,  9.04s/it]
  5%|▌         | 2041/37963 [4:58:52<105:00:09, 10.52s/it]
  5%|▌         | 2042/37963 [4:59:00<96:26:47,  9.67s/it] 
  5%|▌         | 2043/37963 [4:59:07<89:55:33,  9.01s/it]
  5%|▌         | 2044/37963 [4:59:15<85:48:12,  8.60s/it]
  5%|▌         | 2045/37963 [4:59:22<82:33:39,  8.27s/it]
  5%|▌         | 2046/37963 [4:59:30<80:50:10,  8.10s/it]
  5%|▌         | 2047/37963 [4:59:38<79:20:02,  7.95s/it]
  5%|▌         | 2048/37963 [4:59:45<78:10:47,  7.84s/it]
  5%|▌         | 2049/37963 [4:59:53<77:09:17,  7.73s/it]
  5%|▌         | 2050/37963 [5:00:07<95:47:45,  9.60s/it]
                                                         
{'loss': '0.1736', 'grad_norm': '2.086', 'learning_rate': '1.997e-05', 'epoch': '0.054'}

  5%|▌         | 2050/37963 [5:00:07<95:47:45,  9.60s/it]
  5%|▌         | 2051/37963 [5:00:14<89:44:07,  9.00s/it]
  5%|▌         | 2052/37963 [5:00:22<85:06:00,  8.53s/it]
  5%|▌         | 2053/37963 [5:00:29<82:07:56,  8.23s/it]
  5%|▌         | 2054/37963 [5:00:43<99:24:14,  9.97s/it]
  5%|▌         | 2055/37963 [5:00:51<92:27:06,  9.27s/it]
  5%|▌         | 2056/37963 [5:00:58<86:11:45,  8.64s/it]
  5%|▌         | 2057/37963 [5:01:05<81:54:01,  8.21s/it]
  5%|▌         | 2058/37963 [5:01:13<79:40:07,  7.99s/it]
  5%|▌         | 2059/37963 [5:01:20<78:17:23,  7.85s/it]
  5%|▌         | 2060/37963 [5:01:28<77:19:11,  7.75s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '2.774', 'learning_rate': '1.997e-05', 'epoch': '0.05426'}

  5%|▌         | 2060/37963 [5:01:28<77:19:11,  7.75s/it]
  5%|▌         | 2061/37963 [5:01:35<76:10:36,  7.64s/it]
  5%|▌         | 2062/37963 [5:01:43<75:43:48,  7.59s/it]
  5%|▌         | 2063/37963 [5:01:50<75:31:47,  7.57s/it]
  5%|▌         | 2064/37963 [5:01:57<74:41:55,  7.49s/it]
  5%|▌         | 2065/37963 [5:02:05<75:09:44,  7.54s/it]
  5%|▌         | 2066/37963 [5:02:19<94:05:51,  9.44s/it]
  5%|▌         | 2067/37963 [5:02:26<88:43:11,  8.90s/it]
  5%|▌         | 2068/37963 [5:02:34<84:58:19,  8.52s/it]
  5%|▌         | 2069/37963 [5:02:41<81:20:35,  8.16s/it]
  5%|▌         | 2070/37963 [5:02:49<79:30:04,  7.97s/it]
                                                         
{'loss': '0.1902', 'grad_norm': '6.461', 'learning_rate': '1.997e-05', 'epoch': '0.05453'}

  5%|▌         | 2070/37963 [5:02:49<79:30:04,  7.97s/it]
  5%|▌         | 2071/37963 [5:02:56<77:24:09,  7.76s/it]
  5%|▌         | 2072/37963 [5:03:04<76:46:46,  7.70s/it]
  5%|▌         | 2073/37963 [5:03:11<76:04:18,  7.63s/it]
  5%|▌         | 2074/37963 [5:03:19<75:37:56,  7.59s/it]
  5%|▌         | 2075/37963 [5:03:26<75:37:30,  7.59s/it]
  5%|▌         | 2076/37963 [5:03:34<75:17:56,  7.55s/it]
  5%|▌         | 2077/37963 [5:03:41<75:04:27,  7.53s/it]
  5%|▌         | 2078/37963 [5:03:55<94:06:53,  9.44s/it]
  5%|▌         | 2079/37963 [5:04:03<87:51:59,  8.82s/it]
  5%|▌         | 2080/37963 [5:04:10<84:08:11,  8.44s/it]
                                                         
{'loss': '0.1738', 'grad_norm': '4.376', 'learning_rate': '1.997e-05', 'epoch': '0.05479'}

  5%|▌         | 2080/37963 [5:04:10<84:08:11,  8.44s/it]
  5%|▌         | 2081/37963 [5:04:18<81:25:44,  8.17s/it]
  5%|▌         | 2082/37963 [5:04:25<79:19:06,  7.96s/it]
  5%|▌         | 2083/37963 [5:04:32<77:19:14,  7.76s/it]
  5%|▌         | 2084/37963 [5:04:46<95:29:20,  9.58s/it]
  5%|▌         | 2085/37963 [5:05:00<108:48:29, 10.92s/it]
  5%|▌         | 2086/37963 [5:05:08<98:37:32,  9.90s/it] 
  5%|▌         | 2087/37963 [5:05:15<91:36:13,  9.19s/it]
  6%|▌         | 2088/37963 [5:05:23<85:58:34,  8.63s/it]
  6%|▌         | 2089/37963 [5:05:30<82:40:20,  8.30s/it]
  6%|▌         | 2090/37963 [5:05:44<99:44:02, 10.01s/it]
                                                         
{'loss': '0.1796', 'grad_norm': '2.908', 'learning_rate': '1.997e-05', 'epoch': '0.05505'}

  6%|▌         | 2090/37963 [5:05:44<99:44:02, 10.01s/it]
  6%|▌         | 2091/37963 [5:05:52<92:22:22,  9.27s/it]
  6%|▌         | 2092/37963 [5:05:59<86:54:46,  8.72s/it]
  6%|▌         | 2093/37963 [5:06:07<82:50:06,  8.31s/it]
  6%|▌         | 2094/37963 [5:06:14<80:06:00,  8.04s/it]
  6%|▌         | 2095/37963 [5:06:28<97:43:19,  9.81s/it]
  6%|▌         | 2096/37963 [5:06:35<90:54:26,  9.12s/it]
  6%|▌         | 2097/37963 [5:06:43<85:34:59,  8.59s/it]
  6%|▌         | 2098/37963 [5:06:57<101:16:59, 10.17s/it]
  6%|▌         | 2099/37963 [5:07:11<112:31:51, 11.30s/it]
  6%|▌         | 2100/37963 [5:07:18<101:09:54, 10.16s/it]
                                                          
{'loss': '0.1899', 'grad_norm': '1.791', 'learning_rate': '1.997e-05', 'epoch': '0.05532'}

  6%|▌         | 2100/37963 [5:07:18<101:09:54, 10.16s/it]
  6%|▌         | 2101/37963 [5:07:26<93:18:23,  9.37s/it] 
  6%|▌         | 2102/37963 [5:07:33<87:12:58,  8.76s/it]
  6%|▌         | 2103/37963 [5:07:40<83:33:15,  8.39s/it]
  6%|▌         | 2104/37963 [5:07:48<79:53:56,  8.02s/it]
  6%|▌         | 2105/37963 [5:07:55<77:45:08,  7.81s/it]
  6%|▌         | 2106/37963 [5:08:02<77:02:36,  7.74s/it]
  6%|▌         | 2107/37963 [5:08:10<76:01:12,  7.63s/it]
  6%|▌         | 2108/37963 [5:08:17<75:20:03,  7.56s/it]
  6%|▌         | 2109/37963 [5:08:25<75:14:02,  7.55s/it]
  6%|▌         | 2110/37963 [5:08:32<74:53:28,  7.52s/it]
                                                         
{'loss': '0.1675', 'grad_norm': '4.741', 'learning_rate': '1.997e-05', 'epoch': '0.05558'}

  6%|▌         | 2110/37963 [5:08:32<74:53:28,  7.52s/it]
  6%|▌         | 2111/37963 [5:08:40<74:23:43,  7.47s/it]
  6%|▌         | 2112/37963 [5:08:47<74:40:12,  7.50s/it]
  6%|▌         | 2113/37963 [5:08:55<74:46:27,  7.51s/it]
  6%|▌         | 2114/37963 [5:09:02<74:42:27,  7.50s/it]
  6%|▌         | 2115/37963 [5:09:16<93:46:53,  9.42s/it]
  6%|▌         | 2116/37963 [5:09:24<88:24:06,  8.88s/it]
  6%|▌         | 2117/37963 [5:09:31<84:06:14,  8.45s/it]
  6%|▌         | 2118/37963 [5:09:38<80:10:07,  8.05s/it]
  6%|▌         | 2119/37963 [5:09:46<78:01:44,  7.84s/it]
  6%|▌         | 2120/37963 [5:09:53<77:01:49,  7.74s/it]
                                                         
{'loss': '0.1798', 'grad_norm': '2.813', 'learning_rate': '1.997e-05', 'epoch': '0.05584'}

  6%|▌         | 2120/37963 [5:09:53<77:01:49,  7.74s/it]
  6%|▌         | 2121/37963 [5:10:01<76:21:55,  7.67s/it]
  6%|▌         | 2122/37963 [5:10:08<76:12:23,  7.65s/it]
  6%|▌         | 2123/37963 [5:10:16<76:03:17,  7.64s/it]
  6%|▌         | 2124/37963 [5:10:23<75:43:22,  7.61s/it]
  6%|▌         | 2125/37963 [5:10:31<74:39:13,  7.50s/it]
  6%|▌         | 2126/37963 [5:10:38<74:47:39,  7.51s/it]
  6%|▌         | 2127/37963 [5:10:46<75:06:48,  7.55s/it]
  6%|▌         | 2128/37963 [5:10:53<75:08:09,  7.55s/it]
  6%|▌         | 2129/37963 [5:11:13<112:37:16, 11.31s/it]
  6%|▌         | 2130/37963 [5:11:21<101:43:07, 10.22s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '6.888', 'learning_rate': '1.996e-05', 'epoch': '0.05611'}

  6%|▌         | 2130/37963 [5:11:21<101:43:07, 10.22s/it]
  6%|▌         | 2131/37963 [5:11:29<93:32:53,  9.40s/it] 
  6%|▌         | 2132/37963 [5:11:36<88:04:47,  8.85s/it]
  6%|▌         | 2133/37963 [5:11:44<84:16:03,  8.47s/it]
  6%|▌         | 2134/37963 [5:11:51<81:27:54,  8.19s/it]
  6%|▌         | 2135/37963 [5:12:05<98:23:07,  9.89s/it]
  6%|▌         | 2136/37963 [5:12:13<91:11:10,  9.16s/it]
  6%|▌         | 2137/37963 [5:12:20<86:29:12,  8.69s/it]
  6%|▌         | 2138/37963 [5:12:28<83:05:46,  8.35s/it]
  6%|▌         | 2139/37963 [5:12:35<80:42:15,  8.11s/it]
  6%|▌         | 2140/37963 [5:12:43<79:16:15,  7.97s/it]
                                                         
{'loss': '0.1791', 'grad_norm': '2.483', 'learning_rate': '1.996e-05', 'epoch': '0.05637'}

  6%|▌         | 2140/37963 [5:12:43<79:16:15,  7.97s/it]
  6%|▌         | 2141/37963 [5:12:50<78:01:18,  7.84s/it]
  6%|▌         | 2142/37963 [5:13:04<96:21:09,  9.68s/it]
  6%|▌         | 2143/37963 [5:13:25<129:07:50, 12.98s/it]
  6%|▌         | 2144/37963 [5:13:39<133:15:37, 13.39s/it]
  6%|▌         | 2145/37963 [5:13:47<115:20:58, 11.59s/it]
  6%|▌         | 2146/37963 [5:13:54<103:19:33, 10.39s/it]
  6%|▌         | 2147/37963 [5:14:02<94:48:45,  9.53s/it] 
  6%|▌         | 2148/37963 [5:14:09<88:46:55,  8.92s/it]
  6%|▌         | 2149/37963 [5:14:17<83:33:59,  8.40s/it]
  6%|▌         | 2150/37963 [5:14:24<80:25:30,  8.08s/it]
                                                         
{'loss': '0.1663', 'grad_norm': '2.592', 'learning_rate': '1.996e-05', 'epoch': '0.05663'}

  6%|▌         | 2150/37963 [5:14:24<80:25:30,  8.08s/it]
  6%|▌         | 2151/37963 [5:14:32<78:50:48,  7.93s/it]
  6%|▌         | 2152/37963 [5:14:39<77:42:09,  7.81s/it]
  6%|▌         | 2153/37963 [5:14:47<76:45:51,  7.72s/it]
  6%|▌         | 2154/37963 [5:14:54<75:23:37,  7.58s/it]
  6%|▌         | 2155/37963 [5:15:01<74:33:55,  7.50s/it]
  6%|▌         | 2156/37963 [5:15:09<74:36:13,  7.50s/it]
  6%|▌         | 2157/37963 [5:15:16<75:13:13,  7.56s/it]
  6%|▌         | 2158/37963 [5:15:24<74:20:14,  7.47s/it]
  6%|▌         | 2159/37963 [5:15:31<74:28:27,  7.49s/it]
  6%|▌         | 2160/37963 [5:15:45<94:20:10,  9.49s/it]
                                                         
{'loss': '0.1616', 'grad_norm': '2.804', 'learning_rate': '1.996e-05', 'epoch': '0.0569'}

  6%|▌         | 2160/37963 [5:15:45<94:20:10,  9.49s/it]
  6%|▌         | 2161/37963 [5:15:53<88:02:45,  8.85s/it]
  6%|▌         | 2162/37963 [5:16:00<83:43:50,  8.42s/it]
  6%|▌         | 2163/37963 [5:16:08<80:53:16,  8.13s/it]
  6%|▌         | 2164/37963 [5:16:15<79:05:39,  7.95s/it]
  6%|▌         | 2165/37963 [5:16:23<78:13:23,  7.87s/it]
  6%|▌         | 2166/37963 [5:16:30<77:11:12,  7.76s/it]
  6%|▌         | 2167/37963 [5:16:38<76:33:48,  7.70s/it]
  6%|▌         | 2168/37963 [5:16:45<76:07:03,  7.66s/it]
  6%|▌         | 2169/37963 [5:16:53<74:48:51,  7.52s/it]
  6%|▌         | 2170/37963 [5:17:00<74:27:42,  7.49s/it]
                                                         
{'loss': '0.1568', 'grad_norm': '2.562', 'learning_rate': '1.996e-05', 'epoch': '0.05716'}

  6%|▌         | 2170/37963 [5:17:00<74:27:42,  7.49s/it]
  6%|▌         | 2171/37963 [5:17:08<74:33:55,  7.50s/it]
  6%|▌         | 2172/37963 [5:17:15<74:44:04,  7.52s/it]
  6%|▌         | 2173/37963 [5:17:29<93:57:41,  9.45s/it]
  6%|▌         | 2174/37963 [5:17:37<88:24:52,  8.89s/it]
  6%|▌         | 2175/37963 [5:17:44<84:26:36,  8.49s/it]
  6%|▌         | 2176/37963 [5:17:52<81:42:46,  8.22s/it]
  6%|▌         | 2177/37963 [5:17:59<79:35:33,  8.01s/it]
  6%|▌         | 2178/37963 [5:18:07<78:38:40,  7.91s/it]
  6%|▌         | 2179/37963 [5:18:15<77:34:05,  7.80s/it]
  6%|▌         | 2180/37963 [5:18:29<96:01:06,  9.66s/it]
                                                         
{'loss': '0.1969', 'grad_norm': '3.123', 'learning_rate': '1.996e-05', 'epoch': '0.05742'}

  6%|▌         | 2180/37963 [5:18:29<96:01:06,  9.66s/it]
  6%|▌         | 2181/37963 [5:18:43<109:16:52, 10.99s/it]
  6%|▌         | 2182/37963 [5:18:50<99:14:07,  9.98s/it] 
  6%|▌         | 2183/37963 [5:18:58<92:12:59,  9.28s/it]
  6%|▌         | 2184/37963 [5:19:05<87:12:15,  8.77s/it]
  6%|▌         | 2185/37963 [5:19:13<83:37:38,  8.41s/it]
  6%|▌         | 2186/37963 [5:19:27<101:00:32, 10.16s/it]
  6%|▌         | 2187/37963 [5:19:41<111:47:08, 11.25s/it]
  6%|▌         | 2188/37963 [5:19:49<100:59:24, 10.16s/it]
  6%|▌         | 2189/37963 [5:20:03<114:01:23, 11.47s/it]
  6%|▌         | 2190/37963 [5:20:11<102:36:44, 10.33s/it]
                                                          
{'loss': '0.1939', 'grad_norm': '7.861', 'learning_rate': '1.996e-05', 'epoch': '0.05769'}

  6%|▌         | 2190/37963 [5:20:11<102:36:44, 10.33s/it]
  6%|▌         | 2191/37963 [5:20:18<94:19:02,  9.49s/it] 
  6%|▌         | 2192/37963 [5:20:32<107:55:59, 10.86s/it]
  6%|▌         | 2193/37963 [5:20:40<97:23:52,  9.80s/it] 
  6%|▌         | 2194/37963 [5:20:47<90:34:47,  9.12s/it]
  6%|▌         | 2195/37963 [5:20:55<85:45:50,  8.63s/it]
  6%|▌         | 2196/37963 [5:21:02<82:21:21,  8.29s/it]
  6%|▌         | 2197/37963 [5:21:10<80:42:23,  8.12s/it]
  6%|▌         | 2198/37963 [5:21:17<78:00:50,  7.85s/it]
  6%|▌         | 2199/37963 [5:21:25<77:11:45,  7.77s/it]
  6%|▌         | 2200/37963 [5:21:32<75:49:39,  7.63s/it]
                                                         
{'loss': '0.1676', 'grad_norm': '1.92', 'learning_rate': '1.996e-05', 'epoch': '0.05795'}

  6%|▌         | 2200/37963 [5:21:32<75:49:39,  7.63s/it]
  6%|▌         | 2201/37963 [5:21:40<74:57:59,  7.55s/it]
  6%|▌         | 2202/37963 [5:21:47<74:52:37,  7.54s/it]
  6%|▌         | 2203/37963 [5:21:55<75:01:18,  7.55s/it]
  6%|▌         | 2204/37963 [5:22:02<74:44:07,  7.52s/it]
  6%|▌         | 2205/37963 [5:22:16<93:42:18,  9.43s/it]
  6%|▌         | 2206/37963 [5:22:24<88:06:18,  8.87s/it]
  6%|▌         | 2207/37963 [5:22:31<84:13:32,  8.48s/it]
  6%|▌         | 2208/37963 [5:22:39<81:53:18,  8.24s/it]
  6%|▌         | 2209/37963 [5:22:46<79:52:16,  8.04s/it]
  6%|▌         | 2210/37963 [5:22:54<78:24:29,  7.89s/it]
                                                         
{'loss': '0.1742', 'grad_norm': '4.153', 'learning_rate': '1.996e-05', 'epoch': '0.05821'}

  6%|▌         | 2210/37963 [5:22:54<78:24:29,  7.89s/it]
  6%|▌         | 2211/37963 [5:23:02<77:44:46,  7.83s/it]
  6%|▌         | 2212/37963 [5:23:09<77:02:09,  7.76s/it]
  6%|▌         | 2213/37963 [5:23:17<76:23:52,  7.69s/it]
  6%|▌         | 2214/37963 [5:23:24<75:55:58,  7.65s/it]
  6%|▌         | 2215/37963 [5:23:32<75:31:56,  7.61s/it]
  6%|▌         | 2216/37963 [5:23:39<75:17:49,  7.58s/it]
  6%|▌         | 2217/37963 [5:23:47<74:31:11,  7.50s/it]
  6%|▌         | 2218/37963 [5:23:54<74:30:43,  7.50s/it]
  6%|▌         | 2219/37963 [5:24:02<74:28:04,  7.50s/it]
  6%|▌         | 2220/37963 [5:24:09<75:00:50,  7.56s/it]
                                                         
{'loss': '0.169', 'grad_norm': '3.67', 'learning_rate': '1.996e-05', 'epoch': '0.05848'}

  6%|▌         | 2220/37963 [5:24:09<75:00:50,  7.56s/it]
  6%|▌         | 2221/37963 [5:24:23<94:05:05,  9.48s/it]
  6%|▌         | 2222/37963 [5:24:31<88:28:18,  8.91s/it]
  6%|▌         | 2223/37963 [5:24:38<84:21:57,  8.50s/it]
  6%|▌         | 2224/37963 [5:24:46<81:11:46,  8.18s/it]
  6%|▌         | 2225/37963 [5:25:00<98:00:46,  9.87s/it]
  6%|▌         | 2226/37963 [5:25:07<90:20:57,  9.10s/it]
  6%|▌         | 2227/37963 [5:25:14<85:39:48,  8.63s/it]
  6%|▌         | 2228/37963 [5:25:22<82:20:45,  8.30s/it]
  6%|▌         | 2229/37963 [5:25:29<79:45:38,  8.04s/it]
  6%|▌         | 2230/37963 [5:25:37<78:40:29,  7.93s/it]
                                                         
{'loss': '0.1784', 'grad_norm': '5.193', 'learning_rate': '1.996e-05', 'epoch': '0.05874'}

  6%|▌         | 2230/37963 [5:25:37<78:40:29,  7.93s/it]
  6%|▌         | 2231/37963 [5:25:45<77:45:35,  7.83s/it]
  6%|▌         | 2232/37963 [5:25:59<96:07:48,  9.69s/it]
  6%|▌         | 2233/37963 [5:26:13<108:56:37, 10.98s/it]
  6%|▌         | 2234/37963 [5:26:20<98:26:48,  9.92s/it] 
  6%|▌         | 2235/37963 [5:26:28<91:21:56,  9.21s/it]
  6%|▌         | 2236/37963 [5:26:35<86:29:10,  8.71s/it]
  6%|▌         | 2237/37963 [5:26:43<82:12:42,  8.28s/it]
  6%|▌         | 2238/37963 [5:26:50<79:22:22,  8.00s/it]
  6%|▌         | 2239/37963 [5:26:57<77:58:22,  7.86s/it]
  6%|▌         | 2240/37963 [5:27:24<134:01:23, 13.51s/it]
                                                          
{'loss': '0.1668', 'grad_norm': '5.262', 'learning_rate': '1.996e-05', 'epoch': '0.05901'}

  6%|▌         | 2240/37963 [5:27:24<134:01:23, 13.51s/it]
  6%|▌         | 2241/37963 [5:27:32<116:26:10, 11.73s/it]
  6%|▌         | 2242/37963 [5:27:39<104:06:20, 10.49s/it]
  6%|▌         | 2243/37963 [5:27:47<95:09:23,  9.59s/it] 
  6%|▌         | 2244/37963 [5:27:54<89:00:50,  8.97s/it]
  6%|▌         | 2245/37963 [5:28:01<83:38:52,  8.43s/it]
  6%|▌         | 2246/37963 [5:28:09<80:53:47,  8.15s/it]
  6%|▌         | 2247/37963 [5:28:16<78:35:20,  7.92s/it]
  6%|▌         | 2248/37963 [5:28:24<77:45:28,  7.84s/it]
  6%|▌         | 2249/37963 [5:28:32<76:54:38,  7.75s/it]
  6%|▌         | 2250/37963 [5:28:39<75:47:00,  7.64s/it]
                                                         
{'loss': '0.1741', 'grad_norm': '3.427', 'learning_rate': '1.996e-05', 'epoch': '0.05927'}

  6%|▌         | 2250/37963 [5:28:39<75:47:00,  7.64s/it]
  6%|▌         | 2251/37963 [5:28:47<75:35:40,  7.62s/it]
  6%|▌         | 2252/37963 [5:28:54<74:42:10,  7.53s/it]
  6%|▌         | 2253/37963 [5:29:01<74:59:35,  7.56s/it]
  6%|▌         | 2254/37963 [5:29:09<74:56:33,  7.56s/it]
  6%|▌         | 2255/37963 [5:29:16<74:04:10,  7.47s/it]
  6%|▌         | 2256/37963 [5:29:24<74:14:11,  7.48s/it]
  6%|▌         | 2257/37963 [5:29:38<92:57:00,  9.37s/it]
  6%|▌         | 2258/37963 [5:29:45<86:46:52,  8.75s/it]
  6%|▌         | 2259/37963 [5:29:52<82:46:00,  8.35s/it]
  6%|▌         | 2260/37963 [5:30:00<80:17:33,  8.10s/it]
                                                         
{'loss': '0.1762', 'grad_norm': '2.418', 'learning_rate': '1.995e-05', 'epoch': '0.05953'}

  6%|▌         | 2260/37963 [5:30:00<80:17:33,  8.10s/it]
  6%|▌         | 2261/37963 [5:30:07<78:36:39,  7.93s/it]
  6%|▌         | 2262/37963 [5:30:15<77:24:42,  7.81s/it]
  6%|▌         | 2263/37963 [5:30:22<76:15:57,  7.69s/it]
  6%|▌         | 2264/37963 [5:30:30<75:48:20,  7.64s/it]
  6%|▌         | 2265/37963 [5:30:37<75:19:58,  7.60s/it]
  6%|▌         | 2266/37963 [5:30:51<94:26:31,  9.52s/it]
  6%|▌         | 2267/37963 [5:30:59<88:36:20,  8.94s/it]
  6%|▌         | 2268/37963 [5:31:06<84:29:22,  8.52s/it]
  6%|▌         | 2269/37963 [5:31:14<81:31:20,  8.22s/it]
  6%|▌         | 2270/37963 [5:31:21<78:59:19,  7.97s/it]
                                                         
{'loss': '0.167', 'grad_norm': '4.5', 'learning_rate': '1.995e-05', 'epoch': '0.0598'}

  6%|▌         | 2270/37963 [5:31:21<78:59:19,  7.97s/it]
  6%|▌         | 2271/37963 [5:31:29<77:34:31,  7.82s/it]
  6%|▌         | 2272/37963 [5:31:36<76:40:12,  7.73s/it]
  6%|▌         | 2273/37963 [5:31:44<75:13:14,  7.59s/it]
  6%|▌         | 2274/37963 [5:31:51<75:03:31,  7.57s/it]
  6%|▌         | 2275/37963 [5:31:59<74:58:29,  7.56s/it]
  6%|▌         | 2276/37963 [5:32:13<95:35:35,  9.64s/it]
  6%|▌         | 2277/37963 [5:32:21<89:28:20,  9.03s/it]
  6%|▌         | 2278/37963 [5:32:28<85:18:48,  8.61s/it]
  6%|▌         | 2279/37963 [5:32:36<82:21:33,  8.31s/it]
  6%|▌         | 2280/37963 [5:32:44<80:07:10,  8.08s/it]
                                                         
{'loss': '0.1757', 'grad_norm': '3.916', 'learning_rate': '1.995e-05', 'epoch': '0.06006'}

  6%|▌         | 2280/37963 [5:32:44<80:07:10,  8.08s/it]
  6%|▌         | 2281/37963 [5:32:58<98:38:36,  9.95s/it]
  6%|▌         | 2282/37963 [5:33:05<90:59:02,  9.18s/it]
  6%|▌         | 2283/37963 [5:33:13<85:49:04,  8.66s/it]
  6%|▌         | 2284/37963 [5:33:20<82:27:58,  8.32s/it]
  6%|▌         | 2285/37963 [5:33:34<98:43:25,  9.96s/it]
  6%|▌         | 2286/37963 [5:33:42<92:02:22,  9.29s/it]
  6%|▌         | 2287/37963 [5:33:55<104:44:06, 10.57s/it]
  6%|▌         | 2288/37963 [5:34:16<133:55:56, 13.52s/it]
  6%|▌         | 2289/37963 [5:34:23<116:27:01, 11.75s/it]
  6%|▌         | 2290/37963 [5:34:31<104:23:04, 10.53s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '3.446', 'learning_rate': '1.995e-05', 'epoch': '0.06032'}

  6%|▌         | 2290/37963 [5:34:31<104:23:04, 10.53s/it]
  6%|▌         | 2291/37963 [5:34:39<95:30:37,  9.64s/it] 
  6%|▌         | 2292/37963 [5:34:46<88:59:47,  8.98s/it]
  6%|▌         | 2293/37963 [5:34:54<84:55:59,  8.57s/it]
  6%|▌         | 2294/37963 [5:35:01<80:47:27,  8.15s/it]
  6%|▌         | 2295/37963 [5:35:08<79:26:41,  8.02s/it]
  6%|▌         | 2296/37963 [5:35:16<78:10:36,  7.89s/it]
  6%|▌         | 2297/37963 [5:35:24<77:10:33,  7.79s/it]
  6%|▌         | 2298/37963 [5:35:31<76:35:29,  7.73s/it]
  6%|▌         | 2299/37963 [5:35:39<76:06:16,  7.68s/it]
  6%|▌         | 2300/37963 [5:35:46<75:56:12,  7.67s/it]
                                                         
{'loss': '0.1682', 'grad_norm': '5.727', 'learning_rate': '1.995e-05', 'epoch': '0.06059'}

  6%|▌         | 2300/37963 [5:35:46<75:56:12,  7.67s/it]
  6%|▌         | 2301/37963 [5:35:54<74:46:15,  7.55s/it]
  6%|▌         | 2302/37963 [5:36:01<74:13:03,  7.49s/it]
  6%|▌         | 2303/37963 [5:36:09<74:39:59,  7.54s/it]
  6%|▌         | 2304/37963 [5:36:16<74:27:50,  7.52s/it]
  6%|▌         | 2305/37963 [5:36:24<74:08:26,  7.49s/it]
  6%|▌         | 2306/37963 [5:36:31<74:10:00,  7.49s/it]
  6%|▌         | 2307/37963 [5:36:39<74:11:15,  7.49s/it]
  6%|▌         | 2308/37963 [5:36:46<74:52:57,  7.56s/it]
  6%|▌         | 2309/37963 [5:37:00<94:17:17,  9.52s/it]
  6%|▌         | 2310/37963 [5:37:08<88:33:13,  8.94s/it]
                                                         
{'loss': '0.1728', 'grad_norm': '2.199', 'learning_rate': '1.995e-05', 'epoch': '0.06085'}

  6%|▌         | 2310/37963 [5:37:08<88:33:13,  8.94s/it]
  6%|▌         | 2311/37963 [5:37:16<84:22:40,  8.52s/it]
  6%|▌         | 2312/37963 [5:37:23<81:29:32,  8.23s/it]
  6%|▌         | 2313/37963 [5:37:31<79:16:09,  8.00s/it]
  6%|▌         | 2314/37963 [5:37:38<78:13:55,  7.90s/it]
  6%|▌         | 2315/37963 [5:37:46<77:05:28,  7.79s/it]
  6%|▌         | 2316/37963 [5:37:53<76:29:35,  7.73s/it]
  6%|▌         | 2317/37963 [5:38:07<93:49:49,  9.48s/it]
  6%|▌         | 2318/37963 [5:38:14<88:04:26,  8.90s/it]
  6%|▌         | 2319/37963 [5:38:22<84:14:26,  8.51s/it]
  6%|▌         | 2320/37963 [5:38:29<80:46:23,  8.16s/it]
                                                         
{'loss': '0.1813', 'grad_norm': '3.674', 'learning_rate': '1.995e-05', 'epoch': '0.06111'}

  6%|▌         | 2320/37963 [5:38:29<80:46:23,  8.16s/it]
  6%|▌         | 2321/37963 [5:38:37<78:47:58,  7.96s/it]
  6%|▌         | 2322/37963 [5:38:44<77:15:41,  7.80s/it]
  6%|▌         | 2323/37963 [5:38:52<76:31:33,  7.73s/it]
  6%|▌         | 2324/37963 [5:39:06<95:23:56,  9.64s/it]
  6%|▌         | 2325/37963 [5:39:13<89:12:13,  9.01s/it]
  6%|▌         | 2326/37963 [5:39:21<84:35:41,  8.55s/it]
  6%|▌         | 2327/37963 [5:39:29<81:57:12,  8.28s/it]
  6%|▌         | 2328/37963 [5:39:36<79:39:16,  8.05s/it]
  6%|▌         | 2329/37963 [5:39:50<96:58:58,  9.80s/it]
  6%|▌         | 2330/37963 [5:39:58<90:20:39,  9.13s/it]
                                                         
{'loss': '0.175', 'grad_norm': '3.584', 'learning_rate': '1.995e-05', 'epoch': '0.06138'}

  6%|▌         | 2330/37963 [5:39:58<90:20:39,  9.13s/it]
  6%|▌         | 2331/37963 [5:40:05<84:32:50,  8.54s/it]
  6%|▌         | 2332/37963 [5:40:12<81:29:17,  8.23s/it]
  6%|▌         | 2333/37963 [5:40:26<97:44:37,  9.88s/it]
  6%|▌         | 2334/37963 [5:40:34<91:22:03,  9.23s/it]
  6%|▌         | 2335/37963 [5:40:41<86:20:49,  8.72s/it]
  6%|▌         | 2336/37963 [5:40:55<102:04:30, 10.31s/it]
  6%|▌         | 2337/37963 [5:41:03<94:34:41,  9.56s/it] 
  6%|▌         | 2338/37963 [5:41:11<89:13:21,  9.02s/it]
  6%|▌         | 2339/37963 [5:41:25<104:32:31, 10.56s/it]
  6%|▌         | 2340/37963 [5:41:32<94:58:12,  9.60s/it] 
                                                         
{'loss': '0.181', 'grad_norm': '6.66', 'learning_rate': '1.995e-05', 'epoch': '0.06164'}

  6%|▌         | 2340/37963 [5:41:32<94:58:12,  9.60s/it]
  6%|▌         | 2341/37963 [5:41:40<88:55:07,  8.99s/it]
  6%|▌         | 2342/37963 [5:41:54<104:14:17, 10.53s/it]
  6%|▌         | 2343/37963 [5:42:02<95:46:46,  9.68s/it] 
  6%|▌         | 2344/37963 [5:42:09<89:28:30,  9.04s/it]
  6%|▌         | 2345/37963 [5:42:17<84:10:12,  8.51s/it]
  6%|▌         | 2346/37963 [5:42:24<80:54:25,  8.18s/it]
  6%|▌         | 2347/37963 [5:42:31<78:01:50,  7.89s/it]
  6%|▌         | 2348/37963 [5:42:39<77:00:26,  7.78s/it]
  6%|▌         | 2349/37963 [5:42:46<76:20:19,  7.72s/it]
  6%|▌         | 2350/37963 [5:42:54<75:57:10,  7.68s/it]
                                                         
{'loss': '0.1834', 'grad_norm': '4.494', 'learning_rate': '1.995e-05', 'epoch': '0.0619'}

  6%|▌         | 2350/37963 [5:42:54<75:57:10,  7.68s/it]
  6%|▌         | 2351/37963 [5:43:01<75:34:11,  7.64s/it]
  6%|▌         | 2352/37963 [5:43:09<75:46:31,  7.66s/it]
  6%|▌         | 2353/37963 [5:43:16<74:30:27,  7.53s/it]
  6%|▌         | 2354/37963 [5:43:24<73:54:58,  7.47s/it]
  6%|▌         | 2355/37963 [5:43:31<74:01:41,  7.48s/it]
  6%|▌         | 2356/37963 [5:43:45<93:18:28,  9.43s/it]
  6%|▌         | 2357/37963 [5:43:53<87:47:00,  8.88s/it]
  6%|▌         | 2358/37963 [5:44:00<83:41:28,  8.46s/it]
  6%|▌         | 2359/37963 [5:44:08<80:22:41,  8.13s/it]
  6%|▌         | 2360/37963 [5:44:15<78:32:44,  7.94s/it]
                                                         
{'loss': '0.1864', 'grad_norm': '2.929', 'learning_rate': '1.995e-05', 'epoch': '0.06217'}

  6%|▌         | 2360/37963 [5:44:15<78:32:44,  7.94s/it]
  6%|▌         | 2361/37963 [5:44:23<77:22:05,  7.82s/it]
  6%|▌         | 2362/37963 [5:44:30<76:36:41,  7.75s/it]
  6%|▌         | 2363/37963 [5:44:38<75:54:25,  7.68s/it]
  6%|▌         | 2364/37963 [5:44:45<76:02:42,  7.69s/it]
  6%|▌         | 2365/37963 [5:44:53<75:10:48,  7.60s/it]
  6%|▌         | 2366/37963 [5:45:07<93:46:24,  9.48s/it]
  6%|▌         | 2367/37963 [5:45:14<88:03:42,  8.91s/it]
  6%|▌         | 2368/37963 [5:45:22<83:31:28,  8.45s/it]
  6%|▌         | 2369/37963 [5:45:29<81:03:09,  8.20s/it]
  6%|▌         | 2370/37963 [5:45:37<78:36:23,  7.95s/it]
                                                         
{'loss': '0.1677', 'grad_norm': '4.522', 'learning_rate': '1.994e-05', 'epoch': '0.06243'}

  6%|▌         | 2370/37963 [5:45:37<78:36:23,  7.95s/it]
  6%|▌         | 2371/37963 [5:45:44<77:28:13,  7.84s/it]
  6%|▌         | 2372/37963 [5:45:58<95:18:15,  9.64s/it]
  6%|▋         | 2373/37963 [5:46:06<89:18:34,  9.03s/it]
  6%|▋         | 2374/37963 [5:46:13<84:44:47,  8.57s/it]
  6%|▋         | 2375/37963 [5:46:21<81:30:58,  8.25s/it]
  6%|▋         | 2376/37963 [5:46:28<79:33:53,  8.05s/it]
  6%|▋         | 2377/37963 [5:46:36<78:06:26,  7.90s/it]
  6%|▋         | 2378/37963 [5:46:43<77:04:45,  7.80s/it]
  6%|▋         | 2379/37963 [5:46:51<76:14:15,  7.71s/it]
  6%|▋         | 2380/37963 [5:46:58<75:39:30,  7.65s/it]
                                                         
{'loss': '0.1629', 'grad_norm': '4.142', 'learning_rate': '1.994e-05', 'epoch': '0.06269'}

  6%|▋         | 2380/37963 [5:46:58<75:39:30,  7.65s/it]
  6%|▋         | 2381/37963 [5:47:12<93:58:24,  9.51s/it]
  6%|▋         | 2382/37963 [5:47:26<107:40:58, 10.90s/it]
  6%|▋         | 2383/37963 [5:47:40<116:08:25, 11.75s/it]
  6%|▋         | 2384/37963 [5:47:48<103:24:12, 10.46s/it]
  6%|▋         | 2385/37963 [5:47:55<94:43:48,  9.59s/it] 
  6%|▋         | 2386/37963 [5:48:02<88:20:57,  8.94s/it]
  6%|▋         | 2387/37963 [5:48:16<102:35:33, 10.38s/it]
  6%|▋         | 2388/37963 [5:48:24<94:07:00,  9.52s/it] 
  6%|▋         | 2389/37963 [5:48:31<87:54:37,  8.90s/it]
  6%|▋         | 2390/37963 [5:48:39<83:52:01,  8.49s/it]
                                                         
{'loss': '0.1846', 'grad_norm': '6.123', 'learning_rate': '1.994e-05', 'epoch': '0.06296'}

  6%|▋         | 2390/37963 [5:48:39<83:52:01,  8.49s/it]
  6%|▋         | 2391/37963 [5:48:46<80:58:33,  8.20s/it]
  6%|▋         | 2392/37963 [5:49:00<98:18:37,  9.95s/it]
  6%|▋         | 2393/37963 [5:49:08<90:50:52,  9.19s/it]
  6%|▋         | 2394/37963 [5:49:15<86:14:00,  8.73s/it]
  6%|▋         | 2395/37963 [5:49:23<82:25:21,  8.34s/it]
  6%|▋         | 2396/37963 [5:49:30<80:02:29,  8.10s/it]
  6%|▋         | 2397/37963 [5:49:38<78:40:14,  7.96s/it]
  6%|▋         | 2398/37963 [5:49:46<77:34:36,  7.85s/it]
  6%|▋         | 2399/37963 [5:49:53<76:57:01,  7.79s/it]
  6%|▋         | 2400/37963 [5:50:01<76:55:17,  7.79s/it]
                                                         
{'loss': '0.1641', 'grad_norm': '3.535', 'learning_rate': '1.994e-05', 'epoch': '0.06322'}

  6%|▋         | 2400/37963 [5:50:01<76:55:17,  7.79s/it]
  6%|▋         | 2401/37963 [5:50:09<76:16:45,  7.72s/it]
  6%|▋         | 2402/37963 [5:50:23<95:19:15,  9.65s/it]
  6%|▋         | 2403/37963 [5:50:30<89:11:26,  9.03s/it]
  6%|▋         | 2404/37963 [5:50:38<84:44:24,  8.58s/it]
  6%|▋         | 2405/37963 [5:50:45<81:32:15,  8.26s/it]
  6%|▋         | 2406/37963 [5:50:53<79:17:22,  8.03s/it]
  6%|▋         | 2407/37963 [5:51:00<77:25:26,  7.84s/it]
  6%|▋         | 2408/37963 [5:51:08<76:49:35,  7.78s/it]
  6%|▋         | 2409/37963 [5:51:15<76:08:47,  7.71s/it]
  6%|▋         | 2410/37963 [5:51:23<75:28:11,  7.64s/it]
                                                         
{'loss': '0.1788', 'grad_norm': '1.779', 'learning_rate': '1.994e-05', 'epoch': '0.06348'}

  6%|▋         | 2410/37963 [5:51:23<75:28:11,  7.64s/it]
  6%|▋         | 2411/37963 [5:51:30<75:08:07,  7.61s/it]
  6%|▋         | 2412/37963 [5:51:38<74:16:27,  7.52s/it]
  6%|▋         | 2413/37963 [5:51:45<74:45:21,  7.57s/it]
  6%|▋         | 2414/37963 [5:51:53<74:50:06,  7.58s/it]
  6%|▋         | 2415/37963 [5:52:01<75:08:41,  7.61s/it]
  6%|▋         | 2416/37963 [5:52:15<93:54:15,  9.51s/it]
  6%|▋         | 2417/37963 [5:52:22<87:09:48,  8.83s/it]
  6%|▋         | 2418/37963 [5:52:29<83:09:23,  8.42s/it]
  6%|▋         | 2419/37963 [5:52:37<80:20:22,  8.14s/it]
  6%|▋         | 2420/37963 [5:52:51<98:26:25,  9.97s/it]
                                                         
{'loss': '0.1735', 'grad_norm': '1.536', 'learning_rate': '1.994e-05', 'epoch': '0.06375'}

  6%|▋         | 2420/37963 [5:52:51<98:26:25,  9.97s/it]
  6%|▋         | 2421/37963 [5:52:59<91:10:36,  9.24s/it]
  6%|▋         | 2422/37963 [5:53:06<86:11:21,  8.73s/it]
  6%|▋         | 2423/37963 [5:53:13<81:59:09,  8.30s/it]
  6%|▋         | 2424/37963 [5:53:21<79:30:49,  8.05s/it]
  6%|▋         | 2425/37963 [5:53:28<77:56:45,  7.90s/it]
  6%|▋         | 2426/37963 [5:53:49<114:51:52, 11.64s/it]
  6%|▋         | 2427/37963 [5:53:56<102:41:52, 10.40s/it]
  6%|▋         | 2428/37963 [5:54:04<94:11:57,  9.54s/it] 
  6%|▋         | 2429/37963 [5:54:11<88:16:16,  8.94s/it]
  6%|▋         | 2430/37963 [5:54:19<83:06:53,  8.42s/it]
                                                         
{'loss': '0.1704', 'grad_norm': '2.605', 'learning_rate': '1.994e-05', 'epoch': '0.06401'}

  6%|▋         | 2430/37963 [5:54:19<83:06:53,  8.42s/it]
  6%|▋         | 2431/37963 [5:54:33<99:48:07, 10.11s/it]
  6%|▋         | 2432/37963 [5:54:40<91:59:32,  9.32s/it]
  6%|▋         | 2433/37963 [5:54:48<86:52:43,  8.80s/it]
  6%|▋         | 2434/37963 [5:54:55<83:09:45,  8.43s/it]
  6%|▋         | 2435/37963 [5:55:03<79:53:17,  8.09s/it]
  6%|▋         | 2436/37963 [5:55:10<78:36:53,  7.97s/it]
  6%|▋         | 2437/37963 [5:55:18<77:16:03,  7.83s/it]
  6%|▋         | 2438/37963 [5:55:25<76:46:35,  7.78s/it]
  6%|▋         | 2439/37963 [5:55:33<75:57:33,  7.70s/it]
  6%|▋         | 2440/37963 [5:55:53<113:51:52, 11.54s/it]
                                                          
{'loss': '0.1842', 'grad_norm': '8.109', 'learning_rate': '1.994e-05', 'epoch': '0.06427'}

  6%|▋         | 2440/37963 [5:55:53<113:51:52, 11.54s/it]
  6%|▋         | 2441/37963 [5:56:01<102:03:30, 10.34s/it]
  6%|▋         | 2442/37963 [5:56:09<93:42:13,  9.50s/it] 
  6%|▋         | 2443/37963 [5:56:16<88:09:53,  8.94s/it]
  6%|▋         | 2444/37963 [5:56:24<84:33:57,  8.57s/it]
  6%|▋         | 2445/37963 [5:56:31<81:29:53,  8.26s/it]
  6%|▋         | 2446/37963 [5:56:39<78:50:56,  7.99s/it]
  6%|▋         | 2447/37963 [5:56:46<77:27:14,  7.85s/it]
  6%|▋         | 2448/37963 [5:56:54<76:47:40,  7.78s/it]
  6%|▋         | 2449/37963 [5:57:02<76:20:14,  7.74s/it]
  6%|▋         | 2450/37963 [5:57:09<75:49:10,  7.69s/it]
                                                         
{'loss': '0.1566', 'grad_norm': '2.279', 'learning_rate': '1.994e-05', 'epoch': '0.06454'}

  6%|▋         | 2450/37963 [5:57:09<75:49:10,  7.69s/it]
  6%|▋         | 2451/37963 [5:57:17<75:24:28,  7.64s/it]
  6%|▋         | 2452/37963 [5:57:24<74:56:22,  7.60s/it]
  6%|▋         | 2453/37963 [5:57:32<74:21:42,  7.54s/it]
  6%|▋         | 2454/37963 [5:57:39<74:21:13,  7.54s/it]
  6%|▋         | 2455/37963 [5:57:47<74:25:12,  7.55s/it]
  6%|▋         | 2456/37963 [5:58:01<94:07:55,  9.54s/it]
  6%|▋         | 2457/37963 [5:58:08<87:57:09,  8.92s/it]
  6%|▋         | 2458/37963 [5:58:16<83:52:09,  8.50s/it]
  6%|▋         | 2459/37963 [5:58:23<80:36:22,  8.17s/it]
  6%|▋         | 2460/37963 [5:58:30<77:38:54,  7.87s/it]
                                                         
{'loss': '0.1579', 'grad_norm': '2.299', 'learning_rate': '1.994e-05', 'epoch': '0.0648'}

  6%|▋         | 2460/37963 [5:58:30<77:38:54,  7.87s/it]
  6%|▋         | 2461/37963 [5:58:38<76:49:07,  7.79s/it]
  6%|▋         | 2462/37963 [5:58:45<75:34:27,  7.66s/it]
  6%|▋         | 2463/37963 [5:58:53<74:44:38,  7.58s/it]
  6%|▋         | 2464/37963 [5:59:07<93:40:24,  9.50s/it]
  6%|▋         | 2465/37963 [5:59:14<87:46:38,  8.90s/it]
  6%|▋         | 2466/37963 [5:59:22<84:00:51,  8.52s/it]
  6%|▋         | 2467/37963 [5:59:29<80:32:40,  8.17s/it]
  7%|▋         | 2468/37963 [5:59:37<78:33:10,  7.97s/it]
  7%|▋         | 2469/37963 [5:59:44<77:18:56,  7.84s/it]
  7%|▋         | 2470/37963 [5:59:58<95:45:56,  9.71s/it]
                                                         
{'loss': '0.1737', 'grad_norm': '2.229', 'learning_rate': '1.994e-05', 'epoch': '0.06506'}

  7%|▋         | 2470/37963 [5:59:58<95:45:56,  9.71s/it]
  7%|▋         | 2471/37963 [6:00:06<88:45:34,  9.00s/it]
  7%|▋         | 2472/37963 [6:00:20<103:33:46, 10.50s/it]
  7%|▋         | 2473/37963 [6:00:34<114:41:23, 11.63s/it]
  7%|▋         | 2474/37963 [6:00:42<102:39:44, 10.41s/it]
  7%|▋         | 2475/37963 [6:00:49<94:13:28,  9.56s/it] 
  7%|▋         | 2476/37963 [6:00:57<88:35:31,  8.99s/it]
  7%|▋         | 2477/37963 [6:01:04<83:40:41,  8.49s/it]
  7%|▋         | 2478/37963 [6:01:12<80:47:23,  8.20s/it]
  7%|▋         | 2479/37963 [6:01:26<98:03:22,  9.95s/it]
  7%|▋         | 2480/37963 [6:01:33<90:48:05,  9.21s/it]
                                                         
{'loss': '0.1861', 'grad_norm': '3.932', 'learning_rate': '1.993e-05', 'epoch': '0.06533'}

  7%|▋         | 2480/37963 [6:01:33<90:48:05,  9.21s/it]
  7%|▋         | 2481/37963 [6:01:41<86:20:01,  8.76s/it]
  7%|▋         | 2482/37963 [6:01:48<82:54:48,  8.41s/it]
  7%|▋         | 2483/37963 [6:01:56<80:38:27,  8.18s/it]
  7%|▋         | 2484/37963 [6:02:04<79:00:26,  8.02s/it]
  7%|▋         | 2485/37963 [6:02:11<77:32:09,  7.87s/it]
  7%|▋         | 2486/37963 [6:02:19<76:28:57,  7.76s/it]
  7%|▋         | 2487/37963 [6:02:33<94:52:15,  9.63s/it]
  7%|▋         | 2488/37963 [6:02:40<88:55:05,  9.02s/it]
  7%|▋         | 2489/37963 [6:02:48<84:26:39,  8.57s/it]
  7%|▋         | 2490/37963 [6:02:55<81:24:56,  8.26s/it]
                                                         
{'loss': '0.1828', 'grad_norm': '2.768', 'learning_rate': '1.993e-05', 'epoch': '0.06559'}

  7%|▋         | 2490/37963 [6:02:55<81:24:56,  8.26s/it]
  7%|▋         | 2491/37963 [6:03:03<78:26:33,  7.96s/it]
  7%|▋         | 2492/37963 [6:03:10<76:55:13,  7.81s/it]
  7%|▋         | 2493/37963 [6:03:18<75:36:50,  7.67s/it]
  7%|▋         | 2494/37963 [6:03:31<94:00:08,  9.54s/it]
  7%|▋         | 2495/37963 [6:03:39<88:07:37,  8.94s/it]
  7%|▋         | 2496/37963 [6:03:47<84:09:55,  8.54s/it]
  7%|▋         | 2497/37963 [6:03:54<81:04:54,  8.23s/it]
  7%|▋         | 2498/37963 [6:04:02<78:53:47,  8.01s/it]
  7%|▋         | 2499/37963 [6:04:09<76:45:27,  7.79s/it]
  7%|▋         | 2500/37963 [6:04:16<76:06:04,  7.73s/it]
                                                         
{'loss': '0.168', 'grad_norm': '5.352', 'learning_rate': '1.993e-05', 'epoch': '0.06585'}

  7%|▋         | 2500/37963 [6:04:16<76:06:04,  7.73s/it]
  7%|▋         | 2501/37963 [6:04:24<75:24:50,  7.66s/it]
  7%|▋         | 2502/37963 [6:04:31<75:03:05,  7.62s/it]
  7%|▋         | 2503/37963 [6:04:39<74:49:10,  7.60s/it]
  7%|▋         | 2504/37963 [6:04:53<94:14:41,  9.57s/it]
  7%|▋         | 2505/37963 [6:05:01<88:11:44,  8.95s/it]
  7%|▋         | 2506/37963 [6:05:08<83:57:59,  8.53s/it]
  7%|▋         | 2507/37963 [6:05:16<81:30:13,  8.28s/it]
  7%|▋         | 2508/37963 [6:05:23<78:55:17,  8.01s/it]
  7%|▋         | 2509/37963 [6:05:31<77:47:04,  7.90s/it]
  7%|▋         | 2510/37963 [6:05:38<76:39:02,  7.78s/it]
                                                         
{'loss': '0.1805', 'grad_norm': '4.078', 'learning_rate': '1.993e-05', 'epoch': '0.06612'}

  7%|▋         | 2510/37963 [6:05:38<76:39:02,  7.78s/it]
  7%|▋         | 2511/37963 [6:05:46<75:46:22,  7.69s/it]
  7%|▋         | 2512/37963 [6:05:53<74:59:14,  7.61s/it]
  7%|▋         | 2513/37963 [6:06:01<75:09:43,  7.63s/it]
  7%|▋         | 2514/37963 [6:06:09<74:53:45,  7.61s/it]
  7%|▋         | 2515/37963 [6:06:23<94:02:19,  9.55s/it]
  7%|▋         | 2516/37963 [6:06:30<88:31:43,  8.99s/it]
  7%|▋         | 2517/37963 [6:06:38<83:41:49,  8.50s/it]
  7%|▋         | 2518/37963 [6:06:45<81:25:22,  8.27s/it]
  7%|▋         | 2519/37963 [6:06:53<79:27:05,  8.07s/it]
  7%|▋         | 2520/37963 [6:07:13<115:48:42, 11.76s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '4.539', 'learning_rate': '1.993e-05', 'epoch': '0.06638'}

  7%|▋         | 2520/37963 [6:07:13<115:48:42, 11.76s/it]
  7%|▋         | 2521/37963 [6:07:27<121:40:07, 12.36s/it]
  7%|▋         | 2522/37963 [6:07:35<107:42:07, 10.94s/it]
  7%|▋         | 2523/37963 [6:07:42<97:52:30,  9.94s/it] 
  7%|▋         | 2524/37963 [6:07:50<90:49:19,  9.23s/it]
  7%|▋         | 2525/37963 [6:07:58<86:13:08,  8.76s/it]
  7%|▋         | 2526/37963 [6:08:12<101:25:01, 10.30s/it]
  7%|▋         | 2527/37963 [6:08:19<93:26:08,  9.49s/it] 
  7%|▋         | 2528/37963 [6:08:27<88:10:25,  8.96s/it]
  7%|▋         | 2529/37963 [6:08:34<84:00:06,  8.53s/it]
  7%|▋         | 2530/37963 [6:08:42<81:22:37,  8.27s/it]
                                                         
{'loss': '0.1843', 'grad_norm': '2.241', 'learning_rate': '1.993e-05', 'epoch': '0.06664'}

  7%|▋         | 2530/37963 [6:08:42<81:22:37,  8.27s/it]
  7%|▋         | 2531/37963 [6:08:56<98:27:18, 10.00s/it]
  7%|▋         | 2532/37963 [6:09:04<91:02:46,  9.25s/it]
  7%|▋         | 2533/37963 [6:09:11<86:15:49,  8.77s/it]
  7%|▋         | 2534/37963 [6:09:19<82:40:23,  8.40s/it]
  7%|▋         | 2535/37963 [6:09:26<80:13:29,  8.15s/it]
  7%|▋         | 2536/37963 [6:09:34<78:43:51,  8.00s/it]
  7%|▋         | 2537/37963 [6:09:42<77:22:19,  7.86s/it]
  7%|▋         | 2538/37963 [6:09:49<76:28:55,  7.77s/it]
  7%|▋         | 2539/37963 [6:09:57<76:10:42,  7.74s/it]
  7%|▋         | 2540/37963 [6:10:04<75:42:22,  7.69s/it]
                                                         
{'loss': '0.171', 'grad_norm': '2.169', 'learning_rate': '1.993e-05', 'epoch': '0.06691'}

  7%|▋         | 2540/37963 [6:10:04<75:42:22,  7.69s/it]
  7%|▋         | 2541/37963 [6:10:11<74:01:41,  7.52s/it]
  7%|▋         | 2542/37963 [6:10:19<74:00:32,  7.52s/it]
  7%|▋         | 2543/37963 [6:10:33<93:14:15,  9.48s/it]
  7%|▋         | 2544/37963 [6:10:41<87:28:09,  8.89s/it]
  7%|▋         | 2545/37963 [6:10:48<83:23:25,  8.48s/it]
  7%|▋         | 2546/37963 [6:10:56<80:52:07,  8.22s/it]
  7%|▋         | 2547/37963 [6:11:03<78:42:42,  8.00s/it]
  7%|▋         | 2548/37963 [6:11:11<77:46:34,  7.91s/it]
  7%|▋         | 2549/37963 [6:11:18<76:51:56,  7.81s/it]
  7%|▋         | 2550/37963 [6:11:26<76:25:37,  7.77s/it]
                                                         
{'loss': '0.1574', 'grad_norm': '1.421', 'learning_rate': '1.993e-05', 'epoch': '0.06717'}

  7%|▋         | 2550/37963 [6:11:26<76:25:37,  7.77s/it]
  7%|▋         | 2551/37963 [6:11:40<95:04:12,  9.66s/it]
  7%|▋         | 2552/37963 [6:11:48<89:06:45,  9.06s/it]
  7%|▋         | 2553/37963 [6:11:55<83:42:00,  8.51s/it]
  7%|▋         | 2554/37963 [6:12:02<80:10:30,  8.15s/it]
  7%|▋         | 2555/37963 [6:12:10<78:30:03,  7.98s/it]
  7%|▋         | 2556/37963 [6:12:18<77:36:36,  7.89s/it]
  7%|▋         | 2557/37963 [6:12:25<76:58:02,  7.83s/it]
  7%|▋         | 2558/37963 [6:12:33<76:02:16,  7.73s/it]
  7%|▋         | 2559/37963 [6:12:41<75:57:27,  7.72s/it]
  7%|▋         | 2560/37963 [6:12:48<75:47:55,  7.71s/it]
                                                         
{'loss': '0.189', 'grad_norm': '1.367', 'learning_rate': '1.993e-05', 'epoch': '0.06743'}

  7%|▋         | 2560/37963 [6:12:48<75:47:55,  7.71s/it]
  7%|▋         | 2561/37963 [6:12:56<76:13:44,  7.75s/it]
  7%|▋         | 2562/37963 [6:13:10<94:34:56,  9.62s/it]
  7%|▋         | 2563/37963 [6:13:18<88:26:47,  8.99s/it]
  7%|▋         | 2564/37963 [6:13:32<103:07:11, 10.49s/it]
  7%|▋         | 2565/37963 [6:13:39<95:24:51,  9.70s/it] 
  7%|▋         | 2566/37963 [6:13:47<88:09:33,  8.97s/it]
  7%|▋         | 2567/37963 [6:13:54<83:37:32,  8.51s/it]
  7%|▋         | 2568/37963 [6:14:02<80:37:02,  8.20s/it]
  7%|▋         | 2569/37963 [6:14:09<78:35:31,  7.99s/it]
  7%|▋         | 2570/37963 [6:14:23<96:04:42,  9.77s/it]
                                                         
{'loss': '0.185', 'grad_norm': '6.134', 'learning_rate': '1.993e-05', 'epoch': '0.0677'}

  7%|▋         | 2570/37963 [6:14:23<96:04:42,  9.77s/it]
  7%|▋         | 2571/37963 [6:14:37<107:19:58, 10.92s/it]
  7%|▋         | 2572/37963 [6:14:44<96:37:03,  9.83s/it] 
  7%|▋         | 2573/37963 [6:14:51<89:45:13,  9.13s/it]
  7%|▋         | 2574/37963 [6:14:59<84:50:30,  8.63s/it]
  7%|▋         | 2575/37963 [6:15:06<81:42:09,  8.31s/it]
  7%|▋         | 2576/37963 [6:15:14<78:48:47,  8.02s/it]
  7%|▋         | 2577/37963 [6:15:28<96:42:36,  9.84s/it]
  7%|▋         | 2578/37963 [6:15:35<89:47:45,  9.14s/it]
  7%|▋         | 2579/37963 [6:15:49<103:26:54, 10.52s/it]
  7%|▋         | 2580/37963 [6:15:56<94:05:46,  9.57s/it] 
                                                         
{'loss': '0.1774', 'grad_norm': '2.793', 'learning_rate': '1.992e-05', 'epoch': '0.06796'}

  7%|▋         | 2580/37963 [6:15:56<94:05:46,  9.57s/it]
  7%|▋         | 2581/37963 [6:16:04<87:19:30,  8.89s/it]
  7%|▋         | 2582/37963 [6:16:11<82:41:14,  8.41s/it]
  7%|▋         | 2583/37963 [6:16:19<80:19:29,  8.17s/it]
  7%|▋         | 2584/37963 [6:16:26<78:33:40,  7.99s/it]
  7%|▋         | 2585/37963 [6:16:34<77:21:27,  7.87s/it]
  7%|▋         | 2586/37963 [6:16:41<76:22:10,  7.77s/it]
  7%|▋         | 2587/37963 [6:16:49<75:47:32,  7.71s/it]
  7%|▋         | 2588/37963 [6:16:57<75:26:17,  7.68s/it]
  7%|▋         | 2589/37963 [6:17:04<74:42:59,  7.60s/it]
  7%|▋         | 2590/37963 [6:17:12<75:08:05,  7.65s/it]
                                                         
{'loss': '0.188', 'grad_norm': '2.68', 'learning_rate': '1.992e-05', 'epoch': '0.06822'}

  7%|▋         | 2590/37963 [6:17:12<75:08:05,  7.65s/it]
  7%|▋         | 2591/37963 [6:17:26<93:46:15,  9.54s/it]
  7%|▋         | 2592/37963 [6:17:33<87:35:14,  8.91s/it]
  7%|▋         | 2593/37963 [6:17:41<83:01:32,  8.45s/it]
  7%|▋         | 2594/37963 [6:17:48<79:41:24,  8.11s/it]
  7%|▋         | 2595/37963 [6:18:02<97:00:18,  9.87s/it]
  7%|▋         | 2596/37963 [6:18:09<89:57:23,  9.16s/it]
  7%|▋         | 2597/37963 [6:18:17<85:28:34,  8.70s/it]
  7%|▋         | 2598/37963 [6:18:24<82:05:19,  8.36s/it]
  7%|▋         | 2599/37963 [6:18:32<79:47:55,  8.12s/it]
  7%|▋         | 2600/37963 [6:18:39<77:23:04,  7.88s/it]
                                                         
{'loss': '0.1753', 'grad_norm': '4.324', 'learning_rate': '1.992e-05', 'epoch': '0.06849'}

  7%|▋         | 2600/37963 [6:18:39<77:23:04,  7.88s/it]
  7%|▋         | 2601/37963 [6:18:47<76:02:28,  7.74s/it]
  7%|▋         | 2602/37963 [6:18:54<75:32:19,  7.69s/it]
  7%|▋         | 2603/37963 [6:19:02<75:00:42,  7.64s/it]
  7%|▋         | 2604/37963 [6:19:09<74:15:32,  7.56s/it]
  7%|▋         | 2605/37963 [6:19:17<74:13:57,  7.56s/it]
  7%|▋         | 2606/37963 [6:19:24<74:20:48,  7.57s/it]
  7%|▋         | 2607/37963 [6:19:32<73:25:59,  7.48s/it]
  7%|▋         | 2608/37963 [6:19:39<73:49:52,  7.52s/it]
  7%|▋         | 2609/37963 [6:19:47<74:12:02,  7.56s/it]
  7%|▋         | 2610/37963 [6:19:55<74:17:06,  7.56s/it]
                                                         
{'loss': '0.1765', 'grad_norm': '4.831', 'learning_rate': '1.992e-05', 'epoch': '0.06875'}

  7%|▋         | 2610/37963 [6:19:55<74:17:06,  7.56s/it]
  7%|▋         | 2611/37963 [6:20:15<112:30:42, 11.46s/it]
  7%|▋         | 2612/37963 [6:20:23<101:04:18, 10.29s/it]
  7%|▋         | 2613/37963 [6:20:30<92:16:36,  9.40s/it] 
  7%|▋         | 2614/37963 [6:20:37<85:54:36,  8.75s/it]
  7%|▋         | 2615/37963 [6:20:44<80:36:57,  8.21s/it]
  7%|▋         | 2616/37963 [6:20:52<78:32:59,  8.00s/it]
  7%|▋         | 2617/37963 [6:20:59<76:37:02,  7.80s/it]
  7%|▋         | 2618/37963 [6:21:13<95:55:19,  9.77s/it]
  7%|▋         | 2619/37963 [6:21:21<89:24:09,  9.11s/it]
  7%|▋         | 2620/37963 [6:21:28<84:46:16,  8.63s/it]
                                                         
{'loss': '0.1819', 'grad_norm': '2.9', 'learning_rate': '1.992e-05', 'epoch': '0.06901'}

  7%|▋         | 2620/37963 [6:21:28<84:46:16,  8.63s/it]
  7%|▋         | 2621/37963 [6:21:43<100:45:05, 10.26s/it]
  7%|▋         | 2622/37963 [6:21:50<92:00:07,  9.37s/it] 
  7%|▋         | 2623/37963 [6:22:04<105:32:03, 10.75s/it]
  7%|▋         | 2624/37963 [6:22:18<114:47:24, 11.69s/it]
  7%|▋         | 2625/37963 [6:22:25<102:40:52, 10.46s/it]
  7%|▋         | 2626/37963 [6:22:33<93:58:00,  9.57s/it] 
  7%|▋         | 2627/37963 [6:22:40<88:04:57,  8.97s/it]
  7%|▋         | 2628/37963 [6:22:48<83:17:44,  8.49s/it]
  7%|▋         | 2629/37963 [6:22:55<80:17:45,  8.18s/it]
  7%|▋         | 2630/37963 [6:23:03<78:24:34,  7.99s/it]
                                                         
{'loss': '0.1656', 'grad_norm': '4.91', 'learning_rate': '1.992e-05', 'epoch': '0.06928'}

  7%|▋         | 2630/37963 [6:23:03<78:24:34,  7.99s/it]
  7%|▋         | 2631/37963 [6:23:10<77:22:40,  7.88s/it]
  7%|▋         | 2632/37963 [6:23:18<75:43:12,  7.72s/it]
  7%|▋         | 2633/37963 [6:23:25<74:25:00,  7.58s/it]
  7%|▋         | 2634/37963 [6:23:32<73:11:36,  7.46s/it]
  7%|▋         | 2635/37963 [6:23:40<73:32:48,  7.49s/it]
  7%|▋         | 2636/37963 [6:23:47<73:44:04,  7.51s/it]
  7%|▋         | 2637/37963 [6:23:54<72:55:55,  7.43s/it]
  7%|▋         | 2638/37963 [6:24:02<73:09:53,  7.46s/it]
  7%|▋         | 2639/37963 [6:24:16<91:57:11,  9.37s/it]
  7%|▋         | 2640/37963 [6:24:23<86:33:45,  8.82s/it]
                                                         
{'loss': '0.1681', 'grad_norm': '2.132', 'learning_rate': '1.992e-05', 'epoch': '0.06954'}

  7%|▋         | 2640/37963 [6:24:23<86:33:45,  8.82s/it]
  7%|▋         | 2641/37963 [6:24:31<82:51:21,  8.44s/it]
  7%|▋         | 2642/37963 [6:24:44<97:37:44,  9.95s/it]
  7%|▋         | 2643/37963 [6:24:52<90:39:49,  9.24s/it]
  7%|▋         | 2644/37963 [6:24:59<85:01:07,  8.67s/it]
  7%|▋         | 2645/37963 [6:25:06<80:41:31,  8.23s/it]
  7%|▋         | 2646/37963 [6:25:14<78:43:38,  8.02s/it]
  7%|▋         | 2647/37963 [6:25:21<76:49:19,  7.83s/it]
  7%|▋         | 2648/37963 [6:25:29<75:59:11,  7.75s/it]
  7%|▋         | 2649/37963 [6:25:37<75:27:19,  7.69s/it]
  7%|▋         | 2650/37963 [6:25:44<73:48:52,  7.53s/it]
                                                         
{'loss': '0.1665', 'grad_norm': '1.614', 'learning_rate': '1.992e-05', 'epoch': '0.06981'}

  7%|▋         | 2650/37963 [6:25:44<73:48:52,  7.53s/it]
  7%|▋         | 2651/37963 [6:25:51<73:37:48,  7.51s/it]
  7%|▋         | 2652/37963 [6:25:59<73:54:12,  7.53s/it]
  7%|▋         | 2653/37963 [6:26:06<74:01:58,  7.55s/it]
  7%|▋         | 2654/37963 [6:26:14<74:05:31,  7.55s/it]
  7%|▋         | 2655/37963 [6:26:21<73:58:19,  7.54s/it]
  7%|▋         | 2656/37963 [6:26:29<73:41:40,  7.51s/it]
  7%|▋         | 2657/37963 [6:26:36<74:04:27,  7.55s/it]
  7%|▋         | 2658/37963 [6:26:44<74:12:36,  7.57s/it]
  7%|▋         | 2659/37963 [6:26:52<74:11:00,  7.56s/it]
  7%|▋         | 2660/37963 [6:26:59<74:07:14,  7.56s/it]
                                                         
{'loss': '0.1699', 'grad_norm': '4.523', 'learning_rate': '1.992e-05', 'epoch': '0.07007'}

  7%|▋         | 2660/37963 [6:26:59<74:07:14,  7.56s/it]
  7%|▋         | 2661/37963 [6:27:13<93:48:02,  9.57s/it]
  7%|▋         | 2662/37963 [6:27:27<106:29:09, 10.86s/it]
  7%|▋         | 2663/37963 [6:27:35<96:43:34,  9.86s/it] 
  7%|▋         | 2664/37963 [6:27:42<89:04:26,  9.08s/it]
  7%|▋         | 2665/37963 [6:27:50<84:36:31,  8.63s/it]
  7%|▋         | 2666/37963 [6:27:57<81:16:12,  8.29s/it]
  7%|▋         | 2667/37963 [6:28:05<78:44:32,  8.03s/it]
  7%|▋         | 2668/37963 [6:28:25<116:10:39, 11.85s/it]
  7%|▋         | 2669/37963 [6:28:40<122:57:16, 12.54s/it]
  7%|▋         | 2670/37963 [6:28:47<108:09:57, 11.03s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '6.2', 'learning_rate': '1.991e-05', 'epoch': '0.07033'}

  7%|▋         | 2670/37963 [6:28:47<108:09:57, 11.03s/it]
  7%|▋         | 2671/37963 [6:28:55<98:13:42, 10.02s/it] 
  7%|▋         | 2672/37963 [6:29:02<90:42:31,  9.25s/it]
  7%|▋         | 2673/37963 [6:29:16<103:32:46, 10.56s/it]
  7%|▋         | 2674/37963 [6:29:23<95:02:59,  9.70s/it] 
  7%|▋         | 2675/37963 [6:29:31<88:24:23,  9.02s/it]
  7%|▋         | 2676/37963 [6:29:38<83:59:54,  8.57s/it]
  7%|▋         | 2677/37963 [6:29:46<80:09:07,  8.18s/it]
  7%|▋         | 2678/37963 [6:29:53<77:52:12,  7.94s/it]
  7%|▋         | 2679/37963 [6:30:01<78:23:58,  8.00s/it]
  7%|▋         | 2680/37963 [6:30:09<78:00:58,  7.96s/it]
                                                         
{'loss': '0.1583', 'grad_norm': '2.929', 'learning_rate': '1.991e-05', 'epoch': '0.0706'}

  7%|▋         | 2680/37963 [6:30:09<78:00:58,  7.96s/it]
  7%|▋         | 2681/37963 [6:30:16<76:09:32,  7.77s/it]
  7%|▋         | 2682/37963 [6:30:24<75:50:31,  7.74s/it]
  7%|▋         | 2683/37963 [6:30:32<75:17:24,  7.68s/it]
  7%|▋         | 2684/37963 [6:30:39<74:57:16,  7.65s/it]
  7%|▋         | 2685/37963 [6:30:47<75:12:12,  7.67s/it]
  7%|▋         | 2686/37963 [6:30:55<74:59:23,  7.65s/it]
  7%|▋         | 2687/37963 [6:31:09<94:17:49,  9.62s/it]
  7%|▋         | 2688/37963 [6:31:16<88:21:35,  9.02s/it]
  7%|▋         | 2689/37963 [6:31:24<84:43:08,  8.65s/it]
  7%|▋         | 2690/37963 [6:31:38<99:46:17, 10.18s/it]
                                                         
{'loss': '0.1775', 'grad_norm': '2.918', 'learning_rate': '1.991e-05', 'epoch': '0.07086'}

  7%|▋         | 2690/37963 [6:31:38<99:46:17, 10.18s/it]
  7%|▋         | 2691/37963 [6:31:45<90:43:56,  9.26s/it]
  7%|▋         | 2692/37963 [6:31:52<84:30:05,  8.62s/it]
  7%|▋         | 2693/37963 [6:32:00<82:32:10,  8.42s/it]
  7%|▋         | 2694/37963 [6:32:08<79:54:51,  8.16s/it]
  7%|▋         | 2695/37963 [6:32:15<78:05:30,  7.97s/it]
  7%|▋         | 2696/37963 [6:32:22<75:54:25,  7.75s/it]
  7%|▋         | 2697/37963 [6:32:30<75:20:26,  7.69s/it]
  7%|▋         | 2698/37963 [6:32:38<76:00:16,  7.76s/it]
  7%|▋         | 2699/37963 [6:32:45<74:59:31,  7.66s/it]
  7%|▋         | 2700/37963 [6:32:53<76:11:08,  7.78s/it]
                                                         
{'loss': '0.1818', 'grad_norm': '2.848', 'learning_rate': '1.991e-05', 'epoch': '0.07112'}

  7%|▋         | 2700/37963 [6:32:53<76:11:08,  7.78s/it]
  7%|▋         | 2701/37963 [6:33:01<74:39:48,  7.62s/it]
  7%|▋         | 2702/37963 [6:33:08<74:52:30,  7.64s/it]
  7%|▋         | 2703/37963 [6:33:16<74:15:57,  7.58s/it]
  7%|▋         | 2704/37963 [6:33:23<74:01:24,  7.56s/it]
  7%|▋         | 2705/37963 [6:33:31<75:12:35,  7.68s/it]
  7%|▋         | 2706/37963 [6:33:39<74:47:39,  7.64s/it]
  7%|▋         | 2707/37963 [6:33:53<93:36:30,  9.56s/it]
  7%|▋         | 2708/37963 [6:34:00<87:49:18,  8.97s/it]
  7%|▋         | 2709/37963 [6:34:09<85:34:16,  8.74s/it]
  7%|▋         | 2710/37963 [6:34:22<100:29:24, 10.26s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '1.827', 'learning_rate': '1.991e-05', 'epoch': '0.07139'}

  7%|▋         | 2710/37963 [6:34:22<100:29:24, 10.26s/it]
  7%|▋         | 2711/37963 [6:34:30<92:28:36,  9.44s/it] 
  7%|▋         | 2712/37963 [6:34:38<86:58:15,  8.88s/it]
  7%|▋         | 2713/37963 [6:34:46<84:39:00,  8.65s/it]
  7%|▋         | 2714/37963 [6:34:53<81:09:54,  8.29s/it]
  7%|▋         | 2715/37963 [6:35:01<79:01:08,  8.07s/it]
  7%|▋         | 2716/37963 [6:35:08<76:53:15,  7.85s/it]
  7%|▋         | 2717/37963 [6:35:23<96:49:55,  9.89s/it]
  7%|▋         | 2718/37963 [6:35:30<89:40:03,  9.16s/it]
  7%|▋         | 2719/37963 [6:35:37<84:23:25,  8.62s/it]
  7%|▋         | 2720/37963 [6:35:51<99:00:02, 10.11s/it]
                                                         
{'loss': '0.1813', 'grad_norm': '3.845', 'learning_rate': '1.991e-05', 'epoch': '0.07165'}

  7%|▋         | 2720/37963 [6:35:51<99:00:02, 10.11s/it]
  7%|▋         | 2721/37963 [6:35:59<92:53:31,  9.49s/it]
  7%|▋         | 2722/37963 [6:36:13<105:51:22, 10.81s/it]
  7%|▋         | 2723/37963 [6:36:27<115:45:06, 11.82s/it]
  7%|▋         | 2724/37963 [6:36:35<105:03:20, 10.73s/it]
  7%|▋         | 2725/37963 [6:36:42<94:33:11,  9.66s/it] 
  7%|▋         | 2726/37963 [6:36:50<87:16:41,  8.92s/it]
  7%|▋         | 2727/37963 [6:36:57<83:07:43,  8.49s/it]
  7%|▋         | 2728/37963 [6:37:05<80:15:59,  8.20s/it]
  7%|▋         | 2729/37963 [6:37:13<79:24:10,  8.11s/it]
  7%|▋         | 2730/37963 [6:37:27<96:31:56,  9.86s/it]
                                                         
{'loss': '0.1893', 'grad_norm': '2.342', 'learning_rate': '1.991e-05', 'epoch': '0.07191'}

  7%|▋         | 2730/37963 [6:37:27<96:31:56,  9.86s/it]
  7%|▋         | 2731/37963 [6:37:34<89:41:09,  9.16s/it]
  7%|▋         | 2732/37963 [6:37:42<85:30:30,  8.74s/it]
  7%|▋         | 2733/37963 [6:37:50<84:59:52,  8.69s/it]
  7%|▋         | 2734/37963 [6:37:58<81:47:47,  8.36s/it]
  7%|▋         | 2735/37963 [6:38:06<79:23:23,  8.11s/it]
  7%|▋         | 2736/37963 [6:38:13<77:55:47,  7.96s/it]
  7%|▋         | 2737/37963 [6:38:21<77:06:35,  7.88s/it]
  7%|▋         | 2738/37963 [6:38:35<94:45:30,  9.68s/it]
  7%|▋         | 2739/37963 [6:38:42<88:28:43,  9.04s/it]
  7%|▋         | 2740/37963 [6:38:50<84:18:37,  8.62s/it]
                                                         
{'loss': '0.1755', 'grad_norm': '2.96', 'learning_rate': '1.991e-05', 'epoch': '0.07218'}

  7%|▋         | 2740/37963 [6:38:50<84:18:37,  8.62s/it]
  7%|▋         | 2741/37963 [6:38:57<80:22:36,  8.22s/it]
  7%|▋         | 2742/37963 [6:39:05<79:44:32,  8.15s/it]
  7%|▋         | 2743/37963 [6:39:13<78:21:57,  8.01s/it]
  7%|▋         | 2744/37963 [6:39:20<76:47:30,  7.85s/it]
  7%|▋         | 2745/37963 [6:39:28<75:56:27,  7.76s/it]
  7%|▋         | 2746/37963 [6:39:35<75:18:51,  7.70s/it]
  7%|▋         | 2747/37963 [6:39:44<76:28:05,  7.82s/it]
  7%|▋         | 2748/37963 [6:39:51<75:30:51,  7.72s/it]
  7%|▋         | 2749/37963 [6:39:59<74:49:22,  7.65s/it]
  7%|▋         | 2750/37963 [6:40:06<74:16:24,  7.59s/it]
                                                         
{'loss': '0.1756', 'grad_norm': '5.454', 'learning_rate': '1.991e-05', 'epoch': '0.07244'}

  7%|▋         | 2750/37963 [6:40:06<74:16:24,  7.59s/it]
  7%|▋         | 2751/37963 [6:40:13<73:59:25,  7.56s/it]
  7%|▋         | 2752/37963 [6:40:21<75:09:40,  7.68s/it]
  7%|▋         | 2753/37963 [6:40:29<74:45:46,  7.64s/it]
  7%|▋         | 2754/37963 [6:40:37<74:24:24,  7.61s/it]
  7%|▋         | 2755/37963 [6:40:44<73:37:03,  7.53s/it]
  7%|▋         | 2756/37963 [6:40:51<73:34:21,  7.52s/it]
  7%|▋         | 2757/37963 [6:41:06<94:45:58,  9.69s/it]
  7%|▋         | 2758/37963 [6:41:14<88:08:07,  9.01s/it]
  7%|▋         | 2759/37963 [6:41:28<103:00:27, 10.53s/it]
  7%|▋         | 2760/37963 [6:41:36<95:36:53,  9.78s/it] 
                                                         
{'loss': '0.1755', 'grad_norm': '3.901', 'learning_rate': '1.99e-05', 'epoch': '0.0727'}

  7%|▋         | 2760/37963 [6:41:36<95:36:53,  9.78s/it]
  7%|▋         | 2761/37963 [6:41:50<108:13:05, 11.07s/it]
  7%|▋         | 2762/37963 [6:41:57<97:50:57, 10.01s/it] 
  7%|▋         | 2763/37963 [6:42:04<89:42:41,  9.18s/it]
  7%|▋         | 2764/37963 [6:42:13<87:00:07,  8.90s/it]
  7%|▋         | 2765/37963 [6:42:20<83:20:12,  8.52s/it]
  7%|▋         | 2766/37963 [6:42:28<80:27:08,  8.23s/it]
  7%|▋         | 2767/37963 [6:42:42<98:02:30, 10.03s/it]
  7%|▋         | 2768/37963 [6:42:50<92:18:54,  9.44s/it]
  7%|▋         | 2769/37963 [6:42:58<86:30:52,  8.85s/it]
  7%|▋         | 2770/37963 [6:43:05<82:34:53,  8.45s/it]
                                                         
{'loss': '0.1676', 'grad_norm': '2.857', 'learning_rate': '1.99e-05', 'epoch': '0.07297'}

  7%|▋         | 2770/37963 [6:43:05<82:34:53,  8.45s/it]
  7%|▋         | 2771/37963 [6:43:26<118:16:19, 12.10s/it]
  7%|▋         | 2772/37963 [6:43:33<104:15:57, 10.67s/it]
  7%|▋         | 2773/37963 [6:43:41<94:59:39,  9.72s/it] 
  7%|▋         | 2774/37963 [6:43:55<108:25:25, 11.09s/it]
  7%|▋         | 2775/37963 [6:44:03<99:16:18, 10.16s/it] 
  7%|▋         | 2776/37963 [6:44:10<91:20:33,  9.35s/it]
  7%|▋         | 2777/37963 [6:44:18<85:47:39,  8.78s/it]
  7%|▋         | 2778/37963 [6:44:25<82:07:54,  8.40s/it]
  7%|▋         | 2779/37963 [6:44:33<78:50:38,  8.07s/it]
  7%|▋         | 2780/37963 [6:44:41<78:47:12,  8.06s/it]
                                                         
{'loss': '0.1669', 'grad_norm': '2.866', 'learning_rate': '1.99e-05', 'epoch': '0.07323'}

  7%|▋         | 2780/37963 [6:44:41<78:47:12,  8.06s/it]
  7%|▋         | 2781/37963 [6:44:48<77:40:03,  7.95s/it]
  7%|▋         | 2782/37963 [6:44:56<76:27:10,  7.82s/it]
  7%|▋         | 2783/37963 [6:45:03<75:03:29,  7.68s/it]
  7%|▋         | 2784/37963 [6:45:11<74:21:41,  7.61s/it]
  7%|▋         | 2785/37963 [6:45:19<77:05:59,  7.89s/it]
  7%|▋         | 2786/37963 [6:45:27<76:21:24,  7.81s/it]
  7%|▋         | 2787/37963 [6:45:41<94:06:12,  9.63s/it]
  7%|▋         | 2788/37963 [6:45:48<87:58:51,  9.00s/it]
  7%|▋         | 2789/37963 [6:45:56<84:31:33,  8.65s/it]
  7%|▋         | 2790/37963 [6:46:04<81:18:07,  8.32s/it]
                                                         
{'loss': '0.1714', 'grad_norm': '4.987', 'learning_rate': '1.99e-05', 'epoch': '0.07349'}

  7%|▋         | 2790/37963 [6:46:04<81:18:07,  8.32s/it]
  7%|▋         | 2791/37963 [6:46:11<79:20:32,  8.12s/it]
  7%|▋         | 2792/37963 [6:46:19<78:20:30,  8.02s/it]
  7%|▋         | 2793/37963 [6:46:27<76:52:01,  7.87s/it]
  7%|▋         | 2794/37963 [6:46:35<77:19:45,  7.92s/it]
  7%|▋         | 2795/37963 [6:46:42<76:19:03,  7.81s/it]
  7%|▋         | 2796/37963 [6:46:50<75:10:04,  7.69s/it]
  7%|▋         | 2797/37963 [6:46:57<74:40:51,  7.65s/it]
  7%|▋         | 2798/37963 [6:47:04<73:38:02,  7.54s/it]
  7%|▋         | 2799/37963 [6:47:13<75:26:53,  7.72s/it]
  7%|▋         | 2800/37963 [6:47:20<75:33:35,  7.74s/it]
                                                         
{'loss': '0.1783', 'grad_norm': '6.113', 'learning_rate': '1.99e-05', 'epoch': '0.07376'}

  7%|▋         | 2800/37963 [6:47:20<75:33:35,  7.74s/it]
  7%|▋         | 2801/37963 [6:47:28<74:54:39,  7.67s/it]
  7%|▋         | 2802/37963 [6:47:35<73:39:56,  7.54s/it]
  7%|▋         | 2803/37963 [6:47:43<73:54:01,  7.57s/it]
  7%|▋         | 2804/37963 [6:47:51<75:22:54,  7.72s/it]
  7%|▋         | 2805/37963 [6:48:04<92:49:02,  9.50s/it]
  7%|▋         | 2806/37963 [6:48:12<87:12:29,  8.93s/it]
  7%|▋         | 2807/37963 [6:48:19<82:45:33,  8.47s/it]
  7%|▋         | 2808/37963 [6:48:27<81:03:54,  8.30s/it]
  7%|▋         | 2809/37963 [6:48:42<98:58:51, 10.14s/it]
  7%|▋         | 2810/37963 [6:48:56<110:14:47, 11.29s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.938', 'learning_rate': '1.99e-05', 'epoch': '0.07402'}

  7%|▋         | 2810/37963 [6:48:56<110:14:47, 11.29s/it]
  7%|▋         | 2811/37963 [6:49:03<99:14:13, 10.16s/it] 
  7%|▋         | 2812/37963 [6:49:11<93:22:47,  9.56s/it]
  7%|▋         | 2813/37963 [6:49:19<87:07:48,  8.92s/it]
  7%|▋         | 2814/37963 [6:49:26<83:08:41,  8.52s/it]
  7%|▋         | 2815/37963 [6:49:41<99:25:46, 10.18s/it]
  7%|▋         | 2816/37963 [6:49:49<93:29:54,  9.58s/it]
  7%|▋         | 2817/37963 [6:49:56<87:37:17,  8.98s/it]
  7%|▋         | 2818/37963 [6:50:10<101:29:39, 10.40s/it]
  7%|▋         | 2819/37963 [6:50:25<113:37:52, 11.64s/it]
  7%|▋         | 2820/37963 [6:50:32<101:19:37, 10.38s/it]
                                                          
{'loss': '0.1693', 'grad_norm': '3.033', 'learning_rate': '1.99e-05', 'epoch': '0.07428'}

  7%|▋         | 2820/37963 [6:50:32<101:19:37, 10.38s/it]
  7%|▋         | 2821/37963 [6:50:46<111:51:35, 11.46s/it]
  7%|▋         | 2822/37963 [6:50:53<100:20:06, 10.28s/it]
  7%|▋         | 2823/37963 [6:51:02<94:24:09,  9.67s/it] 
  7%|▋         | 2824/37963 [6:51:09<88:09:43,  9.03s/it]
  7%|▋         | 2825/37963 [6:51:17<83:52:38,  8.59s/it]
  7%|▋         | 2826/37963 [6:51:25<81:05:59,  8.31s/it]
  7%|▋         | 2827/37963 [6:51:32<78:14:02,  8.02s/it]
  7%|▋         | 2828/37963 [6:51:40<78:05:07,  8.00s/it]
  7%|▋         | 2829/37963 [6:51:47<76:40:06,  7.86s/it]
  7%|▋         | 2830/37963 [6:51:55<75:53:42,  7.78s/it]
                                                         
{'loss': '0.1884', 'grad_norm': '5.922', 'learning_rate': '1.99e-05', 'epoch': '0.07455'}

  7%|▋         | 2830/37963 [6:51:55<75:53:42,  7.78s/it]
  7%|▋         | 2831/37963 [6:52:03<75:30:40,  7.74s/it]
  7%|▋         | 2832/37963 [6:52:10<75:16:36,  7.71s/it]
  7%|▋         | 2833/37963 [6:52:18<76:13:37,  7.81s/it]
  7%|▋         | 2834/37963 [6:52:26<74:57:53,  7.68s/it]
  7%|▋         | 2835/37963 [6:52:33<74:48:32,  7.67s/it]
  7%|▋         | 2836/37963 [6:52:47<93:58:45,  9.63s/it]
  7%|▋         | 2837/37963 [6:52:55<87:42:24,  8.99s/it]
  7%|▋         | 2838/37963 [6:53:03<83:40:15,  8.58s/it]
  7%|▋         | 2839/37963 [6:53:10<80:45:32,  8.28s/it]
  7%|▋         | 2840/37963 [6:53:17<77:58:33,  7.99s/it]
                                                         
{'loss': '0.1759', 'grad_norm': '3.625', 'learning_rate': '1.99e-05', 'epoch': '0.07481'}

  7%|▋         | 2840/37963 [6:53:17<77:58:33,  7.99s/it]
  7%|▋         | 2841/37963 [6:53:25<77:10:58,  7.91s/it]
  7%|▋         | 2842/37963 [6:53:33<75:35:24,  7.75s/it]
  7%|▋         | 2843/37963 [6:53:40<73:53:37,  7.57s/it]
  7%|▋         | 2844/37963 [6:53:47<73:52:02,  7.57s/it]
  7%|▋         | 2845/37963 [6:53:55<73:42:39,  7.56s/it]
  7%|▋         | 2846/37963 [6:54:03<75:12:35,  7.71s/it]
  7%|▋         | 2847/37963 [6:54:10<74:41:28,  7.66s/it]
  8%|▊         | 2848/37963 [6:54:18<75:35:23,  7.75s/it]
  8%|▊         | 2849/37963 [6:54:26<75:28:14,  7.74s/it]
  8%|▊         | 2850/37963 [6:54:34<74:36:32,  7.65s/it]
                                                         
{'loss': '0.1737', 'grad_norm': '2.598', 'learning_rate': '1.989e-05', 'epoch': '0.07507'}

  8%|▊         | 2850/37963 [6:54:34<74:36:32,  7.65s/it]
  8%|▊         | 2851/37963 [6:54:41<74:16:51,  7.62s/it]
  8%|▊         | 2852/37963 [6:54:55<93:17:13,  9.56s/it]
  8%|▊         | 2853/37963 [6:55:03<88:06:14,  9.03s/it]
  8%|▊         | 2854/37963 [6:55:10<83:15:27,  8.54s/it]
  8%|▊         | 2855/37963 [6:55:18<80:28:19,  8.25s/it]
  8%|▊         | 2856/37963 [6:55:26<78:35:46,  8.06s/it]
  8%|▊         | 2857/37963 [6:55:46<116:11:12, 11.91s/it]
  8%|▊         | 2858/37963 [6:55:54<103:30:02, 10.61s/it]
  8%|▊         | 2859/37963 [6:56:02<94:49:11,  9.72s/it] 
  8%|▊         | 2860/37963 [6:56:09<88:41:14,  9.10s/it]
                                                         
{'loss': '0.1813', 'grad_norm': '9.214', 'learning_rate': '1.989e-05', 'epoch': '0.07534'}

  8%|▊         | 2860/37963 [6:56:09<88:41:14,  9.10s/it]
  8%|▊         | 2861/37963 [6:56:23<102:45:46, 10.54s/it]
  8%|▊         | 2862/37963 [6:56:31<94:25:28,  9.68s/it] 
  8%|▊         | 2863/37963 [6:56:38<88:11:39,  9.05s/it]
  8%|▊         | 2864/37963 [6:56:46<83:41:41,  8.58s/it]
  8%|▊         | 2865/37963 [6:57:00<99:18:59, 10.19s/it]
  8%|▊         | 2866/37963 [6:57:08<91:54:28,  9.43s/it]
  8%|▊         | 2867/37963 [6:57:15<86:48:04,  8.90s/it]
  8%|▊         | 2868/37963 [6:57:23<83:56:24,  8.61s/it]
  8%|▊         | 2869/37963 [6:57:37<99:21:50, 10.19s/it]
  8%|▊         | 2870/37963 [6:57:45<91:39:20,  9.40s/it]
                                                         
{'loss': '0.1755', 'grad_norm': '4.756', 'learning_rate': '1.989e-05', 'epoch': '0.0756'}

  8%|▊         | 2870/37963 [6:57:45<91:39:20,  9.40s/it]
  8%|▊         | 2871/37963 [6:57:52<86:24:54,  8.87s/it]
  8%|▊         | 2872/37963 [6:58:07<102:51:32, 10.55s/it]
  8%|▊         | 2873/37963 [6:58:14<94:05:48,  9.65s/it] 
  8%|▊         | 2874/37963 [6:58:22<87:57:00,  9.02s/it]
  8%|▊         | 2875/37963 [6:58:29<83:19:24,  8.55s/it]
  8%|▊         | 2876/37963 [6:58:38<83:08:35,  8.53s/it]
  8%|▊         | 2877/37963 [6:58:45<80:36:35,  8.27s/it]
  8%|▊         | 2878/37963 [6:58:53<78:30:38,  8.06s/it]
  8%|▊         | 2879/37963 [6:59:00<76:41:48,  7.87s/it]
  8%|▊         | 2880/37963 [6:59:08<76:12:22,  7.82s/it]
                                                         
{'loss': '0.1902', 'grad_norm': '4.869', 'learning_rate': '1.989e-05', 'epoch': '0.07586'}

  8%|▊         | 2880/37963 [6:59:08<76:12:22,  7.82s/it]
  8%|▊         | 2881/37963 [6:59:16<75:35:51,  7.76s/it]
  8%|▊         | 2882/37963 [6:59:23<75:14:31,  7.72s/it]
  8%|▊         | 2883/37963 [6:59:31<74:53:03,  7.68s/it]
  8%|▊         | 2884/37963 [6:59:38<74:01:35,  7.60s/it]
  8%|▊         | 2885/37963 [6:59:46<74:39:47,  7.66s/it]
  8%|▊         | 2886/37963 [7:00:00<94:02:48,  9.65s/it]
  8%|▊         | 2887/37963 [7:00:08<88:25:12,  9.07s/it]
  8%|▊         | 2888/37963 [7:00:16<84:24:17,  8.66s/it]
  8%|▊         | 2889/37963 [7:00:24<82:25:49,  8.46s/it]
  8%|▊         | 2890/37963 [7:00:32<79:55:28,  8.20s/it]
                                                         
{'loss': '0.1637', 'grad_norm': '3.025', 'learning_rate': '1.989e-05', 'epoch': '0.07613'}

  8%|▊         | 2890/37963 [7:00:32<79:55:28,  8.20s/it]
  8%|▊         | 2891/37963 [7:00:39<78:24:56,  8.05s/it]
  8%|▊         | 2892/37963 [7:00:47<76:49:58,  7.89s/it]
  8%|▊         | 2893/37963 [7:00:54<75:55:31,  7.79s/it]
  8%|▊         | 2894/37963 [7:01:02<75:48:58,  7.78s/it]
  8%|▊         | 2895/37963 [7:01:10<76:12:20,  7.82s/it]
  8%|▊         | 2896/37963 [7:01:18<75:24:37,  7.74s/it]
  8%|▊         | 2897/37963 [7:01:25<74:53:36,  7.69s/it]
  8%|▊         | 2898/37963 [7:01:33<74:39:59,  7.67s/it]
  8%|▊         | 2899/37963 [7:01:47<93:10:34,  9.57s/it]
  8%|▊         | 2900/37963 [7:01:54<87:02:59,  8.94s/it]
                                                         
{'loss': '0.1513', 'grad_norm': '5.007', 'learning_rate': '1.989e-05', 'epoch': '0.07639'}

  8%|▊         | 2900/37963 [7:01:54<87:02:59,  8.94s/it]
  8%|▊         | 2901/37963 [7:02:02<82:50:31,  8.51s/it]
  8%|▊         | 2902/37963 [7:02:09<80:18:22,  8.25s/it]
  8%|▊         | 2903/37963 [7:02:23<96:24:49,  9.90s/it]
  8%|▊         | 2904/37963 [7:02:38<109:44:30, 11.27s/it]
  8%|▊         | 2905/37963 [7:02:45<98:58:39, 10.16s/it] 
  8%|▊         | 2906/37963 [7:02:53<91:01:40,  9.35s/it]
  8%|▊         | 2907/37963 [7:03:00<85:59:18,  8.83s/it]
  8%|▊         | 2908/37963 [7:03:08<82:42:33,  8.49s/it]
  8%|▊         | 2909/37963 [7:03:15<79:25:59,  8.16s/it]
  8%|▊         | 2910/37963 [7:03:30<97:39:25, 10.03s/it]
                                                         
{'loss': '0.18', 'grad_norm': '3.339', 'learning_rate': '1.989e-05', 'epoch': '0.07665'}

  8%|▊         | 2910/37963 [7:03:30<97:39:25, 10.03s/it]
  8%|▊         | 2911/37963 [7:03:37<90:57:58,  9.34s/it]
  8%|▊         | 2912/37963 [7:03:45<85:30:48,  8.78s/it]
  8%|▊         | 2913/37963 [7:03:53<82:30:37,  8.47s/it]
  8%|▊         | 2914/37963 [7:04:00<79:55:48,  8.21s/it]
  8%|▊         | 2915/37963 [7:04:09<80:15:51,  8.24s/it]
  8%|▊         | 2916/37963 [7:04:16<78:18:38,  8.04s/it]
  8%|▊         | 2917/37963 [7:04:36<113:53:37, 11.70s/it]
  8%|▊         | 2918/37963 [7:04:50<119:53:10, 12.32s/it]
  8%|▊         | 2919/37963 [7:04:58<105:43:21, 10.86s/it]
  8%|▊         | 2920/37963 [7:05:05<95:10:57,  9.78s/it] 
                                                         
{'loss': '0.1796', 'grad_norm': '4.261', 'learning_rate': '1.988e-05', 'epoch': '0.07692'}

  8%|▊         | 2920/37963 [7:05:05<95:10:57,  9.78s/it]
  8%|▊         | 2921/37963 [7:05:12<88:34:34,  9.10s/it]
  8%|▊         | 2922/37963 [7:05:20<85:15:09,  8.76s/it]
  8%|▊         | 2923/37963 [7:05:28<81:38:12,  8.39s/it]
  8%|▊         | 2924/37963 [7:05:35<79:03:36,  8.12s/it]
  8%|▊         | 2925/37963 [7:05:43<77:22:00,  7.95s/it]
  8%|▊         | 2926/37963 [7:05:51<76:34:22,  7.87s/it]
  8%|▊         | 2927/37963 [7:05:59<77:00:41,  7.91s/it]
  8%|▊         | 2928/37963 [7:06:06<76:01:22,  7.81s/it]
  8%|▊         | 2929/37963 [7:06:14<75:10:03,  7.72s/it]
  8%|▊         | 2930/37963 [7:06:21<73:44:28,  7.58s/it]
                                                         
{'loss': '0.1652', 'grad_norm': '5.5', 'learning_rate': '1.988e-05', 'epoch': '0.07718'}

  8%|▊         | 2930/37963 [7:06:21<73:44:28,  7.58s/it]
  8%|▊         | 2931/37963 [7:06:28<73:34:40,  7.56s/it]
  8%|▊         | 2932/37963 [7:06:36<73:43:37,  7.58s/it]
  8%|▊         | 2933/37963 [7:06:44<74:52:49,  7.70s/it]
  8%|▊         | 2934/37963 [7:06:52<74:23:35,  7.65s/it]
  8%|▊         | 2935/37963 [7:06:59<74:16:11,  7.63s/it]
  8%|▊         | 2936/37963 [7:07:07<73:50:36,  7.59s/it]
  8%|▊         | 2937/37963 [7:07:20<91:57:22,  9.45s/it]
  8%|▊         | 2938/37963 [7:07:28<86:25:26,  8.88s/it]
  8%|▊         | 2939/37963 [7:07:36<82:39:34,  8.50s/it]
  8%|▊         | 2940/37963 [7:07:43<80:01:04,  8.23s/it]
                                                         
{'loss': '0.1813', 'grad_norm': '1.865', 'learning_rate': '1.988e-05', 'epoch': '0.07744'}

  8%|▊         | 2940/37963 [7:07:43<80:01:04,  8.23s/it]
  8%|▊         | 2941/37963 [7:07:51<77:52:17,  8.00s/it]
  8%|▊         | 2942/37963 [7:07:59<77:32:56,  7.97s/it]
  8%|▊         | 2943/37963 [7:08:06<76:11:44,  7.83s/it]
  8%|▊         | 2944/37963 [7:08:14<75:06:58,  7.72s/it]
  8%|▊         | 2945/37963 [7:08:21<73:57:10,  7.60s/it]
  8%|▊         | 2946/37963 [7:08:28<72:19:42,  7.44s/it]
  8%|▊         | 2947/37963 [7:08:42<93:02:35,  9.57s/it]
  8%|▊         | 2948/37963 [7:08:50<86:35:11,  8.90s/it]
  8%|▊         | 2949/37963 [7:08:57<82:51:32,  8.52s/it]
  8%|▊         | 2950/37963 [7:09:05<80:15:15,  8.25s/it]
                                                         
{'loss': '0.1696', 'grad_norm': '3.485', 'learning_rate': '1.988e-05', 'epoch': '0.07771'}

  8%|▊         | 2950/37963 [7:09:05<80:15:15,  8.25s/it]
  8%|▊         | 2951/37963 [7:09:20<99:15:13, 10.21s/it]
  8%|▊         | 2952/37963 [7:09:27<91:24:20,  9.40s/it]
  8%|▊         | 2953/37963 [7:09:35<86:09:51,  8.86s/it]
  8%|▊         | 2954/37963 [7:09:42<82:22:48,  8.47s/it]
  8%|▊         | 2955/37963 [7:09:50<80:42:58,  8.30s/it]
  8%|▊         | 2956/37963 [7:09:58<78:22:24,  8.06s/it]
  8%|▊         | 2957/37963 [7:10:12<94:57:32,  9.77s/it]
  8%|▊         | 2958/37963 [7:10:19<89:15:50,  9.18s/it]
  8%|▊         | 2959/37963 [7:10:28<87:06:09,  8.96s/it]
  8%|▊         | 2960/37963 [7:10:35<82:38:36,  8.50s/it]
                                                         
{'loss': '0.1731', 'grad_norm': '2.562', 'learning_rate': '1.988e-05', 'epoch': '0.07797'}

  8%|▊         | 2960/37963 [7:10:35<82:38:36,  8.50s/it]
  8%|▊         | 2961/37963 [7:10:43<80:01:16,  8.23s/it]
  8%|▊         | 2962/37963 [7:10:57<97:12:58, 10.00s/it]
  8%|▊         | 2963/37963 [7:11:05<91:50:42,  9.45s/it]
  8%|▊         | 2964/37963 [7:11:13<86:39:54,  8.91s/it]
  8%|▊         | 2965/37963 [7:11:20<82:48:30,  8.52s/it]
  8%|▊         | 2966/37963 [7:11:28<79:30:41,  8.18s/it]
  8%|▊         | 2967/37963 [7:11:42<97:51:44, 10.07s/it]
  8%|▊         | 2968/37963 [7:11:56<109:35:00, 11.27s/it]
  8%|▊         | 2969/37963 [7:12:04<98:55:37, 10.18s/it] 
  8%|▊         | 2970/37963 [7:12:12<91:22:53,  9.40s/it]
                                                         
{'loss': '0.1855', 'grad_norm': '2.162', 'learning_rate': '1.988e-05', 'epoch': '0.07823'}

  8%|▊         | 2970/37963 [7:12:12<91:22:53,  9.40s/it]
  8%|▊         | 2971/37963 [7:12:20<87:07:27,  8.96s/it]
  8%|▊         | 2972/37963 [7:12:27<82:16:38,  8.47s/it]
  8%|▊         | 2973/37963 [7:12:34<79:30:32,  8.18s/it]
  8%|▊         | 2974/37963 [7:12:42<77:20:20,  7.96s/it]
  8%|▊         | 2975/37963 [7:12:49<76:21:36,  7.86s/it]
  8%|▊         | 2976/37963 [7:12:58<78:21:24,  8.06s/it]
  8%|▊         | 2977/37963 [7:13:06<76:58:01,  7.92s/it]
  8%|▊         | 2978/37963 [7:13:13<76:13:16,  7.84s/it]
  8%|▊         | 2979/37963 [7:13:21<76:01:19,  7.82s/it]
  8%|▊         | 2980/37963 [7:13:29<75:13:26,  7.74s/it]
                                                         
{'loss': '0.1842', 'grad_norm': '1.797', 'learning_rate': '1.988e-05', 'epoch': '0.0785'}

  8%|▊         | 2980/37963 [7:13:29<75:13:26,  7.74s/it]
  8%|▊         | 2981/37963 [7:13:37<76:07:34,  7.83s/it]
  8%|▊         | 2982/37963 [7:13:44<75:24:40,  7.76s/it]
  8%|▊         | 2983/37963 [7:13:52<74:34:22,  7.67s/it]
  8%|▊         | 2984/37963 [7:13:59<73:16:23,  7.54s/it]
  8%|▊         | 2985/37963 [7:14:06<73:17:39,  7.54s/it]
  8%|▊         | 2986/37963 [7:14:15<75:05:59,  7.73s/it]
  8%|▊         | 2987/37963 [7:14:22<74:07:11,  7.63s/it]
  8%|▊         | 2988/37963 [7:14:36<92:15:28,  9.50s/it]
  8%|▊         | 2989/37963 [7:14:43<86:32:56,  8.91s/it]
  8%|▊         | 2990/37963 [7:14:51<84:12:09,  8.67s/it]
                                                         
{'loss': '0.1722', 'grad_norm': '4.547', 'learning_rate': '1.988e-05', 'epoch': '0.07876'}

  8%|▊         | 2990/37963 [7:14:52<84:12:09,  8.67s/it]
  8%|▊         | 2991/37963 [7:14:59<79:52:59,  8.22s/it]
  8%|▊         | 2992/37963 [7:15:06<77:47:58,  8.01s/it]
  8%|▊         | 2993/37963 [7:15:14<76:17:53,  7.85s/it]
  8%|▊         | 2994/37963 [7:15:21<74:52:18,  7.71s/it]
  8%|▊         | 2995/37963 [7:15:29<75:37:10,  7.79s/it]
  8%|▊         | 2996/37963 [7:15:36<74:25:20,  7.66s/it]
  8%|▊         | 2997/37963 [7:15:43<72:47:36,  7.49s/it]
  8%|▊         | 2998/37963 [7:15:51<73:00:06,  7.52s/it]
  8%|▊         | 2999/37963 [7:15:59<73:04:05,  7.52s/it]
  8%|▊         | 3000/37963 [7:16:13<93:37:42,  9.64s/it]
                                                         
{'loss': '0.1673', 'grad_norm': '5.679', 'learning_rate': '1.987e-05', 'epoch': '0.07902'}

  8%|▊         | 3000/37963 [7:16:13<93:37:42,  9.64s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.59s/it]
Writing model shards: 100%|██████████| 1/1 [00:10<00:00, 10.60s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

  8%|▊         | 3001/37963 [7:17:22<266:05:20, 27.40s/it]
  8%|▊         | 3002/37963 [7:17:36<227:59:28, 23.48s/it]
  8%|▊         | 3003/37963 [7:17:44<182:43:12, 18.82s/it]
  8%|▊         | 3004/37963 [7:17:52<149:41:11, 15.41s/it]
  8%|▊         | 3005/37963 [7:17:59<126:42:40, 13.05s/it]
  8%|▊         | 3006/37963 [7:18:07<110:57:29, 11.43s/it]
  8%|▊         | 3007/37963 [7:18:14<99:01:10, 10.20s/it] 
  8%|▊         | 3008/37963 [7:18:22<91:43:24,  9.45s/it]
  8%|▊         | 3009/37963 [7:18:36<103:58:23, 10.71s/it]
  8%|▊         | 3010/37963 [7:18:43<94:58:50,  9.78s/it] 
                                                         
{'loss': '0.1834', 'grad_norm': '2.982', 'learning_rate': '1.987e-05', 'epoch': '0.07929'}

  8%|▊         | 3010/37963 [7:18:43<94:58:50,  9.78s/it]
  8%|▊         | 3011/37963 [7:18:51<89:02:14,  9.17s/it]
  8%|▊         | 3012/37963 [7:19:05<102:47:19, 10.59s/it]
  8%|▊         | 3013/37963 [7:19:12<93:51:17,  9.67s/it] 
  8%|▊         | 3014/37963 [7:19:20<87:51:14,  9.05s/it]
  8%|▊         | 3015/37963 [7:19:28<83:39:01,  8.62s/it]
  8%|▊         | 3016/37963 [7:19:35<80:19:14,  8.27s/it]
  8%|▊         | 3017/37963 [7:19:43<78:19:40,  8.07s/it]
  8%|▊         | 3018/37963 [7:19:50<76:43:53,  7.90s/it]
  8%|▊         | 3019/37963 [7:19:57<74:57:46,  7.72s/it]
  8%|▊         | 3020/37963 [7:20:11<93:08:45,  9.60s/it]
                                                         
{'loss': '0.1619', 'grad_norm': '5.098', 'learning_rate': '1.987e-05', 'epoch': '0.07955'}

  8%|▊         | 3020/37963 [7:20:11<93:08:45,  9.60s/it]
  8%|▊         | 3021/37963 [7:20:19<87:16:10,  8.99s/it]
  8%|▊         | 3022/37963 [7:20:26<82:17:57,  8.48s/it]
  8%|▊         | 3023/37963 [7:20:34<79:23:46,  8.18s/it]
  8%|▊         | 3024/37963 [7:20:41<77:21:11,  7.97s/it]
  8%|▊         | 3025/37963 [7:20:49<76:01:35,  7.83s/it]
  8%|▊         | 3026/37963 [7:20:56<75:17:29,  7.76s/it]
  8%|▊         | 3027/37963 [7:21:04<74:35:21,  7.69s/it]
  8%|▊         | 3028/37963 [7:21:11<73:45:10,  7.60s/it]
  8%|▊         | 3029/37963 [7:21:19<73:25:42,  7.57s/it]
  8%|▊         | 3030/37963 [7:21:26<73:01:33,  7.53s/it]
                                                         
{'loss': '0.1555', 'grad_norm': '4.194', 'learning_rate': '1.987e-05', 'epoch': '0.07981'}

  8%|▊         | 3030/37963 [7:21:26<73:01:33,  7.53s/it]
  8%|▊         | 3031/37963 [7:21:34<73:08:11,  7.54s/it]
  8%|▊         | 3032/37963 [7:21:41<72:40:08,  7.49s/it]
  8%|▊         | 3033/37963 [7:21:49<72:17:37,  7.45s/it]
  8%|▊         | 3034/37963 [7:21:56<72:42:37,  7.49s/it]
  8%|▊         | 3035/37963 [7:22:04<72:49:02,  7.51s/it]
  8%|▊         | 3036/37963 [7:22:11<73:13:14,  7.55s/it]
  8%|▊         | 3037/37963 [7:22:19<73:15:57,  7.55s/it]
  8%|▊         | 3038/37963 [7:22:26<73:23:56,  7.57s/it]
  8%|▊         | 3039/37963 [7:22:34<73:37:13,  7.59s/it]
  8%|▊         | 3040/37963 [7:22:42<73:47:38,  7.61s/it]
                                                         
{'loss': '0.1628', 'grad_norm': '3.353', 'learning_rate': '1.987e-05', 'epoch': '0.08008'}

  8%|▊         | 3040/37963 [7:22:42<73:47:38,  7.61s/it]
  8%|▊         | 3041/37963 [7:22:56<92:17:43,  9.51s/it]
  8%|▊         | 3042/37963 [7:23:03<87:08:01,  8.98s/it]
  8%|▊         | 3043/37963 [7:23:11<83:19:05,  8.59s/it]
  8%|▊         | 3044/37963 [7:23:19<80:08:17,  8.26s/it]
  8%|▊         | 3045/37963 [7:23:26<78:15:12,  8.07s/it]
  8%|▊         | 3046/37963 [7:23:40<95:13:27,  9.82s/it]
  8%|▊         | 3047/37963 [7:23:47<87:49:55,  9.06s/it]
  8%|▊         | 3048/37963 [7:24:01<101:46:27, 10.49s/it]
  8%|▊         | 3049/37963 [7:24:08<92:15:48,  9.51s/it] 
  8%|▊         | 3050/37963 [7:24:22<105:20:11, 10.86s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '5.69', 'learning_rate': '1.987e-05', 'epoch': '0.08034'}

  8%|▊         | 3050/37963 [7:24:23<105:20:11, 10.86s/it]
  8%|▊         | 3051/37963 [7:24:30<95:41:53,  9.87s/it] 
  8%|▊         | 3052/37963 [7:24:37<88:16:36,  9.10s/it]
  8%|▊         | 3053/37963 [7:24:58<121:07:21, 12.49s/it]
  8%|▊         | 3054/37963 [7:25:05<106:43:44, 11.01s/it]
  8%|▊         | 3055/37963 [7:25:19<114:31:03, 11.81s/it]
  8%|▊         | 3056/37963 [7:25:26<101:20:34, 10.45s/it]
  8%|▊         | 3057/37963 [7:25:34<92:06:10,  9.50s/it] 
  8%|▊         | 3058/37963 [7:25:41<86:28:02,  8.92s/it]
  8%|▊         | 3059/37963 [7:25:48<81:57:01,  8.45s/it]
  8%|▊         | 3060/37963 [7:25:56<78:57:35,  8.14s/it]
                                                         
{'loss': '0.1834', 'grad_norm': '1.967', 'learning_rate': '1.987e-05', 'epoch': '0.08061'}

  8%|▊         | 3060/37963 [7:25:56<78:57:35,  8.14s/it]
  8%|▊         | 3061/37963 [7:26:03<77:09:48,  7.96s/it]
  8%|▊         | 3062/37963 [7:26:11<75:23:21,  7.78s/it]
  8%|▊         | 3063/37963 [7:26:18<73:48:07,  7.61s/it]
  8%|▊         | 3064/37963 [7:26:25<73:20:24,  7.57s/it]
  8%|▊         | 3065/37963 [7:26:33<73:14:23,  7.56s/it]
  8%|▊         | 3066/37963 [7:26:41<73:36:20,  7.59s/it]
  8%|▊         | 3067/37963 [7:26:48<73:22:47,  7.57s/it]
  8%|▊         | 3068/37963 [7:26:56<73:17:44,  7.56s/it]
  8%|▊         | 3069/37963 [7:27:09<91:19:19,  9.42s/it]
  8%|▊         | 3070/37963 [7:27:17<86:13:07,  8.90s/it]
                                                         
{'loss': '0.1598', 'grad_norm': '2.903', 'learning_rate': '1.986e-05', 'epoch': '0.08087'}

  8%|▊         | 3070/37963 [7:27:17<86:13:07,  8.90s/it]
  8%|▊         | 3071/37963 [7:27:25<82:21:36,  8.50s/it]
  8%|▊         | 3072/37963 [7:27:32<79:26:12,  8.20s/it]
  8%|▊         | 3073/37963 [7:27:40<77:54:51,  8.04s/it]
  8%|▊         | 3074/37963 [7:27:48<76:53:46,  7.93s/it]
  8%|▊         | 3075/37963 [7:27:55<76:07:04,  7.85s/it]
  8%|▊         | 3076/37963 [7:28:03<75:12:59,  7.76s/it]
  8%|▊         | 3077/37963 [7:28:10<74:45:35,  7.71s/it]
  8%|▊         | 3078/37963 [7:28:18<73:42:52,  7.61s/it]
  8%|▊         | 3079/37963 [7:28:25<73:21:17,  7.57s/it]
  8%|▊         | 3080/37963 [7:28:33<72:43:49,  7.51s/it]
                                                         
{'loss': '0.1855', 'grad_norm': '3.179', 'learning_rate': '1.986e-05', 'epoch': '0.08113'}

  8%|▊         | 3080/37963 [7:28:33<72:43:49,  7.51s/it]
  8%|▊         | 3081/37963 [7:28:40<72:55:04,  7.53s/it]
  8%|▊         | 3082/37963 [7:28:48<73:11:04,  7.55s/it]
  8%|▊         | 3083/37963 [7:28:55<73:14:35,  7.56s/it]
  8%|▊         | 3084/37963 [7:29:03<73:01:15,  7.54s/it]
  8%|▊         | 3085/37963 [7:29:10<73:13:25,  7.56s/it]
  8%|▊         | 3086/37963 [7:29:18<73:15:52,  7.56s/it]
  8%|▊         | 3087/37963 [7:29:26<73:20:06,  7.57s/it]
  8%|▊         | 3088/37963 [7:29:33<73:04:54,  7.54s/it]
  8%|▊         | 3089/37963 [7:29:47<90:56:19,  9.39s/it]
  8%|▊         | 3090/37963 [7:29:54<85:12:39,  8.80s/it]
                                                         
{'loss': '0.1757', 'grad_norm': '5.171', 'learning_rate': '1.986e-05', 'epoch': '0.0814'}

  8%|▊         | 3090/37963 [7:29:54<85:12:39,  8.80s/it]
  8%|▊         | 3091/37963 [7:30:02<81:11:55,  8.38s/it]
  8%|▊         | 3092/37963 [7:30:09<78:51:23,  8.14s/it]
  8%|▊         | 3093/37963 [7:30:23<95:31:46,  9.86s/it]
  8%|▊         | 3094/37963 [7:30:31<88:57:37,  9.18s/it]
  8%|▊         | 3095/37963 [7:30:38<84:10:58,  8.69s/it]
  8%|▊         | 3096/37963 [7:30:46<80:47:08,  8.34s/it]
  8%|▊         | 3097/37963 [7:31:00<97:02:02, 10.02s/it]
  8%|▊         | 3098/37963 [7:31:07<90:34:12,  9.35s/it]
  8%|▊         | 3099/37963 [7:31:15<85:07:44,  8.79s/it]
  8%|▊         | 3100/37963 [7:31:22<81:12:36,  8.39s/it]
                                                         
{'loss': '0.1922', 'grad_norm': '1.901', 'learning_rate': '1.986e-05', 'epoch': '0.08166'}

  8%|▊         | 3100/37963 [7:31:22<81:12:36,  8.39s/it]
  8%|▊         | 3101/37963 [7:31:36<97:29:21, 10.07s/it]
  8%|▊         | 3102/37963 [7:31:50<108:46:05, 11.23s/it]
  8%|▊         | 3103/37963 [7:32:05<117:32:20, 12.14s/it]
  8%|▊         | 3104/37963 [7:32:12<104:47:27, 10.82s/it]
  8%|▊         | 3105/37963 [7:32:26<114:01:55, 11.78s/it]
  8%|▊         | 3106/37963 [7:32:34<101:46:51, 10.51s/it]
  8%|▊         | 3107/37963 [7:32:41<93:00:56,  9.61s/it] 
  8%|▊         | 3108/37963 [7:32:49<86:48:11,  8.97s/it]
  8%|▊         | 3109/37963 [7:32:56<82:53:19,  8.56s/it]
  8%|▊         | 3110/37963 [7:33:04<80:00:15,  8.26s/it]
                                                         
{'loss': '0.1667', 'grad_norm': '4.879', 'learning_rate': '1.986e-05', 'epoch': '0.08192'}

  8%|▊         | 3110/37963 [7:33:04<80:00:15,  8.26s/it]
  8%|▊         | 3111/37963 [7:33:12<78:48:10,  8.14s/it]
  8%|▊         | 3112/37963 [7:33:19<75:58:45,  7.85s/it]
  8%|▊         | 3113/37963 [7:33:27<75:10:26,  7.77s/it]
  8%|▊         | 3114/37963 [7:33:34<74:33:27,  7.70s/it]
  8%|▊         | 3115/37963 [7:33:42<74:11:10,  7.66s/it]
  8%|▊         | 3116/37963 [7:33:49<73:57:17,  7.64s/it]
  8%|▊         | 3117/37963 [7:33:57<73:44:37,  7.62s/it]
  8%|▊         | 3118/37963 [7:34:11<92:41:31,  9.58s/it]
  8%|▊         | 3119/37963 [7:34:19<87:04:35,  9.00s/it]
  8%|▊         | 3120/37963 [7:34:26<83:17:48,  8.61s/it]
                                                         
{'loss': '0.1697', 'grad_norm': '2.617', 'learning_rate': '1.986e-05', 'epoch': '0.08219'}

  8%|▊         | 3120/37963 [7:34:26<83:17:48,  8.61s/it]
  8%|▊         | 3121/37963 [7:34:34<80:40:55,  8.34s/it]
  8%|▊         | 3122/37963 [7:34:42<78:46:11,  8.14s/it]
  8%|▊         | 3123/37963 [7:34:49<76:55:40,  7.95s/it]
  8%|▊         | 3124/37963 [7:34:57<75:55:11,  7.84s/it]
  8%|▊         | 3125/37963 [7:35:04<75:08:27,  7.76s/it]
  8%|▊         | 3126/37963 [7:35:12<74:16:27,  7.68s/it]
  8%|▊         | 3127/37963 [7:35:20<73:53:43,  7.64s/it]
  8%|▊         | 3128/37963 [7:35:27<73:37:53,  7.61s/it]
  8%|▊         | 3129/37963 [7:35:34<72:51:29,  7.53s/it]
  8%|▊         | 3130/37963 [7:35:42<72:51:53,  7.53s/it]
                                                         
{'loss': '0.1753', 'grad_norm': '7.275', 'learning_rate': '1.986e-05', 'epoch': '0.08245'}

  8%|▊         | 3130/37963 [7:35:42<72:51:53,  7.53s/it]
  8%|▊         | 3131/37963 [7:35:49<72:05:00,  7.45s/it]
  8%|▊         | 3132/37963 [7:35:57<72:07:05,  7.45s/it]
  8%|▊         | 3133/37963 [7:36:11<91:09:26,  9.42s/it]
  8%|▊         | 3134/37963 [7:36:18<85:13:51,  8.81s/it]
  8%|▊         | 3135/37963 [7:36:26<81:36:15,  8.44s/it]
  8%|▊         | 3136/37963 [7:36:33<79:00:14,  8.17s/it]
  8%|▊         | 3137/37963 [7:36:40<76:32:10,  7.91s/it]
  8%|▊         | 3138/37963 [7:36:48<75:39:46,  7.82s/it]
  8%|▊         | 3139/37963 [7:36:56<75:01:31,  7.76s/it]
  8%|▊         | 3140/37963 [7:37:03<74:44:41,  7.73s/it]
                                                         
{'loss': '0.1703', 'grad_norm': '3.954', 'learning_rate': '1.985e-05', 'epoch': '0.08271'}

  8%|▊         | 3140/37963 [7:37:03<74:44:41,  7.73s/it]
  8%|▊         | 3141/37963 [7:37:11<73:56:10,  7.64s/it]
  8%|▊         | 3142/37963 [7:37:25<92:33:16,  9.57s/it]
  8%|▊         | 3143/37963 [7:37:33<87:06:10,  9.01s/it]
  8%|▊         | 3144/37963 [7:37:40<83:07:19,  8.59s/it]
  8%|▊         | 3145/37963 [7:37:54<97:27:09, 10.08s/it]
  8%|▊         | 3146/37963 [7:38:02<90:51:27,  9.39s/it]
  8%|▊         | 3147/37963 [7:38:15<103:38:15, 10.72s/it]
  8%|▊         | 3148/37963 [7:38:23<94:26:43,  9.77s/it] 
  8%|▊         | 3149/37963 [7:38:37<107:26:43, 11.11s/it]
  8%|▊         | 3150/37963 [7:38:51<115:31:45, 11.95s/it]
                                                          
{'loss': '0.1778', 'grad_norm': '5.441', 'learning_rate': '1.985e-05', 'epoch': '0.08298'}

  8%|▊         | 3150/37963 [7:38:51<115:31:45, 11.95s/it]
  8%|▊         | 3151/37963 [7:38:59<103:02:40, 10.66s/it]
  8%|▊         | 3152/37963 [7:39:06<94:02:27,  9.73s/it] 
  8%|▊         | 3153/37963 [7:39:14<87:36:34,  9.06s/it]
  8%|▊         | 3154/37963 [7:39:21<83:08:14,  8.60s/it]
  8%|▊         | 3155/37963 [7:39:29<80:10:41,  8.29s/it]
  8%|▊         | 3156/37963 [7:39:43<96:30:55,  9.98s/it]
  8%|▊         | 3157/37963 [7:39:50<89:05:47,  9.22s/it]
  8%|▊         | 3158/37963 [7:39:58<84:17:46,  8.72s/it]
  8%|▊         | 3159/37963 [7:40:05<80:35:38,  8.34s/it]
  8%|▊         | 3160/37963 [7:40:13<78:19:50,  8.10s/it]
                                                         
{'loss': '0.17', 'grad_norm': '4.559', 'learning_rate': '1.985e-05', 'epoch': '0.08324'}

  8%|▊         | 3160/37963 [7:40:13<78:19:50,  8.10s/it]
  8%|▊         | 3161/37963 [7:40:20<76:24:05,  7.90s/it]
  8%|▊         | 3162/37963 [7:40:28<75:42:44,  7.83s/it]
  8%|▊         | 3163/37963 [7:40:42<93:22:35,  9.66s/it]
  8%|▊         | 3164/37963 [7:40:49<87:14:49,  9.03s/it]
  8%|▊         | 3165/37963 [7:40:57<82:56:02,  8.58s/it]
  8%|▊         | 3166/37963 [7:41:04<80:02:08,  8.28s/it]
  8%|▊         | 3167/37963 [7:41:12<77:22:54,  8.01s/it]
  8%|▊         | 3168/37963 [7:41:19<75:08:19,  7.77s/it]
  8%|▊         | 3169/37963 [7:41:27<74:35:35,  7.72s/it]
  8%|▊         | 3170/37963 [7:41:34<73:16:50,  7.58s/it]
                                                         
{'loss': '0.164', 'grad_norm': '1.548', 'learning_rate': '1.985e-05', 'epoch': '0.0835'}

  8%|▊         | 3170/37963 [7:41:34<73:16:50,  7.58s/it]
  8%|▊         | 3171/37963 [7:41:41<72:36:51,  7.51s/it]
  8%|▊         | 3172/37963 [7:41:49<72:45:40,  7.53s/it]
  8%|▊         | 3173/37963 [7:41:56<72:42:38,  7.52s/it]
  8%|▊         | 3174/37963 [7:42:04<72:43:39,  7.53s/it]
  8%|▊         | 3175/37963 [7:42:11<72:48:05,  7.53s/it]
  8%|▊         | 3176/37963 [7:42:19<72:34:10,  7.51s/it]
  8%|▊         | 3177/37963 [7:42:26<72:40:06,  7.52s/it]
  8%|▊         | 3178/37963 [7:42:34<72:35:11,  7.51s/it]
  8%|▊         | 3179/37963 [7:42:48<91:26:57,  9.46s/it]
  8%|▊         | 3180/37963 [7:42:56<86:10:58,  8.92s/it]
                                                         
{'loss': '0.159', 'grad_norm': '5.061', 'learning_rate': '1.985e-05', 'epoch': '0.08377'}

  8%|▊         | 3180/37963 [7:42:56<86:10:58,  8.92s/it]
  8%|▊         | 3181/37963 [7:43:03<82:08:20,  8.50s/it]
  8%|▊         | 3182/37963 [7:43:11<79:11:57,  8.20s/it]
  8%|▊         | 3183/37963 [7:43:18<77:29:21,  8.02s/it]
  8%|▊         | 3184/37963 [7:43:26<76:09:59,  7.88s/it]
  8%|▊         | 3185/37963 [7:43:33<75:04:57,  7.77s/it]
  8%|▊         | 3186/37963 [7:43:41<74:34:23,  7.72s/it]
  8%|▊         | 3187/37963 [7:43:48<73:32:13,  7.61s/it]
  8%|▊         | 3188/37963 [7:43:56<73:11:08,  7.58s/it]
  8%|▊         | 3189/37963 [7:44:03<72:59:43,  7.56s/it]
  8%|▊         | 3190/37963 [7:44:11<73:02:41,  7.56s/it]
                                                         
{'loss': '0.1699', 'grad_norm': '3.863', 'learning_rate': '1.985e-05', 'epoch': '0.08403'}

  8%|▊         | 3190/37963 [7:44:11<73:02:41,  7.56s/it]
  8%|▊         | 3191/37963 [7:44:25<92:01:50,  9.53s/it]
  8%|▊         | 3192/37963 [7:44:33<86:35:31,  8.97s/it]
  8%|▊         | 3193/37963 [7:44:40<82:17:18,  8.52s/it]
  8%|▊         | 3194/37963 [7:44:48<79:50:26,  8.27s/it]
  8%|▊         | 3195/37963 [7:44:55<78:00:18,  8.08s/it]
  8%|▊         | 3196/37963 [7:45:09<94:10:49,  9.75s/it]
  8%|▊         | 3197/37963 [7:45:23<106:03:24, 10.98s/it]
  8%|▊         | 3198/37963 [7:45:30<96:13:15,  9.96s/it] 
  8%|▊         | 3199/37963 [7:45:38<89:15:59,  9.24s/it]
  8%|▊         | 3200/37963 [7:45:46<84:13:30,  8.72s/it]
                                                         
{'loss': '0.1835', 'grad_norm': '4.386', 'learning_rate': '1.985e-05', 'epoch': '0.08429'}

  8%|▊         | 3200/37963 [7:45:46<84:13:30,  8.72s/it]
  8%|▊         | 3201/37963 [7:45:53<80:18:32,  8.32s/it]
  8%|▊         | 3202/37963 [7:46:07<97:06:33, 10.06s/it]
  8%|▊         | 3203/37963 [7:46:28<127:25:01, 13.20s/it]
  8%|▊         | 3204/37963 [7:46:35<111:01:53, 11.50s/it]
  8%|▊         | 3205/37963 [7:46:43<99:31:52, 10.31s/it] 
  8%|▊         | 3206/37963 [7:46:50<91:07:23,  9.44s/it]
  8%|▊         | 3207/37963 [7:46:58<86:04:36,  8.92s/it]
  8%|▊         | 3208/37963 [7:47:05<81:17:01,  8.42s/it]
  8%|▊         | 3209/37963 [7:47:12<78:42:09,  8.15s/it]
  8%|▊         | 3210/37963 [7:47:20<77:24:36,  8.02s/it]
                                                         
{'loss': '0.1652', 'grad_norm': '2.795', 'learning_rate': '1.984e-05', 'epoch': '0.08456'}

  8%|▊         | 3210/37963 [7:47:20<77:24:36,  8.02s/it]
  8%|▊         | 3211/37963 [7:47:28<75:51:38,  7.86s/it]
  8%|▊         | 3212/37963 [7:47:35<74:53:16,  7.76s/it]
  8%|▊         | 3213/37963 [7:47:49<91:57:00,  9.53s/it]
  8%|▊         | 3214/37963 [7:47:56<86:15:07,  8.94s/it]
  8%|▊         | 3215/37963 [7:48:04<82:16:43,  8.52s/it]
  8%|▊         | 3216/37963 [7:48:12<79:27:24,  8.23s/it]
  8%|▊         | 3217/37963 [7:48:19<77:28:20,  8.03s/it]
  8%|▊         | 3218/37963 [7:48:27<76:07:30,  7.89s/it]
  8%|▊         | 3219/37963 [7:48:34<75:12:15,  7.79s/it]
  8%|▊         | 3220/37963 [7:48:42<74:29:40,  7.72s/it]
                                                         
{'loss': '0.1626', 'grad_norm': '5.931', 'learning_rate': '1.984e-05', 'epoch': '0.08482'}

  8%|▊         | 3220/37963 [7:48:42<74:29:40,  7.72s/it]
  8%|▊         | 3221/37963 [7:48:49<73:45:38,  7.64s/it]
  8%|▊         | 3222/37963 [7:48:57<73:23:32,  7.61s/it]
  8%|▊         | 3223/37963 [7:49:04<72:57:32,  7.56s/it]
  8%|▊         | 3224/37963 [7:49:12<72:51:13,  7.55s/it]
  8%|▊         | 3225/37963 [7:49:19<72:45:10,  7.54s/it]
  8%|▊         | 3226/37963 [7:49:27<72:49:15,  7.55s/it]
  9%|▊         | 3227/37963 [7:49:41<91:25:23,  9.48s/it]
  9%|▊         | 3228/37963 [7:49:48<86:00:21,  8.91s/it]
  9%|▊         | 3229/37963 [7:49:56<81:55:20,  8.49s/it]
  9%|▊         | 3230/37963 [7:50:03<79:06:18,  8.20s/it]
                                                         
{'loss': '0.1763', 'grad_norm': '2.728', 'learning_rate': '1.984e-05', 'epoch': '0.08508'}

  9%|▊         | 3230/37963 [7:50:03<79:06:18,  8.20s/it]
  9%|▊         | 3231/37963 [7:50:11<76:34:43,  7.94s/it]
  9%|▊         | 3232/37963 [7:50:18<75:21:57,  7.81s/it]
  9%|▊         | 3233/37963 [7:50:26<74:48:48,  7.75s/it]
  9%|▊         | 3234/37963 [7:50:33<74:17:27,  7.70s/it]
  9%|▊         | 3235/37963 [7:50:41<74:00:47,  7.67s/it]
  9%|▊         | 3236/37963 [7:50:49<73:23:17,  7.61s/it]
  9%|▊         | 3237/37963 [7:50:56<72:33:31,  7.52s/it]
  9%|▊         | 3238/37963 [7:51:03<72:31:44,  7.52s/it]
  9%|▊         | 3239/37963 [7:51:11<72:41:07,  7.54s/it]
  9%|▊         | 3240/37963 [7:51:18<72:07:04,  7.48s/it]
                                                         
{'loss': '0.1636', 'grad_norm': '3.36', 'learning_rate': '1.984e-05', 'epoch': '0.08535'}

  9%|▊         | 3240/37963 [7:51:18<72:07:04,  7.48s/it]
  9%|▊         | 3241/37963 [7:51:26<71:54:36,  7.46s/it]
  9%|▊         | 3242/37963 [7:51:33<72:15:09,  7.49s/it]
  9%|▊         | 3243/37963 [7:51:41<72:36:41,  7.53s/it]
  9%|▊         | 3244/37963 [7:52:01<110:28:32, 11.46s/it]
  9%|▊         | 3245/37963 [7:52:09<99:41:17, 10.34s/it] 
  9%|▊         | 3246/37963 [7:52:23<109:58:02, 11.40s/it]
  9%|▊         | 3247/37963 [7:52:31<98:54:41, 10.26s/it] 
  9%|▊         | 3248/37963 [7:52:38<91:00:05,  9.44s/it]
  9%|▊         | 3249/37963 [7:52:46<85:28:02,  8.86s/it]
  9%|▊         | 3250/37963 [7:52:53<81:09:53,  8.42s/it]
                                                         
{'loss': '0.185', 'grad_norm': '3.406', 'learning_rate': '1.984e-05', 'epoch': '0.08561'}

  9%|▊         | 3250/37963 [7:52:53<81:09:53,  8.42s/it]
  9%|▊         | 3251/37963 [7:53:01<78:32:09,  8.15s/it]
  9%|▊         | 3252/37963 [7:53:15<95:13:23,  9.88s/it]
  9%|▊         | 3253/37963 [7:53:22<88:47:45,  9.21s/it]
  9%|▊         | 3254/37963 [7:53:30<83:56:30,  8.71s/it]
  9%|▊         | 3255/37963 [7:53:44<98:58:37, 10.27s/it]
  9%|▊         | 3256/37963 [7:53:51<91:08:20,  9.45s/it]
  9%|▊         | 3257/37963 [7:53:59<85:57:42,  8.92s/it]
  9%|▊         | 3258/37963 [7:54:06<82:02:04,  8.51s/it]
  9%|▊         | 3259/37963 [7:54:14<79:14:35,  8.22s/it]
  9%|▊         | 3260/37963 [7:54:21<77:19:01,  8.02s/it]
                                                         
{'loss': '0.1629', 'grad_norm': '3.643', 'learning_rate': '1.984e-05', 'epoch': '0.08587'}

  9%|▊         | 3260/37963 [7:54:21<77:19:01,  8.02s/it]
  9%|▊         | 3261/37963 [7:54:35<94:14:42,  9.78s/it]
  9%|▊         | 3262/37963 [7:54:43<87:59:46,  9.13s/it]
  9%|▊         | 3263/37963 [7:54:50<83:15:20,  8.64s/it]
  9%|▊         | 3264/37963 [7:54:58<80:08:03,  8.31s/it]
  9%|▊         | 3265/37963 [7:55:06<78:00:28,  8.09s/it]
  9%|▊         | 3266/37963 [7:55:13<76:44:17,  7.96s/it]
  9%|▊         | 3267/37963 [7:55:21<75:28:16,  7.83s/it]
  9%|▊         | 3268/37963 [7:55:28<74:41:05,  7.75s/it]
  9%|▊         | 3269/37963 [7:55:36<73:51:26,  7.66s/it]
  9%|▊         | 3270/37963 [7:55:43<73:27:43,  7.62s/it]
                                                         
{'loss': '0.176', 'grad_norm': '2.28', 'learning_rate': '1.984e-05', 'epoch': '0.08614'}

  9%|▊         | 3270/37963 [7:55:43<73:27:43,  7.62s/it]
  9%|▊         | 3271/37963 [7:55:51<73:14:37,  7.60s/it]
  9%|▊         | 3272/37963 [7:55:58<73:12:43,  7.60s/it]
  9%|▊         | 3273/37963 [7:56:06<73:10:38,  7.59s/it]
  9%|▊         | 3274/37963 [7:56:13<72:08:56,  7.49s/it]
  9%|▊         | 3275/37963 [7:56:21<72:04:04,  7.48s/it]
  9%|▊         | 3276/37963 [7:56:28<72:12:09,  7.49s/it]
  9%|▊         | 3277/37963 [7:56:42<90:32:58,  9.40s/it]
  9%|▊         | 3278/37963 [7:56:50<85:07:27,  8.84s/it]
  9%|▊         | 3279/37963 [7:56:57<81:18:24,  8.44s/it]
  9%|▊         | 3280/37963 [7:57:05<78:55:55,  8.19s/it]
                                                         
{'loss': '0.177', 'grad_norm': '2.098', 'learning_rate': '1.983e-05', 'epoch': '0.0864'}

  9%|▊         | 3280/37963 [7:57:05<78:55:55,  8.19s/it]
  9%|▊         | 3281/37963 [7:57:12<76:25:15,  7.93s/it]
  9%|▊         | 3282/37963 [7:57:20<75:51:40,  7.87s/it]
  9%|▊         | 3283/37963 [7:57:27<74:10:03,  7.70s/it]
  9%|▊         | 3284/37963 [7:57:35<74:18:51,  7.71s/it]
  9%|▊         | 3285/37963 [7:57:42<73:51:24,  7.67s/it]
  9%|▊         | 3286/37963 [7:57:50<73:25:14,  7.62s/it]
  9%|▊         | 3287/37963 [7:57:58<73:12:48,  7.60s/it]
  9%|▊         | 3288/37963 [7:58:11<91:23:24,  9.49s/it]
  9%|▊         | 3289/37963 [7:58:19<85:54:06,  8.92s/it]
  9%|▊         | 3290/37963 [7:58:27<81:54:53,  8.51s/it]
                                                         
{'loss': '0.1729', 'grad_norm': '5.265', 'learning_rate': '1.983e-05', 'epoch': '0.08666'}

  9%|▊         | 3290/37963 [7:58:27<81:54:53,  8.51s/it]
  9%|▊         | 3291/37963 [7:58:34<78:32:10,  8.15s/it]
  9%|▊         | 3292/37963 [7:58:41<76:30:35,  7.94s/it]
  9%|▊         | 3293/37963 [7:58:55<93:18:36,  9.69s/it]
  9%|▊         | 3294/37963 [7:59:09<105:20:28, 10.94s/it]
  9%|▊         | 3295/37963 [7:59:17<95:42:42,  9.94s/it] 
  9%|▊         | 3296/37963 [7:59:24<89:00:38,  9.24s/it]
  9%|▊         | 3297/37963 [7:59:32<84:07:05,  8.74s/it]
  9%|▊         | 3298/37963 [7:59:39<79:45:00,  8.28s/it]
  9%|▊         | 3299/37963 [7:59:46<77:00:09,  8.00s/it]
  9%|▊         | 3300/37963 [7:59:54<75:05:54,  7.80s/it]
                                                         
{'loss': '0.1848', 'grad_norm': '6.018', 'learning_rate': '1.983e-05', 'epoch': '0.08693'}

  9%|▊         | 3300/37963 [7:59:54<75:05:54,  7.80s/it]
  9%|▊         | 3301/37963 [8:00:07<92:23:24,  9.60s/it]
  9%|▊         | 3302/37963 [8:00:15<86:18:17,  8.96s/it]
  9%|▊         | 3303/37963 [8:00:22<81:05:25,  8.42s/it]
  9%|▊         | 3304/37963 [8:00:29<77:59:01,  8.10s/it]
  9%|▊         | 3305/37963 [8:00:37<76:21:16,  7.93s/it]
  9%|▊         | 3306/37963 [8:00:57<111:43:16, 11.61s/it]
  9%|▊         | 3307/37963 [8:01:05<100:02:06, 10.39s/it]
  9%|▊         | 3308/37963 [8:01:12<92:03:54,  9.56s/it] 
  9%|▊         | 3309/37963 [8:01:20<86:16:56,  8.96s/it]
  9%|▊         | 3310/37963 [8:01:27<81:28:52,  8.46s/it]
                                                         
{'loss': '0.1714', 'grad_norm': '4.943', 'learning_rate': '1.983e-05', 'epoch': '0.08719'}

  9%|▊         | 3310/37963 [8:01:27<81:28:52,  8.46s/it]
  9%|▊         | 3311/37963 [8:01:41<97:30:42, 10.13s/it]
  9%|▊         | 3312/37963 [8:01:49<89:52:09,  9.34s/it]
  9%|▊         | 3313/37963 [8:01:56<84:11:23,  8.75s/it]
  9%|▊         | 3314/37963 [8:02:04<80:37:43,  8.38s/it]
  9%|▊         | 3315/37963 [8:02:11<78:11:10,  8.12s/it]
  9%|▊         | 3316/37963 [8:02:19<76:26:20,  7.94s/it]
  9%|▊         | 3317/37963 [8:02:26<74:59:34,  7.79s/it]
  9%|▊         | 3318/37963 [8:02:34<74:12:00,  7.71s/it]
  9%|▊         | 3319/37963 [8:02:41<74:12:50,  7.71s/it]
  9%|▊         | 3320/37963 [8:02:49<73:38:44,  7.65s/it]
                                                         
{'loss': '0.1641', 'grad_norm': '7.819', 'learning_rate': '1.983e-05', 'epoch': '0.08745'}

  9%|▊         | 3320/37963 [8:02:49<73:38:44,  7.65s/it]
  9%|▊         | 3321/37963 [8:02:56<73:22:49,  7.63s/it]
  9%|▉         | 3322/37963 [8:03:04<73:20:20,  7.62s/it]
  9%|▉         | 3323/37963 [8:03:12<73:11:02,  7.61s/it]
  9%|▉         | 3324/37963 [8:03:19<72:54:15,  7.58s/it]
  9%|▉         | 3325/37963 [8:03:27<72:51:37,  7.57s/it]
  9%|▉         | 3326/37963 [8:03:34<72:37:54,  7.55s/it]
  9%|▉         | 3327/37963 [8:03:42<72:52:58,  7.58s/it]
  9%|▉         | 3328/37963 [8:03:49<71:43:54,  7.46s/it]
  9%|▉         | 3329/37963 [8:04:03<90:46:20,  9.44s/it]
  9%|▉         | 3330/37963 [8:04:11<85:37:31,  8.90s/it]
                                                         
{'loss': '0.1707', 'grad_norm': '3.388', 'learning_rate': '1.983e-05', 'epoch': '0.08772'}

  9%|▉         | 3330/37963 [8:04:11<85:37:31,  8.90s/it]
  9%|▉         | 3331/37963 [8:04:18<81:45:41,  8.50s/it]
  9%|▉         | 3332/37963 [8:04:32<97:38:14, 10.15s/it]
  9%|▉         | 3333/37963 [8:04:40<90:15:31,  9.38s/it]
  9%|▉         | 3334/37963 [8:04:47<84:52:47,  8.82s/it]
  9%|▉         | 3335/37963 [8:04:55<81:07:31,  8.43s/it]
  9%|▉         | 3336/37963 [8:05:02<78:54:16,  8.20s/it]
  9%|▉         | 3337/37963 [8:05:10<76:46:10,  7.98s/it]
  9%|▉         | 3338/37963 [8:05:24<94:02:32,  9.78s/it]
  9%|▉         | 3339/37963 [8:05:31<86:57:43,  9.04s/it]
  9%|▉         | 3340/37963 [8:05:39<81:49:33,  8.51s/it]
                                                         
{'loss': '0.1709', 'grad_norm': '4.341', 'learning_rate': '1.982e-05', 'epoch': '0.08798'}

  9%|▉         | 3340/37963 [8:05:39<81:49:33,  8.51s/it]
  9%|▉         | 3341/37963 [8:05:52<97:29:12, 10.14s/it]
  9%|▉         | 3342/37963 [8:06:00<90:21:22,  9.40s/it]
  9%|▉         | 3343/37963 [8:06:07<84:22:55,  8.77s/it]
  9%|▉         | 3344/37963 [8:06:15<80:04:35,  8.33s/it]
  9%|▉         | 3345/37963 [8:06:22<77:47:48,  8.09s/it]
  9%|▉         | 3346/37963 [8:06:30<76:17:16,  7.93s/it]
  9%|▉         | 3347/37963 [8:06:37<74:59:21,  7.80s/it]
  9%|▉         | 3348/37963 [8:06:51<91:29:10,  9.51s/it]
  9%|▉         | 3349/37963 [8:06:58<85:56:47,  8.94s/it]
  9%|▉         | 3350/37963 [8:07:06<81:46:26,  8.51s/it]
                                                         
{'loss': '0.1742', 'grad_norm': '3.746', 'learning_rate': '1.982e-05', 'epoch': '0.08824'}

  9%|▉         | 3350/37963 [8:07:06<81:46:26,  8.51s/it]
  9%|▉         | 3351/37963 [8:07:13<79:02:45,  8.22s/it]
  9%|▉         | 3352/37963 [8:07:21<77:06:13,  8.02s/it]
  9%|▉         | 3353/37963 [8:07:35<94:28:14,  9.83s/it]
  9%|▉         | 3354/37963 [8:07:43<88:12:39,  9.18s/it]
  9%|▉         | 3355/37963 [8:07:50<83:25:55,  8.68s/it]
  9%|▉         | 3356/37963 [8:07:58<80:03:16,  8.33s/it]
  9%|▉         | 3357/37963 [8:08:05<78:13:50,  8.14s/it]
  9%|▉         | 3358/37963 [8:08:13<76:26:18,  7.95s/it]
  9%|▉         | 3359/37963 [8:08:27<94:39:02,  9.85s/it]
  9%|▉         | 3360/37963 [8:08:41<105:25:10, 10.97s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '1.795', 'learning_rate': '1.982e-05', 'epoch': '0.08851'}

  9%|▉         | 3360/37963 [8:08:41<105:25:10, 10.97s/it]
  9%|▉         | 3361/37963 [8:08:48<95:34:13,  9.94s/it] 
  9%|▉         | 3362/37963 [8:08:56<88:32:47,  9.21s/it]
  9%|▉         | 3363/37963 [8:09:03<83:51:24,  8.72s/it]
  9%|▉         | 3364/37963 [8:09:11<80:16:53,  8.35s/it]
  9%|▉         | 3365/37963 [8:09:18<77:16:11,  8.04s/it]
  9%|▉         | 3366/37963 [8:09:26<75:47:38,  7.89s/it]
  9%|▉         | 3367/37963 [8:09:33<74:33:36,  7.76s/it]
  9%|▉         | 3368/37963 [8:09:41<74:10:37,  7.72s/it]
  9%|▉         | 3369/37963 [8:09:48<73:43:20,  7.67s/it]
  9%|▉         | 3370/37963 [8:09:56<72:34:13,  7.55s/it]
                                                         
{'loss': '0.1721', 'grad_norm': '3.665', 'learning_rate': '1.982e-05', 'epoch': '0.08877'}

  9%|▉         | 3370/37963 [8:09:56<72:34:13,  7.55s/it]
  9%|▉         | 3371/37963 [8:10:03<72:29:36,  7.54s/it]
  9%|▉         | 3372/37963 [8:10:11<72:20:33,  7.53s/it]
  9%|▉         | 3373/37963 [8:10:18<71:48:48,  7.47s/it]
  9%|▉         | 3374/37963 [8:10:26<71:59:39,  7.49s/it]
  9%|▉         | 3375/37963 [8:10:33<72:05:04,  7.50s/it]
  9%|▉         | 3376/37963 [8:10:47<89:56:58,  9.36s/it]
  9%|▉         | 3377/37963 [8:10:54<84:47:36,  8.83s/it]
  9%|▉         | 3378/37963 [8:11:02<81:04:55,  8.44s/it]
  9%|▉         | 3379/37963 [8:11:09<78:21:50,  8.16s/it]
  9%|▉         | 3380/37963 [8:11:17<76:14:42,  7.94s/it]
                                                         
{'loss': '0.1621', 'grad_norm': '5.804', 'learning_rate': '1.982e-05', 'epoch': '0.08903'}

  9%|▉         | 3380/37963 [8:11:17<76:14:42,  7.94s/it]
  9%|▉         | 3381/37963 [8:11:31<93:04:18,  9.69s/it]
  9%|▉         | 3382/37963 [8:11:38<86:23:21,  8.99s/it]
  9%|▉         | 3383/37963 [8:11:52<101:05:04, 10.52s/it]
  9%|▉         | 3384/37963 [8:12:00<92:41:14,  9.65s/it] 
  9%|▉         | 3385/37963 [8:12:07<85:54:13,  8.94s/it]
  9%|▉         | 3386/37963 [8:12:14<81:24:29,  8.48s/it]
  9%|▉         | 3387/37963 [8:12:22<78:36:58,  8.19s/it]
  9%|▉         | 3388/37963 [8:12:29<76:38:58,  7.98s/it]
  9%|▉         | 3389/37963 [8:12:37<75:51:06,  7.90s/it]
  9%|▉         | 3390/37963 [8:12:45<74:43:47,  7.78s/it]
                                                         
{'loss': '0.1665', 'grad_norm': '2.763', 'learning_rate': '1.982e-05', 'epoch': '0.0893'}

  9%|▉         | 3390/37963 [8:12:45<74:43:47,  7.78s/it]
  9%|▉         | 3391/37963 [8:12:52<74:13:19,  7.73s/it]
  9%|▉         | 3392/37963 [8:13:00<73:17:11,  7.63s/it]
  9%|▉         | 3393/37963 [8:13:13<90:58:42,  9.47s/it]
  9%|▉         | 3394/37963 [8:13:21<85:16:45,  8.88s/it]
  9%|▉         | 3395/37963 [8:13:29<81:32:39,  8.49s/it]
  9%|▉         | 3396/37963 [8:13:36<78:18:49,  8.16s/it]
  9%|▉         | 3397/37963 [8:13:50<95:36:15,  9.96s/it]
  9%|▉         | 3398/37963 [8:13:58<88:51:44,  9.26s/it]
  9%|▉         | 3399/37963 [8:14:05<83:43:31,  8.72s/it]
  9%|▉         | 3400/37963 [8:14:13<80:13:03,  8.36s/it]
                                                         
{'loss': '0.1729', 'grad_norm': '1.451', 'learning_rate': '1.981e-05', 'epoch': '0.08956'}

  9%|▉         | 3400/37963 [8:14:13<80:13:03,  8.36s/it]
  9%|▉         | 3401/37963 [8:14:20<78:01:07,  8.13s/it]
  9%|▉         | 3402/37963 [8:14:28<76:11:07,  7.94s/it]
  9%|▉         | 3403/37963 [8:14:35<74:52:29,  7.80s/it]
  9%|▉         | 3404/37963 [8:14:49<92:31:08,  9.64s/it]
  9%|▉         | 3405/37963 [8:14:57<86:25:55,  9.00s/it]
  9%|▉         | 3406/37963 [8:15:04<82:11:12,  8.56s/it]
  9%|▉         | 3407/37963 [8:15:12<78:42:07,  8.20s/it]
  9%|▉         | 3408/37963 [8:15:19<76:40:19,  7.99s/it]
  9%|▉         | 3409/37963 [8:15:33<94:15:32,  9.82s/it]
  9%|▉         | 3410/37963 [8:15:47<105:10:42, 10.96s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '4.322', 'learning_rate': '1.981e-05', 'epoch': '0.08982'}

  9%|▉         | 3410/37963 [8:15:47<105:10:42, 10.96s/it]
  9%|▉         | 3411/37963 [8:15:54<95:09:46,  9.92s/it] 
  9%|▉         | 3412/37963 [8:16:02<88:35:42,  9.23s/it]
  9%|▉         | 3413/37963 [8:16:09<83:44:24,  8.73s/it]
  9%|▉         | 3414/37963 [8:16:17<80:24:51,  8.38s/it]
  9%|▉         | 3415/37963 [8:16:24<77:12:46,  8.05s/it]
  9%|▉         | 3416/37963 [8:16:32<75:44:34,  7.89s/it]
  9%|▉         | 3417/37963 [8:16:39<74:48:21,  7.80s/it]
  9%|▉         | 3418/37963 [8:16:47<73:52:48,  7.70s/it]
  9%|▉         | 3419/37963 [8:16:54<73:12:49,  7.63s/it]
  9%|▉         | 3420/37963 [8:17:08<91:44:15,  9.56s/it]
                                                         
{'loss': '0.1738', 'grad_norm': '2.765', 'learning_rate': '1.981e-05', 'epoch': '0.09009'}

  9%|▉         | 3420/37963 [8:17:08<91:44:15,  9.56s/it]
  9%|▉         | 3421/37963 [8:17:16<85:26:00,  8.90s/it]
  9%|▉         | 3422/37963 [8:17:23<81:12:49,  8.46s/it]
  9%|▉         | 3423/37963 [8:17:31<78:49:21,  8.22s/it]
  9%|▉         | 3424/37963 [8:17:38<77:21:18,  8.06s/it]
  9%|▉         | 3425/37963 [8:17:46<74:54:25,  7.81s/it]
  9%|▉         | 3426/37963 [8:17:53<73:54:57,  7.70s/it]
  9%|▉         | 3427/37963 [8:18:01<73:22:28,  7.65s/it]
  9%|▉         | 3428/37963 [8:18:08<73:12:19,  7.63s/it]
  9%|▉         | 3429/37963 [8:18:16<73:05:01,  7.62s/it]
  9%|▉         | 3430/37963 [8:18:23<72:48:52,  7.59s/it]
                                                         
{'loss': '0.1728', 'grad_norm': '2.235', 'learning_rate': '1.981e-05', 'epoch': '0.09035'}

  9%|▉         | 3430/37963 [8:18:23<72:48:52,  7.59s/it]
  9%|▉         | 3431/37963 [8:18:31<72:41:24,  7.58s/it]
  9%|▉         | 3432/37963 [8:18:38<71:32:47,  7.46s/it]
  9%|▉         | 3433/37963 [8:18:52<90:14:27,  9.41s/it]
  9%|▉         | 3434/37963 [8:19:00<85:19:44,  8.90s/it]
  9%|▉         | 3435/37963 [8:19:14<100:24:20, 10.47s/it]
  9%|▉         | 3436/37963 [8:19:22<92:06:23,  9.60s/it] 
  9%|▉         | 3437/37963 [8:19:29<85:36:56,  8.93s/it]
  9%|▉         | 3438/37963 [8:19:36<81:29:48,  8.50s/it]
  9%|▉         | 3439/37963 [8:19:44<78:25:54,  8.18s/it]
  9%|▉         | 3440/37963 [8:19:51<76:21:04,  7.96s/it]
                                                         
{'loss': '0.1788', 'grad_norm': '3.527', 'learning_rate': '1.981e-05', 'epoch': '0.09061'}

  9%|▉         | 3440/37963 [8:19:51<76:21:04,  7.96s/it]
  9%|▉         | 3441/37963 [8:20:05<92:40:47,  9.66s/it]
  9%|▉         | 3442/37963 [8:20:13<86:58:56,  9.07s/it]
  9%|▉         | 3443/37963 [8:20:20<81:29:25,  8.50s/it]
  9%|▉         | 3444/37963 [8:20:27<78:39:17,  8.20s/it]
  9%|▉         | 3445/37963 [8:20:41<95:12:11,  9.93s/it]
  9%|▉         | 3446/37963 [8:20:49<88:23:54,  9.22s/it]
  9%|▉         | 3447/37963 [8:20:56<83:25:33,  8.70s/it]
  9%|▉         | 3448/37963 [8:21:04<80:12:53,  8.37s/it]
  9%|▉         | 3449/37963 [8:21:11<77:59:09,  8.13s/it]
  9%|▉         | 3450/37963 [8:21:19<76:21:49,  7.97s/it]
                                                         
{'loss': '0.1689', 'grad_norm': '3.561', 'learning_rate': '1.981e-05', 'epoch': '0.09088'}

  9%|▉         | 3450/37963 [8:21:19<76:21:49,  7.97s/it]
  9%|▉         | 3451/37963 [8:21:33<93:43:06,  9.78s/it]
  9%|▉         | 3452/37963 [8:21:41<87:36:03,  9.14s/it]
  9%|▉         | 3453/37963 [8:21:48<83:03:44,  8.66s/it]
  9%|▉         | 3454/37963 [8:21:55<78:58:42,  8.24s/it]
  9%|▉         | 3455/37963 [8:22:09<94:53:07,  9.90s/it]
  9%|▉         | 3456/37963 [8:22:17<88:28:24,  9.23s/it]
  9%|▉         | 3457/37963 [8:22:31<101:23:22, 10.58s/it]
  9%|▉         | 3458/37963 [8:22:38<93:01:33,  9.71s/it] 
  9%|▉         | 3459/37963 [8:22:46<86:27:14,  9.02s/it]
  9%|▉         | 3460/37963 [8:22:53<81:33:41,  8.51s/it]
                                                         
{'loss': '0.1551', 'grad_norm': '1.602', 'learning_rate': '1.98e-05', 'epoch': '0.09114'}

  9%|▉         | 3460/37963 [8:22:53<81:33:41,  8.51s/it]
  9%|▉         | 3461/37963 [8:23:01<78:51:24,  8.23s/it]
  9%|▉         | 3462/37963 [8:23:08<76:51:20,  8.02s/it]
  9%|▉         | 3463/37963 [8:23:15<74:43:13,  7.80s/it]
  9%|▉         | 3464/37963 [8:23:23<74:03:08,  7.73s/it]
  9%|▉         | 3465/37963 [8:23:30<72:41:47,  7.59s/it]
  9%|▉         | 3466/37963 [8:23:38<72:46:03,  7.59s/it]
  9%|▉         | 3467/37963 [8:23:45<72:40:07,  7.58s/it]
  9%|▉         | 3468/37963 [8:23:59<90:44:35,  9.47s/it]
  9%|▉         | 3469/37963 [8:24:07<85:15:01,  8.90s/it]
  9%|▉         | 3470/37963 [8:24:14<81:26:25,  8.50s/it]
                                                         
{'loss': '0.1653', 'grad_norm': '1.276', 'learning_rate': '1.98e-05', 'epoch': '0.09141'}

  9%|▉         | 3470/37963 [8:24:14<81:26:25,  8.50s/it]
  9%|▉         | 3471/37963 [8:24:22<78:21:17,  8.18s/it]
  9%|▉         | 3472/37963 [8:24:29<76:33:42,  7.99s/it]
  9%|▉         | 3473/37963 [8:24:37<75:12:43,  7.85s/it]
  9%|▉         | 3474/37963 [8:24:44<73:54:18,  7.71s/it]
  9%|▉         | 3475/37963 [8:24:52<73:27:58,  7.67s/it]
  9%|▉         | 3476/37963 [8:24:59<73:02:01,  7.62s/it]
  9%|▉         | 3477/37963 [8:25:07<72:40:20,  7.59s/it]
  9%|▉         | 3478/37963 [8:25:15<73:04:51,  7.63s/it]
  9%|▉         | 3479/37963 [8:25:22<72:44:41,  7.59s/it]
  9%|▉         | 3480/37963 [8:25:36<91:10:35,  9.52s/it]
                                                         
{'loss': '0.1872', 'grad_norm': '2.896', 'learning_rate': '1.98e-05', 'epoch': '0.09167'}

  9%|▉         | 3480/37963 [8:25:36<91:10:35,  9.52s/it]
  9%|▉         | 3481/37963 [8:25:44<85:30:13,  8.93s/it]
  9%|▉         | 3482/37963 [8:25:51<81:38:58,  8.52s/it]
  9%|▉         | 3483/37963 [8:25:59<78:09:49,  8.16s/it]
  9%|▉         | 3484/37963 [8:26:06<76:21:27,  7.97s/it]
  9%|▉         | 3485/37963 [8:26:14<74:47:00,  7.81s/it]
  9%|▉         | 3486/37963 [8:26:21<74:17:19,  7.76s/it]
  9%|▉         | 3487/37963 [8:26:29<73:23:20,  7.66s/it]
  9%|▉         | 3488/37963 [8:26:49<111:04:49, 11.60s/it]
  9%|▉         | 3489/37963 [8:26:57<100:08:51, 10.46s/it]
  9%|▉         | 3490/37963 [8:27:05<91:18:58,  9.54s/it] 
                                                         
{'loss': '0.1579', 'grad_norm': '3.573', 'learning_rate': '1.98e-05', 'epoch': '0.09193'}

  9%|▉         | 3490/37963 [8:27:05<91:18:58,  9.54s/it]
  9%|▉         | 3491/37963 [8:27:12<85:23:06,  8.92s/it]
  9%|▉         | 3492/37963 [8:27:20<81:26:04,  8.50s/it]
  9%|▉         | 3493/37963 [8:27:27<78:38:17,  8.21s/it]
  9%|▉         | 3494/37963 [8:27:34<75:28:48,  7.88s/it]
  9%|▉         | 3495/37963 [8:27:42<74:40:09,  7.80s/it]
  9%|▉         | 3496/37963 [8:27:49<73:49:32,  7.71s/it]
  9%|▉         | 3497/37963 [8:28:03<91:17:43,  9.54s/it]
  9%|▉         | 3498/37963 [8:28:11<85:25:13,  8.92s/it]
  9%|▉         | 3499/37963 [8:28:25<99:52:20, 10.43s/it]
  9%|▉         | 3500/37963 [8:28:32<91:32:58,  9.56s/it]
                                                         
{'loss': '0.1816', 'grad_norm': '1.66', 'learning_rate': '1.98e-05', 'epoch': '0.0922'}

  9%|▉         | 3500/37963 [8:28:32<91:32:58,  9.56s/it]
  9%|▉         | 3501/37963 [8:28:40<85:43:42,  8.96s/it]
  9%|▉         | 3502/37963 [8:28:54<101:13:30, 10.57s/it]
  9%|▉         | 3503/37963 [8:29:02<92:43:33,  9.69s/it] 
  9%|▉         | 3504/37963 [8:29:09<86:32:47,  9.04s/it]
  9%|▉         | 3505/37963 [8:29:17<82:06:00,  8.58s/it]
  9%|▉         | 3506/37963 [8:29:24<79:12:55,  8.28s/it]
  9%|▉         | 3507/37963 [8:29:32<77:05:10,  8.05s/it]
  9%|▉         | 3508/37963 [8:29:46<93:48:28,  9.80s/it]
  9%|▉         | 3509/37963 [8:29:53<87:28:32,  9.14s/it]
  9%|▉         | 3510/37963 [8:30:01<83:14:07,  8.70s/it]
                                                         
{'loss': '0.171', 'grad_norm': '1.988', 'learning_rate': '1.98e-05', 'epoch': '0.09246'}

  9%|▉         | 3510/37963 [8:30:01<83:14:07,  8.70s/it]
  9%|▉         | 3511/37963 [8:30:08<79:44:58,  8.33s/it]
  9%|▉         | 3512/37963 [8:30:23<96:44:39, 10.11s/it]
  9%|▉         | 3513/37963 [8:30:30<89:19:56,  9.34s/it]
  9%|▉         | 3514/37963 [8:30:38<84:12:17,  8.80s/it]
  9%|▉         | 3515/37963 [8:30:45<80:31:34,  8.42s/it]
  9%|▉         | 3516/37963 [8:30:53<77:58:51,  8.15s/it]
  9%|▉         | 3517/37963 [8:31:00<75:31:05,  7.89s/it]
  9%|▉         | 3518/37963 [8:31:08<74:33:51,  7.79s/it]
  9%|▉         | 3519/37963 [8:31:15<73:54:22,  7.72s/it]
  9%|▉         | 3520/37963 [8:31:23<73:27:42,  7.68s/it]
                                                         
{'loss': '0.1714', 'grad_norm': '1.512', 'learning_rate': '1.979e-05', 'epoch': '0.09272'}

  9%|▉         | 3520/37963 [8:31:23<73:27:42,  7.68s/it]
  9%|▉         | 3521/37963 [8:31:30<73:13:23,  7.65s/it]
  9%|▉         | 3522/37963 [8:31:38<72:19:07,  7.56s/it]
  9%|▉         | 3523/37963 [8:31:45<72:27:21,  7.57s/it]
  9%|▉         | 3524/37963 [8:31:53<72:19:40,  7.56s/it]
  9%|▉         | 3525/37963 [8:32:00<72:15:18,  7.55s/it]
  9%|▉         | 3526/37963 [8:32:08<71:32:36,  7.48s/it]
  9%|▉         | 3527/37963 [8:32:15<72:22:34,  7.57s/it]
  9%|▉         | 3528/37963 [8:32:23<72:14:30,  7.55s/it]
  9%|▉         | 3529/37963 [8:32:30<71:50:48,  7.51s/it]
  9%|▉         | 3530/37963 [8:32:44<90:03:08,  9.42s/it]
                                                         
{'loss': '0.1642', 'grad_norm': '3.168', 'learning_rate': '1.979e-05', 'epoch': '0.09299'}

  9%|▉         | 3530/37963 [8:32:44<90:03:08,  9.42s/it]
  9%|▉         | 3531/37963 [8:32:52<84:39:30,  8.85s/it]
  9%|▉         | 3532/37963 [8:32:59<80:21:18,  8.40s/it]
  9%|▉         | 3533/37963 [8:33:07<77:32:31,  8.11s/it]
  9%|▉         | 3534/37963 [8:33:21<94:40:29,  9.90s/it]
  9%|▉         | 3535/37963 [8:33:28<88:12:02,  9.22s/it]
  9%|▉         | 3536/37963 [8:33:36<83:02:47,  8.68s/it]
  9%|▉         | 3537/37963 [8:33:50<98:35:27, 10.31s/it]
  9%|▉         | 3538/37963 [8:33:57<90:40:00,  9.48s/it]
  9%|▉         | 3539/37963 [8:34:05<85:02:18,  8.89s/it]
  9%|▉         | 3540/37963 [8:34:13<81:21:09,  8.51s/it]
                                                         
{'loss': '0.1786', 'grad_norm': '3.227', 'learning_rate': '1.979e-05', 'epoch': '0.09325'}

  9%|▉         | 3540/37963 [8:34:13<81:21:09,  8.51s/it]
  9%|▉         | 3541/37963 [8:34:20<78:34:06,  8.22s/it]
  9%|▉         | 3542/37963 [8:34:28<76:57:24,  8.05s/it]
  9%|▉         | 3543/37963 [8:34:35<74:54:53,  7.84s/it]
  9%|▉         | 3544/37963 [8:34:42<73:23:10,  7.68s/it]
  9%|▉         | 3545/37963 [8:34:50<73:03:39,  7.64s/it]
  9%|▉         | 3546/37963 [8:35:03<89:57:20,  9.41s/it]
  9%|▉         | 3547/37963 [8:35:11<84:05:21,  8.80s/it]
  9%|▉         | 3548/37963 [8:35:25<98:43:39, 10.33s/it]
  9%|▉         | 3549/37963 [8:35:32<91:06:20,  9.53s/it]
  9%|▉         | 3550/37963 [8:35:40<85:26:07,  8.94s/it]
                                                         
{'loss': '0.1709', 'grad_norm': '1.533', 'learning_rate': '1.979e-05', 'epoch': '0.09351'}

  9%|▉         | 3550/37963 [8:35:40<85:26:07,  8.94s/it]
  9%|▉         | 3551/37963 [8:35:54<100:22:11, 10.50s/it]
  9%|▉         | 3552/37963 [8:36:02<92:05:17,  9.63s/it] 
  9%|▉         | 3553/37963 [8:36:09<86:19:29,  9.03s/it]
  9%|▉         | 3554/37963 [8:36:17<82:33:52,  8.64s/it]
  9%|▉         | 3555/37963 [8:36:25<79:22:23,  8.30s/it]
  9%|▉         | 3556/37963 [8:36:32<77:20:56,  8.09s/it]
  9%|▉         | 3557/37963 [8:36:40<76:13:26,  7.98s/it]
  9%|▉         | 3558/37963 [8:36:54<92:48:49,  9.71s/it]
  9%|▉         | 3559/37963 [8:37:01<86:56:07,  9.10s/it]
  9%|▉         | 3560/37963 [8:37:09<82:26:28,  8.63s/it]
                                                         
{'loss': '0.1769', 'grad_norm': '2.692', 'learning_rate': '1.979e-05', 'epoch': '0.09378'}

  9%|▉         | 3560/37963 [8:37:09<82:26:28,  8.63s/it]
  9%|▉         | 3561/37963 [8:37:16<79:38:11,  8.33s/it]
  9%|▉         | 3562/37963 [8:37:30<95:46:59, 10.02s/it]
  9%|▉         | 3563/37963 [8:37:38<88:46:51,  9.29s/it]
  9%|▉         | 3564/37963 [8:37:46<83:59:55,  8.79s/it]
  9%|▉         | 3565/37963 [8:37:53<80:38:21,  8.44s/it]
  9%|▉         | 3566/37963 [8:38:01<77:52:47,  8.15s/it]
  9%|▉         | 3567/37963 [8:38:08<76:05:24,  7.96s/it]
  9%|▉         | 3568/37963 [8:38:16<74:15:32,  7.77s/it]
  9%|▉         | 3569/37963 [8:38:23<73:35:14,  7.70s/it]
  9%|▉         | 3570/37963 [8:38:31<73:04:37,  7.65s/it]
                                                         
{'loss': '0.1745', 'grad_norm': '4.239', 'learning_rate': '1.979e-05', 'epoch': '0.09404'}

  9%|▉         | 3570/37963 [8:38:31<73:04:37,  7.65s/it]
  9%|▉         | 3571/37963 [8:38:38<72:27:05,  7.58s/it]
  9%|▉         | 3572/37963 [8:38:46<72:18:03,  7.57s/it]
  9%|▉         | 3573/37963 [8:38:53<72:11:36,  7.56s/it]
  9%|▉         | 3574/37963 [8:39:01<72:11:55,  7.56s/it]
  9%|▉         | 3575/37963 [8:39:08<72:11:44,  7.56s/it]
  9%|▉         | 3576/37963 [8:39:16<72:10:49,  7.56s/it]
  9%|▉         | 3577/37963 [8:39:23<71:28:25,  7.48s/it]
  9%|▉         | 3578/37963 [8:39:31<71:55:39,  7.53s/it]
  9%|▉         | 3579/37963 [8:39:38<71:50:04,  7.52s/it]
  9%|▉         | 3580/37963 [8:39:46<71:28:32,  7.48s/it]
                                                         
{'loss': '0.1754', 'grad_norm': '2.047', 'learning_rate': '1.978e-05', 'epoch': '0.0943'}

  9%|▉         | 3580/37963 [8:39:46<71:28:32,  7.48s/it]
  9%|▉         | 3581/37963 [8:39:53<72:01:00,  7.54s/it]
  9%|▉         | 3582/37963 [8:40:01<71:57:41,  7.54s/it]
  9%|▉         | 3583/37963 [8:40:09<72:27:29,  7.59s/it]
  9%|▉         | 3584/37963 [8:40:22<89:53:44,  9.41s/it]
  9%|▉         | 3585/37963 [8:40:36<102:20:44, 10.72s/it]
  9%|▉         | 3586/37963 [8:40:50<111:52:45, 11.72s/it]
  9%|▉         | 3587/37963 [8:40:58<99:56:15, 10.47s/it] 
  9%|▉         | 3588/37963 [8:41:05<91:28:06,  9.58s/it]
  9%|▉         | 3589/37963 [8:41:13<85:55:13,  9.00s/it]
  9%|▉         | 3590/37963 [8:41:20<81:15:44,  8.51s/it]
                                                         
{'loss': '0.1673', 'grad_norm': '2.297', 'learning_rate': '1.978e-05', 'epoch': '0.09457'}

  9%|▉         | 3590/37963 [8:41:20<81:15:44,  8.51s/it]
  9%|▉         | 3591/37963 [8:41:28<78:31:36,  8.22s/it]
  9%|▉         | 3592/37963 [8:41:35<76:36:23,  8.02s/it]
  9%|▉         | 3593/37963 [8:41:49<93:13:58,  9.77s/it]
  9%|▉         | 3594/37963 [8:41:57<86:54:58,  9.10s/it]
  9%|▉         | 3595/37963 [8:42:04<82:06:32,  8.60s/it]
  9%|▉         | 3596/37963 [8:42:18<97:34:39, 10.22s/it]
  9%|▉         | 3597/37963 [8:42:26<89:49:33,  9.41s/it]
  9%|▉         | 3598/37963 [8:42:33<84:57:20,  8.90s/it]
  9%|▉         | 3599/37963 [8:42:41<81:00:25,  8.49s/it]
  9%|▉         | 3600/37963 [8:42:55<97:20:54, 10.20s/it]
                                                         
{'loss': '0.1679', 'grad_norm': '2.932', 'learning_rate': '1.978e-05', 'epoch': '0.09483'}

  9%|▉         | 3600/37963 [8:42:55<97:20:54, 10.20s/it]
  9%|▉         | 3601/37963 [8:43:03<89:48:47,  9.41s/it]
  9%|▉         | 3602/37963 [8:43:10<84:24:41,  8.84s/it]
  9%|▉         | 3603/37963 [8:43:18<80:34:55,  8.44s/it]
  9%|▉         | 3604/37963 [8:43:25<77:53:54,  8.16s/it]
  9%|▉         | 3605/37963 [8:43:39<94:16:52,  9.88s/it]
  9%|▉         | 3606/37963 [8:43:47<87:50:29,  9.20s/it]
 10%|▉         | 3607/37963 [8:43:54<82:59:33,  8.70s/it]
 10%|▉         | 3608/37963 [8:44:02<79:27:36,  8.33s/it]
 10%|▉         | 3609/37963 [8:44:09<77:39:08,  8.14s/it]
 10%|▉         | 3610/37963 [8:44:24<95:11:50,  9.98s/it]
                                                         
{'loss': '0.1683', 'grad_norm': '3.089', 'learning_rate': '1.978e-05', 'epoch': '0.09509'}

 10%|▉         | 3610/37963 [8:44:24<95:11:50,  9.98s/it]
 10%|▉         | 3611/37963 [8:44:31<88:08:59,  9.24s/it]
 10%|▉         | 3612/37963 [8:44:39<83:37:01,  8.76s/it]
 10%|▉         | 3613/37963 [8:44:46<80:33:18,  8.44s/it]
 10%|▉         | 3614/37963 [8:44:54<77:54:52,  8.17s/it]
 10%|▉         | 3615/37963 [8:45:02<76:47:08,  8.05s/it]
 10%|▉         | 3616/37963 [8:45:09<75:06:04,  7.87s/it]
 10%|▉         | 3617/37963 [8:45:17<74:11:03,  7.78s/it]
 10%|▉         | 3618/37963 [8:45:24<73:29:54,  7.70s/it]
 10%|▉         | 3619/37963 [8:45:32<73:01:17,  7.65s/it]
 10%|▉         | 3620/37963 [8:45:39<73:00:10,  7.65s/it]
                                                         
{'loss': '0.1671', 'grad_norm': '7.072', 'learning_rate': '1.978e-05', 'epoch': '0.09536'}

 10%|▉         | 3620/37963 [8:45:39<73:00:10,  7.65s/it]
 10%|▉         | 3621/37963 [8:45:47<72:03:17,  7.55s/it]
 10%|▉         | 3622/37963 [8:45:54<71:55:46,  7.54s/it]
 10%|▉         | 3623/37963 [8:46:02<71:41:15,  7.52s/it]
 10%|▉         | 3624/37963 [8:46:09<71:43:11,  7.52s/it]
 10%|▉         | 3625/37963 [8:46:17<71:55:03,  7.54s/it]
 10%|▉         | 3626/37963 [8:46:24<71:54:22,  7.54s/it]
 10%|▉         | 3627/37963 [8:46:32<71:18:57,  7.48s/it]
 10%|▉         | 3628/37963 [8:46:39<71:28:08,  7.49s/it]
 10%|▉         | 3629/37963 [8:46:47<71:34:09,  7.50s/it]
 10%|▉         | 3630/37963 [8:46:54<71:04:41,  7.45s/it]
                                                         
{'loss': '0.1552', 'grad_norm': '2.041', 'learning_rate': '1.978e-05', 'epoch': '0.09562'}

 10%|▉         | 3630/37963 [8:46:54<71:04:41,  7.45s/it]
 10%|▉         | 3631/37963 [8:47:02<71:06:44,  7.46s/it]
 10%|▉         | 3632/37963 [8:47:15<89:04:32,  9.34s/it]
 10%|▉         | 3633/37963 [8:47:23<83:51:09,  8.79s/it]
 10%|▉         | 3634/37963 [8:47:43<116:50:25, 12.25s/it]
 10%|▉         | 3635/37963 [8:47:51<103:30:47, 10.86s/it]
 10%|▉         | 3636/37963 [8:47:58<93:31:35,  9.81s/it] 
 10%|▉         | 3637/37963 [8:48:05<86:34:01,  9.08s/it]
 10%|▉         | 3638/37963 [8:48:13<81:33:25,  8.55s/it]
 10%|▉         | 3639/37963 [8:48:20<78:14:53,  8.21s/it]
 10%|▉         | 3640/37963 [8:48:27<75:32:24,  7.92s/it]
                                                         
{'loss': '0.1807', 'grad_norm': '0.9699', 'learning_rate': '1.977e-05', 'epoch': '0.09588'}

 10%|▉         | 3640/37963 [8:48:27<75:32:24,  7.92s/it]
 10%|▉         | 3641/37963 [8:48:35<73:36:20,  7.72s/it]
 10%|▉         | 3642/37963 [8:48:42<73:37:17,  7.72s/it]
 10%|▉         | 3643/37963 [8:48:50<73:02:03,  7.66s/it]
 10%|▉         | 3644/37963 [8:48:58<72:41:43,  7.63s/it]
 10%|▉         | 3645/37963 [8:49:11<90:27:39,  9.49s/it]
 10%|▉         | 3646/37963 [8:49:19<84:43:35,  8.89s/it]
 10%|▉         | 3647/37963 [8:49:33<98:35:47, 10.34s/it]
 10%|▉         | 3648/37963 [8:49:40<90:37:23,  9.51s/it]
 10%|▉         | 3649/37963 [8:49:48<84:59:21,  8.92s/it]
 10%|▉         | 3650/37963 [8:49:55<81:02:12,  8.50s/it]
                                                         
{'loss': '0.1765', 'grad_norm': '4.11', 'learning_rate': '1.977e-05', 'epoch': '0.09615'}

 10%|▉         | 3650/37963 [8:49:55<81:02:12,  8.50s/it]
 10%|▉         | 3651/37963 [8:50:03<78:11:33,  8.20s/it]
 10%|▉         | 3652/37963 [8:50:10<75:53:05,  7.96s/it]
 10%|▉         | 3653/37963 [8:50:31<111:37:43, 11.71s/it]
 10%|▉         | 3654/37963 [8:50:38<99:30:19, 10.44s/it] 
 10%|▉         | 3655/37963 [8:50:46<91:03:28,  9.55s/it]
 10%|▉         | 3656/37963 [8:50:53<84:47:49,  8.90s/it]
 10%|▉         | 3657/37963 [8:51:00<80:28:29,  8.44s/it]
 10%|▉         | 3658/37963 [8:51:14<96:07:41, 10.09s/it]
 10%|▉         | 3659/37963 [8:51:22<88:44:49,  9.31s/it]
 10%|▉         | 3660/37963 [8:51:29<83:41:11,  8.78s/it]
                                                         
{'loss': '0.1615', 'grad_norm': '1.76', 'learning_rate': '1.977e-05', 'epoch': '0.09641'}

 10%|▉         | 3660/37963 [8:51:29<83:41:11,  8.78s/it]
 10%|▉         | 3661/37963 [8:51:37<80:03:36,  8.40s/it]
 10%|▉         | 3662/37963 [8:51:44<77:37:42,  8.15s/it]
 10%|▉         | 3663/37963 [8:51:52<75:29:07,  7.92s/it]
 10%|▉         | 3664/37963 [8:51:59<74:17:30,  7.80s/it]
 10%|▉         | 3665/37963 [8:52:07<73:48:06,  7.75s/it]
 10%|▉         | 3666/37963 [8:52:14<73:05:46,  7.67s/it]
 10%|▉         | 3667/37963 [8:52:22<73:00:13,  7.66s/it]
 10%|▉         | 3668/37963 [8:52:29<71:57:57,  7.55s/it]
 10%|▉         | 3669/37963 [8:52:37<71:55:13,  7.55s/it]
 10%|▉         | 3670/37963 [8:52:45<72:18:29,  7.59s/it]
                                                         
{'loss': '0.1856', 'grad_norm': '9.139', 'learning_rate': '1.977e-05', 'epoch': '0.09667'}

 10%|▉         | 3670/37963 [8:52:45<72:18:29,  7.59s/it]
 10%|▉         | 3671/37963 [8:52:52<72:32:23,  7.62s/it]
 10%|▉         | 3672/37963 [8:53:00<72:54:22,  7.65s/it]
 10%|▉         | 3673/37963 [8:53:08<72:38:35,  7.63s/it]
 10%|▉         | 3674/37963 [8:53:15<72:32:58,  7.62s/it]
 10%|▉         | 3675/37963 [8:53:23<72:23:40,  7.60s/it]
 10%|▉         | 3676/37963 [8:53:36<89:49:36,  9.43s/it]
 10%|▉         | 3677/37963 [8:53:44<84:42:46,  8.89s/it]
 10%|▉         | 3678/37963 [8:53:52<80:51:57,  8.49s/it]
 10%|▉         | 3679/37963 [8:54:06<97:18:27, 10.22s/it]
 10%|▉         | 3680/37963 [8:54:20<108:01:19, 11.34s/it]
                                                          
{'loss': '0.1875', 'grad_norm': '6.139', 'learning_rate': '1.977e-05', 'epoch': '0.09694'}

 10%|▉         | 3680/37963 [8:54:20<108:01:19, 11.34s/it]
 10%|▉         | 3681/37963 [8:54:27<97:09:32, 10.20s/it] 
 10%|▉         | 3682/37963 [8:54:35<89:42:23,  9.42s/it]
 10%|▉         | 3683/37963 [8:54:42<83:45:55,  8.80s/it]
 10%|▉         | 3684/37963 [8:54:50<80:23:45,  8.44s/it]
 10%|▉         | 3685/37963 [8:54:57<77:54:07,  8.18s/it]
 10%|▉         | 3686/37963 [8:55:05<76:14:01,  8.01s/it]
 10%|▉         | 3687/37963 [8:55:13<74:58:46,  7.88s/it]
 10%|▉         | 3688/37963 [8:55:20<73:55:54,  7.77s/it]
 10%|▉         | 3689/37963 [8:55:28<73:21:17,  7.70s/it]
 10%|▉         | 3690/37963 [8:55:35<72:50:03,  7.65s/it]
                                                         
{'loss': '0.1831', 'grad_norm': '4.398', 'learning_rate': '1.976e-05', 'epoch': '0.0972'}

 10%|▉         | 3690/37963 [8:55:35<72:50:03,  7.65s/it]
 10%|▉         | 3691/37963 [8:55:43<72:59:19,  7.67s/it]
 10%|▉         | 3692/37963 [8:55:57<90:49:51,  9.54s/it]
 10%|▉         | 3693/37963 [8:56:04<85:10:37,  8.95s/it]
 10%|▉         | 3694/37963 [8:56:12<81:24:35,  8.55s/it]
 10%|▉         | 3695/37963 [8:56:20<78:28:57,  8.24s/it]
 10%|▉         | 3696/37963 [8:56:27<76:46:06,  8.07s/it]
 10%|▉         | 3697/37963 [8:56:41<92:22:26,  9.70s/it]
 10%|▉         | 3698/37963 [8:56:48<86:01:07,  9.04s/it]
 10%|▉         | 3699/37963 [8:57:09<118:49:30, 12.48s/it]
 10%|▉         | 3700/37963 [8:57:16<104:27:31, 10.98s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '3.71', 'learning_rate': '1.976e-05', 'epoch': '0.09746'}

 10%|▉         | 3700/37963 [8:57:16<104:27:31, 10.98s/it]
 10%|▉         | 3701/37963 [8:57:24<94:40:34,  9.95s/it] 
 10%|▉         | 3702/37963 [8:57:31<87:23:37,  9.18s/it]
 10%|▉         | 3703/37963 [8:57:38<82:04:36,  8.62s/it]
 10%|▉         | 3704/37963 [8:57:46<79:12:09,  8.32s/it]
 10%|▉         | 3705/37963 [8:57:54<76:47:56,  8.07s/it]
 10%|▉         | 3706/37963 [8:58:08<94:04:44,  9.89s/it]
 10%|▉         | 3707/37963 [8:58:15<87:24:21,  9.19s/it]
 10%|▉         | 3708/37963 [8:58:23<82:59:02,  8.72s/it]
 10%|▉         | 3709/37963 [8:58:30<79:14:14,  8.33s/it]
 10%|▉         | 3710/37963 [8:58:38<77:06:04,  8.10s/it]
                                                         
{'loss': '0.1764', 'grad_norm': '3.213', 'learning_rate': '1.976e-05', 'epoch': '0.09773'}

 10%|▉         | 3710/37963 [8:58:38<77:06:04,  8.10s/it]
 10%|▉         | 3711/37963 [8:58:45<75:40:57,  7.95s/it]
 10%|▉         | 3712/37963 [8:58:53<74:59:18,  7.88s/it]
 10%|▉         | 3713/37963 [8:59:01<74:10:50,  7.80s/it]
 10%|▉         | 3714/37963 [8:59:08<73:44:36,  7.75s/it]
 10%|▉         | 3715/37963 [8:59:16<73:21:35,  7.71s/it]
 10%|▉         | 3716/37963 [8:59:23<72:33:52,  7.63s/it]
 10%|▉         | 3717/37963 [8:59:31<72:09:53,  7.59s/it]
 10%|▉         | 3718/37963 [8:59:38<71:39:50,  7.53s/it]
 10%|▉         | 3719/37963 [8:59:46<71:50:36,  7.55s/it]
 10%|▉         | 3720/37963 [8:59:54<71:49:12,  7.55s/it]
                                                         
{'loss': '0.1635', 'grad_norm': '1.999', 'learning_rate': '1.976e-05', 'epoch': '0.09799'}

 10%|▉         | 3720/37963 [8:59:54<71:49:12,  7.55s/it]
 10%|▉         | 3721/37963 [9:00:01<71:52:41,  7.56s/it]
 10%|▉         | 3722/37963 [9:00:09<71:45:38,  7.54s/it]
 10%|▉         | 3723/37963 [9:00:22<89:40:48,  9.43s/it]
 10%|▉         | 3724/37963 [9:00:30<84:15:56,  8.86s/it]
 10%|▉         | 3725/37963 [9:00:38<80:29:54,  8.46s/it]
 10%|▉         | 3726/37963 [9:00:45<77:55:44,  8.19s/it]
 10%|▉         | 3727/37963 [9:00:52<75:22:48,  7.93s/it]
 10%|▉         | 3728/37963 [9:01:06<92:36:41,  9.74s/it]
 10%|▉         | 3729/37963 [9:01:14<86:50:00,  9.13s/it]
 10%|▉         | 3730/37963 [9:01:21<81:54:09,  8.61s/it]
                                                         
{'loss': '0.1615', 'grad_norm': '3.301', 'learning_rate': '1.976e-05', 'epoch': '0.09825'}

 10%|▉         | 3730/37963 [9:01:21<81:54:09,  8.61s/it]
 10%|▉         | 3731/37963 [9:01:29<79:07:31,  8.32s/it]
 10%|▉         | 3732/37963 [9:01:43<95:38:02, 10.06s/it]
 10%|▉         | 3733/37963 [9:01:51<88:19:23,  9.29s/it]
 10%|▉         | 3734/37963 [9:01:58<83:11:25,  8.75s/it]
 10%|▉         | 3735/37963 [9:02:06<79:38:46,  8.38s/it]
 10%|▉         | 3736/37963 [9:02:13<77:14:51,  8.12s/it]
 10%|▉         | 3737/37963 [9:02:21<75:46:34,  7.97s/it]
 10%|▉         | 3738/37963 [9:02:28<74:31:11,  7.84s/it]
 10%|▉         | 3739/37963 [9:02:36<73:15:51,  7.71s/it]
 10%|▉         | 3740/37963 [9:02:43<73:01:22,  7.68s/it]
                                                         
{'loss': '0.1596', 'grad_norm': '2.515', 'learning_rate': '1.975e-05', 'epoch': '0.09852'}

 10%|▉         | 3740/37963 [9:02:43<73:01:22,  7.68s/it]
 10%|▉         | 3741/37963 [9:02:57<90:40:18,  9.54s/it]
 10%|▉         | 3742/37963 [9:03:05<84:44:37,  8.91s/it]
 10%|▉         | 3743/37963 [9:03:12<81:06:33,  8.53s/it]
 10%|▉         | 3744/37963 [9:03:26<97:02:59, 10.21s/it]
 10%|▉         | 3745/37963 [9:03:47<126:05:07, 13.27s/it]
 10%|▉         | 3746/37963 [9:03:54<108:53:33, 11.46s/it]
 10%|▉         | 3747/37963 [9:04:02<98:19:02, 10.34s/it] 
 10%|▉         | 3748/37963 [9:04:09<89:55:19,  9.46s/it]
 10%|▉         | 3749/37963 [9:04:17<84:24:12,  8.88s/it]
 10%|▉         | 3750/37963 [9:04:24<80:37:10,  8.48s/it]
                                                         
{'loss': '0.1645', 'grad_norm': '2.658', 'learning_rate': '1.975e-05', 'epoch': '0.09878'}

 10%|▉         | 3750/37963 [9:04:24<80:37:10,  8.48s/it]
 10%|▉         | 3751/37963 [9:04:32<78:00:46,  8.21s/it]
 10%|▉         | 3752/37963 [9:04:39<75:39:40,  7.96s/it]
 10%|▉         | 3753/37963 [9:04:47<74:29:21,  7.84s/it]
 10%|▉         | 3754/37963 [9:05:01<91:36:40,  9.64s/it]
 10%|▉         | 3755/37963 [9:05:08<85:48:15,  9.03s/it]
 10%|▉         | 3756/37963 [9:05:16<81:32:28,  8.58s/it]
 10%|▉         | 3757/37963 [9:05:23<78:20:25,  8.24s/it]
 10%|▉         | 3758/37963 [9:05:31<76:17:57,  8.03s/it]
 10%|▉         | 3759/37963 [9:05:38<74:36:40,  7.85s/it]
 10%|▉         | 3760/37963 [9:05:46<73:43:12,  7.76s/it]
                                                         
{'loss': '0.1569', 'grad_norm': '1.801', 'learning_rate': '1.975e-05', 'epoch': '0.09904'}

 10%|▉         | 3760/37963 [9:05:46<73:43:12,  7.76s/it]
 10%|▉         | 3761/37963 [9:05:53<73:09:54,  7.70s/it]
 10%|▉         | 3762/37963 [9:06:01<72:32:59,  7.64s/it]
 10%|▉         | 3763/37963 [9:06:08<72:24:44,  7.62s/it]
 10%|▉         | 3764/37963 [9:06:16<71:20:47,  7.51s/it]
 10%|▉         | 3765/37963 [9:06:23<70:48:05,  7.45s/it]
 10%|▉         | 3766/37963 [9:06:30<70:42:25,  7.44s/it]
 10%|▉         | 3767/37963 [9:06:38<70:53:03,  7.46s/it]
 10%|▉         | 3768/37963 [9:06:46<71:30:18,  7.53s/it]
 10%|▉         | 3769/37963 [9:06:53<71:33:49,  7.53s/it]
 10%|▉         | 3770/37963 [9:07:07<89:54:41,  9.47s/it]
                                                         
{'loss': '1.914', 'grad_norm': '110', 'learning_rate': '1.975e-05', 'epoch': '0.09931'}

 10%|▉         | 3770/37963 [9:07:07<89:54:41,  9.47s/it]
 10%|▉         | 3771/37963 [9:07:15<84:18:04,  8.88s/it]
 10%|▉         | 3772/37963 [9:07:22<80:29:34,  8.48s/it]
 10%|▉         | 3773/37963 [9:07:30<77:38:28,  8.18s/it]
 10%|▉         | 3774/37963 [9:07:37<75:57:04,  8.00s/it]
 10%|▉         | 3775/37963 [9:07:45<74:27:55,  7.84s/it]
 10%|▉         | 3776/37963 [9:07:59<92:37:27,  9.75s/it]
 10%|▉         | 3777/37963 [9:08:13<104:42:30, 11.03s/it]
 10%|▉         | 3778/37963 [9:08:21<95:13:58, 10.03s/it] 
 10%|▉         | 3779/37963 [9:08:28<88:09:09,  9.28s/it]
 10%|▉         | 3780/37963 [9:08:36<82:58:10,  8.74s/it]
                                                         
{'loss': '0.3772', 'grad_norm': '2.482', 'learning_rate': '1.975e-05', 'epoch': '0.09957'}

 10%|▉         | 3780/37963 [9:08:36<82:58:10,  8.74s/it]
 10%|▉         | 3781/37963 [9:08:43<79:36:29,  8.38s/it]
 10%|▉         | 3782/37963 [9:08:51<77:16:37,  8.14s/it]
 10%|▉         | 3783/37963 [9:08:58<75:49:05,  7.99s/it]
 10%|▉         | 3784/37963 [9:09:06<74:35:38,  7.86s/it]
 10%|▉         | 3785/37963 [9:09:14<73:46:35,  7.77s/it]
 10%|▉         | 3786/37963 [9:09:21<73:06:50,  7.70s/it]
 10%|▉         | 3787/37963 [9:09:29<72:29:19,  7.64s/it]
 10%|▉         | 3788/37963 [9:09:36<71:39:30,  7.55s/it]
 10%|▉         | 3789/37963 [9:09:44<72:27:07,  7.63s/it]
 10%|▉         | 3790/37963 [9:09:51<72:01:37,  7.59s/it]
                                                         
{'loss': '0.2314', 'grad_norm': '4.838', 'learning_rate': '1.975e-05', 'epoch': '0.09983'}

 10%|▉         | 3790/37963 [9:09:51<72:01:37,  7.59s/it]
 10%|▉         | 3791/37963 [9:10:05<90:36:22,  9.55s/it]
 10%|▉         | 3792/37963 [9:10:20<104:20:01, 10.99s/it]
 10%|▉         | 3793/37963 [9:10:34<113:52:28, 12.00s/it]
 10%|▉         | 3794/37963 [9:10:48<119:04:09, 12.54s/it]
 10%|▉         | 3795/37963 [9:10:55<104:47:16, 11.04s/it]
 10%|▉         | 3796/37963 [9:11:03<94:43:40,  9.98s/it] 
 10%|█         | 3797/37963 [9:11:10<87:05:07,  9.18s/it]
 10%|█         | 3798/37963 [9:11:18<82:22:46,  8.68s/it]
 10%|█         | 3799/37963 [9:11:25<79:07:05,  8.34s/it]
 10%|█         | 3800/37963 [9:11:39<95:46:32, 10.09s/it]
                                                         
{'loss': '0.218', 'grad_norm': '2.733', 'learning_rate': '1.974e-05', 'epoch': '0.1001'}

 10%|█         | 3800/37963 [9:11:39<95:46:32, 10.09s/it]
 10%|█         | 3801/37963 [9:11:47<87:54:50,  9.26s/it]
 10%|█         | 3802/37963 [9:11:54<82:58:40,  8.74s/it]
 10%|█         | 3803/37963 [9:12:02<79:27:30,  8.37s/it]
 10%|█         | 3804/37963 [9:12:09<77:00:57,  8.12s/it]
 10%|█         | 3805/37963 [9:12:17<74:51:01,  7.89s/it]
 10%|█         | 3806/37963 [9:12:24<73:47:35,  7.78s/it]
 10%|█         | 3807/37963 [9:12:32<72:45:55,  7.67s/it]
 10%|█         | 3808/37963 [9:12:39<72:13:33,  7.61s/it]
 10%|█         | 3809/37963 [9:12:47<71:54:37,  7.58s/it]
 10%|█         | 3810/37963 [9:12:54<71:46:57,  7.57s/it]
                                                         
{'loss': '0.2052', 'grad_norm': '6.986', 'learning_rate': '1.974e-05', 'epoch': '0.1004'}

 10%|█         | 3810/37963 [9:12:54<71:46:57,  7.57s/it]
 10%|█         | 3811/37963 [9:13:02<71:14:52,  7.51s/it]
 10%|█         | 3812/37963 [9:13:09<70:48:41,  7.46s/it]
 10%|█         | 3813/37963 [9:13:16<70:42:39,  7.45s/it]
 10%|█         | 3814/37963 [9:13:30<88:31:31,  9.33s/it]
 10%|█         | 3815/37963 [9:13:38<83:20:53,  8.79s/it]
 10%|█         | 3816/37963 [9:13:45<79:32:08,  8.39s/it]
 10%|█         | 3817/37963 [9:13:52<76:02:32,  8.02s/it]
 10%|█         | 3818/37963 [9:14:00<74:54:09,  7.90s/it]
 10%|█         | 3819/37963 [9:14:07<72:56:29,  7.69s/it]
 10%|█         | 3820/37963 [9:14:15<72:36:29,  7.66s/it]
                                                         
{'loss': '0.1929', 'grad_norm': '4.001', 'learning_rate': '1.974e-05', 'epoch': '0.1006'}

 10%|█         | 3820/37963 [9:14:15<72:36:29,  7.66s/it]
 10%|█         | 3821/37963 [9:14:22<71:13:12,  7.51s/it]
 10%|█         | 3822/37963 [9:14:29<71:09:03,  7.50s/it]
 10%|█         | 3823/37963 [9:14:37<71:22:36,  7.53s/it]
 10%|█         | 3824/37963 [9:14:50<88:35:12,  9.34s/it]
 10%|█         | 3825/37963 [9:14:58<83:44:15,  8.83s/it]
 10%|█         | 3826/37963 [9:15:05<79:36:45,  8.40s/it]
 10%|█         | 3827/37963 [9:15:19<95:22:44, 10.06s/it]
 10%|█         | 3828/37963 [9:15:27<88:09:29,  9.30s/it]
 10%|█         | 3829/37963 [9:15:34<83:10:27,  8.77s/it]
 10%|█         | 3830/37963 [9:15:42<78:58:03,  8.33s/it]
                                                         
{'loss': '0.214', 'grad_norm': '7.733', 'learning_rate': '1.974e-05', 'epoch': '0.1009'}

 10%|█         | 3830/37963 [9:15:42<78:58:03,  8.33s/it]
 10%|█         | 3831/37963 [9:15:49<76:03:58,  8.02s/it]
 10%|█         | 3832/37963 [9:15:57<74:52:25,  7.90s/it]
 10%|█         | 3833/37963 [9:16:04<73:31:39,  7.76s/it]
 10%|█         | 3834/37963 [9:16:12<72:53:45,  7.69s/it]
 10%|█         | 3835/37963 [9:16:19<72:33:06,  7.65s/it]
 10%|█         | 3836/37963 [9:16:33<90:03:51,  9.50s/it]
 10%|█         | 3837/37963 [9:16:41<84:43:36,  8.94s/it]
 10%|█         | 3838/37963 [9:17:01<118:08:44, 12.46s/it]
 10%|█         | 3839/37963 [9:17:09<104:08:08, 10.99s/it]
 10%|█         | 3840/37963 [9:17:16<94:25:02,  9.96s/it] 
                                                         
{'loss': '0.1898', 'grad_norm': '6.14', 'learning_rate': '1.974e-05', 'epoch': '0.1012'}

 10%|█         | 3840/37963 [9:17:16<94:25:02,  9.96s/it]
 10%|█         | 3841/37963 [9:17:24<87:35:30,  9.24s/it]
 10%|█         | 3842/37963 [9:17:31<82:35:02,  8.71s/it]
 10%|█         | 3843/37963 [9:17:45<97:37:21, 10.30s/it]
 10%|█         | 3844/37963 [9:18:00<109:00:22, 11.50s/it]
 10%|█         | 3845/37963 [9:18:07<97:42:56, 10.31s/it] 
 10%|█         | 3846/37963 [9:18:15<90:34:20,  9.56s/it]
 10%|█         | 3847/37963 [9:18:22<83:59:08,  8.86s/it]
 10%|█         | 3848/37963 [9:18:30<80:22:48,  8.48s/it]
 10%|█         | 3849/37963 [9:18:37<77:37:56,  8.19s/it]
 10%|█         | 3850/37963 [9:18:45<75:38:18,  7.98s/it]
                                                         
{'loss': '0.1932', 'grad_norm': '2.615', 'learning_rate': '1.973e-05', 'epoch': '0.1014'}

 10%|█         | 3850/37963 [9:18:45<75:38:18,  7.98s/it]
 10%|█         | 3851/37963 [9:18:52<74:16:15,  7.84s/it]
 10%|█         | 3852/37963 [9:19:00<73:20:48,  7.74s/it]
 10%|█         | 3853/37963 [9:19:07<72:36:32,  7.66s/it]
 10%|█         | 3854/37963 [9:19:15<72:13:01,  7.62s/it]
 10%|█         | 3855/37963 [9:19:22<71:53:21,  7.59s/it]
 10%|█         | 3856/37963 [9:19:30<71:31:27,  7.55s/it]
 10%|█         | 3857/37963 [9:19:38<71:50:19,  7.58s/it]
 10%|█         | 3858/37963 [9:19:45<71:24:36,  7.54s/it]
 10%|█         | 3859/37963 [9:19:52<70:58:03,  7.49s/it]
 10%|█         | 3860/37963 [9:20:00<71:21:20,  7.53s/it]
                                                         
{'loss': '0.19', 'grad_norm': '1.842', 'learning_rate': '1.973e-05', 'epoch': '0.1017'}

 10%|█         | 3860/37963 [9:20:00<71:21:20,  7.53s/it]
 10%|█         | 3861/37963 [9:20:07<70:36:09,  7.45s/it]
 10%|█         | 3862/37963 [9:20:21<88:36:36,  9.35s/it]
 10%|█         | 3863/37963 [9:20:29<83:20:55,  8.80s/it]
 10%|█         | 3864/37963 [9:20:36<79:17:28,  8.37s/it]
 10%|█         | 3865/37963 [9:20:43<76:49:45,  8.11s/it]
 10%|█         | 3866/37963 [9:20:51<74:37:27,  7.88s/it]
 10%|█         | 3867/37963 [9:20:58<74:13:13,  7.84s/it]
 10%|█         | 3868/37963 [9:21:06<73:16:07,  7.74s/it]
 10%|█         | 3869/37963 [9:21:14<74:33:10,  7.87s/it]
 10%|█         | 3870/37963 [9:21:22<73:44:43,  7.79s/it]
                                                         
{'loss': '0.1939', 'grad_norm': '2.378', 'learning_rate': '1.973e-05', 'epoch': '0.1019'}

 10%|█         | 3870/37963 [9:21:22<73:44:43,  7.79s/it]
 10%|█         | 3871/37963 [9:21:29<73:22:20,  7.75s/it]
 10%|█         | 3872/37963 [9:21:37<72:17:57,  7.63s/it]
 10%|█         | 3873/37963 [9:21:51<92:01:24,  9.72s/it]
 10%|█         | 3874/37963 [9:21:59<85:42:45,  9.05s/it]
 10%|█         | 3875/37963 [9:22:07<81:54:46,  8.65s/it]
 10%|█         | 3876/37963 [9:22:14<78:57:43,  8.34s/it]
 10%|█         | 3877/37963 [9:22:22<76:44:52,  8.11s/it]
 10%|█         | 3878/37963 [9:22:30<76:19:06,  8.06s/it]
 10%|█         | 3879/37963 [9:22:37<75:00:12,  7.92s/it]
 10%|█         | 3880/37963 [9:22:45<73:48:47,  7.80s/it]
                                                         
{'loss': '0.1858', 'grad_norm': '2.027', 'learning_rate': '1.973e-05', 'epoch': '0.1022'}

 10%|█         | 3880/37963 [9:22:45<73:48:47,  7.80s/it]
 10%|█         | 3881/37963 [9:22:52<73:17:55,  7.74s/it]
 10%|█         | 3882/37963 [9:23:07<92:01:12,  9.72s/it]
 10%|█         | 3883/37963 [9:23:14<85:14:30,  9.00s/it]
 10%|█         | 3884/37963 [9:23:22<81:47:45,  8.64s/it]
 10%|█         | 3885/37963 [9:23:29<78:48:51,  8.33s/it]
 10%|█         | 3886/37963 [9:23:44<95:47:16, 10.12s/it]
 10%|█         | 3887/37963 [9:23:51<88:37:27,  9.36s/it]
 10%|█         | 3888/37963 [9:23:59<84:20:40,  8.91s/it]
 10%|█         | 3889/37963 [9:24:07<80:27:33,  8.50s/it]
 10%|█         | 3890/37963 [9:24:14<78:03:36,  8.25s/it]
                                                         
{'loss': '0.1905', 'grad_norm': '1.963', 'learning_rate': '1.973e-05', 'epoch': '0.1025'}

 10%|█         | 3890/37963 [9:24:14<78:03:36,  8.25s/it]
 10%|█         | 3891/37963 [9:24:22<75:47:42,  8.01s/it]
 10%|█         | 3892/37963 [9:24:30<75:17:13,  7.95s/it]
 10%|█         | 3893/37963 [9:24:38<76:05:07,  8.04s/it]
 10%|█         | 3894/37963 [9:24:45<74:35:04,  7.88s/it]
 10%|█         | 3895/37963 [9:24:53<73:34:04,  7.77s/it]
 10%|█         | 3896/37963 [9:25:14<110:00:39, 11.63s/it]
 10%|█         | 3897/37963 [9:25:21<98:39:13, 10.43s/it] 
 10%|█         | 3898/37963 [9:25:29<90:46:53,  9.59s/it]
 10%|█         | 3899/37963 [9:25:37<85:31:21,  9.04s/it]
 10%|█         | 3900/37963 [9:25:44<81:47:29,  8.64s/it]
                                                         
{'loss': '0.1927', 'grad_norm': '2.755', 'learning_rate': '1.972e-05', 'epoch': '0.1027'}

 10%|█         | 3900/37963 [9:25:44<81:47:29,  8.64s/it]
 10%|█         | 3901/37963 [9:25:52<79:21:45,  8.39s/it]
 10%|█         | 3902/37963 [9:25:59<76:23:58,  8.07s/it]
 10%|█         | 3903/37963 [9:26:07<74:53:43,  7.92s/it]
 10%|█         | 3904/37963 [9:26:15<74:57:18,  7.92s/it]
 10%|█         | 3905/37963 [9:26:23<73:50:17,  7.80s/it]
 10%|█         | 3906/37963 [9:26:37<91:51:25,  9.71s/it]
 10%|█         | 3907/37963 [9:26:44<85:54:26,  9.08s/it]
 10%|█         | 3908/37963 [9:26:52<82:39:20,  8.74s/it]
 10%|█         | 3909/37963 [9:27:00<79:16:04,  8.38s/it]
 10%|█         | 3910/37963 [9:27:07<77:15:38,  8.17s/it]
                                                         
{'loss': '0.1933', 'grad_norm': '3.489', 'learning_rate': '1.972e-05', 'epoch': '0.103'}

 10%|█         | 3910/37963 [9:27:07<77:15:38,  8.17s/it]
 10%|█         | 3911/37963 [9:27:15<75:29:38,  7.98s/it]
 10%|█         | 3912/37963 [9:27:23<74:13:08,  7.85s/it]
 10%|█         | 3913/37963 [9:27:30<74:06:40,  7.84s/it]
 10%|█         | 3914/37963 [9:27:38<73:08:11,  7.73s/it]
 10%|█         | 3915/37963 [9:27:45<72:30:07,  7.67s/it]
 10%|█         | 3916/37963 [9:27:53<72:08:59,  7.63s/it]
 10%|█         | 3917/37963 [9:28:00<71:52:41,  7.60s/it]
 10%|█         | 3918/37963 [9:28:08<72:22:34,  7.65s/it]
 10%|█         | 3919/37963 [9:28:16<72:18:10,  7.65s/it]
 10%|█         | 3920/37963 [9:28:30<90:15:07,  9.54s/it]
                                                         
{'loss': '0.1914', 'grad_norm': '2.294', 'learning_rate': '1.972e-05', 'epoch': '0.1033'}

 10%|█         | 3920/37963 [9:28:30<90:15:07,  9.54s/it]
 10%|█         | 3921/37963 [9:28:44<103:02:44, 10.90s/it]
 10%|█         | 3922/37963 [9:28:51<93:01:28,  9.84s/it] 
 10%|█         | 3923/37963 [9:28:59<86:36:38,  9.16s/it]
 10%|█         | 3924/37963 [9:29:06<81:39:49,  8.64s/it]
 10%|█         | 3925/37963 [9:29:14<78:29:59,  8.30s/it]
 10%|█         | 3926/37963 [9:29:21<76:04:53,  8.05s/it]
 10%|█         | 3927/37963 [9:29:29<74:39:46,  7.90s/it]
 10%|█         | 3928/37963 [9:29:36<73:27:18,  7.77s/it]
 10%|█         | 3929/37963 [9:29:43<71:48:54,  7.60s/it]
 10%|█         | 3930/37963 [9:29:51<71:55:45,  7.61s/it]
                                                         
{'loss': '0.1821', 'grad_norm': '1.254', 'learning_rate': '1.972e-05', 'epoch': '0.1035'}

 10%|█         | 3930/37963 [9:29:51<71:55:45,  7.61s/it]
 10%|█         | 3931/37963 [9:30:05<90:12:07,  9.54s/it]
 10%|█         | 3932/37963 [9:30:13<84:46:38,  8.97s/it]
 10%|█         | 3933/37963 [9:30:20<80:45:07,  8.54s/it]
 10%|█         | 3934/37963 [9:30:28<78:03:08,  8.26s/it]
 10%|█         | 3935/37963 [9:30:36<77:23:05,  8.19s/it]
 10%|█         | 3936/37963 [9:30:50<93:13:45,  9.86s/it]
 10%|█         | 3937/37963 [9:31:04<104:58:44, 11.11s/it]
 10%|█         | 3938/37963 [9:31:12<95:53:10, 10.15s/it] 
 10%|█         | 3939/37963 [9:31:19<87:49:43,  9.29s/it]
 10%|█         | 3940/37963 [9:31:32<99:56:42, 10.58s/it]
                                                         
{'loss': '0.1817', 'grad_norm': '4.164', 'learning_rate': '1.972e-05', 'epoch': '0.1038'}

 10%|█         | 3940/37963 [9:31:32<99:56:42, 10.58s/it]
 10%|█         | 3941/37963 [9:31:40<91:21:04,  9.67s/it]
 10%|█         | 3942/37963 [9:31:48<86:53:08,  9.19s/it]
 10%|█         | 3943/37963 [9:31:56<82:06:42,  8.69s/it]
 10%|█         | 3944/37963 [9:32:10<97:02:49, 10.27s/it]
 10%|█         | 3945/37963 [9:32:17<89:03:09,  9.42s/it]
 10%|█         | 3946/37963 [9:32:25<85:08:49,  9.01s/it]
 10%|█         | 3947/37963 [9:32:33<80:57:22,  8.57s/it]
 10%|█         | 3948/37963 [9:32:40<78:05:48,  8.27s/it]
 10%|█         | 3949/37963 [9:32:47<75:35:14,  8.00s/it]
 10%|█         | 3950/37963 [9:32:55<74:14:42,  7.86s/it]
                                                         
{'loss': '0.2085', 'grad_norm': '4.033', 'learning_rate': '1.971e-05', 'epoch': '0.104'}

 10%|█         | 3950/37963 [9:32:55<74:14:42,  7.86s/it]
 10%|█         | 3951/37963 [9:33:03<75:02:55,  7.94s/it]
 10%|█         | 3952/37963 [9:33:11<74:13:05,  7.86s/it]
 10%|█         | 3953/37963 [9:33:18<73:05:44,  7.74s/it]
 10%|█         | 3954/37963 [9:33:32<90:58:04,  9.63s/it]
 10%|█         | 3955/37963 [9:33:40<86:14:08,  9.13s/it]
 10%|█         | 3956/37963 [9:33:48<82:02:50,  8.69s/it]
 10%|█         | 3957/37963 [9:33:55<78:40:47,  8.33s/it]
 10%|█         | 3958/37963 [9:34:03<76:18:21,  8.08s/it]
 10%|█         | 3959/37963 [9:34:10<74:52:45,  7.93s/it]
 10%|█         | 3960/37963 [9:34:18<73:42:01,  7.80s/it]
                                                         
{'loss': '0.2016', 'grad_norm': '1.476', 'learning_rate': '1.971e-05', 'epoch': '0.1043'}

 10%|█         | 3960/37963 [9:34:18<73:42:01,  7.80s/it]
 10%|█         | 3961/37963 [9:34:26<72:50:04,  7.71s/it]
 10%|█         | 3962/37963 [9:34:33<72:15:23,  7.65s/it]
 10%|█         | 3963/37963 [9:34:40<71:27:13,  7.57s/it]
 10%|█         | 3964/37963 [9:34:48<72:30:15,  7.68s/it]
 10%|█         | 3965/37963 [9:34:56<72:20:06,  7.66s/it]
 10%|█         | 3966/37963 [9:35:03<71:51:32,  7.61s/it]
 10%|█         | 3967/37963 [9:35:11<71:35:15,  7.58s/it]
 10%|█         | 3968/37963 [9:35:25<89:49:48,  9.51s/it]
 10%|█         | 3969/37963 [9:35:39<102:15:32, 10.83s/it]
 10%|█         | 3970/37963 [9:35:46<93:02:04,  9.85s/it] 
                                                         
{'loss': '0.1854', 'grad_norm': '3.896', 'learning_rate': '1.971e-05', 'epoch': '0.1046'}

 10%|█         | 3970/37963 [9:35:46<93:02:04,  9.85s/it]
 10%|█         | 3971/37963 [9:35:54<87:31:22,  9.27s/it]
 10%|█         | 3972/37963 [9:36:02<82:40:35,  8.76s/it]
 10%|█         | 3973/37963 [9:36:10<79:23:53,  8.41s/it]
 10%|█         | 3974/37963 [9:36:17<77:03:18,  8.16s/it]
 10%|█         | 3975/37963 [9:36:25<75:13:28,  7.97s/it]
 10%|█         | 3976/37963 [9:36:33<75:42:33,  8.02s/it]
 10%|█         | 3977/37963 [9:36:40<74:10:28,  7.86s/it]
 10%|█         | 3978/37963 [9:36:48<73:17:07,  7.76s/it]
 10%|█         | 3979/37963 [9:36:55<72:57:30,  7.73s/it]
 10%|█         | 3980/37963 [9:37:09<89:09:52,  9.45s/it]
                                                         
{'loss': '0.1812', 'grad_norm': '1.609', 'learning_rate': '1.971e-05', 'epoch': '0.1048'}

 10%|█         | 3980/37963 [9:37:09<89:09:52,  9.45s/it]
 10%|█         | 3981/37963 [9:37:16<83:56:44,  8.89s/it]
 10%|█         | 3982/37963 [9:37:24<80:24:33,  8.52s/it]
 10%|█         | 3983/37963 [9:37:32<77:42:24,  8.23s/it]
 10%|█         | 3984/37963 [9:37:46<94:31:37, 10.01s/it]
 10%|█         | 3985/37963 [9:37:53<87:21:50,  9.26s/it]
 10%|█         | 3986/37963 [9:38:07<101:04:51, 10.71s/it]
 11%|█         | 3987/37963 [9:38:15<91:58:51,  9.75s/it] 
 11%|█         | 3988/37963 [9:38:23<87:00:56,  9.22s/it]
 11%|█         | 3989/37963 [9:38:30<81:30:31,  8.64s/it]
 11%|█         | 3990/37963 [9:38:38<78:20:21,  8.30s/it]
                                                         
{'loss': '0.1918', 'grad_norm': '5.766', 'learning_rate': '1.971e-05', 'epoch': '0.1051'}

 11%|█         | 3990/37963 [9:38:38<78:20:21,  8.30s/it]
 11%|█         | 3991/37963 [9:38:45<76:09:18,  8.07s/it]
 11%|█         | 3992/37963 [9:39:00<93:51:42,  9.95s/it]
 11%|█         | 3993/37963 [9:39:07<86:42:41,  9.19s/it]
 11%|█         | 3994/37963 [9:39:21<100:51:08, 10.69s/it]
 11%|█         | 3995/37963 [9:39:28<91:04:59,  9.65s/it] 
 11%|█         | 3996/37963 [9:39:36<86:31:37,  9.17s/it]
 11%|█         | 3997/37963 [9:39:44<82:03:47,  8.70s/it]
 11%|█         | 3998/37963 [9:39:51<77:56:55,  8.26s/it]
 11%|█         | 3999/37963 [9:39:59<75:57:58,  8.05s/it]
 11%|█         | 4000/37963 [9:40:06<74:39:48,  7.91s/it]
                                                         
{'loss': '0.1724', 'grad_norm': '2.242', 'learning_rate': '1.97e-05', 'epoch': '0.1054'}

 11%|█         | 4000/37963 [9:40:06<74:39:48,  7.91s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.46s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.46s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 11%|█         | 4001/37963 [9:41:09<229:38:11, 24.34s/it]
 11%|█         | 4002/37963 [9:41:17<182:10:45, 19.31s/it]
 11%|█         | 4003/37963 [9:41:24<149:02:22, 15.80s/it]
 11%|█         | 4004/37963 [9:41:32<126:49:06, 13.44s/it]
 11%|█         | 4005/37963 [9:41:40<111:57:43, 11.87s/it]
 11%|█         | 4006/37963 [9:41:48<99:58:05, 10.60s/it] 
 11%|█         | 4007/37963 [9:41:56<91:43:31,  9.72s/it]
 11%|█         | 4008/37963 [9:42:03<85:45:51,  9.09s/it]
 11%|█         | 4009/37963 [9:42:11<81:29:01,  8.64s/it]
 11%|█         | 4010/37963 [9:42:19<78:52:45,  8.36s/it]
                                                         
{'loss': '0.2004', 'grad_norm': '2.049', 'learning_rate': '1.97e-05', 'epoch': '0.1056'}

 11%|█         | 4010/37963 [9:42:19<78:52:45,  8.36s/it]
 11%|█         | 4011/37963 [9:42:26<76:36:09,  8.12s/it]
 11%|█         | 4012/37963 [9:42:34<74:43:48,  7.92s/it]
 11%|█         | 4013/37963 [9:42:41<73:37:38,  7.81s/it]
 11%|█         | 4014/37963 [9:42:55<90:59:11,  9.65s/it]
 11%|█         | 4015/37963 [9:43:03<85:14:48,  9.04s/it]
 11%|█         | 4016/37963 [9:43:17<98:53:56, 10.49s/it]
 11%|█         | 4017/37963 [9:43:24<90:45:43,  9.63s/it]
 11%|█         | 4018/37963 [9:43:32<84:59:08,  9.01s/it]
 11%|█         | 4019/37963 [9:43:40<81:05:29,  8.60s/it]
 11%|█         | 4020/37963 [9:43:47<78:06:09,  8.28s/it]
                                                         
{'loss': '0.1832', 'grad_norm': '5.607', 'learning_rate': '1.97e-05', 'epoch': '0.1059'}

 11%|█         | 4020/37963 [9:43:47<78:06:09,  8.28s/it]
 11%|█         | 4021/37963 [9:43:55<75:52:25,  8.05s/it]
 11%|█         | 4022/37963 [9:44:02<74:27:06,  7.90s/it]
 11%|█         | 4023/37963 [9:44:10<73:39:23,  7.81s/it]
 11%|█         | 4024/37963 [9:44:17<73:09:23,  7.76s/it]
 11%|█         | 4025/37963 [9:44:25<72:23:38,  7.68s/it]
 11%|█         | 4026/37963 [9:44:32<71:33:59,  7.59s/it]
 11%|█         | 4027/37963 [9:44:40<71:18:54,  7.57s/it]
 11%|█         | 4028/37963 [9:44:54<88:59:54,  9.44s/it]
 11%|█         | 4029/37963 [9:45:01<82:52:42,  8.79s/it]
 11%|█         | 4030/37963 [9:45:08<79:00:41,  8.38s/it]
                                                         
{'loss': '0.186', 'grad_norm': '3.915', 'learning_rate': '1.97e-05', 'epoch': '0.1062'}

 11%|█         | 4030/37963 [9:45:08<79:00:41,  8.38s/it]
 11%|█         | 4031/37963 [9:45:16<76:37:45,  8.13s/it]
 11%|█         | 4032/37963 [9:45:30<92:54:06,  9.86s/it]
 11%|█         | 4033/37963 [9:45:37<86:24:38,  9.17s/it]
 11%|█         | 4034/37963 [9:45:45<81:31:32,  8.65s/it]
 11%|█         | 4035/37963 [9:45:59<96:06:52, 10.20s/it]
 11%|█         | 4036/37963 [9:46:06<88:35:49,  9.40s/it]
 11%|█         | 4037/37963 [9:46:13<82:56:27,  8.80s/it]
 11%|█         | 4038/37963 [9:46:28<97:56:46, 10.39s/it]
 11%|█         | 4039/37963 [9:46:35<90:10:35,  9.57s/it]
 11%|█         | 4040/37963 [9:46:43<84:32:40,  8.97s/it]
                                                         
{'loss': '0.1866', 'grad_norm': '2.63', 'learning_rate': '1.97e-05', 'epoch': '0.1064'}

 11%|█         | 4040/37963 [9:46:43<84:32:40,  8.97s/it]
 11%|█         | 4041/37963 [9:46:50<80:30:28,  8.54s/it]
 11%|█         | 4042/37963 [9:47:04<95:54:51, 10.18s/it]
 11%|█         | 4043/37963 [9:47:12<88:40:35,  9.41s/it]
 11%|█         | 4044/37963 [9:47:26<102:24:03, 10.87s/it]
 11%|█         | 4045/37963 [9:47:34<92:17:34,  9.80s/it] 
 11%|█         | 4046/37963 [9:47:41<85:57:57,  9.12s/it]
 11%|█         | 4047/37963 [9:47:49<81:19:21,  8.63s/it]
 11%|█         | 4048/37963 [9:47:56<77:32:44,  8.23s/it]
 11%|█         | 4049/37963 [9:48:03<75:30:53,  8.02s/it]
 11%|█         | 4050/37963 [9:48:11<74:11:48,  7.88s/it]
                                                         
{'loss': '0.1656', 'grad_norm': '4.615', 'learning_rate': '1.969e-05', 'epoch': '0.1067'}

 11%|█         | 4050/37963 [9:48:11<74:11:48,  7.88s/it]
 11%|█         | 4051/37963 [9:48:18<73:16:27,  7.78s/it]
 11%|█         | 4052/37963 [9:48:26<72:48:23,  7.73s/it]
 11%|█         | 4053/37963 [9:48:34<72:26:20,  7.69s/it]
 11%|█         | 4054/37963 [9:48:41<72:03:05,  7.65s/it]
 11%|█         | 4055/37963 [9:48:49<71:15:38,  7.57s/it]
 11%|█         | 4056/37963 [9:48:56<71:22:35,  7.58s/it]
 11%|█         | 4057/37963 [9:49:04<71:22:23,  7.58s/it]
 11%|█         | 4058/37963 [9:49:11<71:12:18,  7.56s/it]
 11%|█         | 4059/37963 [9:49:19<71:00:09,  7.54s/it]
 11%|█         | 4060/37963 [9:49:26<70:53:40,  7.53s/it]
                                                         
{'loss': '0.1915', 'grad_norm': '4.839', 'learning_rate': '1.969e-05', 'epoch': '0.1069'}

 11%|█         | 4060/37963 [9:49:26<70:53:40,  7.53s/it]
 11%|█         | 4061/37963 [9:49:34<70:44:22,  7.51s/it]
 11%|█         | 4062/37963 [9:49:48<89:00:53,  9.45s/it]
 11%|█         | 4063/37963 [9:49:55<83:27:16,  8.86s/it]
 11%|█         | 4064/37963 [9:50:03<80:01:48,  8.50s/it]
 11%|█         | 4065/37963 [9:50:11<77:52:00,  8.27s/it]
 11%|█         | 4066/37963 [9:50:18<74:43:23,  7.94s/it]
 11%|█         | 4067/37963 [9:50:32<91:18:49,  9.70s/it]
 11%|█         | 4068/37963 [9:50:39<85:36:30,  9.09s/it]
 11%|█         | 4069/37963 [9:50:47<81:07:30,  8.62s/it]
 11%|█         | 4070/37963 [9:50:54<78:12:25,  8.31s/it]
                                                         
{'loss': '0.1848', 'grad_norm': '5.146', 'learning_rate': '1.969e-05', 'epoch': '0.1072'}

 11%|█         | 4070/37963 [9:50:54<78:12:25,  8.31s/it]
 11%|█         | 4071/37963 [9:51:02<76:03:51,  8.08s/it]
 11%|█         | 4072/37963 [9:51:10<75:04:01,  7.97s/it]
 11%|█         | 4073/37963 [9:51:17<73:27:47,  7.80s/it]
 11%|█         | 4074/37963 [9:51:25<72:33:26,  7.71s/it]
 11%|█         | 4075/37963 [9:51:39<90:43:40,  9.64s/it]
 11%|█         | 4076/37963 [9:51:46<84:44:58,  9.00s/it]
 11%|█         | 4077/37963 [9:51:54<80:17:22,  8.53s/it]
 11%|█         | 4078/37963 [9:52:01<77:30:34,  8.23s/it]
 11%|█         | 4079/37963 [9:52:09<75:44:21,  8.05s/it]
 11%|█         | 4080/37963 [9:52:16<74:01:38,  7.87s/it]
                                                         
{'loss': '0.1718', 'grad_norm': '2.728', 'learning_rate': '1.969e-05', 'epoch': '0.1075'}

 11%|█         | 4080/37963 [9:52:16<74:01:38,  7.87s/it]
 11%|█         | 4081/37963 [9:52:30<90:42:58,  9.64s/it]
 11%|█         | 4082/37963 [9:52:37<84:39:42,  9.00s/it]
 11%|█         | 4083/37963 [9:52:45<80:47:30,  8.58s/it]
 11%|█         | 4084/37963 [9:52:52<77:01:00,  8.18s/it]
 11%|█         | 4085/37963 [9:53:00<75:07:09,  7.98s/it]
 11%|█         | 4086/37963 [9:53:14<92:27:02,  9.82s/it]
 11%|█         | 4087/37963 [9:53:22<86:19:58,  9.17s/it]
 11%|█         | 4088/37963 [9:53:35<99:28:11, 10.57s/it]
 11%|█         | 4089/37963 [9:53:43<91:05:25,  9.68s/it]
 11%|█         | 4090/37963 [9:53:51<85:02:34,  9.04s/it]
                                                         
{'loss': '0.1713', 'grad_norm': '1.963', 'learning_rate': '1.968e-05', 'epoch': '0.1077'}

 11%|█         | 4090/37963 [9:53:51<85:02:34,  9.04s/it]
 11%|█         | 4091/37963 [9:54:04<98:31:45, 10.47s/it]
 11%|█         | 4092/37963 [9:54:18<108:33:12, 11.54s/it]
 11%|█         | 4093/37963 [9:54:26<96:36:27, 10.27s/it] 
 11%|█         | 4094/37963 [9:54:34<89:32:24,  9.52s/it]
 11%|█         | 4095/37963 [9:54:41<84:07:41,  8.94s/it]
 11%|█         | 4096/37963 [9:54:48<79:39:18,  8.47s/it]
 11%|█         | 4097/37963 [9:54:56<76:55:30,  8.18s/it]
 11%|█         | 4098/37963 [9:55:04<75:11:28,  7.99s/it]
 11%|█         | 4099/37963 [9:55:11<73:38:13,  7.83s/it]
 11%|█         | 4100/37963 [9:55:18<72:40:45,  7.73s/it]
                                                         
{'loss': '0.2041', 'grad_norm': '4.499', 'learning_rate': '1.968e-05', 'epoch': '0.108'}

 11%|█         | 4100/37963 [9:55:18<72:40:45,  7.73s/it]
 11%|█         | 4101/37963 [9:55:26<72:14:46,  7.68s/it]
 11%|█         | 4102/37963 [9:55:34<71:36:55,  7.61s/it]
 11%|█         | 4103/37963 [9:55:41<71:38:53,  7.62s/it]
 11%|█         | 4104/37963 [9:55:49<71:35:55,  7.61s/it]
 11%|█         | 4105/37963 [9:55:56<70:40:57,  7.52s/it]
 11%|█         | 4106/37963 [9:56:04<70:55:42,  7.54s/it]
 11%|█         | 4107/37963 [9:56:11<71:08:57,  7.57s/it]
 11%|█         | 4108/37963 [9:56:25<89:48:18,  9.55s/it]
 11%|█         | 4109/37963 [9:56:33<84:20:07,  8.97s/it]
 11%|█         | 4110/37963 [9:56:41<80:15:06,  8.53s/it]
                                                         
{'loss': '0.1577', 'grad_norm': '2.534', 'learning_rate': '1.968e-05', 'epoch': '0.1083'}

 11%|█         | 4110/37963 [9:56:41<80:15:06,  8.53s/it]
 11%|█         | 4111/37963 [9:56:48<77:32:20,  8.25s/it]
 11%|█         | 4112/37963 [9:56:56<75:34:25,  8.04s/it]
 11%|█         | 4113/37963 [9:57:03<74:07:41,  7.88s/it]
 11%|█         | 4114/37963 [9:57:11<73:33:15,  7.82s/it]
 11%|█         | 4115/37963 [9:57:18<72:37:00,  7.72s/it]
 11%|█         | 4116/37963 [9:57:26<72:16:00,  7.69s/it]
 11%|█         | 4117/37963 [9:57:34<71:49:18,  7.64s/it]
 11%|█         | 4118/37963 [9:57:41<71:08:35,  7.57s/it]
 11%|█         | 4119/37963 [9:57:48<71:02:42,  7.56s/it]
 11%|█         | 4120/37963 [9:58:02<88:58:53,  9.47s/it]
                                                         
{'loss': '0.1894', 'grad_norm': '1.579', 'learning_rate': '1.968e-05', 'epoch': '0.1085'}

 11%|█         | 4120/37963 [9:58:02<88:58:53,  9.47s/it]
 11%|█         | 4121/37963 [9:58:10<83:00:17,  8.83s/it]
 11%|█         | 4122/37963 [9:58:17<79:36:10,  8.47s/it]
 11%|█         | 4123/37963 [9:58:25<76:59:14,  8.19s/it]
 11%|█         | 4124/37963 [9:58:32<75:06:07,  7.99s/it]
 11%|█         | 4125/37963 [9:58:46<92:17:22,  9.82s/it]
 11%|█         | 4126/37963 [9:58:54<85:38:16,  9.11s/it]
 11%|█         | 4127/37963 [9:59:01<80:39:57,  8.58s/it]
 11%|█         | 4128/37963 [9:59:09<77:40:17,  8.26s/it]
 11%|█         | 4129/37963 [9:59:23<93:57:08, 10.00s/it]
 11%|█         | 4130/37963 [9:59:30<87:07:00,  9.27s/it]
                                                         
{'loss': '0.1833', 'grad_norm': '4.954', 'learning_rate': '1.968e-05', 'epoch': '0.1088'}

 11%|█         | 4130/37963 [9:59:30<87:07:00,  9.27s/it]
 11%|█         | 4131/37963 [9:59:44<100:26:34, 10.69s/it]
 11%|█         | 4132/37963 [9:59:52<91:15:11,  9.71s/it] 
 11%|█         | 4133/37963 [10:00:00<85:29:24,  9.10s/it]
 11%|█         | 4134/37963 [10:00:07<81:08:22,  8.63s/it]
 11%|█         | 4135/37963 [10:00:15<78:12:09,  8.32s/it]
 11%|█         | 4136/37963 [10:00:29<93:58:42, 10.00s/it]
 11%|█         | 4137/37963 [10:00:36<87:09:01,  9.28s/it]
 11%|█         | 4138/37963 [10:00:44<82:17:52,  8.76s/it]
 11%|█         | 4139/37963 [10:01:04<114:05:54, 12.14s/it]
 11%|█         | 4140/37963 [10:01:11<101:24:22, 10.79s/it]
                                                           
{'loss': '0.1904', 'grad_norm': '8.799', 'learning_rate': '1.967e-05', 'epoch': '0.1091'}

 11%|█         | 4140/37963 [10:01:11<101:24:22, 10.79s/it]
 11%|█         | 4141/37963 [10:01:19<92:20:29,  9.83s/it] 
 11%|█         | 4142/37963 [10:01:27<85:59:48,  9.15s/it]
 11%|█         | 4143/37963 [10:01:34<81:53:13,  8.72s/it]
 11%|█         | 4144/37963 [10:01:42<78:43:44,  8.38s/it]
 11%|█         | 4145/37963 [10:01:49<76:15:48,  8.12s/it]
 11%|█         | 4146/37963 [10:01:57<74:26:23,  7.92s/it]
 11%|█         | 4147/37963 [10:02:04<73:15:45,  7.80s/it]
 11%|█         | 4148/37963 [10:02:12<72:31:10,  7.72s/it]
 11%|█         | 4149/37963 [10:02:19<71:12:38,  7.58s/it]
 11%|█         | 4150/37963 [10:02:27<71:02:43,  7.56s/it]
                                                          
{'loss': '0.1831', 'grad_norm': '3.286', 'learning_rate': '1.967e-05', 'epoch': '0.1093'}

 11%|█         | 4150/37963 [10:02:27<71:02:43,  7.56s/it]
 11%|█         | 4151/37963 [10:02:34<71:11:22,  7.58s/it]
 11%|█         | 4152/37963 [10:02:42<71:35:17,  7.62s/it]
 11%|█         | 4153/37963 [10:02:50<71:39:03,  7.63s/it]
 11%|█         | 4154/37963 [10:02:57<71:43:25,  7.64s/it]
 11%|█         | 4155/37963 [10:03:11<89:34:45,  9.54s/it]
 11%|█         | 4156/37963 [10:03:19<83:55:05,  8.94s/it]
 11%|█         | 4157/37963 [10:03:26<79:55:38,  8.51s/it]
 11%|█         | 4158/37963 [10:03:34<76:57:14,  8.20s/it]
 11%|█         | 4159/37963 [10:03:41<74:54:02,  7.98s/it]
 11%|█         | 4160/37963 [10:03:49<73:35:32,  7.84s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '5.79', 'learning_rate': '1.967e-05', 'epoch': '0.1096'}

 11%|█         | 4160/37963 [10:03:49<73:35:32,  7.84s/it]
 11%|█         | 4161/37963 [10:03:56<73:00:10,  7.78s/it]
 11%|█         | 4162/37963 [10:04:04<72:30:50,  7.72s/it]
 11%|█         | 4163/37963 [10:04:11<70:59:29,  7.56s/it]
 11%|█         | 4164/37963 [10:04:19<70:52:25,  7.55s/it]
 11%|█         | 4165/37963 [10:04:26<70:02:21,  7.46s/it]
 11%|█         | 4166/37963 [10:04:33<70:13:43,  7.48s/it]
 11%|█         | 4167/37963 [10:04:41<70:51:07,  7.55s/it]
 11%|█         | 4168/37963 [10:04:49<71:13:10,  7.59s/it]
 11%|█         | 4169/37963 [10:04:56<71:06:51,  7.58s/it]
 11%|█         | 4170/37963 [10:05:11<89:58:23,  9.58s/it]
                                                          
{'loss': '0.171', 'grad_norm': '1.271', 'learning_rate': '1.967e-05', 'epoch': '0.1098'}

 11%|█         | 4170/37963 [10:05:11<89:58:23,  9.58s/it]
 11%|█         | 4171/37963 [10:05:18<84:19:35,  8.98s/it]
 11%|█         | 4172/37963 [10:05:32<98:57:17, 10.54s/it]
 11%|█         | 4173/37963 [10:05:40<90:42:14,  9.66s/it]
 11%|█         | 4174/37963 [10:05:48<84:44:18,  9.03s/it]
 11%|█         | 4175/37963 [10:06:01<97:31:28, 10.39s/it]
 11%|█         | 4176/37963 [10:06:09<90:18:04,  9.62s/it]
 11%|█         | 4177/37963 [10:06:16<83:53:26,  8.94s/it]
 11%|█         | 4178/37963 [10:06:24<79:47:20,  8.50s/it]
 11%|█         | 4179/37963 [10:06:38<94:55:45, 10.12s/it]
 11%|█         | 4180/37963 [10:06:45<87:54:30,  9.37s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '2.713', 'learning_rate': '1.967e-05', 'epoch': '0.1101'}

 11%|█         | 4180/37963 [10:06:45<87:54:30,  9.37s/it]
 11%|█         | 4181/37963 [10:06:53<82:30:09,  8.79s/it]
 11%|█         | 4182/37963 [10:07:00<78:52:47,  8.41s/it]
 11%|█         | 4183/37963 [10:07:14<94:22:20, 10.06s/it]
 11%|█         | 4184/37963 [10:07:22<87:43:44,  9.35s/it]
 11%|█         | 4185/37963 [10:07:29<82:43:32,  8.82s/it]
 11%|█         | 4186/37963 [10:07:37<79:09:42,  8.44s/it]
 11%|█         | 4187/37963 [10:07:51<94:38:42, 10.09s/it]
 11%|█         | 4188/37963 [10:07:58<87:19:40,  9.31s/it]
 11%|█         | 4189/37963 [10:08:06<81:42:11,  8.71s/it]
 11%|█         | 4190/37963 [10:08:14<79:17:28,  8.45s/it]
                                                          
{'loss': '0.178', 'grad_norm': '3.366', 'learning_rate': '1.966e-05', 'epoch': '0.1104'}

 11%|█         | 4190/37963 [10:08:14<79:17:28,  8.45s/it]
 11%|█         | 4191/37963 [10:08:21<76:44:32,  8.18s/it]
 11%|█         | 4192/37963 [10:08:29<74:50:49,  7.98s/it]
 11%|█         | 4193/37963 [10:08:36<73:40:41,  7.85s/it]
 11%|█         | 4194/37963 [10:08:44<72:37:13,  7.74s/it]
 11%|█         | 4195/37963 [10:08:51<72:31:21,  7.73s/it]
 11%|█         | 4196/37963 [10:08:59<71:46:41,  7.65s/it]
 11%|█         | 4197/37963 [10:09:06<71:31:50,  7.63s/it]
 11%|█         | 4198/37963 [10:09:14<71:22:14,  7.61s/it]
 11%|█         | 4199/37963 [10:09:21<70:50:01,  7.55s/it]
 11%|█         | 4200/37963 [10:09:29<70:13:32,  7.49s/it]
                                                          
{'loss': '0.1827', 'grad_norm': '1.073', 'learning_rate': '1.966e-05', 'epoch': '0.1106'}

 11%|█         | 4200/37963 [10:09:29<70:13:32,  7.49s/it]
 11%|█         | 4201/37963 [10:09:36<70:46:08,  7.55s/it]
 11%|█         | 4202/37963 [10:09:44<70:39:04,  7.53s/it]
 11%|█         | 4203/37963 [10:09:51<70:11:55,  7.49s/it]
 11%|█         | 4204/37963 [10:09:59<70:33:20,  7.52s/it]
 11%|█         | 4205/37963 [10:10:13<89:39:45,  9.56s/it]
 11%|█         | 4206/37963 [10:10:21<84:24:29,  9.00s/it]
 11%|█         | 4207/37963 [10:10:29<80:53:41,  8.63s/it]
 11%|█         | 4208/37963 [10:10:36<77:47:46,  8.30s/it]
 11%|█         | 4209/37963 [10:10:44<75:50:30,  8.09s/it]
 11%|█         | 4210/37963 [10:10:51<74:25:04,  7.94s/it]
                                                          
{'loss': '0.166', 'grad_norm': '2.264', 'learning_rate': '1.966e-05', 'epoch': '0.1109'}

 11%|█         | 4210/37963 [10:10:51<74:25:04,  7.94s/it]
 11%|█         | 4211/37963 [10:10:59<72:38:11,  7.75s/it]
 11%|█         | 4212/37963 [10:11:06<72:02:46,  7.68s/it]
 11%|█         | 4213/37963 [10:11:14<71:37:44,  7.64s/it]
 11%|█         | 4214/37963 [10:11:21<71:13:30,  7.60s/it]
 11%|█         | 4215/37963 [10:11:28<70:01:18,  7.47s/it]
 11%|█         | 4216/37963 [10:11:36<70:03:26,  7.47s/it]
 11%|█         | 4217/37963 [10:11:50<88:23:15,  9.43s/it]
 11%|█         | 4218/37963 [10:11:57<82:30:08,  8.80s/it]
 11%|█         | 4219/37963 [10:12:11<96:57:14, 10.34s/it]
 11%|█         | 4220/37963 [10:12:19<89:30:57,  9.55s/it]
                                                          
{'loss': '0.1562', 'grad_norm': '1.735', 'learning_rate': '1.966e-05', 'epoch': '0.1112'}

 11%|█         | 4220/37963 [10:12:19<89:30:57,  9.55s/it]
 11%|█         | 4221/37963 [10:12:26<83:42:37,  8.93s/it]
 11%|█         | 4222/37963 [10:12:40<97:27:23, 10.40s/it]
 11%|█         | 4223/37963 [10:12:48<88:52:56,  9.48s/it]
 11%|█         | 4224/37963 [10:12:55<83:22:46,  8.90s/it]
 11%|█         | 4225/37963 [10:13:02<78:57:45,  8.43s/it]
 11%|█         | 4226/37963 [10:13:10<77:04:44,  8.22s/it]
 11%|█         | 4227/37963 [10:13:18<74:49:35,  7.98s/it]
 11%|█         | 4228/37963 [10:13:25<73:49:05,  7.88s/it]
 11%|█         | 4229/37963 [10:13:33<72:53:58,  7.78s/it]
 11%|█         | 4230/37963 [10:13:47<90:14:44,  9.63s/it]
                                                          
{'loss': '0.1767', 'grad_norm': '3.56', 'learning_rate': '1.965e-05', 'epoch': '0.1114'}

 11%|█         | 4230/37963 [10:13:47<90:14:44,  9.63s/it]
 11%|█         | 4231/37963 [10:14:07<120:27:35, 12.86s/it]
 11%|█         | 4232/37963 [10:14:15<105:21:47, 11.25s/it]
 11%|█         | 4233/37963 [10:14:22<94:27:22, 10.08s/it] 
 11%|█         | 4234/37963 [10:14:36<105:25:09, 11.25s/it]
 11%|█         | 4235/37963 [10:14:44<95:27:29, 10.19s/it] 
 11%|█         | 4236/37963 [10:14:51<88:07:10,  9.41s/it]
 11%|█         | 4237/37963 [10:14:59<82:40:25,  8.82s/it]
 11%|█         | 4238/37963 [10:15:06<79:00:18,  8.43s/it]
 11%|█         | 4239/37963 [10:15:14<76:33:08,  8.17s/it]
 11%|█         | 4240/37963 [10:15:21<73:47:19,  7.88s/it]
                                                          
{'loss': '0.178', 'grad_norm': '5.6', 'learning_rate': '1.965e-05', 'epoch': '0.1117'}

 11%|█         | 4240/37963 [10:15:21<73:47:19,  7.88s/it]
 11%|█         | 4241/37963 [10:15:29<72:57:59,  7.79s/it]
 11%|█         | 4242/37963 [10:15:36<72:23:10,  7.73s/it]
 11%|█         | 4243/37963 [10:15:44<71:25:52,  7.63s/it]
 11%|█         | 4244/37963 [10:15:51<71:10:26,  7.60s/it]
 11%|█         | 4245/37963 [10:15:59<70:57:11,  7.58s/it]
 11%|█         | 4246/37963 [10:16:06<70:53:29,  7.57s/it]
 11%|█         | 4247/37963 [10:16:14<70:48:50,  7.56s/it]
 11%|█         | 4248/37963 [10:16:21<71:18:28,  7.61s/it]
 11%|█         | 4249/37963 [10:16:29<71:02:22,  7.59s/it]
 11%|█         | 4250/37963 [10:16:36<70:50:50,  7.57s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '2.018', 'learning_rate': '1.965e-05', 'epoch': '0.112'}

 11%|█         | 4250/37963 [10:16:37<70:50:50,  7.57s/it]
 11%|█         | 4251/37963 [10:16:44<70:41:44,  7.55s/it]
 11%|█         | 4252/37963 [10:16:51<70:07:02,  7.49s/it]
 11%|█         | 4253/37963 [10:16:59<70:07:12,  7.49s/it]
 11%|█         | 4254/37963 [10:17:06<70:02:12,  7.48s/it]
 11%|█         | 4255/37963 [10:17:14<70:20:44,  7.51s/it]
 11%|█         | 4256/37963 [10:17:21<69:51:19,  7.46s/it]
 11%|█         | 4257/37963 [10:17:35<88:09:34,  9.42s/it]
 11%|█         | 4258/37963 [10:17:43<82:57:37,  8.86s/it]
 11%|█         | 4259/37963 [10:17:50<79:14:30,  8.46s/it]
 11%|█         | 4260/37963 [10:17:58<76:07:08,  8.13s/it]
                                                          
{'loss': '0.1766', 'grad_norm': '1.949', 'learning_rate': '1.965e-05', 'epoch': '0.1122'}

 11%|█         | 4260/37963 [10:17:58<76:07:08,  8.13s/it]
 11%|█         | 4261/37963 [10:18:05<74:35:01,  7.97s/it]
 11%|█         | 4262/37963 [10:18:13<73:29:13,  7.85s/it]
 11%|█         | 4263/37963 [10:18:20<72:29:18,  7.74s/it]
 11%|█         | 4264/37963 [10:18:28<71:19:35,  7.62s/it]
 11%|█         | 4265/37963 [10:18:35<71:10:30,  7.60s/it]
 11%|█         | 4266/37963 [10:18:49<88:52:22,  9.49s/it]
 11%|█         | 4267/37963 [10:19:03<100:47:37, 10.77s/it]
 11%|█         | 4268/37963 [10:19:10<91:20:42,  9.76s/it] 
 11%|█         | 4269/37963 [10:19:18<84:46:11,  9.06s/it]
 11%|█         | 4270/37963 [10:19:25<80:15:47,  8.58s/it]
                                                          
{'loss': '0.1813', 'grad_norm': '1.995', 'learning_rate': '1.965e-05', 'epoch': '0.1125'}

 11%|█         | 4270/37963 [10:19:25<80:15:47,  8.58s/it]
 11%|█▏        | 4271/37963 [10:19:32<76:33:07,  8.18s/it]
 11%|█▏        | 4272/37963 [10:19:40<74:28:37,  7.96s/it]
 11%|█▏        | 4273/37963 [10:19:47<72:58:27,  7.80s/it]
 11%|█▏        | 4274/37963 [10:20:01<90:56:52,  9.72s/it]
 11%|█▏        | 4275/37963 [10:20:09<84:47:17,  9.06s/it]
 11%|█▏        | 4276/37963 [10:20:23<98:27:34, 10.52s/it]
 11%|█▏        | 4277/37963 [10:20:37<108:50:49, 11.63s/it]
 11%|█▏        | 4278/37963 [10:20:51<114:34:34, 12.25s/it]
 11%|█▏        | 4279/37963 [10:21:05<119:26:55, 12.77s/it]
 11%|█▏        | 4280/37963 [10:21:12<104:23:17, 11.16s/it]
                                                           
{'loss': '0.1831', 'grad_norm': '4.824', 'learning_rate': '1.964e-05', 'epoch': '0.1127'}

 11%|█▏        | 4280/37963 [10:21:12<104:23:17, 11.16s/it]
 11%|█▏        | 4281/37963 [10:21:20<93:59:33, 10.05s/it] 
 11%|█▏        | 4282/37963 [10:21:27<86:39:42,  9.26s/it]
 11%|█▏        | 4283/37963 [10:21:35<81:59:10,  8.76s/it]
 11%|█▏        | 4284/37963 [10:21:42<78:32:46,  8.40s/it]
 11%|█▏        | 4285/37963 [10:21:50<76:03:33,  8.13s/it]
 11%|█▏        | 4286/37963 [10:21:57<74:24:46,  7.95s/it]
 11%|█▏        | 4287/37963 [10:22:05<73:15:50,  7.83s/it]
 11%|█▏        | 4288/37963 [10:22:12<72:27:20,  7.75s/it]
 11%|█▏        | 4289/37963 [10:22:20<71:46:51,  7.67s/it]
 11%|█▏        | 4290/37963 [10:22:27<71:14:41,  7.62s/it]
                                                          
{'loss': '0.182', 'grad_norm': '3.329', 'learning_rate': '1.964e-05', 'epoch': '0.113'}

 11%|█▏        | 4290/37963 [10:22:27<71:14:41,  7.62s/it]
 11%|█▏        | 4291/37963 [10:22:35<70:53:34,  7.58s/it]
 11%|█▏        | 4292/37963 [10:22:42<70:44:05,  7.56s/it]
 11%|█▏        | 4293/37963 [10:22:50<70:28:38,  7.54s/it]
 11%|█▏        | 4294/37963 [10:22:57<70:25:18,  7.53s/it]
 11%|█▏        | 4295/37963 [10:23:05<70:11:59,  7.51s/it]
 11%|█▏        | 4296/37963 [10:23:12<70:25:35,  7.53s/it]
 11%|█▏        | 4297/37963 [10:23:20<70:27:53,  7.53s/it]
 11%|█▏        | 4298/37963 [10:23:27<70:01:15,  7.49s/it]
 11%|█▏        | 4299/37963 [10:23:35<70:10:15,  7.50s/it]
 11%|█▏        | 4300/37963 [10:23:42<70:22:46,  7.53s/it]
                                                          
{'loss': '0.159', 'grad_norm': '1.427', 'learning_rate': '1.964e-05', 'epoch': '0.1133'}

 11%|█▏        | 4300/37963 [10:23:42<70:22:46,  7.53s/it]
 11%|█▏        | 4301/37963 [10:23:50<70:32:24,  7.54s/it]
 11%|█▏        | 4302/37963 [10:23:57<69:57:43,  7.48s/it]
 11%|█▏        | 4303/37963 [10:24:05<70:08:33,  7.50s/it]
 11%|█▏        | 4304/37963 [10:24:12<70:19:18,  7.52s/it]
 11%|█▏        | 4305/37963 [10:24:20<70:33:48,  7.55s/it]
 11%|█▏        | 4306/37963 [10:24:27<69:39:23,  7.45s/it]
 11%|█▏        | 4307/37963 [10:24:35<69:59:45,  7.49s/it]
 11%|█▏        | 4308/37963 [10:24:49<88:49:49,  9.50s/it]
 11%|█▏        | 4309/37963 [10:24:57<83:15:24,  8.91s/it]
 11%|█▏        | 4310/37963 [10:25:10<97:07:07, 10.39s/it]
                                                          
{'loss': '0.1819', 'grad_norm': '3.33', 'learning_rate': '1.964e-05', 'epoch': '0.1135'}

 11%|█▏        | 4310/37963 [10:25:10<97:07:07, 10.39s/it]
 11%|█▏        | 4311/37963 [10:25:18<89:04:59,  9.53s/it]
 11%|█▏        | 4312/37963 [10:25:26<83:56:43,  8.98s/it]
 11%|█▏        | 4313/37963 [10:25:33<79:59:20,  8.56s/it]
 11%|█▏        | 4314/37963 [10:25:41<76:55:54,  8.23s/it]
 11%|█▏        | 4315/37963 [10:25:48<75:19:29,  8.06s/it]
 11%|█▏        | 4316/37963 [10:25:56<74:16:01,  7.95s/it]
 11%|█▏        | 4317/37963 [10:26:10<90:09:41,  9.65s/it]
 11%|█▏        | 4318/37963 [10:26:17<84:13:50,  9.01s/it]
 11%|█▏        | 4319/37963 [10:26:25<79:42:41,  8.53s/it]
 11%|█▏        | 4320/37963 [10:26:32<76:25:54,  8.18s/it]
                                                          
{'loss': '0.1759', 'grad_norm': '2.732', 'learning_rate': '1.963e-05', 'epoch': '0.1138'}

 11%|█▏        | 4320/37963 [10:26:32<76:25:54,  8.18s/it]
 11%|█▏        | 4321/37963 [10:26:39<74:06:39,  7.93s/it]
 11%|█▏        | 4322/37963 [10:26:53<91:13:49,  9.76s/it]
 11%|█▏        | 4323/37963 [10:27:08<103:32:28, 11.08s/it]
 11%|█▏        | 4324/37963 [10:27:15<93:31:54, 10.01s/it] 
 11%|█▏        | 4325/37963 [10:27:23<86:33:08,  9.26s/it]
 11%|█▏        | 4326/37963 [10:27:43<117:32:22, 12.58s/it]
 11%|█▏        | 4327/37963 [10:27:50<102:48:42, 11.00s/it]
 11%|█▏        | 4328/37963 [10:27:58<93:11:42,  9.97s/it] 
 11%|█▏        | 4329/37963 [10:28:05<86:25:38,  9.25s/it]
 11%|█▏        | 4330/37963 [10:28:13<82:09:33,  8.79s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '1.923', 'learning_rate': '1.963e-05', 'epoch': '0.1141'}

 11%|█▏        | 4330/37963 [10:28:13<82:09:33,  8.79s/it]
 11%|█▏        | 4331/37963 [10:28:21<78:41:03,  8.42s/it]
 11%|█▏        | 4332/37963 [10:28:28<76:11:00,  8.15s/it]
 11%|█▏        | 4333/37963 [10:28:36<74:00:37,  7.92s/it]
 11%|█▏        | 4334/37963 [10:28:43<73:29:02,  7.87s/it]
 11%|█▏        | 4335/37963 [10:28:51<72:01:04,  7.71s/it]
 11%|█▏        | 4336/37963 [10:28:58<71:33:19,  7.66s/it]
 11%|█▏        | 4337/37963 [10:29:06<71:15:30,  7.63s/it]
 11%|█▏        | 4338/37963 [10:29:14<71:59:51,  7.71s/it]
 11%|█▏        | 4339/37963 [10:29:21<71:40:22,  7.67s/it]
 11%|█▏        | 4340/37963 [10:29:29<71:35:47,  7.67s/it]
                                                          
{'loss': '0.1873', 'grad_norm': '3.895', 'learning_rate': '1.963e-05', 'epoch': '0.1143'}

 11%|█▏        | 4340/37963 [10:29:29<71:35:47,  7.67s/it]
 11%|█▏        | 4341/37963 [10:29:36<71:11:34,  7.62s/it]
 11%|█▏        | 4342/37963 [10:29:44<70:53:03,  7.59s/it]
 11%|█▏        | 4343/37963 [10:29:51<70:35:59,  7.56s/it]
 11%|█▏        | 4344/37963 [10:29:59<69:34:55,  7.45s/it]
 11%|█▏        | 4345/37963 [10:30:06<69:51:20,  7.48s/it]
 11%|█▏        | 4346/37963 [10:30:14<70:26:15,  7.54s/it]
 11%|█▏        | 4347/37963 [10:30:21<70:21:07,  7.53s/it]
 11%|█▏        | 4348/37963 [10:30:29<70:31:31,  7.55s/it]
 11%|█▏        | 4349/37963 [10:30:36<70:03:39,  7.50s/it]
 11%|█▏        | 4350/37963 [10:30:44<70:04:47,  7.51s/it]
                                                          
{'loss': '0.1859', 'grad_norm': '3.108', 'learning_rate': '1.963e-05', 'epoch': '0.1146'}

 11%|█▏        | 4350/37963 [10:30:44<70:04:47,  7.51s/it]
 11%|█▏        | 4351/37963 [10:30:51<70:05:27,  7.51s/it]
 11%|█▏        | 4352/37963 [10:31:05<87:28:56,  9.37s/it]
 11%|█▏        | 4353/37963 [10:31:13<82:22:12,  8.82s/it]
 11%|█▏        | 4354/37963 [10:31:20<78:40:01,  8.43s/it]
 11%|█▏        | 4355/37963 [10:31:28<77:09:59,  8.27s/it]
 11%|█▏        | 4356/37963 [10:31:35<74:41:25,  8.00s/it]
 11%|█▏        | 4357/37963 [10:31:43<72:42:32,  7.79s/it]
 11%|█▏        | 4358/37963 [10:31:50<72:09:27,  7.73s/it]
 11%|█▏        | 4359/37963 [10:31:58<71:27:57,  7.66s/it]
 11%|█▏        | 4360/37963 [10:32:05<71:23:43,  7.65s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '3.534', 'learning_rate': '1.963e-05', 'epoch': '0.1148'}

 11%|█▏        | 4360/37963 [10:32:05<71:23:43,  7.65s/it]
 11%|█▏        | 4361/37963 [10:32:13<71:11:40,  7.63s/it]
 11%|█▏        | 4362/37963 [10:32:20<70:56:08,  7.60s/it]
 11%|█▏        | 4363/37963 [10:32:28<71:09:00,  7.62s/it]
 11%|█▏        | 4364/37963 [10:32:42<88:45:37,  9.51s/it]
 11%|█▏        | 4365/37963 [10:32:50<83:12:31,  8.92s/it]
 12%|█▏        | 4366/37963 [10:32:57<79:22:24,  8.51s/it]
 12%|█▏        | 4367/37963 [10:33:05<76:42:43,  8.22s/it]
 12%|█▏        | 4368/37963 [10:33:12<74:47:20,  8.01s/it]
 12%|█▏        | 4369/37963 [10:33:20<73:19:19,  7.86s/it]
 12%|█▏        | 4370/37963 [10:33:27<72:21:56,  7.76s/it]
                                                          
{'loss': '0.1852', 'grad_norm': '7.266', 'learning_rate': '1.962e-05', 'epoch': '0.1151'}

 12%|█▏        | 4370/37963 [10:33:27<72:21:56,  7.76s/it]
 12%|█▏        | 4371/37963 [10:33:48<108:39:17, 11.64s/it]
 12%|█▏        | 4372/37963 [10:34:02<115:26:29, 12.37s/it]
 12%|█▏        | 4373/37963 [10:34:10<102:06:24, 10.94s/it]
 12%|█▏        | 4374/37963 [10:34:24<110:33:34, 11.85s/it]
 12%|█▏        | 4375/37963 [10:34:31<98:08:16, 10.52s/it] 
 12%|█▏        | 4376/37963 [10:34:38<89:32:16,  9.60s/it]
 12%|█▏        | 4377/37963 [10:34:52<100:16:00, 10.75s/it]
 12%|█▏        | 4378/37963 [10:35:00<91:35:40,  9.82s/it] 
 12%|█▏        | 4379/37963 [10:35:07<85:35:06,  9.17s/it]
 12%|█▏        | 4380/37963 [10:35:15<81:26:31,  8.73s/it]
                                                          
{'loss': '0.1857', 'grad_norm': '3.129', 'learning_rate': '1.962e-05', 'epoch': '0.1154'}

 12%|█▏        | 4380/37963 [10:35:15<81:26:31,  8.73s/it]
 12%|█▏        | 4381/37963 [10:35:23<78:20:29,  8.40s/it]
 12%|█▏        | 4382/37963 [10:35:30<75:48:35,  8.13s/it]
 12%|█▏        | 4383/37963 [10:35:38<74:02:33,  7.94s/it]
 12%|█▏        | 4384/37963 [10:35:45<71:52:25,  7.71s/it]
 12%|█▏        | 4385/37963 [10:35:52<71:27:52,  7.66s/it]
 12%|█▏        | 4386/37963 [10:36:00<71:14:25,  7.64s/it]
 12%|█▏        | 4387/37963 [10:36:07<70:54:16,  7.60s/it]
 12%|█▏        | 4388/37963 [10:36:15<70:47:04,  7.59s/it]
 12%|█▏        | 4389/37963 [10:36:22<70:31:44,  7.56s/it]
 12%|█▏        | 4390/37963 [10:36:30<70:26:25,  7.55s/it]
                                                          
{'loss': '0.1609', 'grad_norm': '2.056', 'learning_rate': '1.962e-05', 'epoch': '0.1156'}

 12%|█▏        | 4390/37963 [10:36:30<70:26:25,  7.55s/it]
 12%|█▏        | 4391/37963 [10:36:37<69:48:56,  7.49s/it]
 12%|█▏        | 4392/37963 [10:36:45<70:05:19,  7.52s/it]
 12%|█▏        | 4393/37963 [10:36:52<69:53:04,  7.49s/it]
 12%|█▏        | 4394/37963 [10:37:00<69:56:12,  7.50s/it]
 12%|█▏        | 4395/37963 [10:37:07<70:23:34,  7.55s/it]
 12%|█▏        | 4396/37963 [10:37:15<69:48:46,  7.49s/it]
 12%|█▏        | 4397/37963 [10:37:22<70:08:08,  7.52s/it]
 12%|█▏        | 4398/37963 [10:37:30<70:11:10,  7.53s/it]
 12%|█▏        | 4399/37963 [10:37:37<69:57:56,  7.50s/it]
 12%|█▏        | 4400/37963 [10:37:45<70:23:33,  7.55s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '2.927', 'learning_rate': '1.962e-05', 'epoch': '0.1159'}

 12%|█▏        | 4400/37963 [10:37:45<70:23:33,  7.55s/it]
 12%|█▏        | 4401/37963 [10:37:53<70:32:17,  7.57s/it]
 12%|█▏        | 4402/37963 [10:38:00<70:32:29,  7.57s/it]
 12%|█▏        | 4403/37963 [10:38:14<88:28:49,  9.49s/it]
 12%|█▏        | 4404/37963 [10:38:22<83:41:10,  8.98s/it]
 12%|█▏        | 4405/37963 [10:38:30<79:47:00,  8.56s/it]
 12%|█▏        | 4406/37963 [10:38:37<76:51:43,  8.25s/it]
 12%|█▏        | 4407/37963 [10:38:45<74:36:16,  8.00s/it]
 12%|█▏        | 4408/37963 [10:38:52<72:49:54,  7.81s/it]
 12%|█▏        | 4409/37963 [10:38:59<72:01:25,  7.73s/it]
 12%|█▏        | 4410/37963 [10:39:07<71:20:07,  7.65s/it]
                                                          
{'loss': '0.1719', 'grad_norm': '4.635', 'learning_rate': '1.961e-05', 'epoch': '0.1162'}

 12%|█▏        | 4410/37963 [10:39:07<71:20:07,  7.65s/it]
 12%|█▏        | 4411/37963 [10:39:21<88:49:03,  9.53s/it]
 12%|█▏        | 4412/37963 [10:39:28<83:30:10,  8.96s/it]
 12%|█▏        | 4413/37963 [10:39:36<79:27:32,  8.53s/it]
 12%|█▏        | 4414/37963 [10:39:43<76:34:02,  8.22s/it]
 12%|█▏        | 4415/37963 [10:39:51<74:29:37,  7.99s/it]
 12%|█▏        | 4416/37963 [10:40:05<90:57:45,  9.76s/it]
 12%|█▏        | 4417/37963 [10:40:12<84:48:12,  9.10s/it]
 12%|█▏        | 4418/37963 [10:40:20<79:55:16,  8.58s/it]
 12%|█▏        | 4419/37963 [10:40:34<95:35:20, 10.26s/it]
 12%|█▏        | 4420/37963 [10:40:42<88:07:11,  9.46s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.735', 'learning_rate': '1.961e-05', 'epoch': '0.1164'}

 12%|█▏        | 4420/37963 [10:40:42<88:07:11,  9.46s/it]
 12%|█▏        | 4421/37963 [10:40:56<101:53:30, 10.94s/it]
 12%|█▏        | 4422/37963 [10:41:03<92:19:38,  9.91s/it] 
 12%|█▏        | 4423/37963 [10:41:17<103:57:40, 11.16s/it]
 12%|█▏        | 4424/37963 [10:41:25<93:54:18, 10.08s/it] 
 12%|█▏        | 4425/37963 [10:41:39<105:05:38, 11.28s/it]
 12%|█▏        | 4426/37963 [10:41:47<95:10:25, 10.22s/it] 
 12%|█▏        | 4427/37963 [10:41:54<86:59:42,  9.34s/it]
 12%|█▏        | 4428/37963 [10:42:02<81:55:39,  8.79s/it]
 12%|█▏        | 4429/37963 [10:42:09<78:24:25,  8.42s/it]
 12%|█▏        | 4430/37963 [10:42:17<75:50:56,  8.14s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '4.445', 'learning_rate': '1.961e-05', 'epoch': '0.1167'}

 12%|█▏        | 4430/37963 [10:42:17<75:50:56,  8.14s/it]
 12%|█▏        | 4431/37963 [10:42:24<74:05:32,  7.95s/it]
 12%|█▏        | 4432/37963 [10:42:32<73:18:12,  7.87s/it]
 12%|█▏        | 4433/37963 [10:42:39<72:17:48,  7.76s/it]
 12%|█▏        | 4434/37963 [10:42:47<71:43:04,  7.70s/it]
 12%|█▏        | 4435/37963 [10:42:54<70:45:10,  7.60s/it]
 12%|█▏        | 4436/37963 [10:43:02<70:35:25,  7.58s/it]
 12%|█▏        | 4437/37963 [10:43:10<70:45:53,  7.60s/it]
 12%|█▏        | 4438/37963 [10:43:17<70:04:37,  7.53s/it]
 12%|█▏        | 4439/37963 [10:43:24<70:10:12,  7.54s/it]
 12%|█▏        | 4440/37963 [10:43:32<69:01:18,  7.41s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '3.822', 'learning_rate': '1.961e-05', 'epoch': '0.117'}

 12%|█▏        | 4440/37963 [10:43:32<69:01:18,  7.41s/it]
 12%|█▏        | 4441/37963 [10:43:39<69:20:49,  7.45s/it]
 12%|█▏        | 4442/37963 [10:43:47<69:40:49,  7.48s/it]
 12%|█▏        | 4443/37963 [10:43:54<69:50:14,  7.50s/it]
 12%|█▏        | 4444/37963 [10:44:01<69:06:49,  7.42s/it]
 12%|█▏        | 4445/37963 [10:44:09<69:25:32,  7.46s/it]
 12%|█▏        | 4446/37963 [10:44:17<69:57:14,  7.51s/it]
 12%|█▏        | 4447/37963 [10:44:24<70:22:49,  7.56s/it]
 12%|█▏        | 4448/37963 [10:44:32<70:39:36,  7.59s/it]
 12%|█▏        | 4449/37963 [10:44:40<70:58:46,  7.62s/it]
 12%|█▏        | 4450/37963 [10:44:47<70:41:40,  7.59s/it]
                                                          
{'loss': '0.1804', 'grad_norm': '2.673', 'learning_rate': '1.96e-05', 'epoch': '0.1172'}

 12%|█▏        | 4450/37963 [10:44:47<70:41:40,  7.59s/it]
 12%|█▏        | 4451/37963 [10:44:54<69:55:07,  7.51s/it]
 12%|█▏        | 4452/37963 [10:45:02<69:36:45,  7.48s/it]
 12%|█▏        | 4453/37963 [10:45:09<69:28:30,  7.46s/it]
 12%|█▏        | 4454/37963 [10:45:23<87:56:56,  9.45s/it]
 12%|█▏        | 4455/37963 [10:45:31<82:20:38,  8.85s/it]
 12%|█▏        | 4456/37963 [10:45:38<78:48:11,  8.47s/it]
 12%|█▏        | 4457/37963 [10:45:46<76:17:31,  8.20s/it]
 12%|█▏        | 4458/37963 [10:45:54<74:59:59,  8.06s/it]
 12%|█▏        | 4459/37963 [10:46:01<73:19:27,  7.88s/it]
 12%|█▏        | 4460/37963 [10:46:15<90:16:22,  9.70s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '2.298', 'learning_rate': '1.96e-05', 'epoch': '0.1175'}

 12%|█▏        | 4460/37963 [10:46:15<90:16:22,  9.70s/it]
 12%|█▏        | 4461/37963 [10:46:29<101:37:17, 10.92s/it]
 12%|█▏        | 4462/37963 [10:46:36<92:09:10,  9.90s/it] 
 12%|█▏        | 4463/37963 [10:46:50<103:20:14, 11.10s/it]
 12%|█▏        | 4464/37963 [10:46:58<93:28:56, 10.05s/it] 
 12%|█▏        | 4465/37963 [10:47:05<86:23:39,  9.28s/it]
 12%|█▏        | 4466/37963 [10:47:13<81:26:40,  8.75s/it]
 12%|█▏        | 4467/37963 [10:47:21<78:11:42,  8.40s/it]
 12%|█▏        | 4468/37963 [10:47:28<76:07:07,  8.18s/it]
 12%|█▏        | 4469/37963 [10:47:42<91:12:37,  9.80s/it]
 12%|█▏        | 4470/37963 [10:47:50<85:28:55,  9.19s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '3.102', 'learning_rate': '1.96e-05', 'epoch': '0.1177'}

 12%|█▏        | 4470/37963 [10:47:50<85:28:55,  9.19s/it]
 12%|█▏        | 4471/37963 [10:48:03<98:08:55, 10.55s/it]
 12%|█▏        | 4472/37963 [10:48:11<89:19:37,  9.60s/it]
 12%|█▏        | 4473/37963 [10:48:18<83:29:32,  8.97s/it]
 12%|█▏        | 4474/37963 [10:48:26<79:22:30,  8.53s/it]
 12%|█▏        | 4475/37963 [10:48:40<95:21:20, 10.25s/it]
 12%|█▏        | 4476/37963 [10:48:47<87:52:00,  9.45s/it]
 12%|█▏        | 4477/37963 [10:49:01<100:17:02, 10.78s/it]
 12%|█▏        | 4478/37963 [10:49:09<90:43:19,  9.75s/it] 
 12%|█▏        | 4479/37963 [10:49:16<84:36:44,  9.10s/it]
 12%|█▏        | 4480/37963 [10:49:24<79:39:52,  8.57s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '2.214', 'learning_rate': '1.96e-05', 'epoch': '0.118'}

 12%|█▏        | 4480/37963 [10:49:24<79:39:52,  8.57s/it]
 12%|█▏        | 4481/37963 [10:49:31<76:59:46,  8.28s/it]
 12%|█▏        | 4482/37963 [10:49:39<74:21:39,  8.00s/it]
 12%|█▏        | 4483/37963 [10:49:46<73:12:53,  7.87s/it]
 12%|█▏        | 4484/37963 [10:49:54<72:30:02,  7.80s/it]
 12%|█▏        | 4485/37963 [10:50:01<71:52:13,  7.73s/it]
 12%|█▏        | 4486/37963 [10:50:09<70:59:59,  7.64s/it]
 12%|█▏        | 4487/37963 [10:50:16<70:31:45,  7.58s/it]
 12%|█▏        | 4488/37963 [10:50:23<68:56:51,  7.41s/it]
 12%|█▏        | 4489/37963 [10:50:31<69:00:32,  7.42s/it]
 12%|█▏        | 4490/37963 [10:50:38<68:33:50,  7.37s/it]
                                                          
{'loss': '0.1758', 'grad_norm': '3.3', 'learning_rate': '1.959e-05', 'epoch': '0.1183'}

 12%|█▏        | 4490/37963 [10:50:38<68:33:50,  7.37s/it]
 12%|█▏        | 4491/37963 [10:50:46<69:19:45,  7.46s/it]
 12%|█▏        | 4492/37963 [10:50:53<69:12:30,  7.44s/it]
 12%|█▏        | 4493/37963 [10:51:01<69:21:59,  7.46s/it]
 12%|█▏        | 4494/37963 [10:51:08<69:26:17,  7.47s/it]
 12%|█▏        | 4495/37963 [10:51:15<69:07:27,  7.44s/it]
 12%|█▏        | 4496/37963 [10:51:23<69:54:05,  7.52s/it]
 12%|█▏        | 4497/37963 [10:51:31<70:06:05,  7.54s/it]
 12%|█▏        | 4498/37963 [10:51:38<68:55:39,  7.41s/it]
 12%|█▏        | 4499/37963 [10:51:45<69:42:59,  7.50s/it]
 12%|█▏        | 4500/37963 [10:51:53<70:04:23,  7.54s/it]
                                                          
{'loss': '0.166', 'grad_norm': '1.533', 'learning_rate': '1.959e-05', 'epoch': '0.1185'}

 12%|█▏        | 4500/37963 [10:51:53<70:04:23,  7.54s/it]
 12%|█▏        | 4501/37963 [10:52:01<70:06:25,  7.54s/it]
 12%|█▏        | 4502/37963 [10:52:08<70:08:51,  7.55s/it]
 12%|█▏        | 4503/37963 [10:52:16<70:02:36,  7.54s/it]
 12%|█▏        | 4504/37963 [10:52:23<69:56:26,  7.53s/it]
 12%|█▏        | 4505/37963 [10:52:37<86:34:13,  9.31s/it]
 12%|█▏        | 4506/37963 [10:52:44<81:03:23,  8.72s/it]
 12%|█▏        | 4507/37963 [10:52:52<77:51:06,  8.38s/it]
 12%|█▏        | 4508/37963 [10:52:59<74:47:27,  8.05s/it]
 12%|█▏        | 4509/37963 [10:53:13<91:17:31,  9.82s/it]
 12%|█▏        | 4510/37963 [10:53:20<85:05:15,  9.16s/it]
                                                          
{'loss': '0.1644', 'grad_norm': '3.473', 'learning_rate': '1.959e-05', 'epoch': '0.1188'}

 12%|█▏        | 4510/37963 [10:53:20<85:05:15,  9.16s/it]
 12%|█▏        | 4511/37963 [10:53:28<80:30:27,  8.66s/it]
 12%|█▏        | 4512/37963 [10:53:42<95:25:23, 10.27s/it]
 12%|█▏        | 4513/37963 [10:53:49<87:28:44,  9.41s/it]
 12%|█▏        | 4514/37963 [10:54:03<100:13:44, 10.79s/it]
 12%|█▏        | 4515/37963 [10:54:11<91:30:04,  9.85s/it] 
 12%|█▏        | 4516/37963 [10:54:19<85:13:36,  9.17s/it]
 12%|█▏        | 4517/37963 [10:54:26<80:54:09,  8.71s/it]
 12%|█▏        | 4518/37963 [10:54:34<77:04:43,  8.30s/it]
 12%|█▏        | 4519/37963 [10:54:41<74:53:07,  8.06s/it]
 12%|█▏        | 4520/37963 [10:54:49<73:22:18,  7.90s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '1.35', 'learning_rate': '1.959e-05', 'epoch': '0.1191'}

 12%|█▏        | 4520/37963 [10:54:49<73:22:18,  7.90s/it]
 12%|█▏        | 4521/37963 [10:55:09<108:34:39, 11.69s/it]
 12%|█▏        | 4522/37963 [10:55:17<97:08:52, 10.46s/it] 
 12%|█▏        | 4523/37963 [10:55:24<89:10:24,  9.60s/it]
 12%|█▏        | 4524/37963 [10:55:32<83:21:22,  8.97s/it]
 12%|█▏        | 4525/37963 [10:55:46<96:52:00, 10.43s/it]
 12%|█▏        | 4526/37963 [10:55:53<87:59:35,  9.47s/it]
 12%|█▏        | 4527/37963 [10:56:01<82:42:48,  8.91s/it]
 12%|█▏        | 4528/37963 [10:56:08<78:24:31,  8.44s/it]
 12%|█▏        | 4529/37963 [10:56:15<75:48:28,  8.16s/it]
 12%|█▏        | 4530/37963 [10:56:23<73:59:43,  7.97s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '3.726', 'learning_rate': '1.958e-05', 'epoch': '0.1193'}

 12%|█▏        | 4530/37963 [10:56:23<73:59:43,  7.97s/it]
 12%|█▏        | 4531/37963 [10:56:37<91:13:01,  9.82s/it]
 12%|█▏        | 4532/37963 [10:56:45<85:02:09,  9.16s/it]
 12%|█▏        | 4533/37963 [10:56:52<80:32:08,  8.67s/it]
 12%|█▏        | 4534/37963 [10:57:00<77:39:11,  8.36s/it]
 12%|█▏        | 4535/37963 [10:57:07<75:26:47,  8.13s/it]
 12%|█▏        | 4536/37963 [10:57:15<73:47:34,  7.95s/it]
 12%|█▏        | 4537/37963 [10:57:22<72:38:13,  7.82s/it]
 12%|█▏        | 4538/37963 [10:57:30<71:36:41,  7.71s/it]
 12%|█▏        | 4539/37963 [10:57:37<70:33:22,  7.60s/it]
 12%|█▏        | 4540/37963 [10:57:45<70:29:55,  7.59s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '3.419', 'learning_rate': '1.958e-05', 'epoch': '0.1196'}

 12%|█▏        | 4540/37963 [10:57:45<70:29:55,  7.59s/it]
 12%|█▏        | 4541/37963 [10:57:52<70:21:41,  7.58s/it]
 12%|█▏        | 4542/37963 [10:58:00<70:13:45,  7.56s/it]
 12%|█▏        | 4543/37963 [10:58:07<69:18:40,  7.47s/it]
 12%|█▏        | 4544/37963 [10:58:15<69:56:36,  7.53s/it]
 12%|█▏        | 4545/37963 [10:58:22<69:35:05,  7.50s/it]
 12%|█▏        | 4546/37963 [10:58:30<69:47:38,  7.52s/it]
 12%|█▏        | 4547/37963 [10:58:37<69:54:29,  7.53s/it]
 12%|█▏        | 4548/37963 [10:58:45<69:33:38,  7.49s/it]
 12%|█▏        | 4549/37963 [10:58:52<69:42:40,  7.51s/it]
 12%|█▏        | 4550/37963 [10:59:00<70:01:05,  7.54s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '1.835', 'learning_rate': '1.958e-05', 'epoch': '0.1199'}

 12%|█▏        | 4550/37963 [10:59:00<70:01:05,  7.54s/it]
 12%|█▏        | 4551/37963 [10:59:08<70:13:22,  7.57s/it]
 12%|█▏        | 4552/37963 [10:59:22<88:20:50,  9.52s/it]
 12%|█▏        | 4553/37963 [10:59:29<82:58:18,  8.94s/it]
 12%|█▏        | 4554/37963 [10:59:37<79:16:09,  8.54s/it]
 12%|█▏        | 4555/37963 [10:59:44<76:11:29,  8.21s/it]
 12%|█▏        | 4556/37963 [10:59:52<74:15:17,  8.00s/it]
 12%|█▏        | 4557/37963 [10:59:59<73:01:13,  7.87s/it]
 12%|█▏        | 4558/37963 [11:00:07<72:05:09,  7.77s/it]
 12%|█▏        | 4559/37963 [11:00:15<71:38:21,  7.72s/it]
 12%|█▏        | 4560/37963 [11:00:22<71:04:12,  7.66s/it]
                                                          
{'loss': '0.171', 'grad_norm': '1.821', 'learning_rate': '1.958e-05', 'epoch': '0.1201'}

 12%|█▏        | 4560/37963 [11:00:22<71:04:12,  7.66s/it]
 12%|█▏        | 4561/37963 [11:00:36<88:33:12,  9.54s/it]
 12%|█▏        | 4562/37963 [11:00:44<82:56:14,  8.94s/it]
 12%|█▏        | 4563/37963 [11:00:57<96:55:28, 10.45s/it]
 12%|█▏        | 4564/37963 [11:01:05<89:06:32,  9.60s/it]
 12%|█▏        | 4565/37963 [11:01:12<82:41:43,  8.91s/it]
 12%|█▏        | 4566/37963 [11:01:20<78:59:10,  8.51s/it]
 12%|█▏        | 4567/37963 [11:01:34<94:00:23, 10.13s/it]
 12%|█▏        | 4568/37963 [11:01:41<86:49:24,  9.36s/it]
 12%|█▏        | 4569/37963 [11:02:02<117:08:14, 12.63s/it]
 12%|█▏        | 4570/37963 [11:02:09<103:29:47, 11.16s/it]
                                                           
{'loss': '0.1778', 'grad_norm': '1.337', 'learning_rate': '1.957e-05', 'epoch': '0.1204'}

 12%|█▏        | 4570/37963 [11:02:09<103:29:47, 11.16s/it]
 12%|█▏        | 4571/37963 [11:02:17<93:16:13, 10.06s/it] 
 12%|█▏        | 4572/37963 [11:02:25<86:28:41,  9.32s/it]
 12%|█▏        | 4573/37963 [11:02:32<80:39:24,  8.70s/it]
 12%|█▏        | 4574/37963 [11:02:39<77:18:22,  8.34s/it]
 12%|█▏        | 4575/37963 [11:02:53<92:37:01,  9.99s/it]
 12%|█▏        | 4576/37963 [11:03:01<86:42:52,  9.35s/it]
 12%|█▏        | 4577/37963 [11:03:09<81:42:13,  8.81s/it]
 12%|█▏        | 4578/37963 [11:03:16<77:42:52,  8.38s/it]
 12%|█▏        | 4579/37963 [11:03:24<75:37:29,  8.16s/it]
 12%|█▏        | 4580/37963 [11:03:31<73:54:24,  7.97s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '1.48', 'learning_rate': '1.957e-05', 'epoch': '0.1206'}

 12%|█▏        | 4580/37963 [11:03:31<73:54:24,  7.97s/it]
 12%|█▏        | 4581/37963 [11:03:45<90:22:49,  9.75s/it]
 12%|█▏        | 4582/37963 [11:03:52<84:05:35,  9.07s/it]
 12%|█▏        | 4583/37963 [11:04:00<80:13:20,  8.65s/it]
 12%|█▏        | 4584/37963 [11:04:08<77:23:45,  8.35s/it]
 12%|█▏        | 4585/37963 [11:04:15<75:00:15,  8.09s/it]
 12%|█▏        | 4586/37963 [11:04:23<73:26:09,  7.92s/it]
 12%|█▏        | 4587/37963 [11:04:30<72:27:06,  7.81s/it]
 12%|█▏        | 4588/37963 [11:04:38<71:36:42,  7.72s/it]
 12%|█▏        | 4589/37963 [11:04:45<70:41:40,  7.63s/it]
 12%|█▏        | 4590/37963 [11:04:53<70:40:58,  7.62s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '2.363', 'learning_rate': '1.957e-05', 'epoch': '0.1209'}

 12%|█▏        | 4590/37963 [11:04:53<70:40:58,  7.62s/it]
 12%|█▏        | 4591/37963 [11:05:01<70:41:55,  7.63s/it]
 12%|█▏        | 4592/37963 [11:05:08<69:47:54,  7.53s/it]
 12%|█▏        | 4593/37963 [11:05:15<69:38:26,  7.51s/it]
 12%|█▏        | 4594/37963 [11:05:23<69:47:04,  7.53s/it]
 12%|█▏        | 4595/37963 [11:05:30<69:59:20,  7.55s/it]
 12%|█▏        | 4596/37963 [11:05:38<69:54:14,  7.54s/it]
 12%|█▏        | 4597/37963 [11:05:45<69:25:36,  7.49s/it]
 12%|█▏        | 4598/37963 [11:05:53<69:31:08,  7.50s/it]
 12%|█▏        | 4599/37963 [11:06:00<69:35:59,  7.51s/it]
 12%|█▏        | 4600/37963 [11:06:08<69:46:06,  7.53s/it]
                                                          
{'loss': '0.1815', 'grad_norm': '3.229', 'learning_rate': '1.957e-05', 'epoch': '0.1212'}

 12%|█▏        | 4600/37963 [11:06:08<69:46:06,  7.53s/it]
 12%|█▏        | 4601/37963 [11:06:16<69:45:05,  7.53s/it]
 12%|█▏        | 4602/37963 [11:06:23<69:28:22,  7.50s/it]
 12%|█▏        | 4603/37963 [11:06:37<87:02:28,  9.39s/it]
 12%|█▏        | 4604/37963 [11:06:44<81:52:02,  8.83s/it]
 12%|█▏        | 4605/37963 [11:06:52<78:12:13,  8.44s/it]
 12%|█▏        | 4606/37963 [11:06:59<75:43:04,  8.17s/it]
 12%|█▏        | 4607/37963 [11:07:07<74:10:04,  8.00s/it]
 12%|█▏        | 4608/37963 [11:07:15<73:06:07,  7.89s/it]
 12%|█▏        | 4609/37963 [11:07:22<71:08:49,  7.68s/it]
 12%|█▏        | 4610/37963 [11:07:36<89:18:58,  9.64s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '4.898', 'learning_rate': '1.956e-05', 'epoch': '0.1214'}

 12%|█▏        | 4610/37963 [11:07:36<89:18:58,  9.64s/it]
 12%|█▏        | 4611/37963 [11:07:44<83:40:13,  9.03s/it]
 12%|█▏        | 4612/37963 [11:07:51<79:32:04,  8.59s/it]
 12%|█▏        | 4613/37963 [11:07:59<76:24:52,  8.25s/it]
 12%|█▏        | 4614/37963 [11:08:06<74:40:01,  8.06s/it]
 12%|█▏        | 4615/37963 [11:08:14<73:23:55,  7.92s/it]
 12%|█▏        | 4616/37963 [11:08:21<71:37:01,  7.73s/it]
 12%|█▏        | 4617/37963 [11:08:29<71:14:10,  7.69s/it]
 12%|█▏        | 4618/37963 [11:08:36<71:05:10,  7.67s/it]
 12%|█▏        | 4619/37963 [11:08:50<87:36:53,  9.46s/it]
 12%|█▏        | 4620/37963 [11:08:58<82:25:56,  8.90s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '3.037', 'learning_rate': '1.956e-05', 'epoch': '0.1217'}

 12%|█▏        | 4620/37963 [11:08:58<82:25:56,  8.90s/it]
 12%|█▏        | 4621/37963 [11:09:05<78:49:26,  8.51s/it]
 12%|█▏        | 4622/37963 [11:09:19<94:26:11, 10.20s/it]
 12%|█▏        | 4623/37963 [11:09:27<87:06:37,  9.41s/it]
 12%|█▏        | 4624/37963 [11:09:41<100:37:28, 10.87s/it]
 12%|█▏        | 4625/37963 [11:09:55<109:25:11, 11.82s/it]
 12%|█▏        | 4626/37963 [11:10:03<97:15:20, 10.50s/it] 
 12%|█▏        | 4627/37963 [11:10:10<89:00:35,  9.61s/it]
 12%|█▏        | 4628/37963 [11:10:18<83:10:47,  8.98s/it]
 12%|█▏        | 4629/37963 [11:10:31<96:14:25, 10.39s/it]
 12%|█▏        | 4630/37963 [11:10:39<88:44:14,  9.58s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '3.21', 'learning_rate': '1.956e-05', 'epoch': '0.122'}

 12%|█▏        | 4630/37963 [11:10:39<88:44:14,  9.58s/it]
 12%|█▏        | 4631/37963 [11:10:47<83:19:29,  9.00s/it]
 12%|█▏        | 4632/37963 [11:10:54<79:04:07,  8.54s/it]
 12%|█▏        | 4633/37963 [11:11:02<76:17:55,  8.24s/it]
 12%|█▏        | 4634/37963 [11:11:09<74:29:13,  8.05s/it]
 12%|█▏        | 4635/37963 [11:11:17<73:14:06,  7.91s/it]
 12%|█▏        | 4636/37963 [11:11:24<72:10:46,  7.80s/it]
 12%|█▏        | 4637/37963 [11:11:32<71:42:28,  7.75s/it]
 12%|█▏        | 4638/37963 [11:11:40<71:13:55,  7.69s/it]
 12%|█▏        | 4639/37963 [11:11:47<70:56:09,  7.66s/it]
 12%|█▏        | 4640/37963 [11:11:55<70:23:47,  7.61s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '2.165', 'learning_rate': '1.956e-05', 'epoch': '0.1222'}

 12%|█▏        | 4640/37963 [11:11:55<70:23:47,  7.61s/it]
 12%|█▏        | 4641/37963 [11:12:02<70:00:54,  7.56s/it]
 12%|█▏        | 4642/37963 [11:12:09<69:17:18,  7.49s/it]
 12%|█▏        | 4643/37963 [11:12:17<69:13:05,  7.48s/it]
 12%|█▏        | 4644/37963 [11:12:24<69:20:56,  7.49s/it]
 12%|█▏        | 4645/37963 [11:12:32<69:29:57,  7.51s/it]
 12%|█▏        | 4646/37963 [11:12:40<69:44:02,  7.53s/it]
 12%|█▏        | 4647/37963 [11:12:47<69:49:35,  7.55s/it]
 12%|█▏        | 4648/37963 [11:13:01<88:05:30,  9.52s/it]
 12%|█▏        | 4649/37963 [11:13:09<82:23:07,  8.90s/it]
 12%|█▏        | 4650/37963 [11:13:16<78:37:22,  8.50s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '4.192', 'learning_rate': '1.955e-05', 'epoch': '0.1225'}

 12%|█▏        | 4650/37963 [11:13:16<78:37:22,  8.50s/it]
 12%|█▏        | 4651/37963 [11:13:24<76:09:28,  8.23s/it]
 12%|█▏        | 4652/37963 [11:13:31<73:55:13,  7.99s/it]
 12%|█▏        | 4653/37963 [11:13:39<73:01:37,  7.89s/it]
 12%|█▏        | 4654/37963 [11:13:52<88:29:38,  9.56s/it]
 12%|█▏        | 4655/37963 [11:14:00<83:00:11,  8.97s/it]
 12%|█▏        | 4656/37963 [11:14:08<79:30:00,  8.59s/it]
 12%|█▏        | 4657/37963 [11:14:15<76:22:51,  8.26s/it]
 12%|█▏        | 4658/37963 [11:14:23<74:18:02,  8.03s/it]
 12%|█▏        | 4659/37963 [11:14:30<73:15:01,  7.92s/it]
 12%|█▏        | 4660/37963 [11:14:38<72:38:41,  7.85s/it]
                                                          
{'loss': '0.1829', 'grad_norm': '1.166', 'learning_rate': '1.955e-05', 'epoch': '0.1228'}

 12%|█▏        | 4660/37963 [11:14:38<72:38:41,  7.85s/it]
 12%|█▏        | 4661/37963 [11:14:46<71:56:18,  7.78s/it]
 12%|█▏        | 4662/37963 [11:14:53<71:25:31,  7.72s/it]
 12%|█▏        | 4663/37963 [11:15:07<88:54:11,  9.61s/it]
 12%|█▏        | 4664/37963 [11:15:15<83:03:32,  8.98s/it]
 12%|█▏        | 4665/37963 [11:15:22<79:01:31,  8.54s/it]
 12%|█▏        | 4666/37963 [11:15:30<75:39:30,  8.18s/it]
 12%|█▏        | 4667/37963 [11:15:37<73:29:53,  7.95s/it]
 12%|█▏        | 4668/37963 [11:15:45<72:17:52,  7.82s/it]
 12%|█▏        | 4669/37963 [11:15:52<71:40:47,  7.75s/it]
 12%|█▏        | 4670/37963 [11:16:00<71:16:53,  7.71s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '1.912', 'learning_rate': '1.955e-05', 'epoch': '0.123'}

 12%|█▏        | 4670/37963 [11:16:00<71:16:53,  7.71s/it]
 12%|█▏        | 4671/37963 [11:16:14<88:15:53,  9.54s/it]
 12%|█▏        | 4672/37963 [11:16:21<82:36:56,  8.93s/it]
 12%|█▏        | 4673/37963 [11:16:29<78:55:58,  8.54s/it]
 12%|█▏        | 4674/37963 [11:16:36<75:29:54,  8.16s/it]
 12%|█▏        | 4675/37963 [11:16:56<109:21:10, 11.83s/it]
 12%|█▏        | 4676/37963 [11:17:10<115:35:02, 12.50s/it]
 12%|█▏        | 4677/37963 [11:17:18<102:13:35, 11.06s/it]
 12%|█▏        | 4678/37963 [11:17:26<92:37:27, 10.02s/it] 
 12%|█▏        | 4679/37963 [11:17:33<85:46:58,  9.28s/it]
 12%|█▏        | 4680/37963 [11:17:41<81:07:06,  8.77s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '7.3', 'learning_rate': '1.955e-05', 'epoch': '0.1233'}

 12%|█▏        | 4680/37963 [11:17:41<81:07:06,  8.77s/it]
 12%|█▏        | 4681/37963 [11:17:48<77:48:47,  8.42s/it]
 12%|█▏        | 4682/37963 [11:18:02<92:49:28, 10.04s/it]
 12%|█▏        | 4683/37963 [11:18:10<86:33:06,  9.36s/it]
 12%|█▏        | 4684/37963 [11:18:17<81:09:11,  8.78s/it]
 12%|█▏        | 4685/37963 [11:18:25<77:54:14,  8.43s/it]
 12%|█▏        | 4686/37963 [11:18:32<74:54:19,  8.10s/it]
 12%|█▏        | 4687/37963 [11:18:40<72:55:10,  7.89s/it]
 12%|█▏        | 4688/37963 [11:18:47<71:35:48,  7.75s/it]
 12%|█▏        | 4689/37963 [11:18:55<71:14:22,  7.71s/it]
 12%|█▏        | 4690/37963 [11:19:02<70:55:46,  7.67s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '1.583', 'learning_rate': '1.954e-05', 'epoch': '0.1235'}

 12%|█▏        | 4690/37963 [11:19:02<70:55:46,  7.67s/it]
 12%|█▏        | 4691/37963 [11:19:10<70:32:00,  7.63s/it]
 12%|█▏        | 4692/37963 [11:19:18<70:11:56,  7.60s/it]
 12%|█▏        | 4693/37963 [11:19:25<69:42:08,  7.54s/it]
 12%|█▏        | 4694/37963 [11:19:39<87:28:56,  9.47s/it]
 12%|█▏        | 4695/37963 [11:19:47<82:22:59,  8.91s/it]
 12%|█▏        | 4696/37963 [11:19:54<77:52:54,  8.43s/it]
 12%|█▏        | 4697/37963 [11:20:01<75:35:02,  8.18s/it]
 12%|█▏        | 4698/37963 [11:20:09<73:21:25,  7.94s/it]
 12%|█▏        | 4699/37963 [11:20:16<71:42:47,  7.76s/it]
 12%|█▏        | 4700/37963 [11:20:24<71:06:55,  7.70s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '2.023', 'learning_rate': '1.954e-05', 'epoch': '0.1238'}

 12%|█▏        | 4700/37963 [11:20:24<71:06:55,  7.70s/it]
 12%|█▏        | 4701/37963 [11:20:31<70:36:02,  7.64s/it]
 12%|█▏        | 4702/37963 [11:20:45<88:07:21,  9.54s/it]
 12%|█▏        | 4703/37963 [11:20:52<81:56:58,  8.87s/it]
 12%|█▏        | 4704/37963 [11:21:00<77:59:57,  8.44s/it]
 12%|█▏        | 4705/37963 [11:21:07<75:26:38,  8.17s/it]
 12%|█▏        | 4706/37963 [11:21:15<73:10:14,  7.92s/it]
 12%|█▏        | 4707/37963 [11:21:22<72:19:39,  7.83s/it]
 12%|█▏        | 4708/37963 [11:21:30<71:33:48,  7.75s/it]
 12%|█▏        | 4709/37963 [11:21:38<71:06:42,  7.70s/it]
 12%|█▏        | 4710/37963 [11:21:45<70:37:33,  7.65s/it]
                                                          
{'loss': '0.1781', 'grad_norm': '3.373', 'learning_rate': '1.954e-05', 'epoch': '0.1241'}

 12%|█▏        | 4710/37963 [11:21:45<70:37:33,  7.65s/it]
 12%|█▏        | 4711/37963 [11:21:59<88:18:51,  9.56s/it]
 12%|█▏        | 4712/37963 [11:22:07<82:58:55,  8.98s/it]
 12%|█▏        | 4713/37963 [11:22:14<79:11:03,  8.57s/it]
 12%|█▏        | 4714/37963 [11:22:22<75:25:49,  8.17s/it]
 12%|█▏        | 4715/37963 [11:22:29<73:26:15,  7.95s/it]
 12%|█▏        | 4716/37963 [11:22:43<89:21:02,  9.67s/it]
 12%|█▏        | 4717/37963 [11:22:50<83:42:08,  9.06s/it]
 12%|█▏        | 4718/37963 [11:22:58<78:46:15,  8.53s/it]
 12%|█▏        | 4719/37963 [11:23:05<76:22:57,  8.27s/it]
 12%|█▏        | 4720/37963 [11:23:13<74:08:18,  8.03s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '5.156', 'learning_rate': '1.954e-05', 'epoch': '0.1243'}

 12%|█▏        | 4720/37963 [11:23:13<74:08:18,  8.03s/it]
 12%|█▏        | 4721/37963 [11:23:20<72:36:44,  7.86s/it]
 12%|█▏        | 4722/37963 [11:23:28<71:39:57,  7.76s/it]
 12%|█▏        | 4723/37963 [11:23:35<71:03:52,  7.70s/it]
 12%|█▏        | 4724/37963 [11:23:56<106:12:06, 11.50s/it]
 12%|█▏        | 4725/37963 [11:24:10<113:12:22, 12.26s/it]
 12%|█▏        | 4726/37963 [11:24:17<100:08:11, 10.85s/it]
 12%|█▏        | 4727/37963 [11:24:25<90:57:27,  9.85s/it] 
 12%|█▏        | 4728/37963 [11:24:32<84:29:00,  9.15s/it]
 12%|█▏        | 4729/37963 [11:24:40<79:20:44,  8.59s/it]
 12%|█▏        | 4730/37963 [11:24:47<76:26:40,  8.28s/it]
                                                          
{'loss': '0.1799', 'grad_norm': '3.952', 'learning_rate': '1.953e-05', 'epoch': '0.1246'}

 12%|█▏        | 4730/37963 [11:24:47<76:26:40,  8.28s/it]
 12%|█▏        | 4731/37963 [11:24:55<74:03:29,  8.02s/it]
 12%|█▏        | 4732/37963 [11:25:02<72:47:14,  7.89s/it]
 12%|█▏        | 4733/37963 [11:25:10<72:05:57,  7.81s/it]
 12%|█▏        | 4734/37963 [11:25:17<71:28:28,  7.74s/it]
 12%|█▏        | 4735/37963 [11:25:25<70:49:33,  7.67s/it]
 12%|█▏        | 4736/37963 [11:25:32<69:59:03,  7.58s/it]
 12%|█▏        | 4737/37963 [11:25:40<69:44:36,  7.56s/it]
 12%|█▏        | 4738/37963 [11:25:47<69:48:11,  7.56s/it]
 12%|█▏        | 4739/37963 [11:25:55<69:20:30,  7.51s/it]
 12%|█▏        | 4740/37963 [11:26:09<86:54:58,  9.42s/it]
                                                          
{'loss': '0.1798', 'grad_norm': '2.226', 'learning_rate': '1.953e-05', 'epoch': '0.1249'}

 12%|█▏        | 4740/37963 [11:26:09<86:54:58,  9.42s/it]
 12%|█▏        | 4741/37963 [11:26:16<81:09:01,  8.79s/it]
 12%|█▏        | 4742/37963 [11:26:23<77:19:22,  8.38s/it]
 12%|█▏        | 4743/37963 [11:26:31<75:10:23,  8.15s/it]
 12%|█▏        | 4744/37963 [11:26:38<73:24:57,  7.96s/it]
 12%|█▏        | 4745/37963 [11:26:46<72:15:52,  7.83s/it]
 13%|█▎        | 4746/37963 [11:26:54<71:33:26,  7.76s/it]
 13%|█▎        | 4747/37963 [11:27:01<69:59:23,  7.59s/it]
 13%|█▎        | 4748/37963 [11:27:08<69:50:01,  7.57s/it]
 13%|█▎        | 4749/37963 [11:27:22<87:27:05,  9.48s/it]
 13%|█▎        | 4750/37963 [11:27:30<82:19:40,  8.92s/it]
                                                          
{'loss': '0.1862', 'grad_norm': '2.909', 'learning_rate': '1.953e-05', 'epoch': '0.1251'}

 13%|█▎        | 4750/37963 [11:27:30<82:19:40,  8.92s/it]
 13%|█▎        | 4751/37963 [11:27:37<78:29:57,  8.51s/it]
 13%|█▎        | 4752/37963 [11:27:45<75:32:39,  8.19s/it]
 13%|█▎        | 4753/37963 [11:27:52<73:54:23,  8.01s/it]
 13%|█▎        | 4754/37963 [11:28:00<71:45:43,  7.78s/it]
 13%|█▎        | 4755/37963 [11:28:07<71:05:03,  7.71s/it]
 13%|█▎        | 4756/37963 [11:28:14<69:37:19,  7.55s/it]
 13%|█▎        | 4757/37963 [11:28:22<69:42:32,  7.56s/it]
 13%|█▎        | 4758/37963 [11:28:29<69:33:26,  7.54s/it]
 13%|█▎        | 4759/37963 [11:28:37<69:28:57,  7.53s/it]
 13%|█▎        | 4760/37963 [11:28:51<87:54:26,  9.53s/it]
                                                          
{'loss': '0.1589', 'grad_norm': '3.223', 'learning_rate': '1.953e-05', 'epoch': '0.1254'}

 13%|█▎        | 4760/37963 [11:28:51<87:54:26,  9.53s/it]
 13%|█▎        | 4761/37963 [11:28:59<82:30:32,  8.95s/it]
 13%|█▎        | 4762/37963 [11:29:06<78:41:39,  8.53s/it]
 13%|█▎        | 4763/37963 [11:29:14<76:04:10,  8.25s/it]
 13%|█▎        | 4764/37963 [11:29:21<74:00:05,  8.02s/it]
 13%|█▎        | 4765/37963 [11:29:29<72:13:26,  7.83s/it]
 13%|█▎        | 4766/37963 [11:29:43<89:18:50,  9.69s/it]
 13%|█▎        | 4767/37963 [11:29:50<82:55:03,  8.99s/it]
 13%|█▎        | 4768/37963 [11:29:58<78:50:39,  8.55s/it]
 13%|█▎        | 4769/37963 [11:30:05<76:07:01,  8.26s/it]
 13%|█▎        | 4770/37963 [11:30:13<73:53:52,  8.01s/it]
                                                          
{'loss': '0.185', 'grad_norm': '2.034', 'learning_rate': '1.952e-05', 'epoch': '0.1256'}

 13%|█▎        | 4770/37963 [11:30:13<73:53:52,  8.01s/it]
 13%|█▎        | 4771/37963 [11:30:27<90:24:33,  9.81s/it]
 13%|█▎        | 4772/37963 [11:30:41<102:41:59, 11.14s/it]
 13%|█▎        | 4773/37963 [11:30:55<110:51:36, 12.02s/it]
 13%|█▎        | 4774/37963 [11:31:03<98:18:26, 10.66s/it] 
 13%|█▎        | 4775/37963 [11:31:10<89:52:39,  9.75s/it]
 13%|█▎        | 4776/37963 [11:31:23<99:40:04, 10.81s/it]
 13%|█▎        | 4777/37963 [11:31:31<90:51:57,  9.86s/it]
 13%|█▎        | 4778/37963 [11:31:39<84:23:54,  9.16s/it]
 13%|█▎        | 4779/37963 [11:31:46<79:42:56,  8.65s/it]
 13%|█▎        | 4780/37963 [11:31:54<76:39:11,  8.32s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '3.045', 'learning_rate': '1.952e-05', 'epoch': '0.1259'}

 13%|█▎        | 4780/37963 [11:31:54<76:39:11,  8.32s/it]
 13%|█▎        | 4781/37963 [11:32:01<74:30:28,  8.08s/it]
 13%|█▎        | 4782/37963 [11:32:08<72:17:17,  7.84s/it]
 13%|█▎        | 4783/37963 [11:32:16<71:42:12,  7.78s/it]
 13%|█▎        | 4784/37963 [11:32:23<70:39:23,  7.67s/it]
 13%|█▎        | 4785/37963 [11:32:31<70:17:24,  7.63s/it]
 13%|█▎        | 4786/37963 [11:32:38<69:59:46,  7.60s/it]
 13%|█▎        | 4787/37963 [11:32:46<69:14:24,  7.51s/it]
 13%|█▎        | 4788/37963 [11:32:53<68:39:55,  7.45s/it]
 13%|█▎        | 4789/37963 [11:33:07<86:45:11,  9.41s/it]
 13%|█▎        | 4790/37963 [11:33:15<81:51:53,  8.88s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '2.236', 'learning_rate': '1.952e-05', 'epoch': '0.1262'}

 13%|█▎        | 4790/37963 [11:33:15<81:51:53,  8.88s/it]
 13%|█▎        | 4791/37963 [11:33:22<78:02:44,  8.47s/it]
 13%|█▎        | 4792/37963 [11:33:30<75:19:00,  8.17s/it]
 13%|█▎        | 4793/37963 [11:33:37<73:24:20,  7.97s/it]
 13%|█▎        | 4794/37963 [11:33:45<72:04:23,  7.82s/it]
 13%|█▎        | 4795/37963 [11:33:52<71:16:06,  7.74s/it]
 13%|█▎        | 4796/37963 [11:34:00<70:42:51,  7.68s/it]
 13%|█▎        | 4797/37963 [11:34:07<70:26:24,  7.65s/it]
 13%|█▎        | 4798/37963 [11:34:15<70:03:31,  7.60s/it]
 13%|█▎        | 4799/37963 [11:34:22<69:53:36,  7.59s/it]
 13%|█▎        | 4800/37963 [11:34:30<69:32:08,  7.55s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '1.481', 'learning_rate': '1.952e-05', 'epoch': '0.1264'}

 13%|█▎        | 4800/37963 [11:34:30<69:32:08,  7.55s/it]
 13%|█▎        | 4801/37963 [11:34:37<68:58:58,  7.49s/it]
 13%|█▎        | 4802/37963 [11:34:51<85:58:12,  9.33s/it]
 13%|█▎        | 4803/37963 [11:34:58<81:07:41,  8.81s/it]
 13%|█▎        | 4804/37963 [11:35:06<77:22:27,  8.40s/it]
 13%|█▎        | 4805/37963 [11:35:14<75:23:33,  8.19s/it]
 13%|█▎        | 4806/37963 [11:35:21<73:45:18,  8.01s/it]
 13%|█▎        | 4807/37963 [11:35:29<72:31:55,  7.88s/it]
 13%|█▎        | 4808/37963 [11:35:43<89:06:10,  9.67s/it]
 13%|█▎        | 4809/37963 [11:35:50<82:59:26,  9.01s/it]
 13%|█▎        | 4810/37963 [11:36:04<96:13:01, 10.45s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '2.663', 'learning_rate': '1.951e-05', 'epoch': '0.1267'}

 13%|█▎        | 4810/37963 [11:36:04<96:13:01, 10.45s/it]
 13%|█▎        | 4811/37963 [11:36:11<88:19:26,  9.59s/it]
 13%|█▎        | 4812/37963 [11:36:19<83:01:28,  9.02s/it]
 13%|█▎        | 4813/37963 [11:36:27<78:53:05,  8.57s/it]
 13%|█▎        | 4814/37963 [11:36:34<76:03:29,  8.26s/it]
 13%|█▎        | 4815/37963 [11:36:42<74:15:57,  8.07s/it]
 13%|█▎        | 4816/37963 [11:36:49<72:45:09,  7.90s/it]
 13%|█▎        | 4817/37963 [11:36:57<71:35:27,  7.78s/it]
 13%|█▎        | 4818/37963 [11:37:04<70:58:08,  7.71s/it]
 13%|█▎        | 4819/37963 [11:37:19<89:18:27,  9.70s/it]
 13%|█▎        | 4820/37963 [11:37:26<83:30:55,  9.07s/it]
                                                          
{'loss': '0.1863', 'grad_norm': '2.262', 'learning_rate': '1.951e-05', 'epoch': '0.127'}

 13%|█▎        | 4820/37963 [11:37:26<83:30:55,  9.07s/it]
 13%|█▎        | 4821/37963 [11:37:34<79:14:22,  8.61s/it]
 13%|█▎        | 4822/37963 [11:37:41<76:16:13,  8.28s/it]
 13%|█▎        | 4823/37963 [11:38:02<110:09:42, 11.97s/it]
 13%|█▎        | 4824/37963 [11:38:09<97:44:57, 10.62s/it] 
 13%|█▎        | 4825/37963 [11:38:17<88:12:12,  9.58s/it]
 13%|█▎        | 4826/37963 [11:38:30<100:02:17, 10.87s/it]
 13%|█▎        | 4827/37963 [11:38:38<91:10:42,  9.91s/it] 
 13%|█▎        | 4828/37963 [11:38:45<83:37:41,  9.09s/it]
 13%|█▎        | 4829/37963 [11:38:53<78:44:57,  8.56s/it]
 13%|█▎        | 4830/37963 [11:39:00<75:47:12,  8.23s/it]
                                                          
{'loss': '0.165', 'grad_norm': '2.022', 'learning_rate': '1.951e-05', 'epoch': '0.1272'}

 13%|█▎        | 4830/37963 [11:39:00<75:47:12,  8.23s/it]
 13%|█▎        | 4831/37963 [11:39:08<73:56:37,  8.03s/it]
 13%|█▎        | 4832/37963 [11:39:15<72:50:05,  7.91s/it]
 13%|█▎        | 4833/37963 [11:39:23<71:40:33,  7.79s/it]
 13%|█▎        | 4834/37963 [11:39:30<70:00:57,  7.61s/it]
 13%|█▎        | 4835/37963 [11:39:43<86:18:14,  9.38s/it]
 13%|█▎        | 4836/37963 [11:39:51<81:26:45,  8.85s/it]
 13%|█▎        | 4837/37963 [11:39:59<77:40:22,  8.44s/it]
 13%|█▎        | 4838/37963 [11:40:06<75:01:03,  8.15s/it]
 13%|█▎        | 4839/37963 [11:40:13<72:15:23,  7.85s/it]
 13%|█▎        | 4840/37963 [11:40:21<71:12:58,  7.74s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '1.186', 'learning_rate': '1.951e-05', 'epoch': '0.1275'}

 13%|█▎        | 4840/37963 [11:40:21<71:12:58,  7.74s/it]
 13%|█▎        | 4841/37963 [11:40:28<70:27:55,  7.66s/it]
 13%|█▎        | 4842/37963 [11:40:36<70:01:07,  7.61s/it]
 13%|█▎        | 4843/37963 [11:40:43<69:36:43,  7.57s/it]
 13%|█▎        | 4844/37963 [11:40:50<68:24:39,  7.44s/it]
 13%|█▎        | 4845/37963 [11:40:58<68:27:19,  7.44s/it]
 13%|█▎        | 4846/37963 [11:41:05<68:16:33,  7.42s/it]
 13%|█▎        | 4847/37963 [11:41:13<68:28:11,  7.44s/it]
 13%|█▎        | 4848/37963 [11:41:27<86:41:17,  9.42s/it]
 13%|█▎        | 4849/37963 [11:41:34<81:54:23,  8.90s/it]
 13%|█▎        | 4850/37963 [11:41:42<77:43:33,  8.45s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '1.188', 'learning_rate': '1.95e-05', 'epoch': '0.1278'}

 13%|█▎        | 4850/37963 [11:41:42<77:43:33,  8.45s/it]
 13%|█▎        | 4851/37963 [11:41:49<75:30:34,  8.21s/it]
 13%|█▎        | 4852/37963 [11:41:57<73:25:10,  7.98s/it]
 13%|█▎        | 4853/37963 [11:42:11<89:41:02,  9.75s/it]
 13%|█▎        | 4854/37963 [11:42:18<83:31:09,  9.08s/it]
 13%|█▎        | 4855/37963 [11:42:26<79:08:07,  8.60s/it]
 13%|█▎        | 4856/37963 [11:42:33<76:26:33,  8.31s/it]
 13%|█▎        | 4857/37963 [11:42:41<74:14:22,  8.07s/it]
 13%|█▎        | 4858/37963 [11:42:48<72:51:31,  7.92s/it]
 13%|█▎        | 4859/37963 [11:42:56<71:00:31,  7.72s/it]
 13%|█▎        | 4860/37963 [11:43:10<87:59:40,  9.57s/it]
                                                          
{'loss': '0.1639', 'grad_norm': '2.979', 'learning_rate': '1.95e-05', 'epoch': '0.128'}

 13%|█▎        | 4860/37963 [11:43:10<87:59:40,  9.57s/it]
 13%|█▎        | 4861/37963 [11:43:17<83:00:11,  9.03s/it]
 13%|█▎        | 4862/37963 [11:43:25<79:05:41,  8.60s/it]
 13%|█▎        | 4863/37963 [11:43:32<75:38:24,  8.23s/it]
 13%|█▎        | 4864/37963 [11:43:40<74:10:55,  8.07s/it]
 13%|█▎        | 4865/37963 [11:43:54<90:38:43,  9.86s/it]
 13%|█▎        | 4866/37963 [11:44:02<84:33:08,  9.20s/it]
 13%|█▎        | 4867/37963 [11:44:09<79:48:36,  8.68s/it]
 13%|█▎        | 4868/37963 [11:44:17<76:34:40,  8.33s/it]
 13%|█▎        | 4869/37963 [11:44:24<74:33:10,  8.11s/it]
 13%|█▎        | 4870/37963 [11:44:32<72:32:18,  7.89s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '1.422', 'learning_rate': '1.95e-05', 'epoch': '0.1283'}

 13%|█▎        | 4870/37963 [11:44:32<72:32:18,  7.89s/it]
 13%|█▎        | 4871/37963 [11:44:52<106:41:06, 11.61s/it]
 13%|█▎        | 4872/37963 [11:44:59<95:27:22, 10.38s/it] 
 13%|█▎        | 4873/37963 [11:45:07<87:32:28,  9.52s/it]
 13%|█▎        | 4874/37963 [11:45:15<82:13:55,  8.95s/it]
 13%|█▎        | 4875/37963 [11:45:28<95:40:35, 10.41s/it]
 13%|█▎        | 4876/37963 [11:45:36<87:49:36,  9.56s/it]
 13%|█▎        | 4877/37963 [11:45:44<82:34:58,  8.99s/it]
 13%|█▎        | 4878/37963 [11:45:51<78:46:06,  8.57s/it]
 13%|█▎        | 4879/37963 [11:45:59<75:58:21,  8.27s/it]
 13%|█▎        | 4880/37963 [11:46:06<73:48:08,  8.03s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '5.067', 'learning_rate': '1.95e-05', 'epoch': '0.1285'}

 13%|█▎        | 4880/37963 [11:46:06<73:48:08,  8.03s/it]
 13%|█▎        | 4881/37963 [11:46:14<72:52:13,  7.93s/it]
 13%|█▎        | 4882/37963 [11:46:21<71:43:07,  7.80s/it]
 13%|█▎        | 4883/37963 [11:46:36<89:01:38,  9.69s/it]
 13%|█▎        | 4884/37963 [11:46:43<83:10:04,  9.05s/it]
 13%|█▎        | 4885/37963 [11:46:51<79:02:41,  8.60s/it]
 13%|█▎        | 4886/37963 [11:46:58<75:37:17,  8.23s/it]
 13%|█▎        | 4887/37963 [11:47:06<73:43:17,  8.02s/it]
 13%|█▎        | 4888/37963 [11:47:13<71:20:53,  7.77s/it]
 13%|█▎        | 4889/37963 [11:47:20<70:16:07,  7.65s/it]
 13%|█▎        | 4890/37963 [11:47:28<70:08:16,  7.63s/it]
                                                          
{'loss': '0.1802', 'grad_norm': '2.417', 'learning_rate': '1.949e-05', 'epoch': '0.1288'}

 13%|█▎        | 4890/37963 [11:47:28<70:08:16,  7.63s/it]
 13%|█▎        | 4891/37963 [11:47:35<69:44:12,  7.59s/it]
 13%|█▎        | 4892/37963 [11:47:43<69:47:32,  7.60s/it]
 13%|█▎        | 4893/37963 [11:47:50<69:42:47,  7.59s/it]
 13%|█▎        | 4894/37963 [11:47:58<69:26:19,  7.56s/it]
 13%|█▎        | 4895/37963 [11:48:05<69:37:46,  7.58s/it]
 13%|█▎        | 4896/37963 [11:48:13<68:47:24,  7.49s/it]
 13%|█▎        | 4897/37963 [11:48:20<69:01:28,  7.51s/it]
 13%|█▎        | 4898/37963 [11:48:28<68:21:19,  7.44s/it]
 13%|█▎        | 4899/37963 [11:48:35<68:55:15,  7.50s/it]
 13%|█▎        | 4900/37963 [11:48:49<86:39:26,  9.44s/it]
                                                          
{'loss': '0.1772', 'grad_norm': '4.407', 'learning_rate': '1.949e-05', 'epoch': '0.1291'}

 13%|█▎        | 4900/37963 [11:48:49<86:39:26,  9.44s/it]
 13%|█▎        | 4901/37963 [11:48:57<80:54:20,  8.81s/it]
 13%|█▎        | 4902/37963 [11:49:04<77:21:51,  8.42s/it]
 13%|█▎        | 4903/37963 [11:49:18<92:32:02, 10.08s/it]
 13%|█▎        | 4904/37963 [11:49:26<85:35:45,  9.32s/it]
 13%|█▎        | 4905/37963 [11:49:33<81:02:07,  8.82s/it]
 13%|█▎        | 4906/37963 [11:49:41<77:27:41,  8.44s/it]
 13%|█▎        | 4907/37963 [11:49:48<74:47:46,  8.15s/it]
 13%|█▎        | 4908/37963 [11:49:56<73:16:47,  7.98s/it]
 13%|█▎        | 4909/37963 [11:50:03<71:58:42,  7.84s/it]
 13%|█▎        | 4910/37963 [11:50:17<88:28:33,  9.64s/it]
                                                          
{'loss': '0.1738', 'grad_norm': '4.473', 'learning_rate': '1.949e-05', 'epoch': '0.1293'}

 13%|█▎        | 4910/37963 [11:50:17<88:28:33,  9.64s/it]
 13%|█▎        | 4911/37963 [11:50:25<82:27:14,  8.98s/it]
 13%|█▎        | 4912/37963 [11:50:32<78:25:52,  8.54s/it]
 13%|█▎        | 4913/37963 [11:50:40<75:29:17,  8.22s/it]
 13%|█▎        | 4914/37963 [11:50:54<91:42:59,  9.99s/it]
 13%|█▎        | 4915/37963 [11:51:01<85:01:48,  9.26s/it]
 13%|█▎        | 4916/37963 [11:51:09<80:16:17,  8.74s/it]
 13%|█▎        | 4917/37963 [11:51:16<76:49:13,  8.37s/it]
 13%|█▎        | 4918/37963 [11:51:30<91:24:09,  9.96s/it]
 13%|█▎        | 4919/37963 [11:51:38<85:06:16,  9.27s/it]
 13%|█▎        | 4920/37963 [11:51:52<97:47:10, 10.65s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '6.689', 'learning_rate': '1.948e-05', 'epoch': '0.1296'}

 13%|█▎        | 4920/37963 [11:51:52<97:47:10, 10.65s/it]
 13%|█▎        | 4921/37963 [11:51:59<88:45:17,  9.67s/it]
 13%|█▎        | 4922/37963 [11:52:06<82:56:41,  9.04s/it]
 13%|█▎        | 4923/37963 [11:52:14<78:24:10,  8.54s/it]
 13%|█▎        | 4924/37963 [11:52:28<92:52:11, 10.12s/it]
 13%|█▎        | 4925/37963 [11:52:35<85:41:39,  9.34s/it]
 13%|█▎        | 4926/37963 [11:52:43<80:46:49,  8.80s/it]
 13%|█▎        | 4927/37963 [11:52:50<77:38:55,  8.46s/it]
 13%|█▎        | 4928/37963 [11:52:58<74:56:27,  8.17s/it]
 13%|█▎        | 4929/37963 [11:53:05<73:15:18,  7.98s/it]
 13%|█▎        | 4930/37963 [11:53:19<89:09:50,  9.72s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '4.988', 'learning_rate': '1.948e-05', 'epoch': '0.1299'}

 13%|█▎        | 4930/37963 [11:53:19<89:09:50,  9.72s/it]
 13%|█▎        | 4931/37963 [11:53:27<83:06:56,  9.06s/it]
 13%|█▎        | 4932/37963 [11:53:34<78:52:37,  8.60s/it]
 13%|█▎        | 4933/37963 [11:53:42<75:56:20,  8.28s/it]
 13%|█▎        | 4934/37963 [11:53:49<73:02:07,  7.96s/it]
 13%|█▎        | 4935/37963 [11:53:57<72:09:23,  7.86s/it]
 13%|█▎        | 4936/37963 [11:54:04<71:16:59,  7.77s/it]
 13%|█▎        | 4937/37963 [11:54:12<70:35:44,  7.70s/it]
 13%|█▎        | 4938/37963 [11:54:19<70:12:06,  7.65s/it]
 13%|█▎        | 4939/37963 [11:54:27<69:45:44,  7.60s/it]
 13%|█▎        | 4940/37963 [11:54:34<69:38:53,  7.59s/it]
                                                          
{'loss': '0.1657', 'grad_norm': '1.47', 'learning_rate': '1.948e-05', 'epoch': '0.1301'}

 13%|█▎        | 4940/37963 [11:54:34<69:38:53,  7.59s/it]
 13%|█▎        | 4941/37963 [11:54:42<69:28:42,  7.57s/it]
 13%|█▎        | 4942/37963 [11:54:49<69:00:14,  7.52s/it]
 13%|█▎        | 4943/37963 [11:54:57<69:30:41,  7.58s/it]
 13%|█▎        | 4944/37963 [11:55:11<87:23:15,  9.53s/it]
 13%|█▎        | 4945/37963 [11:55:19<82:11:33,  8.96s/it]
 13%|█▎        | 4946/37963 [11:55:26<78:34:52,  8.57s/it]
 13%|█▎        | 4947/37963 [11:55:34<75:43:13,  8.26s/it]
 13%|█▎        | 4948/37963 [11:55:41<73:41:29,  8.04s/it]
 13%|█▎        | 4949/37963 [11:55:49<72:17:44,  7.88s/it]
 13%|█▎        | 4950/37963 [11:55:56<71:31:22,  7.80s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '1.136', 'learning_rate': '1.948e-05', 'epoch': '0.1304'}

 13%|█▎        | 4950/37963 [11:55:56<71:31:22,  7.80s/it]
 13%|█▎        | 4951/37963 [11:56:04<70:39:52,  7.71s/it]
 13%|█▎        | 4952/37963 [11:56:11<70:04:36,  7.64s/it]
 13%|█▎        | 4953/37963 [11:56:25<86:59:13,  9.49s/it]
 13%|█▎        | 4954/37963 [11:56:33<82:07:21,  8.96s/it]
 13%|█▎        | 4955/37963 [11:56:40<77:56:36,  8.50s/it]
 13%|█▎        | 4956/37963 [11:56:48<75:26:47,  8.23s/it]
 13%|█▎        | 4957/37963 [11:56:56<73:52:47,  8.06s/it]
 13%|█▎        | 4958/37963 [11:57:03<72:35:27,  7.92s/it]
 13%|█▎        | 4959/37963 [11:57:11<71:56:43,  7.85s/it]
 13%|█▎        | 4960/37963 [11:57:31<106:44:45, 11.64s/it]
                                                           
{'loss': '0.1805', 'grad_norm': '1.278', 'learning_rate': '1.947e-05', 'epoch': '0.1307'}

 13%|█▎        | 4960/37963 [11:57:31<106:44:45, 11.64s/it]
 13%|█▎        | 4961/37963 [11:57:39<95:26:12, 10.41s/it] 
 13%|█▎        | 4962/37963 [11:57:47<87:48:22,  9.58s/it]
 13%|█▎        | 4963/37963 [11:57:54<81:45:16,  8.92s/it]
 13%|█▎        | 4964/37963 [11:58:01<77:21:38,  8.44s/it]
 13%|█▎        | 4965/37963 [11:58:09<75:04:23,  8.19s/it]
 13%|█▎        | 4966/37963 [11:58:16<73:17:19,  8.00s/it]
 13%|█▎        | 4967/37963 [11:58:30<89:39:02,  9.78s/it]
 13%|█▎        | 4968/37963 [11:58:38<83:46:53,  9.14s/it]
 13%|█▎        | 4969/37963 [11:58:52<97:09:57, 10.60s/it]
 13%|█▎        | 4970/37963 [11:59:00<88:39:40,  9.67s/it]
                                                          
{'loss': '0.182', 'grad_norm': '5.696', 'learning_rate': '1.947e-05', 'epoch': '0.1309'}

 13%|█▎        | 4970/37963 [11:59:00<88:39:40,  9.67s/it]
 13%|█▎        | 4971/37963 [11:59:07<82:25:06,  8.99s/it]
 13%|█▎        | 4972/37963 [11:59:15<78:40:58,  8.59s/it]
 13%|█▎        | 4973/37963 [11:59:22<75:33:11,  8.24s/it]
 13%|█▎        | 4974/37963 [11:59:30<73:36:27,  8.03s/it]
 13%|█▎        | 4975/37963 [11:59:37<71:53:58,  7.85s/it]
 13%|█▎        | 4976/37963 [11:59:45<71:03:08,  7.75s/it]
 13%|█▎        | 4977/37963 [11:59:52<70:29:33,  7.69s/it]
 13%|█▎        | 4978/37963 [12:00:12<104:47:51, 11.44s/it]
 13%|█▎        | 4979/37963 [12:00:20<94:09:00, 10.28s/it] 
 13%|█▎        | 4980/37963 [12:00:27<86:04:58,  9.40s/it]
                                                          
{'loss': '0.1836', 'grad_norm': '2.582', 'learning_rate': '1.947e-05', 'epoch': '0.1312'}

 13%|█▎        | 4980/37963 [12:00:27<86:04:58,  9.40s/it]
 13%|█▎        | 4981/37963 [12:00:35<80:50:01,  8.82s/it]
 13%|█▎        | 4982/37963 [12:00:42<77:09:13,  8.42s/it]
 13%|█▎        | 4983/37963 [12:00:50<74:55:10,  8.18s/it]
 13%|█▎        | 4984/37963 [12:00:57<73:29:44,  8.02s/it]
 13%|█▎        | 4985/37963 [12:01:05<72:09:27,  7.88s/it]
 13%|█▎        | 4986/37963 [12:01:12<70:45:05,  7.72s/it]
 13%|█▎        | 4987/37963 [12:01:20<69:52:01,  7.63s/it]
 13%|█▎        | 4988/37963 [12:01:27<69:44:08,  7.61s/it]
 13%|█▎        | 4989/37963 [12:01:35<69:37:49,  7.60s/it]
 13%|█▎        | 4990/37963 [12:01:49<87:29:34,  9.55s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '3.957', 'learning_rate': '1.947e-05', 'epoch': '0.1314'}

 13%|█▎        | 4990/37963 [12:01:49<87:29:34,  9.55s/it]
 13%|█▎        | 4991/37963 [12:01:57<82:31:49,  9.01s/it]
 13%|█▎        | 4992/37963 [12:02:04<78:21:41,  8.56s/it]
 13%|█▎        | 4993/37963 [12:02:12<75:39:45,  8.26s/it]
 13%|█▎        | 4994/37963 [12:02:19<73:01:45,  7.97s/it]
 13%|█▎        | 4995/37963 [12:02:27<71:36:24,  7.82s/it]
 13%|█▎        | 4996/37963 [12:02:34<70:38:21,  7.71s/it]
 13%|█▎        | 4997/37963 [12:02:42<70:22:04,  7.68s/it]
 13%|█▎        | 4998/37963 [12:02:49<69:42:16,  7.61s/it]
 13%|█▎        | 4999/37963 [12:02:57<69:33:08,  7.60s/it]
 13%|█▎        | 5000/37963 [12:03:04<69:24:58,  7.58s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '1.02', 'learning_rate': '1.946e-05', 'epoch': '0.1317'}

 13%|█▎        | 5000/37963 [12:03:04<69:24:58,  7.58s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.16s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.16s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 13%|█▎        | 5001/37963 [12:04:00<201:27:03, 22.00s/it]
 13%|█▎        | 5002/37963 [12:04:07<161:59:21, 17.69s/it]
 13%|█▎        | 5003/37963 [12:04:15<133:47:06, 14.61s/it]
 13%|█▎        | 5004/37963 [12:04:22<114:22:16, 12.49s/it]
 13%|█▎        | 5005/37963 [12:04:30<100:20:43, 10.96s/it]
 13%|█▎        | 5006/37963 [12:04:44<108:22:36, 11.84s/it]
 13%|█▎        | 5007/37963 [12:04:51<96:38:22, 10.56s/it] 
 13%|█▎        | 5008/37963 [12:05:06<106:40:42, 11.65s/it]
 13%|█▎        | 5009/37963 [12:05:13<95:14:20, 10.40s/it] 
 13%|█▎        | 5010/37963 [12:05:21<87:24:56,  9.55s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '2.78', 'learning_rate': '1.946e-05', 'epoch': '0.132'}

 13%|█▎        | 5010/37963 [12:05:21<87:24:56,  9.55s/it]
 13%|█▎        | 5011/37963 [12:05:34<99:17:49, 10.85s/it]
 13%|█▎        | 5012/37963 [12:05:42<90:37:48,  9.90s/it]
 13%|█▎        | 5013/37963 [12:05:50<84:00:52,  9.18s/it]
 13%|█▎        | 5014/37963 [12:06:03<96:53:55, 10.59s/it]
 13%|█▎        | 5015/37963 [12:06:11<88:09:52,  9.63s/it]
 13%|█▎        | 5016/37963 [12:06:18<82:23:38,  9.00s/it]
 13%|█▎        | 5017/37963 [12:06:32<95:55:54, 10.48s/it]
 13%|█▎        | 5018/37963 [12:06:40<87:12:16,  9.53s/it]
 13%|█▎        | 5019/37963 [12:06:47<81:51:54,  8.95s/it]
 13%|█▎        | 5020/37963 [12:06:55<78:10:56,  8.54s/it]
                                                          
{'loss': '0.1583', 'grad_norm': '1.668', 'learning_rate': '1.946e-05', 'epoch': '0.1322'}

 13%|█▎        | 5020/37963 [12:06:55<78:10:56,  8.54s/it]
 13%|█▎        | 5021/37963 [12:07:02<75:26:36,  8.24s/it]
 13%|█▎        | 5022/37963 [12:07:17<91:36:07, 10.01s/it]
 13%|█▎        | 5023/37963 [12:07:24<84:48:54,  9.27s/it]
 13%|█▎        | 5024/37963 [12:07:32<80:00:57,  8.75s/it]
 13%|█▎        | 5025/37963 [12:07:45<93:00:23, 10.17s/it]
 13%|█▎        | 5026/37963 [12:07:53<86:06:23,  9.41s/it]
 13%|█▎        | 5027/37963 [12:08:00<81:08:23,  8.87s/it]
 13%|█▎        | 5028/37963 [12:08:08<76:50:42,  8.40s/it]
 13%|█▎        | 5029/37963 [12:08:15<74:38:23,  8.16s/it]
 13%|█▎        | 5030/37963 [12:08:23<72:56:36,  7.97s/it]
                                                          
{'loss': '0.1691', 'grad_norm': '4.807', 'learning_rate': '1.945e-05', 'epoch': '0.1325'}

 13%|█▎        | 5030/37963 [12:08:23<72:56:36,  7.97s/it]
 13%|█▎        | 5031/37963 [12:08:30<71:36:52,  7.83s/it]
 13%|█▎        | 5032/37963 [12:08:38<70:51:06,  7.75s/it]
 13%|█▎        | 5033/37963 [12:08:45<70:26:38,  7.70s/it]
 13%|█▎        | 5034/37963 [12:08:53<69:57:02,  7.65s/it]
 13%|█▎        | 5035/37963 [12:09:00<69:37:05,  7.61s/it]
 13%|█▎        | 5036/37963 [12:09:08<69:53:55,  7.64s/it]
 13%|█▎        | 5037/37963 [12:09:16<69:29:59,  7.60s/it]
 13%|█▎        | 5038/37963 [12:09:30<86:53:35,  9.50s/it]
 13%|█▎        | 5039/37963 [12:09:37<81:18:17,  8.89s/it]
 13%|█▎        | 5040/37963 [12:09:44<77:02:11,  8.42s/it]
                                                          
{'loss': '0.1772', 'grad_norm': '1.538', 'learning_rate': '1.945e-05', 'epoch': '0.1328'}

 13%|█▎        | 5040/37963 [12:09:44<77:02:11,  8.42s/it]
 13%|█▎        | 5041/37963 [12:09:52<75:03:58,  8.21s/it]
 13%|█▎        | 5042/37963 [12:09:59<72:38:12,  7.94s/it]
 13%|█▎        | 5043/37963 [12:10:07<71:33:40,  7.83s/it]
 13%|█▎        | 5044/37963 [12:10:15<70:43:01,  7.73s/it]
 13%|█▎        | 5045/37963 [12:10:22<69:24:36,  7.59s/it]
 13%|█▎        | 5046/37963 [12:10:29<68:43:43,  7.52s/it]
 13%|█▎        | 5047/37963 [12:10:37<68:47:26,  7.52s/it]
 13%|█▎        | 5048/37963 [12:10:44<68:44:40,  7.52s/it]
 13%|█▎        | 5049/37963 [12:10:52<68:55:29,  7.54s/it]
 13%|█▎        | 5050/37963 [12:10:59<68:55:21,  7.54s/it]
                                                          
{'loss': '0.1802', 'grad_norm': '2.309', 'learning_rate': '1.945e-05', 'epoch': '0.133'}

 13%|█▎        | 5050/37963 [12:10:59<68:55:21,  7.54s/it]
 13%|█▎        | 5051/37963 [12:11:07<69:02:30,  7.55s/it]
 13%|█▎        | 5052/37963 [12:11:15<69:22:27,  7.59s/it]
 13%|█▎        | 5053/37963 [12:11:22<68:59:59,  7.55s/it]
 13%|█▎        | 5054/37963 [12:11:36<87:22:43,  9.56s/it]
 13%|█▎        | 5055/37963 [12:11:50<98:31:18, 10.78s/it]
 13%|█▎        | 5056/37963 [12:11:57<88:45:19,  9.71s/it]
 13%|█▎        | 5057/37963 [12:12:05<82:42:19,  9.05s/it]
 13%|█▎        | 5058/37963 [12:12:12<78:23:25,  8.58s/it]
 13%|█▎        | 5059/37963 [12:12:26<93:06:15, 10.19s/it]
 13%|█▎        | 5060/37963 [12:12:33<85:39:10,  9.37s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '3.687', 'learning_rate': '1.945e-05', 'epoch': '0.1333'}

 13%|█▎        | 5060/37963 [12:12:33<85:39:10,  9.37s/it]
 13%|█▎        | 5061/37963 [12:12:41<80:39:06,  8.82s/it]
 13%|█▎        | 5062/37963 [12:12:49<77:05:04,  8.43s/it]
 13%|█▎        | 5063/37963 [12:13:09<109:42:43, 12.00s/it]
 13%|█▎        | 5064/37963 [12:13:16<97:26:37, 10.66s/it] 
 13%|█▎        | 5065/37963 [12:13:24<88:56:22,  9.73s/it]
 13%|█▎        | 5066/37963 [12:13:31<82:42:05,  9.05s/it]
 13%|█▎        | 5067/37963 [12:13:39<78:45:57,  8.62s/it]
 13%|█▎        | 5068/37963 [12:13:53<93:23:51, 10.22s/it]
 13%|█▎        | 5069/37963 [12:14:01<85:56:15,  9.41s/it]
 13%|█▎        | 5070/37963 [12:14:08<81:12:20,  8.89s/it]
                                                          
{'loss': '0.1581', 'grad_norm': '2.349', 'learning_rate': '1.944e-05', 'epoch': '0.1336'}

 13%|█▎        | 5070/37963 [12:14:08<81:12:20,  8.89s/it]
 13%|█▎        | 5071/37963 [12:14:16<77:23:02,  8.47s/it]
 13%|█▎        | 5072/37963 [12:14:23<75:01:05,  8.21s/it]
 13%|█▎        | 5073/37963 [12:14:31<73:18:18,  8.02s/it]
 13%|█▎        | 5074/37963 [12:14:45<89:43:42,  9.82s/it]
 13%|█▎        | 5075/37963 [12:14:53<83:46:39,  9.17s/it]
 13%|█▎        | 5076/37963 [12:15:00<79:28:12,  8.70s/it]
 13%|█▎        | 5077/37963 [12:15:08<76:11:47,  8.34s/it]
 13%|█▎        | 5078/37963 [12:15:15<74:05:37,  8.11s/it]
 13%|█▎        | 5079/37963 [12:15:23<71:59:06,  7.88s/it]
 13%|█▎        | 5080/37963 [12:15:30<70:36:42,  7.73s/it]
                                                          
{'loss': '0.1764', 'grad_norm': '2.48', 'learning_rate': '1.944e-05', 'epoch': '0.1338'}

 13%|█▎        | 5080/37963 [12:15:30<70:36:42,  7.73s/it]
 13%|█▎        | 5081/37963 [12:15:37<69:17:12,  7.59s/it]
 13%|█▎        | 5082/37963 [12:15:45<69:03:44,  7.56s/it]
 13%|█▎        | 5083/37963 [12:15:52<69:05:07,  7.56s/it]
 13%|█▎        | 5084/37963 [12:16:00<68:25:11,  7.49s/it]
 13%|█▎        | 5085/37963 [12:16:13<85:26:53,  9.36s/it]
 13%|█▎        | 5086/37963 [12:16:21<80:26:15,  8.81s/it]
 13%|█▎        | 5087/37963 [12:16:28<77:01:07,  8.43s/it]
 13%|█▎        | 5088/37963 [12:16:36<74:31:36,  8.16s/it]
 13%|█▎        | 5089/37963 [12:16:43<72:31:07,  7.94s/it]
 13%|█▎        | 5090/37963 [12:16:51<71:19:22,  7.81s/it]
                                                          
{'loss': '0.1597', 'grad_norm': '1.294', 'learning_rate': '1.944e-05', 'epoch': '0.1341'}

 13%|█▎        | 5090/37963 [12:16:51<71:19:22,  7.81s/it]
 13%|█▎        | 5091/37963 [12:16:58<70:10:06,  7.68s/it]
 13%|█▎        | 5092/37963 [12:17:06<69:50:12,  7.65s/it]
 13%|█▎        | 5093/37963 [12:17:13<69:16:40,  7.59s/it]
 13%|█▎        | 5094/37963 [12:17:21<69:37:25,  7.63s/it]
 13%|█▎        | 5095/37963 [12:17:29<69:36:09,  7.62s/it]
 13%|█▎        | 5096/37963 [12:17:36<69:25:05,  7.60s/it]
 13%|█▎        | 5097/37963 [12:17:44<69:08:27,  7.57s/it]
 13%|█▎        | 5098/37963 [12:17:51<69:20:52,  7.60s/it]
 13%|█▎        | 5099/37963 [12:17:59<69:06:05,  7.57s/it]
 13%|█▎        | 5100/37963 [12:18:06<68:43:39,  7.53s/it]
                                                          
{'loss': '0.172', 'grad_norm': '3.615', 'learning_rate': '1.943e-05', 'epoch': '0.1343'}

 13%|█▎        | 5100/37963 [12:18:06<68:43:39,  7.53s/it]
 13%|█▎        | 5101/37963 [12:18:14<68:41:26,  7.53s/it]
 13%|█▎        | 5102/37963 [12:18:28<86:02:07,  9.43s/it]
 13%|█▎        | 5103/37963 [12:18:35<80:50:18,  8.86s/it]
 13%|█▎        | 5104/37963 [12:18:43<77:31:24,  8.49s/it]
 13%|█▎        | 5105/37963 [12:18:50<74:55:37,  8.21s/it]
 13%|█▎        | 5106/37963 [12:19:04<90:57:02,  9.97s/it]
 13%|█▎        | 5107/37963 [12:19:12<84:01:33,  9.21s/it]
 13%|█▎        | 5108/37963 [12:19:19<79:38:50,  8.73s/it]
 13%|█▎        | 5109/37963 [12:19:27<76:40:09,  8.40s/it]
 13%|█▎        | 5110/37963 [12:19:35<74:06:54,  8.12s/it]
                                                          
{'loss': '0.1826', 'grad_norm': '3.075', 'learning_rate': '1.943e-05', 'epoch': '0.1346'}

 13%|█▎        | 5110/37963 [12:19:35<74:06:54,  8.12s/it]
 13%|█▎        | 5111/37963 [12:19:49<90:10:32,  9.88s/it]
 13%|█▎        | 5112/37963 [12:20:09<119:47:39, 13.13s/it]
 13%|█▎        | 5113/37963 [12:20:23<122:10:10, 13.39s/it]
 13%|█▎        | 5114/37963 [12:20:31<106:10:34, 11.64s/it]
 13%|█▎        | 5115/37963 [12:20:38<94:54:10, 10.40s/it] 
 13%|█▎        | 5116/37963 [12:20:46<86:48:45,  9.51s/it]
 13%|█▎        | 5117/37963 [12:20:53<81:08:13,  8.89s/it]
 13%|█▎        | 5118/37963 [12:21:01<76:59:04,  8.44s/it]
 13%|█▎        | 5119/37963 [12:21:08<74:40:23,  8.18s/it]
 13%|█▎        | 5120/37963 [12:21:15<71:46:34,  7.87s/it]
                                                          
{'loss': '0.1642', 'grad_norm': '4.569', 'learning_rate': '1.943e-05', 'epoch': '0.1349'}

 13%|█▎        | 5120/37963 [12:21:15<71:46:34,  7.87s/it]
 13%|█▎        | 5121/37963 [12:21:23<70:38:31,  7.74s/it]
 13%|█▎        | 5122/37963 [12:21:37<87:47:38,  9.62s/it]
 13%|█▎        | 5123/37963 [12:21:45<82:45:51,  9.07s/it]
 13%|█▎        | 5124/37963 [12:21:52<78:27:53,  8.60s/it]
 13%|█▎        | 5125/37963 [12:22:00<75:30:36,  8.28s/it]
 14%|█▎        | 5126/37963 [12:22:07<73:13:43,  8.03s/it]
 14%|█▎        | 5127/37963 [12:22:14<71:01:01,  7.79s/it]
 14%|█▎        | 5128/37963 [12:22:22<69:58:30,  7.67s/it]
 14%|█▎        | 5129/37963 [12:22:29<69:36:34,  7.63s/it]
 14%|█▎        | 5130/37963 [12:22:37<68:52:24,  7.55s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '3.468', 'learning_rate': '1.943e-05', 'epoch': '0.1351'}

 14%|█▎        | 5130/37963 [12:22:37<68:52:24,  7.55s/it]
 14%|█▎        | 5131/37963 [12:22:44<68:48:12,  7.54s/it]
 14%|█▎        | 5132/37963 [12:22:58<86:26:36,  9.48s/it]
 14%|█▎        | 5133/37963 [12:23:06<81:07:28,  8.90s/it]
 14%|█▎        | 5134/37963 [12:23:13<77:46:11,  8.53s/it]
 14%|█▎        | 5135/37963 [12:23:21<74:57:09,  8.22s/it]
 14%|█▎        | 5136/37963 [12:23:28<73:17:38,  8.04s/it]
 14%|█▎        | 5137/37963 [12:23:36<71:52:25,  7.88s/it]
 14%|█▎        | 5138/37963 [12:23:43<70:56:58,  7.78s/it]
 14%|█▎        | 5139/37963 [12:23:51<69:36:05,  7.63s/it]
 14%|█▎        | 5140/37963 [12:23:58<69:26:22,  7.62s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '1.067', 'learning_rate': '1.942e-05', 'epoch': '0.1354'}

 14%|█▎        | 5140/37963 [12:23:58<69:26:22,  7.62s/it]
 14%|█▎        | 5141/37963 [12:24:06<69:11:22,  7.59s/it]
 14%|█▎        | 5142/37963 [12:24:13<68:57:34,  7.56s/it]
 14%|█▎        | 5143/37963 [12:24:21<69:05:08,  7.58s/it]
 14%|█▎        | 5144/37963 [12:24:29<69:07:00,  7.58s/it]
 14%|█▎        | 5145/37963 [12:24:36<68:51:12,  7.55s/it]
 14%|█▎        | 5146/37963 [12:24:44<68:48:28,  7.55s/it]
 14%|█▎        | 5147/37963 [12:24:51<68:30:29,  7.52s/it]
 14%|█▎        | 5148/37963 [12:24:59<68:31:14,  7.52s/it]
 14%|█▎        | 5149/37963 [12:25:12<85:40:16,  9.40s/it]
 14%|█▎        | 5150/37963 [12:25:20<80:32:35,  8.84s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.741', 'learning_rate': '1.942e-05', 'epoch': '0.1357'}

 14%|█▎        | 5150/37963 [12:25:20<80:32:35,  8.84s/it]
 14%|█▎        | 5151/37963 [12:25:27<76:30:09,  8.39s/it]
 14%|█▎        | 5152/37963 [12:25:35<74:08:05,  8.13s/it]
 14%|█▎        | 5153/37963 [12:25:49<90:12:44,  9.90s/it]
 14%|█▎        | 5154/37963 [12:25:56<83:55:26,  9.21s/it]
 14%|█▎        | 5155/37963 [12:26:04<79:22:18,  8.71s/it]
 14%|█▎        | 5156/37963 [12:26:12<76:24:36,  8.38s/it]
 14%|█▎        | 5157/37963 [12:26:19<74:06:04,  8.13s/it]
 14%|█▎        | 5158/37963 [12:26:27<72:37:12,  7.97s/it]
 14%|█▎        | 5159/37963 [12:26:34<71:29:39,  7.85s/it]
 14%|█▎        | 5160/37963 [12:26:54<105:10:23, 11.54s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '1.283', 'learning_rate': '1.942e-05', 'epoch': '0.1359'}

 14%|█▎        | 5160/37963 [12:26:54<105:10:23, 11.54s/it]
 14%|█▎        | 5161/37963 [12:27:02<94:36:51, 10.38s/it] 
 14%|█▎        | 5162/37963 [12:27:16<104:44:31, 11.50s/it]
 14%|█▎        | 5163/37963 [12:27:24<94:00:41, 10.32s/it] 
 14%|█▎        | 5164/37963 [12:27:31<86:01:18,  9.44s/it]
 14%|█▎        | 5165/37963 [12:27:39<80:51:51,  8.88s/it]
 14%|█▎        | 5166/37963 [12:27:52<94:18:53, 10.35s/it]
 14%|█▎        | 5167/37963 [12:28:00<86:39:03,  9.51s/it]
 14%|█▎        | 5168/37963 [12:28:08<81:11:29,  8.91s/it]
 14%|█▎        | 5169/37963 [12:28:15<76:50:00,  8.43s/it]
 14%|█▎        | 5170/37963 [12:28:29<92:05:35, 10.11s/it]
                                                          
{'loss': '0.181', 'grad_norm': '3.3', 'learning_rate': '1.941e-05', 'epoch': '0.1362'}

 14%|█▎        | 5170/37963 [12:28:29<92:05:35, 10.11s/it]
 14%|█▎        | 5171/37963 [12:28:36<84:47:04,  9.31s/it]
 14%|█▎        | 5172/37963 [12:28:44<80:21:10,  8.82s/it]
 14%|█▎        | 5173/37963 [12:28:52<77:11:12,  8.47s/it]
 14%|█▎        | 5174/37963 [12:28:59<74:46:34,  8.21s/it]
 14%|█▎        | 5175/37963 [12:29:07<72:50:36,  8.00s/it]
 14%|█▎        | 5176/37963 [12:29:14<71:36:03,  7.86s/it]
 14%|█▎        | 5177/37963 [12:29:28<88:39:03,  9.73s/it]
 14%|█▎        | 5178/37963 [12:29:36<83:03:31,  9.12s/it]
 14%|█▎        | 5179/37963 [12:29:44<78:39:22,  8.64s/it]
 14%|█▎        | 5180/37963 [12:29:51<75:51:38,  8.33s/it]
                                                          
{'loss': '0.1709', 'grad_norm': '2.077', 'learning_rate': '1.941e-05', 'epoch': '0.1364'}

 14%|█▎        | 5180/37963 [12:29:51<75:51:38,  8.33s/it]
 14%|█▎        | 5181/37963 [12:29:59<73:53:55,  8.12s/it]
 14%|█▎        | 5182/37963 [12:30:06<72:19:07,  7.94s/it]
 14%|█▎        | 5183/37963 [12:30:14<71:12:26,  7.82s/it]
 14%|█▎        | 5184/37963 [12:30:21<70:19:07,  7.72s/it]
 14%|█▎        | 5185/37963 [12:30:29<69:27:02,  7.63s/it]
 14%|█▎        | 5186/37963 [12:30:36<68:52:07,  7.56s/it]
 14%|█▎        | 5187/37963 [12:30:44<68:56:17,  7.57s/it]
 14%|█▎        | 5188/37963 [12:30:51<68:50:24,  7.56s/it]
 14%|█▎        | 5189/37963 [12:30:59<68:54:10,  7.57s/it]
 14%|█▎        | 5190/37963 [12:31:06<68:49:01,  7.56s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.379', 'learning_rate': '1.941e-05', 'epoch': '0.1367'}

 14%|█▎        | 5190/37963 [12:31:06<68:49:01,  7.56s/it]
 14%|█▎        | 5191/37963 [12:31:14<68:59:08,  7.58s/it]
 14%|█▎        | 5192/37963 [12:31:22<68:52:09,  7.57s/it]
 14%|█▎        | 5193/37963 [12:31:29<68:52:00,  7.57s/it]
 14%|█▎        | 5194/37963 [12:31:37<68:58:15,  7.58s/it]
 14%|█▎        | 5195/37963 [12:31:44<68:48:15,  7.56s/it]
 14%|█▎        | 5196/37963 [12:31:52<68:12:37,  7.49s/it]
 14%|█▎        | 5197/37963 [12:32:12<102:30:17, 11.26s/it]
 14%|█▎        | 5198/37963 [12:32:19<92:30:05, 10.16s/it] 
 14%|█▎        | 5199/37963 [12:32:27<85:18:38,  9.37s/it]
 14%|█▎        | 5200/37963 [12:32:34<80:34:11,  8.85s/it]
                                                          
{'loss': '0.1724', 'grad_norm': '1.797', 'learning_rate': '1.941e-05', 'epoch': '0.137'}

 14%|█▎        | 5200/37963 [12:32:34<80:34:11,  8.85s/it]
 14%|█▎        | 5201/37963 [12:32:42<76:56:19,  8.45s/it]
 14%|█▎        | 5202/37963 [12:32:50<74:39:06,  8.20s/it]
 14%|█▎        | 5203/37963 [12:32:57<72:34:35,  7.98s/it]
 14%|█▎        | 5204/37963 [12:33:05<71:24:39,  7.85s/it]
 14%|█▎        | 5205/37963 [12:33:12<70:29:10,  7.75s/it]
 14%|█▎        | 5206/37963 [12:33:20<70:06:21,  7.70s/it]
 14%|█▎        | 5207/37963 [12:33:34<86:52:26,  9.55s/it]
 14%|█▎        | 5208/37963 [12:33:41<81:30:27,  8.96s/it]
 14%|█▎        | 5209/37963 [12:34:08<130:34:53, 14.35s/it]
 14%|█▎        | 5210/37963 [12:34:16<112:00:06, 12.31s/it]
                                                           
{'loss': '0.17', 'grad_norm': '7.521', 'learning_rate': '1.94e-05', 'epoch': '0.1372'}

 14%|█▎        | 5210/37963 [12:34:16<112:00:06, 12.31s/it]
 14%|█▎        | 5211/37963 [12:34:23<98:54:12, 10.87s/it] 
 14%|█▎        | 5212/37963 [12:34:31<89:40:55,  9.86s/it]
 14%|█▎        | 5213/37963 [12:34:38<83:28:32,  9.18s/it]
 14%|█▎        | 5214/37963 [12:34:46<78:45:45,  8.66s/it]
 14%|█▎        | 5215/37963 [12:34:53<75:55:40,  8.35s/it]
 14%|█▎        | 5216/37963 [12:35:01<73:42:07,  8.10s/it]
 14%|█▎        | 5217/37963 [12:35:15<89:13:45,  9.81s/it]
 14%|█▎        | 5218/37963 [12:35:22<83:53:35,  9.22s/it]
 14%|█▎        | 5219/37963 [12:35:30<79:08:48,  8.70s/it]
 14%|█▍        | 5220/37963 [12:35:37<75:07:48,  8.26s/it]
                                                          
{'loss': '0.1787', 'grad_norm': '2.517', 'learning_rate': '1.94e-05', 'epoch': '0.1375'}

 14%|█▍        | 5220/37963 [12:35:37<75:07:48,  8.26s/it]
 14%|█▍        | 5221/37963 [12:35:45<73:16:21,  8.06s/it]
 14%|█▍        | 5222/37963 [12:35:59<89:23:45,  9.83s/it]
 14%|█▍        | 5223/37963 [12:36:06<82:38:30,  9.09s/it]
 14%|█▍        | 5224/37963 [12:36:14<78:06:18,  8.59s/it]
 14%|█▍        | 5225/37963 [12:36:21<75:26:26,  8.30s/it]
 14%|█▍        | 5226/37963 [12:36:29<73:32:17,  8.09s/it]
 14%|█▍        | 5227/37963 [12:36:36<72:22:53,  7.96s/it]
 14%|█▍        | 5228/37963 [12:36:44<71:11:45,  7.83s/it]
 14%|█▍        | 5229/37963 [12:36:52<70:29:43,  7.75s/it]
 14%|█▍        | 5230/37963 [12:36:59<69:59:37,  7.70s/it]
                                                          
{'loss': '0.1753', 'grad_norm': '0.9895', 'learning_rate': '1.94e-05', 'epoch': '0.1378'}

 14%|█▍        | 5230/37963 [12:36:59<69:59:37,  7.70s/it]
 14%|█▍        | 5231/37963 [12:37:07<69:40:36,  7.66s/it]
 14%|█▍        | 5232/37963 [12:37:14<69:13:37,  7.61s/it]
 14%|█▍        | 5233/37963 [12:37:22<69:16:22,  7.62s/it]
 14%|█▍        | 5234/37963 [12:37:29<68:58:40,  7.59s/it]
 14%|█▍        | 5235/37963 [12:37:37<68:42:56,  7.56s/it]
 14%|█▍        | 5236/37963 [12:37:44<68:24:18,  7.52s/it]
 14%|█▍        | 5237/37963 [12:37:52<68:54:10,  7.58s/it]
 14%|█▍        | 5238/37963 [12:37:59<68:40:06,  7.55s/it]
 14%|█▍        | 5239/37963 [12:38:07<68:35:31,  7.55s/it]
 14%|█▍        | 5240/37963 [12:38:14<68:07:19,  7.49s/it]
                                                          
{'loss': '0.1625', 'grad_norm': '3.682', 'learning_rate': '1.939e-05', 'epoch': '0.138'}

 14%|█▍        | 5240/37963 [12:38:14<68:07:19,  7.49s/it]
 14%|█▍        | 5241/37963 [12:38:22<68:20:52,  7.52s/it]
 14%|█▍        | 5242/37963 [12:38:29<68:24:44,  7.53s/it]
 14%|█▍        | 5243/37963 [12:38:37<68:38:09,  7.55s/it]
 14%|█▍        | 5244/37963 [12:38:45<68:33:20,  7.54s/it]
 14%|█▍        | 5245/37963 [12:38:52<68:09:12,  7.50s/it]
 14%|█▍        | 5246/37963 [12:38:59<68:04:36,  7.49s/it]
 14%|█▍        | 5247/37963 [12:39:14<86:22:08,  9.50s/it]
 14%|█▍        | 5248/37963 [12:39:21<80:43:52,  8.88s/it]
 14%|█▍        | 5249/37963 [12:39:29<77:01:55,  8.48s/it]
 14%|█▍        | 5250/37963 [12:39:43<92:50:48, 10.22s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '1.999', 'learning_rate': '1.939e-05', 'epoch': '0.1383'}

 14%|█▍        | 5250/37963 [12:39:43<92:50:48, 10.22s/it]
 14%|█▍        | 5251/37963 [12:39:50<85:36:15,  9.42s/it]
 14%|█▍        | 5252/37963 [12:39:58<80:03:23,  8.81s/it]
 14%|█▍        | 5253/37963 [12:40:12<93:46:50, 10.32s/it]
 14%|█▍        | 5254/37963 [12:40:19<86:02:29,  9.47s/it]
 14%|█▍        | 5255/37963 [12:40:27<80:41:22,  8.88s/it]
 14%|█▍        | 5256/37963 [12:40:34<77:04:18,  8.48s/it]
 14%|█▍        | 5257/37963 [12:40:55<109:21:09, 12.04s/it]
 14%|█▍        | 5258/37963 [12:41:02<97:29:08, 10.73s/it] 
 14%|█▍        | 5259/37963 [12:41:16<106:22:43, 11.71s/it]
 14%|█▍        | 5260/37963 [12:41:24<95:23:39, 10.50s/it] 
                                                          
{'loss': '0.1804', 'grad_norm': '1.565', 'learning_rate': '1.939e-05', 'epoch': '0.1386'}

 14%|█▍        | 5260/37963 [12:41:24<95:23:39, 10.50s/it]
 14%|█▍        | 5261/37963 [12:41:31<87:15:56,  9.61s/it]
 14%|█▍        | 5262/37963 [12:41:39<81:16:59,  8.95s/it]
 14%|█▍        | 5263/37963 [12:41:46<77:17:11,  8.51s/it]
 14%|█▍        | 5264/37963 [12:41:54<74:27:21,  8.20s/it]
 14%|█▍        | 5265/37963 [12:42:01<72:16:56,  7.96s/it]
 14%|█▍        | 5266/37963 [12:42:09<70:59:03,  7.82s/it]
 14%|█▍        | 5267/37963 [12:42:16<70:07:59,  7.72s/it]
 14%|█▍        | 5268/37963 [12:42:24<69:10:54,  7.62s/it]
 14%|█▍        | 5269/37963 [12:42:38<86:44:12,  9.55s/it]
 14%|█▍        | 5270/37963 [12:42:45<81:02:13,  8.92s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '2.339', 'learning_rate': '1.939e-05', 'epoch': '0.1388'}

 14%|█▍        | 5270/37963 [12:42:45<81:02:13,  8.92s/it]
 14%|█▍        | 5271/37963 [12:42:53<77:21:13,  8.52s/it]
 14%|█▍        | 5272/37963 [12:43:07<92:13:36, 10.16s/it]
 14%|█▍        | 5273/37963 [12:43:14<85:22:12,  9.40s/it]
 14%|█▍        | 5274/37963 [12:43:22<80:46:48,  8.90s/it]
 14%|█▍        | 5275/37963 [12:43:30<77:23:17,  8.52s/it]
 14%|█▍        | 5276/37963 [12:43:37<74:40:23,  8.22s/it]
 14%|█▍        | 5277/37963 [12:43:45<73:08:07,  8.06s/it]
 14%|█▍        | 5278/37963 [12:43:52<71:02:15,  7.82s/it]
 14%|█▍        | 5279/37963 [12:43:59<69:24:43,  7.65s/it]
 14%|█▍        | 5280/37963 [12:44:07<68:25:21,  7.54s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '1.575', 'learning_rate': '1.938e-05', 'epoch': '0.1391'}

 14%|█▍        | 5280/37963 [12:44:07<68:25:21,  7.54s/it]
 14%|█▍        | 5281/37963 [12:44:14<68:23:47,  7.53s/it]
 14%|█▍        | 5282/37963 [12:44:22<68:20:05,  7.53s/it]
 14%|█▍        | 5283/37963 [12:44:29<68:39:37,  7.56s/it]
 14%|█▍        | 5284/37963 [12:44:37<68:30:58,  7.55s/it]
 14%|█▍        | 5285/37963 [12:44:44<68:26:19,  7.54s/it]
 14%|█▍        | 5286/37963 [12:44:52<68:34:31,  7.55s/it]
 14%|█▍        | 5287/37963 [12:44:59<68:14:06,  7.52s/it]
 14%|█▍        | 5288/37963 [12:45:07<67:54:43,  7.48s/it]
 14%|█▍        | 5289/37963 [12:45:14<67:56:09,  7.49s/it]
 14%|█▍        | 5290/37963 [12:45:22<68:26:09,  7.54s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.266', 'learning_rate': '1.938e-05', 'epoch': '0.1393'}

 14%|█▍        | 5290/37963 [12:45:22<68:26:09,  7.54s/it]
 14%|█▍        | 5291/37963 [12:45:30<68:54:04,  7.59s/it]
 14%|█▍        | 5292/37963 [12:45:44<87:00:03,  9.59s/it]
 14%|█▍        | 5293/37963 [12:45:52<81:35:22,  8.99s/it]
 14%|█▍        | 5294/37963 [12:45:59<77:48:57,  8.58s/it]
 14%|█▍        | 5295/37963 [12:46:06<74:27:18,  8.20s/it]
 14%|█▍        | 5296/37963 [12:46:14<72:33:55,  8.00s/it]
 14%|█▍        | 5297/37963 [12:46:22<71:51:56,  7.92s/it]
 14%|█▍        | 5298/37963 [12:46:29<71:07:18,  7.84s/it]
 14%|█▍        | 5299/37963 [12:46:37<70:15:20,  7.74s/it]
 14%|█▍        | 5300/37963 [12:46:44<69:37:19,  7.67s/it]
                                                          
{'loss': '0.1642', 'grad_norm': '2.453', 'learning_rate': '1.938e-05', 'epoch': '0.1396'}

 14%|█▍        | 5300/37963 [12:46:44<69:37:19,  7.67s/it]
 14%|█▍        | 5301/37963 [12:46:58<85:36:15,  9.44s/it]
 14%|█▍        | 5302/37963 [12:47:19<115:55:12, 12.78s/it]
 14%|█▍        | 5303/37963 [12:47:26<101:58:47, 11.24s/it]
 14%|█▍        | 5304/37963 [12:47:34<91:36:34, 10.10s/it] 
 14%|█▍        | 5305/37963 [12:47:48<102:01:56, 11.25s/it]
 14%|█▍        | 5306/37963 [12:47:55<92:18:24, 10.18s/it] 
 14%|█▍        | 5307/37963 [12:48:03<85:12:14,  9.39s/it]
 14%|█▍        | 5308/37963 [12:48:10<80:20:34,  8.86s/it]
 14%|█▍        | 5309/37963 [12:48:18<76:43:05,  8.46s/it]
 14%|█▍        | 5310/37963 [12:48:26<74:52:39,  8.26s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '2.25', 'learning_rate': '1.937e-05', 'epoch': '0.1399'}

 14%|█▍        | 5310/37963 [12:48:26<74:52:39,  8.26s/it]
 14%|█▍        | 5311/37963 [12:48:33<73:13:30,  8.07s/it]
 14%|█▍        | 5312/37963 [12:48:41<72:12:15,  7.96s/it]
 14%|█▍        | 5313/37963 [12:48:49<71:20:41,  7.87s/it]
 14%|█▍        | 5314/37963 [12:48:56<70:35:17,  7.78s/it]
 14%|█▍        | 5315/37963 [12:49:04<69:59:46,  7.72s/it]
 14%|█▍        | 5316/37963 [12:49:18<86:56:29,  9.59s/it]
 14%|█▍        | 5317/37963 [12:49:32<99:20:44, 10.96s/it]
 14%|█▍        | 5318/37963 [12:49:40<90:14:26,  9.95s/it]
 14%|█▍        | 5319/37963 [12:49:47<83:28:57,  9.21s/it]
 14%|█▍        | 5320/37963 [12:49:55<79:03:55,  8.72s/it]
                                                          
{'loss': '0.1747', 'grad_norm': '3.08', 'learning_rate': '1.937e-05', 'epoch': '0.1401'}

 14%|█▍        | 5320/37963 [12:49:55<79:03:55,  8.72s/it]
 14%|█▍        | 5321/37963 [12:50:02<75:47:33,  8.36s/it]
 14%|█▍        | 5322/37963 [12:50:10<73:34:26,  8.11s/it]
 14%|█▍        | 5323/37963 [12:50:17<72:02:12,  7.95s/it]
 14%|█▍        | 5324/37963 [12:50:25<71:08:23,  7.85s/it]
 14%|█▍        | 5325/37963 [12:50:32<69:11:59,  7.63s/it]
 14%|█▍        | 5326/37963 [12:50:40<68:58:39,  7.61s/it]
 14%|█▍        | 5327/37963 [12:50:47<68:20:38,  7.54s/it]
 14%|█▍        | 5328/37963 [12:50:54<67:58:14,  7.50s/it]
 14%|█▍        | 5329/37963 [12:51:02<67:47:22,  7.48s/it]
 14%|█▍        | 5330/37963 [12:51:09<67:40:53,  7.47s/it]
                                                          
{'loss': '0.175', 'grad_norm': '5.6', 'learning_rate': '1.937e-05', 'epoch': '0.1404'}

 14%|█▍        | 5330/37963 [12:51:09<67:40:53,  7.47s/it]
 14%|█▍        | 5331/37963 [12:51:17<67:56:48,  7.50s/it]
 14%|█▍        | 5332/37963 [12:51:24<67:57:08,  7.50s/it]
 14%|█▍        | 5333/37963 [12:51:32<67:45:19,  7.48s/it]
 14%|█▍        | 5334/37963 [12:51:39<68:00:23,  7.50s/it]
 14%|█▍        | 5335/37963 [12:51:47<68:16:44,  7.53s/it]
 14%|█▍        | 5336/37963 [12:51:54<68:08:26,  7.52s/it]
 14%|█▍        | 5337/37963 [12:52:02<68:07:43,  7.52s/it]
 14%|█▍        | 5338/37963 [12:52:09<68:24:20,  7.55s/it]
 14%|█▍        | 5339/37963 [12:52:17<68:33:20,  7.57s/it]
 14%|█▍        | 5340/37963 [12:52:25<68:37:04,  7.57s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '1.437', 'learning_rate': '1.936e-05', 'epoch': '0.1407'}

 14%|█▍        | 5340/37963 [12:52:25<68:37:04,  7.57s/it]
 14%|█▍        | 5341/37963 [12:52:32<68:28:38,  7.56s/it]
 14%|█▍        | 5342/37963 [12:52:46<86:16:16,  9.52s/it]
 14%|█▍        | 5343/37963 [12:52:54<80:40:34,  8.90s/it]
 14%|█▍        | 5344/37963 [12:53:01<77:02:08,  8.50s/it]
 14%|█▍        | 5345/37963 [12:53:09<74:27:51,  8.22s/it]
 14%|█▍        | 5346/37963 [12:53:17<73:16:17,  8.09s/it]
 14%|█▍        | 5347/37963 [12:53:30<87:58:39,  9.71s/it]
 14%|█▍        | 5348/37963 [12:53:38<82:05:48,  9.06s/it]
 14%|█▍        | 5349/37963 [12:53:52<95:37:18, 10.55s/it]
 14%|█▍        | 5350/37963 [12:54:06<104:36:05, 11.55s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '3.536', 'learning_rate': '1.936e-05', 'epoch': '0.1409'}

 14%|█▍        | 5350/37963 [12:54:06<104:36:05, 11.55s/it]
 14%|█▍        | 5351/37963 [12:54:26<129:22:26, 14.28s/it]
 14%|█▍        | 5352/37963 [12:54:34<110:46:51, 12.23s/it]
 14%|█▍        | 5353/37963 [12:54:41<98:10:16, 10.84s/it] 
 14%|█▍        | 5354/37963 [12:54:49<88:45:49,  9.80s/it]
 14%|█▍        | 5355/37963 [12:54:56<81:50:03,  9.03s/it]
 14%|█▍        | 5356/37963 [12:55:03<76:48:22,  8.48s/it]
 14%|█▍        | 5357/37963 [12:55:11<73:58:42,  8.17s/it]
 14%|█▍        | 5358/37963 [12:55:18<72:28:44,  8.00s/it]
 14%|█▍        | 5359/37963 [12:55:26<71:06:16,  7.85s/it]
 14%|█▍        | 5360/37963 [12:55:33<70:21:23,  7.77s/it]
                                                          
{'loss': '0.1735', 'grad_norm': '1.528', 'learning_rate': '1.936e-05', 'epoch': '0.1412'}

 14%|█▍        | 5360/37963 [12:55:33<70:21:23,  7.77s/it]
 14%|█▍        | 5361/37963 [12:55:41<69:46:46,  7.71s/it]
 14%|█▍        | 5362/37963 [12:55:55<86:44:54,  9.58s/it]
 14%|█▍        | 5363/37963 [12:56:09<98:34:01, 10.88s/it]
 14%|█▍        | 5364/37963 [12:56:16<90:17:25,  9.97s/it]
 14%|█▍        | 5365/37963 [12:56:24<83:55:15,  9.27s/it]
 14%|█▍        | 5366/37963 [12:56:32<78:57:37,  8.72s/it]
 14%|█▍        | 5367/37963 [12:56:39<75:57:08,  8.39s/it]
 14%|█▍        | 5368/37963 [12:56:47<73:35:09,  8.13s/it]
 14%|█▍        | 5369/37963 [12:56:54<71:45:21,  7.93s/it]
 14%|█▍        | 5370/37963 [12:57:02<70:45:23,  7.82s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '1.705', 'learning_rate': '1.936e-05', 'epoch': '0.1415'}

 14%|█▍        | 5370/37963 [12:57:02<70:45:23,  7.82s/it]
 14%|█▍        | 5371/37963 [12:57:09<70:08:09,  7.75s/it]
 14%|█▍        | 5372/37963 [12:57:17<69:12:50,  7.65s/it]
 14%|█▍        | 5373/37963 [12:57:24<68:48:37,  7.60s/it]
 14%|█▍        | 5374/37963 [12:57:31<67:44:31,  7.48s/it]
 14%|█▍        | 5375/37963 [12:57:39<67:52:14,  7.50s/it]
 14%|█▍        | 5376/37963 [12:57:46<66:18:14,  7.32s/it]
 14%|█▍        | 5377/37963 [12:57:53<66:47:47,  7.38s/it]
 14%|█▍        | 5378/37963 [12:58:01<66:46:30,  7.38s/it]
 14%|█▍        | 5379/37963 [12:58:08<67:08:32,  7.42s/it]
 14%|█▍        | 5380/37963 [12:58:16<67:12:41,  7.43s/it]
                                                          
{'loss': '0.1569', 'grad_norm': '2.199', 'learning_rate': '1.935e-05', 'epoch': '0.1417'}

 14%|█▍        | 5380/37963 [12:58:16<67:12:41,  7.43s/it]
 14%|█▍        | 5381/37963 [12:58:23<66:15:36,  7.32s/it]
 14%|█▍        | 5382/37963 [12:58:30<67:01:49,  7.41s/it]
 14%|█▍        | 5383/37963 [12:58:38<67:21:29,  7.44s/it]
 14%|█▍        | 5384/37963 [12:58:45<67:28:10,  7.46s/it]
 14%|█▍        | 5385/37963 [12:58:53<67:44:27,  7.49s/it]
 14%|█▍        | 5386/37963 [12:59:00<67:50:19,  7.50s/it]
 14%|█▍        | 5387/37963 [12:59:08<67:59:03,  7.51s/it]
 14%|█▍        | 5388/37963 [12:59:22<86:17:59,  9.54s/it]
 14%|█▍        | 5389/37963 [12:59:30<80:56:27,  8.95s/it]
 14%|█▍        | 5390/37963 [12:59:37<77:15:06,  8.54s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '1.941', 'learning_rate': '1.935e-05', 'epoch': '0.142'}

 14%|█▍        | 5390/37963 [12:59:37<77:15:06,  8.54s/it]
 14%|█▍        | 5391/37963 [12:59:45<74:28:49,  8.23s/it]
 14%|█▍        | 5392/37963 [12:59:53<72:44:03,  8.04s/it]
 14%|█▍        | 5393/37963 [13:00:13<106:15:56, 11.75s/it]
 14%|█▍        | 5394/37963 [13:00:20<94:46:53, 10.48s/it] 
 14%|█▍        | 5395/37963 [13:00:34<104:04:25, 11.50s/it]
 14%|█▍        | 5396/37963 [13:00:42<93:50:38, 10.37s/it] 
 14%|█▍        | 5397/37963 [13:00:56<104:05:45, 11.51s/it]
 14%|█▍        | 5398/37963 [13:01:04<93:39:56, 10.35s/it] 
 14%|█▍        | 5399/37963 [13:01:11<84:47:03,  9.37s/it]
 14%|█▍        | 5400/37963 [13:01:18<79:13:54,  8.76s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '2.015', 'learning_rate': '1.935e-05', 'epoch': '0.1422'}

 14%|█▍        | 5400/37963 [13:01:18<79:13:54,  8.76s/it]
 14%|█▍        | 5401/37963 [13:01:32<93:02:44, 10.29s/it]
 14%|█▍        | 5402/37963 [13:01:40<85:08:41,  9.41s/it]
 14%|█▍        | 5403/37963 [13:01:47<79:27:42,  8.79s/it]
 14%|█▍        | 5404/37963 [13:01:54<76:12:19,  8.43s/it]
 14%|█▍        | 5405/37963 [13:02:02<73:50:27,  8.16s/it]
 14%|█▍        | 5406/37963 [13:02:10<72:09:43,  7.98s/it]
 14%|█▍        | 5407/37963 [13:02:17<71:01:39,  7.85s/it]
 14%|█▍        | 5408/37963 [13:02:25<70:16:54,  7.77s/it]
 14%|█▍        | 5409/37963 [13:02:32<70:02:50,  7.75s/it]
 14%|█▍        | 5410/37963 [13:02:40<69:37:10,  7.70s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '5.843', 'learning_rate': '1.934e-05', 'epoch': '0.1425'}

 14%|█▍        | 5410/37963 [13:02:40<69:37:10,  7.70s/it]
 14%|█▍        | 5411/37963 [13:02:48<69:25:48,  7.68s/it]
 14%|█▍        | 5412/37963 [13:02:55<69:03:35,  7.64s/it]
 14%|█▍        | 5413/37963 [13:03:03<68:46:26,  7.61s/it]
 14%|█▍        | 5414/37963 [13:03:17<86:00:56,  9.51s/it]
 14%|█▍        | 5415/37963 [13:03:31<98:35:11, 10.90s/it]
 14%|█▍        | 5416/37963 [13:03:38<89:45:16,  9.93s/it]
 14%|█▍        | 5417/37963 [13:03:46<83:17:19,  9.21s/it]
 14%|█▍        | 5418/37963 [13:03:53<78:35:52,  8.69s/it]
 14%|█▍        | 5419/37963 [13:04:01<75:21:43,  8.34s/it]
 14%|█▍        | 5420/37963 [13:04:08<73:06:40,  8.09s/it]
                                                          
{'loss': '0.1746', 'grad_norm': '1.995', 'learning_rate': '1.934e-05', 'epoch': '0.1428'}

 14%|█▍        | 5420/37963 [13:04:08<73:06:40,  8.09s/it]
 14%|█▍        | 5421/37963 [13:04:16<71:20:32,  7.89s/it]
 14%|█▍        | 5422/37963 [13:04:23<70:19:02,  7.78s/it]
 14%|█▍        | 5423/37963 [13:04:31<69:58:57,  7.74s/it]
 14%|█▍        | 5424/37963 [13:04:39<69:36:18,  7.70s/it]
 14%|█▍        | 5425/37963 [13:04:46<68:44:31,  7.61s/it]
 14%|█▍        | 5426/37963 [13:04:54<68:54:08,  7.62s/it]
 14%|█▍        | 5427/37963 [13:05:01<68:51:35,  7.62s/it]
 14%|█▍        | 5428/37963 [13:05:09<68:30:50,  7.58s/it]
 14%|█▍        | 5429/37963 [13:05:16<68:23:51,  7.57s/it]
 14%|█▍        | 5430/37963 [13:05:24<68:14:44,  7.55s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '2.526', 'learning_rate': '1.934e-05', 'epoch': '0.143'}

 14%|█▍        | 5430/37963 [13:05:24<68:14:44,  7.55s/it]
 14%|█▍        | 5431/37963 [13:05:31<68:06:50,  7.54s/it]
 14%|█▍        | 5432/37963 [13:05:39<67:25:26,  7.46s/it]
 14%|█▍        | 5433/37963 [13:05:46<67:45:41,  7.50s/it]
 14%|█▍        | 5434/37963 [13:05:54<68:00:13,  7.53s/it]
 14%|█▍        | 5435/37963 [13:06:02<68:35:42,  7.59s/it]
 14%|█▍        | 5436/37963 [13:06:16<86:12:27,  9.54s/it]
 14%|█▍        | 5437/37963 [13:06:30<99:26:05, 11.01s/it]
 14%|█▍        | 5438/37963 [13:06:38<90:28:11, 10.01s/it]
 14%|█▍        | 5439/37963 [13:06:52<101:09:46, 11.20s/it]
 14%|█▍        | 5440/37963 [13:06:59<91:26:08, 10.12s/it] 
                                                          
{'loss': '0.1718', 'grad_norm': '2.763', 'learning_rate': '1.933e-05', 'epoch': '0.1433'}

 14%|█▍        | 5440/37963 [13:06:59<91:26:08, 10.12s/it]
 14%|█▍        | 5441/37963 [13:07:07<84:35:42,  9.36s/it]
 14%|█▍        | 5442/37963 [13:07:14<79:12:29,  8.77s/it]
 14%|█▍        | 5443/37963 [13:07:28<93:02:46, 10.30s/it]
 14%|█▍        | 5444/37963 [13:07:42<102:39:31, 11.36s/it]
 14%|█▍        | 5445/37963 [13:07:49<91:54:24, 10.17s/it] 
 14%|█▍        | 5446/37963 [13:07:57<84:44:42,  9.38s/it]
 14%|█▍        | 5447/37963 [13:08:05<80:01:06,  8.86s/it]
 14%|█▍        | 5448/37963 [13:08:12<75:22:20,  8.35s/it]
 14%|█▍        | 5449/37963 [13:08:19<73:14:19,  8.11s/it]
 14%|█▍        | 5450/37963 [13:08:27<70:59:26,  7.86s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '2.243', 'learning_rate': '1.933e-05', 'epoch': '0.1436'}

 14%|█▍        | 5450/37963 [13:08:27<70:59:26,  7.86s/it]
 14%|█▍        | 5451/37963 [13:08:41<87:58:08,  9.74s/it]
 14%|█▍        | 5452/37963 [13:08:48<82:01:01,  9.08s/it]
 14%|█▍        | 5453/37963 [13:08:56<77:54:58,  8.63s/it]
 14%|█▍        | 5454/37963 [13:09:04<75:21:13,  8.34s/it]
 14%|█▍        | 5455/37963 [13:09:11<72:46:44,  8.06s/it]
 14%|█▍        | 5456/37963 [13:09:19<71:31:59,  7.92s/it]
 14%|█▍        | 5457/37963 [13:09:26<70:25:22,  7.80s/it]
 14%|█▍        | 5458/37963 [13:09:34<69:41:09,  7.72s/it]
 14%|█▍        | 5459/37963 [13:09:41<69:13:37,  7.67s/it]
 14%|█▍        | 5460/37963 [13:09:55<85:43:17,  9.49s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '3.069', 'learning_rate': '1.933e-05', 'epoch': '0.1438'}

 14%|█▍        | 5460/37963 [13:09:55<85:43:17,  9.49s/it]
 14%|█▍        | 5461/37963 [13:10:02<80:20:41,  8.90s/it]
 14%|█▍        | 5462/37963 [13:10:10<76:41:32,  8.49s/it]
 14%|█▍        | 5463/37963 [13:10:18<74:16:54,  8.23s/it]
 14%|█▍        | 5464/37963 [13:10:25<72:30:22,  8.03s/it]
 14%|█▍        | 5465/37963 [13:10:32<70:40:58,  7.83s/it]
 14%|█▍        | 5466/37963 [13:10:46<87:17:17,  9.67s/it]
 14%|█▍        | 5467/37963 [13:10:54<81:40:01,  9.05s/it]
 14%|█▍        | 5468/37963 [13:11:02<77:53:17,  8.63s/it]
 14%|█▍        | 5469/37963 [13:11:09<74:44:59,  8.28s/it]
 14%|█▍        | 5470/37963 [13:11:17<72:34:10,  8.04s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '2.578', 'learning_rate': '1.933e-05', 'epoch': '0.1441'}

 14%|█▍        | 5470/37963 [13:11:17<72:34:10,  8.04s/it]
 14%|█▍        | 5471/37963 [13:11:24<71:18:44,  7.90s/it]
 14%|█▍        | 5472/37963 [13:11:32<70:10:08,  7.77s/it]
 14%|█▍        | 5473/37963 [13:11:39<69:23:53,  7.69s/it]
 14%|█▍        | 5474/37963 [13:11:47<68:52:50,  7.63s/it]
 14%|█▍        | 5475/37963 [13:11:54<69:02:26,  7.65s/it]
 14%|█▍        | 5476/37963 [13:12:02<68:00:21,  7.54s/it]
 14%|█▍        | 5477/37963 [13:12:09<68:19:19,  7.57s/it]
 14%|█▍        | 5478/37963 [13:12:17<68:19:28,  7.57s/it]
 14%|█▍        | 5479/37963 [13:12:24<68:11:29,  7.56s/it]
 14%|█▍        | 5480/37963 [13:12:32<68:20:02,  7.57s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '1.27', 'learning_rate': '1.932e-05', 'epoch': '0.1444'}

 14%|█▍        | 5480/37963 [13:12:32<68:20:02,  7.57s/it]
 14%|█▍        | 5481/37963 [13:12:40<68:09:30,  7.55s/it]
 14%|█▍        | 5482/37963 [13:12:47<68:04:37,  7.55s/it]
 14%|█▍        | 5483/37963 [13:12:55<68:06:52,  7.55s/it]
 14%|█▍        | 5484/37963 [13:13:08<84:47:44,  9.40s/it]
 14%|█▍        | 5485/37963 [13:13:16<78:57:10,  8.75s/it]
 14%|█▍        | 5486/37963 [13:13:23<75:37:32,  8.38s/it]
 14%|█▍        | 5487/37963 [13:13:31<73:00:47,  8.09s/it]
 14%|█▍        | 5488/37963 [13:13:44<88:26:17,  9.80s/it]
 14%|█▍        | 5489/37963 [13:13:58<99:38:18, 11.05s/it]
 14%|█▍        | 5490/37963 [13:14:19<124:40:23, 13.82s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '2.772', 'learning_rate': '1.932e-05', 'epoch': '0.1446'}

 14%|█▍        | 5490/37963 [13:14:19<124:40:23, 13.82s/it]
 14%|█▍        | 5491/37963 [13:14:26<107:45:41, 11.95s/it]
 14%|█▍        | 5492/37963 [13:14:34<95:59:45, 10.64s/it] 
 14%|█▍        | 5493/37963 [13:14:41<87:49:17,  9.74s/it]
 14%|█▍        | 5494/37963 [13:14:49<81:52:39,  9.08s/it]
 14%|█▍        | 5495/37963 [13:14:56<77:36:15,  8.60s/it]
 14%|█▍        | 5496/37963 [13:15:04<73:46:30,  8.18s/it]
 14%|█▍        | 5497/37963 [13:15:11<71:42:27,  7.95s/it]
 14%|█▍        | 5498/37963 [13:15:19<70:38:01,  7.83s/it]
 14%|█▍        | 5499/37963 [13:15:26<70:05:32,  7.77s/it]
 14%|█▍        | 5500/37963 [13:15:34<69:16:45,  7.68s/it]
                                                          
{'loss': '0.1698', 'grad_norm': '1.198', 'learning_rate': '1.932e-05', 'epoch': '0.1449'}

 14%|█▍        | 5500/37963 [13:15:34<69:16:45,  7.68s/it]
 14%|█▍        | 5501/37963 [13:15:41<69:05:27,  7.66s/it]
 14%|█▍        | 5502/37963 [13:15:48<67:41:24,  7.51s/it]
 14%|█▍        | 5503/37963 [13:15:56<67:26:17,  7.48s/it]
 14%|█▍        | 5504/37963 [13:16:16<102:18:44, 11.35s/it]
 15%|█▍        | 5505/37963 [13:16:24<92:02:19, 10.21s/it] 
 15%|█▍        | 5506/37963 [13:16:31<84:51:23,  9.41s/it]
 15%|█▍        | 5507/37963 [13:16:39<78:58:54,  8.76s/it]
 15%|█▍        | 5508/37963 [13:16:46<75:34:31,  8.38s/it]
 15%|█▍        | 5509/37963 [13:16:53<73:03:55,  8.10s/it]
 15%|█▍        | 5510/37963 [13:17:01<71:47:34,  7.96s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '2.232', 'learning_rate': '1.931e-05', 'epoch': '0.1451'}

 15%|█▍        | 5510/37963 [13:17:01<71:47:34,  7.96s/it]
 15%|█▍        | 5511/37963 [13:17:09<70:41:23,  7.84s/it]
 15%|█▍        | 5512/37963 [13:17:23<87:33:22,  9.71s/it]
 15%|█▍        | 5513/37963 [13:17:30<81:41:39,  9.06s/it]
 15%|█▍        | 5514/37963 [13:17:38<77:37:36,  8.61s/it]
 15%|█▍        | 5515/37963 [13:17:45<74:40:21,  8.28s/it]
 15%|█▍        | 5516/37963 [13:17:53<72:58:06,  8.10s/it]
 15%|█▍        | 5517/37963 [13:18:01<71:21:55,  7.92s/it]
 15%|█▍        | 5518/37963 [13:18:08<69:31:30,  7.71s/it]
 15%|█▍        | 5519/37963 [13:18:15<69:07:58,  7.67s/it]
 15%|█▍        | 5520/37963 [13:18:23<68:56:05,  7.65s/it]
                                                          
{'loss': '0.1728', 'grad_norm': '1.976', 'learning_rate': '1.931e-05', 'epoch': '0.1454'}

 15%|█▍        | 5520/37963 [13:18:23<68:56:05,  7.65s/it]
 15%|█▍        | 5521/37963 [13:18:31<68:55:34,  7.65s/it]
 15%|█▍        | 5522/37963 [13:18:38<68:26:40,  7.60s/it]
 15%|█▍        | 5523/37963 [13:18:46<68:16:40,  7.58s/it]
 15%|█▍        | 5524/37963 [13:18:53<68:05:37,  7.56s/it]
 15%|█▍        | 5525/37963 [13:19:01<68:04:57,  7.56s/it]
 15%|█▍        | 5526/37963 [13:19:08<68:12:07,  7.57s/it]
 15%|█▍        | 5527/37963 [13:19:16<68:18:59,  7.58s/it]
 15%|█▍        | 5528/37963 [13:19:23<68:03:11,  7.55s/it]
 15%|█▍        | 5529/37963 [13:19:31<68:20:15,  7.59s/it]
 15%|█▍        | 5530/37963 [13:19:39<68:08:41,  7.56s/it]
                                                          
{'loss': '0.1755', 'grad_norm': '3.083', 'learning_rate': '1.931e-05', 'epoch': '0.1457'}

 15%|█▍        | 5530/37963 [13:19:39<68:08:41,  7.56s/it]
 15%|█▍        | 5531/37963 [13:19:46<67:45:31,  7.52s/it]
 15%|█▍        | 5532/37963 [13:20:06<100:38:00, 11.17s/it]
 15%|█▍        | 5533/37963 [13:20:20<108:00:36, 11.99s/it]
 15%|█▍        | 5534/37963 [13:20:27<96:17:50, 10.69s/it] 
 15%|█▍        | 5535/37963 [13:20:34<86:45:19,  9.63s/it]
 15%|█▍        | 5536/37963 [13:20:42<81:01:55,  9.00s/it]
 15%|█▍        | 5537/37963 [13:20:49<76:39:22,  8.51s/it]
 15%|█▍        | 5538/37963 [13:20:57<74:09:28,  8.23s/it]
 15%|█▍        | 5539/37963 [13:21:04<72:14:11,  8.02s/it]
 15%|█▍        | 5540/37963 [13:21:12<71:07:50,  7.90s/it]
                                                          
{'loss': '0.1806', 'grad_norm': '2.123', 'learning_rate': '1.93e-05', 'epoch': '0.1459'}

 15%|█▍        | 5540/37963 [13:21:12<71:07:50,  7.90s/it]
 15%|█▍        | 5541/37963 [13:21:26<87:35:15,  9.73s/it]
 15%|█▍        | 5542/37963 [13:21:34<81:45:36,  9.08s/it]
 15%|█▍        | 5543/37963 [13:21:41<77:54:13,  8.65s/it]
 15%|█▍        | 5544/37963 [13:21:55<92:28:26, 10.27s/it]
 15%|█▍        | 5545/37963 [13:22:03<85:07:30,  9.45s/it]
 15%|█▍        | 5546/37963 [13:22:10<80:07:22,  8.90s/it]
 15%|█▍        | 5547/37963 [13:22:18<76:50:26,  8.53s/it]
 15%|█▍        | 5548/37963 [13:22:32<91:57:39, 10.21s/it]
 15%|█▍        | 5549/37963 [13:22:40<84:36:50,  9.40s/it]
 15%|█▍        | 5550/37963 [13:22:47<79:33:14,  8.84s/it]
                                                          
{'loss': '0.169', 'grad_norm': '1.864', 'learning_rate': '1.93e-05', 'epoch': '0.1462'}

 15%|█▍        | 5550/37963 [13:22:47<79:33:14,  8.84s/it]
 15%|█▍        | 5551/37963 [13:22:55<75:55:41,  8.43s/it]
 15%|█▍        | 5552/37963 [13:23:09<91:08:57, 10.12s/it]
 15%|█▍        | 5553/37963 [13:23:16<84:22:04,  9.37s/it]
 15%|█▍        | 5554/37963 [13:23:24<79:46:54,  8.86s/it]
 15%|█▍        | 5555/37963 [13:23:32<76:22:18,  8.48s/it]
 15%|█▍        | 5556/37963 [13:23:39<73:25:06,  8.16s/it]
 15%|█▍        | 5557/37963 [13:23:47<71:51:27,  7.98s/it]
 15%|█▍        | 5558/37963 [13:23:54<71:01:21,  7.89s/it]
 15%|█▍        | 5559/37963 [13:24:02<70:02:02,  7.78s/it]
 15%|█▍        | 5560/37963 [13:24:09<69:26:37,  7.72s/it]
                                                          
{'loss': '0.1603', 'grad_norm': '2.44', 'learning_rate': '1.93e-05', 'epoch': '0.1465'}

 15%|█▍        | 5560/37963 [13:24:09<69:26:37,  7.72s/it]
 15%|█▍        | 5561/37963 [13:24:23<86:22:49,  9.60s/it]
 15%|█▍        | 5562/37963 [13:24:31<81:22:33,  9.04s/it]
 15%|█▍        | 5563/37963 [13:24:39<77:31:21,  8.61s/it]
 15%|█▍        | 5564/37963 [13:24:46<74:36:15,  8.29s/it]
 15%|█▍        | 5565/37963 [13:24:54<72:30:19,  8.06s/it]
 15%|█▍        | 5566/37963 [13:25:01<70:54:10,  7.88s/it]
 15%|█▍        | 5567/37963 [13:25:09<69:45:12,  7.75s/it]
 15%|█▍        | 5568/37963 [13:25:16<69:13:02,  7.69s/it]
 15%|█▍        | 5569/37963 [13:25:24<68:44:26,  7.64s/it]
 15%|█▍        | 5570/37963 [13:25:31<67:34:09,  7.51s/it]
                                                          
{'loss': '0.1641', 'grad_norm': '4.671', 'learning_rate': '1.929e-05', 'epoch': '0.1467'}

 15%|█▍        | 5570/37963 [13:25:31<67:34:09,  7.51s/it]
 15%|█▍        | 5571/37963 [13:25:39<67:45:31,  7.53s/it]
 15%|█▍        | 5572/37963 [13:25:46<67:47:09,  7.53s/it]
 15%|█▍        | 5573/37963 [13:25:54<67:57:41,  7.55s/it]
 15%|█▍        | 5574/37963 [13:26:01<68:09:29,  7.58s/it]
 15%|█▍        | 5575/37963 [13:26:09<68:44:09,  7.64s/it]
 15%|█▍        | 5576/37963 [13:26:23<85:31:48,  9.51s/it]
 15%|█▍        | 5577/37963 [13:26:30<80:02:51,  8.90s/it]
 15%|█▍        | 5578/37963 [13:26:44<92:22:30, 10.27s/it]
 15%|█▍        | 5579/37963 [13:26:51<84:40:53,  9.41s/it]
 15%|█▍        | 5580/37963 [13:26:59<79:11:08,  8.80s/it]
                                                          
{'loss': '0.1792', 'grad_norm': '2.985', 'learning_rate': '1.929e-05', 'epoch': '0.147'}

 15%|█▍        | 5580/37963 [13:26:59<79:11:08,  8.80s/it]
 15%|█▍        | 5581/37963 [13:27:06<75:36:01,  8.40s/it]
 15%|█▍        | 5582/37963 [13:27:14<73:20:20,  8.15s/it]
 15%|█▍        | 5583/37963 [13:27:21<71:37:28,  7.96s/it]
 15%|█▍        | 5584/37963 [13:27:36<88:28:54,  9.84s/it]
 15%|█▍        | 5585/37963 [13:27:43<82:14:36,  9.14s/it]
 15%|█▍        | 5586/37963 [13:27:50<77:34:51,  8.63s/it]
 15%|█▍        | 5587/37963 [13:28:05<92:25:40, 10.28s/it]
 15%|█▍        | 5588/37963 [13:28:12<84:54:41,  9.44s/it]
 15%|█▍        | 5589/37963 [13:28:20<79:34:00,  8.85s/it]
 15%|█▍        | 5590/37963 [13:28:27<76:02:14,  8.46s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '1.133', 'learning_rate': '1.929e-05', 'epoch': '0.1472'}

 15%|█▍        | 5590/37963 [13:28:27<76:02:14,  8.46s/it]
 15%|█▍        | 5591/37963 [13:28:34<72:45:04,  8.09s/it]
 15%|█▍        | 5592/37963 [13:28:42<71:04:18,  7.90s/it]
 15%|█▍        | 5593/37963 [13:29:02<103:42:02, 11.53s/it]
 15%|█▍        | 5594/37963 [13:29:09<93:17:34, 10.38s/it] 
 15%|█▍        | 5595/37963 [13:29:17<85:19:16,  9.49s/it]
 15%|█▍        | 5596/37963 [13:29:24<79:22:31,  8.83s/it]
 15%|█▍        | 5597/37963 [13:29:32<75:52:18,  8.44s/it]
 15%|█▍        | 5598/37963 [13:29:39<73:53:12,  8.22s/it]
 15%|█▍        | 5599/37963 [13:29:47<72:26:35,  8.06s/it]
 15%|█▍        | 5600/37963 [13:29:55<71:08:18,  7.91s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '3.173', 'learning_rate': '1.928e-05', 'epoch': '0.1475'}

 15%|█▍        | 5600/37963 [13:29:55<71:08:18,  7.91s/it]
 15%|█▍        | 5601/37963 [13:30:02<70:17:18,  7.82s/it]
 15%|█▍        | 5602/37963 [13:30:10<69:42:13,  7.75s/it]
 15%|█▍        | 5603/37963 [13:30:24<86:40:43,  9.64s/it]
 15%|█▍        | 5604/37963 [13:30:31<80:50:17,  8.99s/it]
 15%|█▍        | 5605/37963 [13:30:39<76:28:27,  8.51s/it]
 15%|█▍        | 5606/37963 [13:30:46<73:11:41,  8.14s/it]
 15%|█▍        | 5607/37963 [13:30:54<71:27:25,  7.95s/it]
 15%|█▍        | 5608/37963 [13:31:01<70:22:10,  7.83s/it]
 15%|█▍        | 5609/37963 [13:31:09<69:46:18,  7.76s/it]
 15%|█▍        | 5610/37963 [13:31:16<69:01:09,  7.68s/it]
                                                          
{'loss': '0.1706', 'grad_norm': '2.483', 'learning_rate': '1.928e-05', 'epoch': '0.1478'}

 15%|█▍        | 5610/37963 [13:31:16<69:01:09,  7.68s/it]
 15%|█▍        | 5611/37963 [13:31:24<68:33:15,  7.63s/it]
 15%|█▍        | 5612/37963 [13:31:31<68:14:35,  7.59s/it]
 15%|█▍        | 5613/37963 [13:31:39<68:02:56,  7.57s/it]
 15%|█▍        | 5614/37963 [13:31:46<67:53:30,  7.56s/it]
 15%|█▍        | 5615/37963 [13:32:00<85:16:31,  9.49s/it]
 15%|█▍        | 5616/37963 [13:32:08<80:09:56,  8.92s/it]
 15%|█▍        | 5617/37963 [13:32:15<76:26:18,  8.51s/it]
 15%|█▍        | 5618/37963 [13:32:23<73:49:57,  8.22s/it]
 15%|█▍        | 5619/37963 [13:32:31<72:06:29,  8.03s/it]
 15%|█▍        | 5620/37963 [13:32:38<70:48:24,  7.88s/it]
                                                          
{'loss': '0.1553', 'grad_norm': '1.39', 'learning_rate': '1.928e-05', 'epoch': '0.148'}

 15%|█▍        | 5620/37963 [13:32:38<70:48:24,  7.88s/it]
 15%|█▍        | 5621/37963 [13:32:46<70:02:29,  7.80s/it]
 15%|█▍        | 5622/37963 [13:32:53<69:31:15,  7.74s/it]
 15%|█▍        | 5623/37963 [13:33:01<69:25:13,  7.73s/it]
 15%|█▍        | 5624/37963 [13:33:09<69:13:32,  7.71s/it]
 15%|█▍        | 5625/37963 [13:33:16<68:43:28,  7.65s/it]
 15%|█▍        | 5626/37963 [13:33:30<85:32:14,  9.52s/it]
 15%|█▍        | 5627/37963 [13:33:38<80:06:40,  8.92s/it]
 15%|█▍        | 5628/37963 [13:33:45<76:27:58,  8.51s/it]
 15%|█▍        | 5629/37963 [13:33:53<73:49:17,  8.22s/it]
 15%|█▍        | 5630/37963 [13:34:14<108:01:38, 12.03s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '3.834', 'learning_rate': '1.928e-05', 'epoch': '0.1483'}

 15%|█▍        | 5630/37963 [13:34:14<108:01:38, 12.03s/it]
 15%|█▍        | 5631/37963 [13:34:21<95:51:40, 10.67s/it] 
 15%|█▍        | 5632/37963 [13:34:28<86:41:52,  9.65s/it]
 15%|█▍        | 5633/37963 [13:34:36<81:04:21,  9.03s/it]
 15%|█▍        | 5634/37963 [13:34:44<77:17:36,  8.61s/it]
 15%|█▍        | 5635/37963 [13:34:51<74:29:37,  8.30s/it]
 15%|█▍        | 5636/37963 [13:34:59<72:28:10,  8.07s/it]
 15%|█▍        | 5637/37963 [13:35:13<88:20:58,  9.84s/it]
 15%|█▍        | 5638/37963 [13:35:26<99:08:47, 11.04s/it]
 15%|█▍        | 5639/37963 [13:35:34<89:40:40,  9.99s/it]
 15%|█▍        | 5640/37963 [13:35:41<82:25:38,  9.18s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '4.602', 'learning_rate': '1.927e-05', 'epoch': '0.1486'}

 15%|█▍        | 5640/37963 [13:35:41<82:25:38,  9.18s/it]
 15%|█▍        | 5641/37963 [13:35:49<78:01:39,  8.69s/it]
 15%|█▍        | 5642/37963 [13:35:56<75:10:30,  8.37s/it]
 15%|█▍        | 5643/37963 [13:36:04<72:42:11,  8.10s/it]
 15%|█▍        | 5644/37963 [13:36:18<88:22:54,  9.84s/it]
 15%|█▍        | 5645/37963 [13:36:26<82:50:39,  9.23s/it]
 15%|█▍        | 5646/37963 [13:36:33<78:26:58,  8.74s/it]
 15%|█▍        | 5647/37963 [13:36:41<74:48:36,  8.33s/it]
 15%|█▍        | 5648/37963 [13:36:48<72:33:53,  8.08s/it]
 15%|█▍        | 5649/37963 [13:36:56<70:56:12,  7.90s/it]
 15%|█▍        | 5650/37963 [13:37:03<69:59:57,  7.80s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '5.647', 'learning_rate': '1.927e-05', 'epoch': '0.1488'}

 15%|█▍        | 5650/37963 [13:37:03<69:59:57,  7.80s/it]
 15%|█▍        | 5651/37963 [13:37:10<68:34:34,  7.64s/it]
 15%|█▍        | 5652/37963 [13:37:18<68:25:14,  7.62s/it]
 15%|█▍        | 5653/37963 [13:37:26<68:06:34,  7.59s/it]
 15%|█▍        | 5654/37963 [13:37:40<86:14:54,  9.61s/it]
 15%|█▍        | 5655/37963 [13:37:47<80:29:27,  8.97s/it]
 15%|█▍        | 5656/37963 [13:37:55<76:38:08,  8.54s/it]
 15%|█▍        | 5657/37963 [13:38:02<73:48:51,  8.23s/it]
 15%|█▍        | 5658/37963 [13:38:10<71:56:41,  8.02s/it]
 15%|█▍        | 5659/37963 [13:38:17<70:19:41,  7.84s/it]
 15%|█▍        | 5660/37963 [13:38:25<69:11:16,  7.71s/it]
                                                          
{'loss': '0.1839', 'grad_norm': '1.837', 'learning_rate': '1.927e-05', 'epoch': '0.1491'}

 15%|█▍        | 5660/37963 [13:38:25<69:11:16,  7.71s/it]
 15%|█▍        | 5661/37963 [13:38:32<68:12:08,  7.60s/it]
 15%|█▍        | 5662/37963 [13:38:40<67:53:06,  7.57s/it]
 15%|█▍        | 5663/37963 [13:38:47<67:47:36,  7.56s/it]
 15%|█▍        | 5664/37963 [13:38:55<67:36:44,  7.54s/it]
 15%|█▍        | 5665/37963 [13:39:02<67:40:33,  7.54s/it]
 15%|█▍        | 5666/37963 [13:39:10<67:58:56,  7.58s/it]
 15%|█▍        | 5667/37963 [13:39:24<85:23:46,  9.52s/it]
 15%|█▍        | 5668/37963 [13:39:31<80:10:17,  8.94s/it]
 15%|█▍        | 5669/37963 [13:39:39<76:44:10,  8.55s/it]
 15%|█▍        | 5670/37963 [13:39:53<90:48:52, 10.12s/it]
                                                          
{'loss': '0.1845', 'grad_norm': '6.097', 'learning_rate': '1.926e-05', 'epoch': '0.1494'}

 15%|█▍        | 5670/37963 [13:39:53<90:48:52, 10.12s/it]
 15%|█▍        | 5671/37963 [13:40:00<83:37:16,  9.32s/it]
 15%|█▍        | 5672/37963 [13:40:08<79:52:00,  8.90s/it]
 15%|█▍        | 5673/37963 [13:40:16<76:55:25,  8.58s/it]
 15%|█▍        | 5674/37963 [13:40:24<74:39:30,  8.32s/it]
 15%|█▍        | 5675/37963 [13:40:38<90:19:36, 10.07s/it]
 15%|█▍        | 5676/37963 [13:40:46<83:45:17,  9.34s/it]
 15%|█▍        | 5677/37963 [13:41:00<97:09:12, 10.83s/it]
 15%|█▍        | 5678/37963 [13:41:07<87:59:09,  9.81s/it]
 15%|█▍        | 5679/37963 [13:41:15<82:16:11,  9.17s/it]
 15%|█▍        | 5680/37963 [13:41:23<77:52:39,  8.68s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '1.385', 'learning_rate': '1.926e-05', 'epoch': '0.1496'}

 15%|█▍        | 5680/37963 [13:41:23<77:52:39,  8.68s/it]
 15%|█▍        | 5681/37963 [13:41:30<73:58:50,  8.25s/it]
 15%|█▍        | 5682/37963 [13:41:37<72:13:05,  8.05s/it]
 15%|█▍        | 5683/37963 [13:41:51<88:20:10,  9.85s/it]
 15%|█▍        | 5684/37963 [13:41:59<82:11:46,  9.17s/it]
 15%|█▍        | 5685/37963 [13:42:07<77:46:25,  8.67s/it]
 15%|█▍        | 5686/37963 [13:42:14<74:12:01,  8.28s/it]
 15%|█▍        | 5687/37963 [13:42:22<72:36:29,  8.10s/it]
 15%|█▍        | 5688/37963 [13:42:35<88:06:31,  9.83s/it]
 15%|█▍        | 5689/37963 [13:42:43<81:33:16,  9.10s/it]
 15%|█▍        | 5690/37963 [13:42:50<77:22:09,  8.63s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '2.061', 'learning_rate': '1.926e-05', 'epoch': '0.1499'}

 15%|█▍        | 5690/37963 [13:42:50<77:22:09,  8.63s/it]
 15%|█▍        | 5691/37963 [13:42:58<74:45:08,  8.34s/it]
 15%|█▍        | 5692/37963 [13:43:06<72:37:58,  8.10s/it]
 15%|█▍        | 5693/37963 [13:43:13<70:25:40,  7.86s/it]
 15%|█▍        | 5694/37963 [13:43:20<69:36:46,  7.77s/it]
 15%|█▌        | 5695/37963 [13:43:34<86:31:56,  9.65s/it]
 15%|█▌        | 5696/37963 [13:43:42<81:25:24,  9.08s/it]
 15%|█▌        | 5697/37963 [13:43:49<76:17:22,  8.51s/it]
 15%|█▌        | 5698/37963 [13:43:57<73:45:56,  8.23s/it]
 15%|█▌        | 5699/37963 [13:44:05<72:09:39,  8.05s/it]
 15%|█▌        | 5700/37963 [13:44:12<70:46:03,  7.90s/it]
                                                          
{'loss': '0.1537', 'grad_norm': '3.503', 'learning_rate': '1.925e-05', 'epoch': '0.1501'}

 15%|█▌        | 5700/37963 [13:44:12<70:46:03,  7.90s/it]
 15%|█▌        | 5701/37963 [13:44:20<69:49:55,  7.79s/it]
 15%|█▌        | 5702/37963 [13:44:27<69:03:04,  7.71s/it]
 15%|█▌        | 5703/37963 [13:44:35<68:27:12,  7.64s/it]
 15%|█▌        | 5704/37963 [13:44:42<68:37:43,  7.66s/it]
 15%|█▌        | 5705/37963 [13:44:50<68:16:41,  7.62s/it]
 15%|█▌        | 5706/37963 [13:44:58<68:31:59,  7.65s/it]
 15%|█▌        | 5707/37963 [13:45:05<68:18:55,  7.62s/it]
 15%|█▌        | 5708/37963 [13:45:19<85:17:05,  9.52s/it]
 15%|█▌        | 5709/37963 [13:45:27<79:58:26,  8.93s/it]
 15%|█▌        | 5710/37963 [13:45:34<76:10:15,  8.50s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '6.72', 'learning_rate': '1.925e-05', 'epoch': '0.1504'}

 15%|█▌        | 5710/37963 [13:45:34<76:10:15,  8.50s/it]
 15%|█▌        | 5711/37963 [13:45:42<73:35:59,  8.22s/it]
 15%|█▌        | 5712/37963 [13:45:49<71:56:33,  8.03s/it]
 15%|█▌        | 5713/37963 [13:45:57<70:49:24,  7.91s/it]
 15%|█▌        | 5714/37963 [13:46:04<69:46:28,  7.79s/it]
 15%|█▌        | 5715/37963 [13:46:12<69:10:05,  7.72s/it]
 15%|█▌        | 5716/37963 [13:46:19<68:17:28,  7.62s/it]
 15%|█▌        | 5717/37963 [13:46:33<85:07:18,  9.50s/it]
 15%|█▌        | 5718/37963 [13:46:41<80:07:58,  8.95s/it]
 15%|█▌        | 5719/37963 [13:46:55<93:22:54, 10.43s/it]
 15%|█▌        | 5720/37963 [13:47:02<85:34:08,  9.55s/it]
                                                          
{'loss': '0.1689', 'grad_norm': '6.196', 'learning_rate': '1.925e-05', 'epoch': '0.1507'}

 15%|█▌        | 5720/37963 [13:47:02<85:34:08,  9.55s/it]
 15%|█▌        | 5721/37963 [13:47:10<80:14:02,  8.96s/it]
 15%|█▌        | 5722/37963 [13:47:24<94:11:08, 10.52s/it]
 15%|█▌        | 5723/37963 [13:47:32<86:35:45,  9.67s/it]
 15%|█▌        | 5724/37963 [13:47:39<81:00:49,  9.05s/it]
 15%|█▌        | 5725/37963 [13:47:53<93:29:01, 10.44s/it]
 15%|█▌        | 5726/37963 [13:48:01<86:05:58,  9.61s/it]
 15%|█▌        | 5727/37963 [13:48:08<79:23:09,  8.87s/it]
 15%|█▌        | 5728/37963 [13:48:15<75:40:01,  8.45s/it]
 15%|█▌        | 5729/37963 [13:48:23<73:35:12,  8.22s/it]
 15%|█▌        | 5730/37963 [13:48:31<71:58:50,  8.04s/it]
                                                          
{'loss': '0.1762', 'grad_norm': '2.738', 'learning_rate': '1.924e-05', 'epoch': '0.1509'}

 15%|█▌        | 5730/37963 [13:48:31<71:58:50,  8.04s/it]
 15%|█▌        | 5731/37963 [13:48:38<70:39:02,  7.89s/it]
 15%|█▌        | 5732/37963 [13:48:46<69:41:17,  7.78s/it]
 15%|█▌        | 5733/37963 [13:48:53<69:12:05,  7.73s/it]
 15%|█▌        | 5734/37963 [13:49:13<102:33:23, 11.46s/it]
 15%|█▌        | 5735/37963 [13:49:21<91:58:12, 10.27s/it] 
 15%|█▌        | 5736/37963 [13:49:29<84:33:35,  9.45s/it]
 15%|█▌        | 5737/37963 [13:49:36<79:20:50,  8.86s/it]
 15%|█▌        | 5738/37963 [13:49:43<75:05:49,  8.39s/it]
 15%|█▌        | 5739/37963 [13:49:51<72:50:06,  8.14s/it]
 15%|█▌        | 5740/37963 [13:49:58<71:18:25,  7.97s/it]
                                                          
{'loss': '0.1775', 'grad_norm': '5.094', 'learning_rate': '1.924e-05', 'epoch': '0.1512'}

 15%|█▌        | 5740/37963 [13:49:58<71:18:25,  7.97s/it]
 15%|█▌        | 5741/37963 [13:50:06<70:08:41,  7.84s/it]
 15%|█▌        | 5742/37963 [13:50:14<69:29:42,  7.76s/it]
 15%|█▌        | 5743/37963 [13:50:21<69:05:47,  7.72s/it]
 15%|█▌        | 5744/37963 [13:50:35<85:37:38,  9.57s/it]
 15%|█▌        | 5745/37963 [13:50:43<80:26:53,  8.99s/it]
 15%|█▌        | 5746/37963 [13:50:50<76:42:46,  8.57s/it]
 15%|█▌        | 5747/37963 [13:50:58<73:50:49,  8.25s/it]
 15%|█▌        | 5748/37963 [13:51:05<72:10:03,  8.06s/it]
 15%|█▌        | 5749/37963 [13:51:13<70:15:16,  7.85s/it]
 15%|█▌        | 5750/37963 [13:51:20<69:21:10,  7.75s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '5.164', 'learning_rate': '1.924e-05', 'epoch': '0.1515'}

 15%|█▌        | 5750/37963 [13:51:20<69:21:10,  7.75s/it]
 15%|█▌        | 5751/37963 [13:51:28<68:57:54,  7.71s/it]
 15%|█▌        | 5752/37963 [13:51:35<67:56:00,  7.59s/it]
 15%|█▌        | 5753/37963 [13:51:43<67:14:44,  7.52s/it]
 15%|█▌        | 5754/37963 [13:51:50<67:44:03,  7.57s/it]
 15%|█▌        | 5755/37963 [13:51:58<67:51:43,  7.59s/it]
 15%|█▌        | 5756/37963 [13:52:05<67:34:47,  7.55s/it]
 15%|█▌        | 5757/37963 [13:52:13<67:16:33,  7.52s/it]
 15%|█▌        | 5758/37963 [13:52:21<67:51:15,  7.59s/it]
 15%|█▌        | 5759/37963 [13:52:28<67:50:04,  7.58s/it]
 15%|█▌        | 5760/37963 [13:52:36<67:55:00,  7.59s/it]
                                                          
{'loss': '0.1643', 'grad_norm': '4.04', 'learning_rate': '1.923e-05', 'epoch': '0.1517'}

 15%|█▌        | 5760/37963 [13:52:36<67:55:00,  7.59s/it]
 15%|█▌        | 5761/37963 [13:52:43<68:22:20,  7.64s/it]
 15%|█▌        | 5762/37963 [13:53:04<101:48:06, 11.38s/it]
 15%|█▌        | 5763/37963 [13:53:11<91:25:49, 10.22s/it] 
 15%|█▌        | 5764/37963 [13:53:19<84:08:46,  9.41s/it]
 15%|█▌        | 5765/37963 [13:53:26<78:56:39,  8.83s/it]
 15%|█▌        | 5766/37963 [13:53:34<75:37:16,  8.46s/it]
 15%|█▌        | 5767/37963 [13:53:41<73:11:40,  8.18s/it]
 15%|█▌        | 5768/37963 [13:53:49<71:19:21,  7.98s/it]
 15%|█▌        | 5769/37963 [13:53:56<70:03:37,  7.83s/it]
 15%|█▌        | 5770/37963 [13:54:10<86:44:33,  9.70s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.417', 'learning_rate': '1.923e-05', 'epoch': '0.152'}

 15%|█▌        | 5770/37963 [13:54:10<86:44:33,  9.70s/it]
 15%|█▌        | 5771/37963 [13:54:18<80:23:35,  8.99s/it]
 15%|█▌        | 5772/37963 [13:54:32<93:34:29, 10.46s/it]
 15%|█▌        | 5773/37963 [13:54:46<103:08:04, 11.53s/it]
 15%|█▌        | 5774/37963 [13:54:53<92:16:47, 10.32s/it] 
 15%|█▌        | 5775/37963 [13:55:00<84:02:38,  9.40s/it]
 15%|█▌        | 5776/37963 [13:55:08<79:04:17,  8.84s/it]
 15%|█▌        | 5777/37963 [13:55:15<75:37:30,  8.46s/it]
 15%|█▌        | 5778/37963 [13:55:23<73:13:17,  8.19s/it]
 15%|█▌        | 5779/37963 [13:55:31<71:52:41,  8.04s/it]
 15%|█▌        | 5780/37963 [13:55:38<70:19:26,  7.87s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.816', 'learning_rate': '1.923e-05', 'epoch': '0.1523'}

 15%|█▌        | 5780/37963 [13:55:38<70:19:26,  7.87s/it]
 15%|█▌        | 5781/37963 [13:55:46<69:15:55,  7.75s/it]
 15%|█▌        | 5782/37963 [13:55:53<68:23:17,  7.65s/it]
 15%|█▌        | 5783/37963 [13:56:01<68:04:44,  7.62s/it]
 15%|█▌        | 5784/37963 [13:56:08<68:01:13,  7.61s/it]
 15%|█▌        | 5785/37963 [13:56:16<67:47:43,  7.58s/it]
 15%|█▌        | 5786/37963 [13:56:30<85:45:02,  9.59s/it]
 15%|█▌        | 5787/37963 [13:56:44<97:19:52, 10.89s/it]
 15%|█▌        | 5788/37963 [13:56:51<88:14:07,  9.87s/it]
 15%|█▌        | 5789/37963 [13:56:59<81:46:33,  9.15s/it]
 15%|█▌        | 5790/37963 [13:57:06<77:09:04,  8.63s/it]
                                                          
{'loss': '0.1623', 'grad_norm': '3.149', 'learning_rate': '1.922e-05', 'epoch': '0.1525'}

 15%|█▌        | 5790/37963 [13:57:06<77:09:04,  8.63s/it]
 15%|█▌        | 5791/37963 [13:57:14<74:18:27,  8.31s/it]
 15%|█▌        | 5792/37963 [13:57:21<72:11:08,  8.08s/it]
 15%|█▌        | 5793/37963 [13:57:29<71:08:17,  7.96s/it]
 15%|█▌        | 5794/37963 [13:57:37<70:33:07,  7.90s/it]
 15%|█▌        | 5795/37963 [13:57:44<69:39:36,  7.80s/it]
 15%|█▌        | 5796/37963 [13:57:52<69:27:25,  7.77s/it]
 15%|█▌        | 5797/37963 [13:58:00<68:41:41,  7.69s/it]
 15%|█▌        | 5798/37963 [13:58:14<85:41:00,  9.59s/it]
 15%|█▌        | 5799/37963 [13:58:21<80:44:02,  9.04s/it]
 15%|█▌        | 5800/37963 [13:58:29<76:06:19,  8.52s/it]
                                                          
{'loss': '0.1747', 'grad_norm': '8.263', 'learning_rate': '1.922e-05', 'epoch': '0.1528'}

 15%|█▌        | 5800/37963 [13:58:29<76:06:19,  8.52s/it]
 15%|█▌        | 5801/37963 [13:58:36<72:52:22,  8.16s/it]
 15%|█▌        | 5802/37963 [13:58:43<70:51:17,  7.93s/it]
 15%|█▌        | 5803/37963 [13:58:51<70:10:43,  7.86s/it]
 15%|█▌        | 5804/37963 [13:58:58<68:36:38,  7.68s/it]
 15%|█▌        | 5805/37963 [13:59:06<68:48:28,  7.70s/it]
 15%|█▌        | 5806/37963 [13:59:20<85:22:32,  9.56s/it]
 15%|█▌        | 5807/37963 [13:59:28<80:14:49,  8.98s/it]
 15%|█▌        | 5808/37963 [13:59:35<76:37:30,  8.58s/it]
 15%|█▌        | 5809/37963 [13:59:43<73:23:36,  8.22s/it]
 15%|█▌        | 5810/37963 [13:59:57<89:12:07,  9.99s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '3.836', 'learning_rate': '1.922e-05', 'epoch': '0.153'}

 15%|█▌        | 5810/37963 [13:59:57<89:12:07,  9.99s/it]
 15%|█▌        | 5811/37963 [14:00:04<82:36:33,  9.25s/it]
 15%|█▌        | 5812/37963 [14:00:12<77:42:40,  8.70s/it]
 15%|█▌        | 5813/37963 [14:00:19<74:38:52,  8.36s/it]
 15%|█▌        | 5814/37963 [14:00:27<72:36:24,  8.13s/it]
 15%|█▌        | 5815/37963 [14:00:34<71:11:39,  7.97s/it]
 15%|█▌        | 5816/37963 [14:00:42<69:32:17,  7.79s/it]
 15%|█▌        | 5817/37963 [14:00:49<69:13:41,  7.75s/it]
 15%|█▌        | 5818/37963 [14:01:03<85:08:04,  9.53s/it]
 15%|█▌        | 5819/37963 [14:01:17<97:04:10, 10.87s/it]
 15%|█▌        | 5820/37963 [14:01:31<105:36:54, 11.83s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '0.979', 'learning_rate': '1.921e-05', 'epoch': '0.1533'}

 15%|█▌        | 5820/37963 [14:01:31<105:36:54, 11.83s/it]
 15%|█▌        | 5821/37963 [14:01:39<94:23:13, 10.57s/it] 
 15%|█▌        | 5822/37963 [14:01:46<86:09:43,  9.65s/it]
 15%|█▌        | 5823/37963 [14:01:54<80:25:18,  9.01s/it]
 15%|█▌        | 5824/37963 [14:02:01<75:50:46,  8.50s/it]
 15%|█▌        | 5825/37963 [14:02:09<73:10:33,  8.20s/it]
 15%|█▌        | 5826/37963 [14:02:16<71:47:37,  8.04s/it]
 15%|█▌        | 5827/37963 [14:02:24<70:20:54,  7.88s/it]
 15%|█▌        | 5828/37963 [14:02:31<69:38:17,  7.80s/it]
 15%|█▌        | 5829/37963 [14:02:39<68:44:50,  7.70s/it]
 15%|█▌        | 5830/37963 [14:02:46<68:04:33,  7.63s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '2.206', 'learning_rate': '1.921e-05', 'epoch': '0.1536'}

 15%|█▌        | 5830/37963 [14:02:46<68:04:33,  7.63s/it]
 15%|█▌        | 5831/37963 [14:02:54<67:54:13,  7.61s/it]
 15%|█▌        | 5832/37963 [14:03:01<67:47:44,  7.60s/it]
 15%|█▌        | 5833/37963 [14:03:09<66:51:06,  7.49s/it]
 15%|█▌        | 5834/37963 [14:03:23<84:15:02,  9.44s/it]
 15%|█▌        | 5835/37963 [14:03:37<96:50:05, 10.85s/it]
 15%|█▌        | 5836/37963 [14:03:44<87:15:53,  9.78s/it]
 15%|█▌        | 5837/37963 [14:03:52<81:41:27,  9.15s/it]
 15%|█▌        | 5838/37963 [14:03:59<77:21:53,  8.67s/it]
 15%|█▌        | 5839/37963 [14:04:07<74:13:01,  8.32s/it]
 15%|█▌        | 5840/37963 [14:04:14<72:09:29,  8.09s/it]
                                                          
{'loss': '0.1539', 'grad_norm': '3.529', 'learning_rate': '1.921e-05', 'epoch': '0.1538'}

 15%|█▌        | 5840/37963 [14:04:14<72:09:29,  8.09s/it]
 15%|█▌        | 5841/37963 [14:04:22<70:38:09,  7.92s/it]
 15%|█▌        | 5842/37963 [14:04:29<69:27:03,  7.78s/it]
 15%|█▌        | 5843/37963 [14:04:37<68:47:36,  7.71s/it]
 15%|█▌        | 5844/37963 [14:04:45<68:33:46,  7.68s/it]
 15%|█▌        | 5845/37963 [14:04:52<67:42:24,  7.59s/it]
 15%|█▌        | 5846/37963 [14:04:59<67:12:58,  7.53s/it]
 15%|█▌        | 5847/37963 [14:05:07<66:25:26,  7.45s/it]
 15%|█▌        | 5848/37963 [14:05:21<84:52:39,  9.51s/it]
 15%|█▌        | 5849/37963 [14:05:35<97:10:19, 10.89s/it]
 15%|█▌        | 5850/37963 [14:05:43<88:25:22,  9.91s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '2.067', 'learning_rate': '1.92e-05', 'epoch': '0.1541'}

 15%|█▌        | 5850/37963 [14:05:43<88:25:22,  9.91s/it]
 15%|█▌        | 5851/37963 [14:05:50<81:40:41,  9.16s/it]
 15%|█▌        | 5852/37963 [14:05:58<77:10:11,  8.65s/it]
 15%|█▌        | 5853/37963 [14:06:05<74:01:50,  8.30s/it]
 15%|█▌        | 5854/37963 [14:06:13<72:12:15,  8.10s/it]
 15%|█▌        | 5855/37963 [14:06:20<70:40:04,  7.92s/it]
 15%|█▌        | 5856/37963 [14:06:28<69:35:30,  7.80s/it]
 15%|█▌        | 5857/37963 [14:06:35<69:26:22,  7.79s/it]
 15%|█▌        | 5858/37963 [14:06:43<68:21:48,  7.67s/it]
 15%|█▌        | 5859/37963 [14:06:57<85:11:09,  9.55s/it]
 15%|█▌        | 5860/37963 [14:07:04<79:41:01,  8.94s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '1.167', 'learning_rate': '1.92e-05', 'epoch': '0.1544'}

 15%|█▌        | 5860/37963 [14:07:04<79:41:01,  8.94s/it]
 15%|█▌        | 5861/37963 [14:07:12<75:49:34,  8.50s/it]
 15%|█▌        | 5862/37963 [14:07:19<73:16:52,  8.22s/it]
 15%|█▌        | 5863/37963 [14:07:27<71:56:55,  8.07s/it]
 15%|█▌        | 5864/37963 [14:07:34<70:19:44,  7.89s/it]
 15%|█▌        | 5865/37963 [14:07:49<86:48:19,  9.74s/it]
 15%|█▌        | 5866/37963 [14:07:56<80:18:42,  9.01s/it]
 15%|█▌        | 5867/37963 [14:08:03<75:57:12,  8.52s/it]
 15%|█▌        | 5868/37963 [14:08:17<90:23:56, 10.14s/it]
 15%|█▌        | 5869/37963 [14:08:31<100:23:22, 11.26s/it]
 15%|█▌        | 5870/37963 [14:08:39<90:53:00, 10.19s/it] 
                                                          
{'loss': '0.1564', 'grad_norm': '2.217', 'learning_rate': '1.92e-05', 'epoch': '0.1546'}

 15%|█▌        | 5870/37963 [14:08:39<90:53:00, 10.19s/it]
 15%|█▌        | 5871/37963 [14:08:46<83:36:25,  9.38s/it]
 15%|█▌        | 5872/37963 [14:08:54<78:13:19,  8.78s/it]
 15%|█▌        | 5873/37963 [14:09:01<74:45:37,  8.39s/it]
 15%|█▌        | 5874/37963 [14:09:08<72:02:42,  8.08s/it]
 15%|█▌        | 5875/37963 [14:09:16<69:44:00,  7.82s/it]
 15%|█▌        | 5876/37963 [14:09:23<69:07:33,  7.76s/it]
 15%|█▌        | 5877/37963 [14:09:31<68:34:55,  7.69s/it]
 15%|█▌        | 5878/37963 [14:09:38<67:55:03,  7.62s/it]
 15%|█▌        | 5879/37963 [14:09:46<67:50:43,  7.61s/it]
 15%|█▌        | 5880/37963 [14:09:53<67:48:02,  7.61s/it]
                                                          
{'loss': '0.1589', 'grad_norm': '4.523', 'learning_rate': '1.919e-05', 'epoch': '0.1549'}

 15%|█▌        | 5880/37963 [14:09:53<67:48:02,  7.61s/it]
 15%|█▌        | 5881/37963 [14:10:07<84:33:59,  9.49s/it]
 15%|█▌        | 5882/37963 [14:10:15<79:32:16,  8.93s/it]
 15%|█▌        | 5883/37963 [14:10:29<93:06:04, 10.45s/it]
 15%|█▌        | 5884/37963 [14:10:36<85:13:36,  9.56s/it]
 16%|█▌        | 5885/37963 [14:10:44<79:47:38,  8.96s/it]
 16%|█▌        | 5886/37963 [14:10:52<76:17:17,  8.56s/it]
 16%|█▌        | 5887/37963 [14:10:59<73:43:25,  8.27s/it]
 16%|█▌        | 5888/37963 [14:11:07<71:19:52,  8.01s/it]
 16%|█▌        | 5889/37963 [14:11:14<69:35:20,  7.81s/it]
 16%|█▌        | 5890/37963 [14:11:21<68:44:14,  7.72s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '5.278', 'learning_rate': '1.919e-05', 'epoch': '0.1552'}

 16%|█▌        | 5890/37963 [14:11:21<68:44:14,  7.72s/it]
 16%|█▌        | 5891/37963 [14:11:29<68:16:12,  7.66s/it]
 16%|█▌        | 5892/37963 [14:11:37<67:55:30,  7.62s/it]
 16%|█▌        | 5893/37963 [14:11:44<68:01:40,  7.64s/it]
 16%|█▌        | 5894/37963 [14:11:52<67:56:12,  7.63s/it]
 16%|█▌        | 5895/37963 [14:11:59<67:19:06,  7.56s/it]
 16%|█▌        | 5896/37963 [14:12:14<85:43:53,  9.62s/it]
 16%|█▌        | 5897/37963 [14:12:21<80:36:38,  9.05s/it]
 16%|█▌        | 5898/37963 [14:12:35<93:45:48, 10.53s/it]
 16%|█▌        | 5899/37963 [14:12:43<85:19:04,  9.58s/it]
 16%|█▌        | 5900/37963 [14:12:50<80:01:36,  8.99s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '1.709', 'learning_rate': '1.919e-05', 'epoch': '0.1554'}

 16%|█▌        | 5900/37963 [14:12:50<80:01:36,  8.99s/it]
 16%|█▌        | 5901/37963 [14:12:58<75:57:33,  8.53s/it]
 16%|█▌        | 5902/37963 [14:13:05<73:29:56,  8.25s/it]
 16%|█▌        | 5903/37963 [14:13:13<71:43:12,  8.05s/it]
 16%|█▌        | 5904/37963 [14:13:20<70:25:29,  7.91s/it]
 16%|█▌        | 5905/37963 [14:13:28<69:18:56,  7.78s/it]
 16%|█▌        | 5906/37963 [14:13:36<68:40:30,  7.71s/it]
 16%|█▌        | 5907/37963 [14:13:43<68:19:18,  7.67s/it]
 16%|█▌        | 5908/37963 [14:13:51<67:54:45,  7.63s/it]
 16%|█▌        | 5909/37963 [14:14:04<84:00:02,  9.43s/it]
 16%|█▌        | 5910/37963 [14:14:12<79:27:24,  8.92s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '5.334', 'learning_rate': '1.918e-05', 'epoch': '0.1557'}

 16%|█▌        | 5910/37963 [14:14:12<79:27:24,  8.92s/it]
 16%|█▌        | 5911/37963 [14:14:20<76:02:21,  8.54s/it]
 16%|█▌        | 5912/37963 [14:14:27<73:22:07,  8.24s/it]
 16%|█▌        | 5913/37963 [14:14:35<71:07:32,  7.99s/it]
 16%|█▌        | 5914/37963 [14:14:42<69:53:29,  7.85s/it]
 16%|█▌        | 5915/37963 [14:14:56<86:12:33,  9.68s/it]
 16%|█▌        | 5916/37963 [14:15:10<97:46:47, 10.98s/it]
 16%|█▌        | 5917/37963 [14:15:18<88:31:59,  9.95s/it]
 16%|█▌        | 5918/37963 [14:15:32<99:15:00, 11.15s/it]
 16%|█▌        | 5919/37963 [14:15:39<89:55:56, 10.10s/it]
 16%|█▌        | 5920/37963 [14:15:47<83:20:23,  9.36s/it]
                                                          
{'loss': '0.1645', 'grad_norm': '1.385', 'learning_rate': '1.918e-05', 'epoch': '0.1559'}

 16%|█▌        | 5920/37963 [14:15:47<83:20:23,  9.36s/it]
 16%|█▌        | 5921/37963 [14:15:55<78:43:16,  8.84s/it]
 16%|█▌        | 5922/37963 [14:16:02<74:52:06,  8.41s/it]
 16%|█▌        | 5923/37963 [14:16:09<72:01:05,  8.09s/it]
 16%|█▌        | 5924/37963 [14:16:17<70:37:06,  7.93s/it]
 16%|█▌        | 5925/37963 [14:16:24<68:21:19,  7.68s/it]
 16%|█▌        | 5926/37963 [14:16:31<67:12:08,  7.55s/it]
 16%|█▌        | 5927/37963 [14:16:39<67:08:03,  7.54s/it]
 16%|█▌        | 5928/37963 [14:16:46<66:48:03,  7.51s/it]
 16%|█▌        | 5929/37963 [14:17:00<84:18:53,  9.48s/it]
 16%|█▌        | 5930/37963 [14:17:08<78:41:38,  8.84s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '1.001', 'learning_rate': '1.918e-05', 'epoch': '0.1562'}

 16%|█▌        | 5930/37963 [14:17:08<78:41:38,  8.84s/it]
 16%|█▌        | 5931/37963 [14:17:15<75:05:44,  8.44s/it]
 16%|█▌        | 5932/37963 [14:17:23<72:46:23,  8.18s/it]
 16%|█▌        | 5933/37963 [14:17:30<71:04:07,  7.99s/it]
 16%|█▌        | 5934/37963 [14:17:44<86:56:34,  9.77s/it]
 16%|█▌        | 5935/37963 [14:17:52<80:48:30,  9.08s/it]
 16%|█▌        | 5936/37963 [14:17:59<76:38:10,  8.61s/it]
 16%|█▌        | 5937/37963 [14:18:07<73:50:31,  8.30s/it]
 16%|█▌        | 5938/37963 [14:18:14<71:40:29,  8.06s/it]
 16%|█▌        | 5939/37963 [14:18:22<70:43:28,  7.95s/it]
 16%|█▌        | 5940/37963 [14:18:29<69:14:06,  7.78s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '1.863', 'learning_rate': '1.917e-05', 'epoch': '0.1565'}

 16%|█▌        | 5940/37963 [14:18:29<69:14:06,  7.78s/it]
 16%|█▌        | 5941/37963 [14:18:37<68:06:12,  7.66s/it]
 16%|█▌        | 5942/37963 [14:18:44<68:16:36,  7.68s/it]
 16%|█▌        | 5943/37963 [14:18:52<67:41:09,  7.61s/it]
 16%|█▌        | 5944/37963 [14:18:59<67:35:45,  7.60s/it]
 16%|█▌        | 5945/37963 [14:19:13<84:39:14,  9.52s/it]
 16%|█▌        | 5946/37963 [14:19:27<96:26:03, 10.84s/it]
 16%|█▌        | 5947/37963 [14:19:35<87:44:45,  9.87s/it]
 16%|█▌        | 5948/37963 [14:19:42<81:22:21,  9.15s/it]
 16%|█▌        | 5949/37963 [14:19:50<77:05:05,  8.67s/it]
 16%|█▌        | 5950/37963 [14:19:57<74:07:39,  8.34s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '2.445', 'learning_rate': '1.917e-05', 'epoch': '0.1567'}

 16%|█▌        | 5950/37963 [14:19:57<74:07:39,  8.34s/it]
 16%|█▌        | 5951/37963 [14:20:05<72:07:28,  8.11s/it]
 16%|█▌        | 5952/37963 [14:20:13<71:07:04,  8.00s/it]
 16%|█▌        | 5953/37963 [14:20:20<69:31:17,  7.82s/it]
 16%|█▌        | 5954/37963 [14:20:28<68:37:16,  7.72s/it]
 16%|█▌        | 5955/37963 [14:20:35<67:49:43,  7.63s/it]
 16%|█▌        | 5956/37963 [14:20:43<67:24:25,  7.58s/it]
 16%|█▌        | 5957/37963 [14:20:50<67:49:12,  7.63s/it]
 16%|█▌        | 5958/37963 [14:20:58<67:32:37,  7.60s/it]
 16%|█▌        | 5959/37963 [14:21:12<84:25:48,  9.50s/it]
 16%|█▌        | 5960/37963 [14:21:19<79:19:18,  8.92s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '2.726', 'learning_rate': '1.917e-05', 'epoch': '0.157'}

 16%|█▌        | 5960/37963 [14:21:19<79:19:18,  8.92s/it]
 16%|█▌        | 5961/37963 [14:21:27<75:36:18,  8.51s/it]
 16%|█▌        | 5962/37963 [14:21:34<73:03:20,  8.22s/it]
 16%|█▌        | 5963/37963 [14:21:42<71:33:24,  8.05s/it]
 16%|█▌        | 5964/37963 [14:21:56<87:16:21,  9.82s/it]
 16%|█▌        | 5965/37963 [14:22:16<115:19:57, 12.98s/it]
 16%|█▌        | 5966/37963 [14:22:24<101:33:47, 11.43s/it]
 16%|█▌        | 5967/37963 [14:22:32<90:37:46, 10.20s/it] 
 16%|█▌        | 5968/37963 [14:22:39<83:22:01,  9.38s/it]
 16%|█▌        | 5969/37963 [14:22:47<78:26:40,  8.83s/it]
 16%|█▌        | 5970/37963 [14:22:54<74:56:11,  8.43s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '2.642', 'learning_rate': '1.916e-05', 'epoch': '0.1573'}

 16%|█▌        | 5970/37963 [14:22:54<74:56:11,  8.43s/it]
 16%|█▌        | 5971/37963 [14:23:01<72:20:54,  8.14s/it]
 16%|█▌        | 5972/37963 [14:23:09<70:31:27,  7.94s/it]
 16%|█▌        | 5973/37963 [14:23:16<69:27:17,  7.82s/it]
 16%|█▌        | 5974/37963 [14:23:24<68:05:46,  7.66s/it]
 16%|█▌        | 5975/37963 [14:23:31<67:58:56,  7.65s/it]
 16%|█▌        | 5976/37963 [14:23:45<84:57:08,  9.56s/it]
 16%|█▌        | 5977/37963 [14:23:53<79:27:48,  8.94s/it]
 16%|█▌        | 5978/37963 [14:24:00<75:05:32,  8.45s/it]
 16%|█▌        | 5979/37963 [14:24:08<72:50:25,  8.20s/it]
 16%|█▌        | 5980/37963 [14:24:22<88:00:08,  9.91s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '1.166', 'learning_rate': '1.916e-05', 'epoch': '0.1575'}

 16%|█▌        | 5980/37963 [14:24:22<88:00:08,  9.91s/it]
 16%|█▌        | 5981/37963 [14:24:29<82:15:35,  9.26s/it]
 16%|█▌        | 5982/37963 [14:24:37<77:11:33,  8.69s/it]
 16%|█▌        | 5983/37963 [14:24:44<73:56:39,  8.32s/it]
 16%|█▌        | 5984/37963 [14:24:52<71:48:34,  8.08s/it]
 16%|█▌        | 5985/37963 [14:24:59<70:18:33,  7.92s/it]
 16%|█▌        | 5986/37963 [14:25:07<69:36:48,  7.84s/it]
 16%|█▌        | 5987/37963 [14:25:15<69:29:10,  7.82s/it]
 16%|█▌        | 5988/37963 [14:25:23<69:32:20,  7.83s/it]
 16%|█▌        | 5989/37963 [14:25:30<69:24:35,  7.81s/it]
 16%|█▌        | 5990/37963 [14:25:38<68:46:58,  7.74s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '2.588', 'learning_rate': '1.916e-05', 'epoch': '0.1578'}

 16%|█▌        | 5990/37963 [14:25:38<68:46:58,  7.74s/it]
 16%|█▌        | 5991/37963 [14:25:46<68:29:31,  7.71s/it]
 16%|█▌        | 5992/37963 [14:25:53<68:00:52,  7.66s/it]
 16%|█▌        | 5993/37963 [14:26:07<83:42:42,  9.43s/it]
 16%|█▌        | 5994/37963 [14:26:14<78:18:45,  8.82s/it]
 16%|█▌        | 5995/37963 [14:26:28<92:06:26, 10.37s/it]
 16%|█▌        | 5996/37963 [14:26:35<83:48:57,  9.44s/it]
 16%|█▌        | 5997/37963 [14:26:43<78:20:17,  8.82s/it]
 16%|█▌        | 5998/37963 [14:26:50<74:53:13,  8.43s/it]
 16%|█▌        | 5999/37963 [14:26:58<72:58:40,  8.22s/it]
 16%|█▌        | 6000/37963 [14:27:06<71:38:02,  8.07s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '1.238', 'learning_rate': '1.915e-05', 'epoch': '0.158'}

 16%|█▌        | 6000/37963 [14:27:06<71:38:02,  8.07s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.05s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.05s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 16%|█▌        | 6001/37963 [14:28:04<204:21:57, 23.02s/it]
 16%|█▌        | 6002/37963 [14:28:11<163:22:00, 18.40s/it]
 16%|█▌        | 6003/37963 [14:28:19<134:15:17, 15.12s/it]
 16%|█▌        | 6004/37963 [14:28:26<114:19:56, 12.88s/it]
 16%|█▌        | 6005/37963 [14:28:34<100:20:28, 11.30s/it]
 16%|█▌        | 6006/37963 [14:28:42<90:51:05, 10.23s/it] 
 16%|█▌        | 6007/37963 [14:28:56<100:47:50, 11.36s/it]
 16%|█▌        | 6008/37963 [14:29:10<107:46:38, 12.14s/it]
 16%|█▌        | 6009/37963 [14:29:17<95:02:23, 10.71s/it] 
 16%|█▌        | 6010/37963 [14:29:31<103:36:36, 11.67s/it]
                                                           
{'loss': '0.17', 'grad_norm': '6.294', 'learning_rate': '1.915e-05', 'epoch': '0.1583'}

 16%|█▌        | 6010/37963 [14:29:31<103:36:36, 11.67s/it]
 16%|█▌        | 6011/37963 [14:29:39<93:38:43, 10.55s/it] 
 16%|█▌        | 6012/37963 [14:29:53<102:46:18, 11.58s/it]
 16%|█▌        | 6013/37963 [14:30:00<91:58:07, 10.36s/it] 
 16%|█▌        | 6014/37963 [14:30:08<84:48:01,  9.56s/it]
 16%|█▌        | 6015/37963 [14:30:16<79:48:31,  8.99s/it]
 16%|█▌        | 6016/37963 [14:30:23<76:08:12,  8.58s/it]
 16%|█▌        | 6017/37963 [14:30:31<73:19:16,  8.26s/it]
 16%|█▌        | 6018/37963 [14:30:38<71:25:13,  8.05s/it]
 16%|█▌        | 6019/37963 [14:30:46<69:40:06,  7.85s/it]
 16%|█▌        | 6020/37963 [14:30:53<68:40:35,  7.74s/it]
                                                          
{'loss': '0.1835', 'grad_norm': '2.281', 'learning_rate': '1.915e-05', 'epoch': '0.1586'}

 16%|█▌        | 6020/37963 [14:30:53<68:40:35,  7.74s/it]
 16%|█▌        | 6021/37963 [14:31:01<68:20:52,  7.70s/it]
 16%|█▌        | 6022/37963 [14:31:09<68:02:49,  7.67s/it]
 16%|█▌        | 6023/37963 [14:31:22<84:30:55,  9.53s/it]
 16%|█▌        | 6024/37963 [14:31:30<79:17:40,  8.94s/it]
 16%|█▌        | 6025/37963 [14:31:37<75:27:03,  8.50s/it]
 16%|█▌        | 6026/37963 [14:31:45<72:55:21,  8.22s/it]
 16%|█▌        | 6027/37963 [14:31:59<88:04:07,  9.93s/it]
 16%|█▌        | 6028/37963 [14:32:06<81:38:43,  9.20s/it]
 16%|█▌        | 6029/37963 [14:32:14<77:32:09,  8.74s/it]
 16%|█▌        | 6030/37963 [14:32:22<74:04:55,  8.35s/it]
                                                          
{'loss': '0.1635', 'grad_norm': '2.336', 'learning_rate': '1.914e-05', 'epoch': '0.1588'}

 16%|█▌        | 6030/37963 [14:32:22<74:04:55,  8.35s/it]
 16%|█▌        | 6031/37963 [14:32:29<72:13:19,  8.14s/it]
 16%|█▌        | 6032/37963 [14:32:37<70:09:36,  7.91s/it]
 16%|█▌        | 6033/37963 [14:32:44<69:06:08,  7.79s/it]
 16%|█▌        | 6034/37963 [14:32:51<67:44:34,  7.64s/it]
 16%|█▌        | 6035/37963 [14:32:59<67:23:47,  7.60s/it]
 16%|█▌        | 6036/37963 [14:33:06<67:18:30,  7.59s/it]
 16%|█▌        | 6037/37963 [14:33:14<67:01:39,  7.56s/it]
 16%|█▌        | 6038/37963 [14:33:28<84:06:31,  9.48s/it]
 16%|█▌        | 6039/37963 [14:33:36<79:04:05,  8.92s/it]
 16%|█▌        | 6040/37963 [14:33:43<75:28:52,  8.51s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '2.667', 'learning_rate': '1.914e-05', 'epoch': '0.1591'}

 16%|█▌        | 6040/37963 [14:33:43<75:28:52,  8.51s/it]
 16%|█▌        | 6041/37963 [14:33:57<89:58:43, 10.15s/it]
 16%|█▌        | 6042/37963 [14:34:05<83:10:16,  9.38s/it]
 16%|█▌        | 6043/37963 [14:34:12<78:12:29,  8.82s/it]
 16%|█▌        | 6044/37963 [14:34:20<74:35:53,  8.41s/it]
 16%|█▌        | 6045/37963 [14:34:27<72:12:11,  8.14s/it]
 16%|█▌        | 6046/37963 [14:34:34<70:02:18,  7.90s/it]
 16%|█▌        | 6047/37963 [14:34:42<69:04:06,  7.79s/it]
 16%|█▌        | 6048/37963 [14:34:49<67:50:05,  7.65s/it]
 16%|█▌        | 6049/37963 [14:34:57<68:03:19,  7.68s/it]
 16%|█▌        | 6050/37963 [14:35:05<67:55:26,  7.66s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '4.385', 'learning_rate': '1.914e-05', 'epoch': '0.1594'}

 16%|█▌        | 6050/37963 [14:35:05<67:55:26,  7.66s/it]
 16%|█▌        | 6051/37963 [14:35:12<66:53:01,  7.55s/it]
 16%|█▌        | 6052/37963 [14:35:19<66:46:10,  7.53s/it]
 16%|█▌        | 6053/37963 [14:35:33<83:38:17,  9.44s/it]
 16%|█▌        | 6054/37963 [14:35:41<78:38:13,  8.87s/it]
 16%|█▌        | 6055/37963 [14:35:48<74:58:41,  8.46s/it]
 16%|█▌        | 6056/37963 [14:35:56<72:25:27,  8.17s/it]
 16%|█▌        | 6057/37963 [14:36:03<70:08:55,  7.91s/it]
 16%|█▌        | 6058/37963 [14:36:17<86:15:56,  9.73s/it]
 16%|█▌        | 6059/37963 [14:36:25<80:06:23,  9.04s/it]
 16%|█▌        | 6060/37963 [14:36:38<92:23:52, 10.43s/it]
                                                          
{'loss': '0.1609', 'grad_norm': '2.803', 'learning_rate': '1.913e-05', 'epoch': '0.1596'}

 16%|█▌        | 6060/37963 [14:36:38<92:23:52, 10.43s/it]
 16%|█▌        | 6061/37963 [14:36:52<101:18:02, 11.43s/it]
 16%|█▌        | 6062/37963 [14:37:00<91:05:22, 10.28s/it] 
 16%|█▌        | 6063/37963 [14:37:07<83:51:08,  9.46s/it]
 16%|█▌        | 6064/37963 [14:37:15<78:39:30,  8.88s/it]
 16%|█▌        | 6065/37963 [14:37:22<75:02:05,  8.47s/it]
 16%|█▌        | 6066/37963 [14:37:30<72:18:33,  8.16s/it]
 16%|█▌        | 6067/37963 [14:37:37<70:34:34,  7.97s/it]
 16%|█▌        | 6068/37963 [14:37:45<69:39:20,  7.86s/it]
 16%|█▌        | 6069/37963 [14:37:52<68:53:21,  7.78s/it]
 16%|█▌        | 6070/37963 [14:38:06<85:26:46,  9.64s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '1.717', 'learning_rate': '1.913e-05', 'epoch': '0.1599'}

 16%|█▌        | 6070/37963 [14:38:06<85:26:46,  9.64s/it]
 16%|█▌        | 6071/37963 [14:38:14<80:11:21,  9.05s/it]
 16%|█▌        | 6072/37963 [14:38:22<76:07:50,  8.59s/it]
 16%|█▌        | 6073/37963 [14:38:29<73:24:50,  8.29s/it]
 16%|█▌        | 6074/37963 [14:38:37<71:22:29,  8.06s/it]
 16%|█▌        | 6075/37963 [14:38:44<70:26:03,  7.95s/it]
 16%|█▌        | 6076/37963 [14:38:58<86:41:24,  9.79s/it]
 16%|█▌        | 6077/37963 [14:39:06<80:56:56,  9.14s/it]
 16%|█▌        | 6078/37963 [14:39:14<76:51:06,  8.68s/it]
 16%|█▌        | 6079/37963 [14:39:21<73:58:12,  8.35s/it]
 16%|█▌        | 6080/37963 [14:39:29<71:56:25,  8.12s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '3.984', 'learning_rate': '1.912e-05', 'epoch': '0.1602'}

 16%|█▌        | 6080/37963 [14:39:29<71:56:25,  8.12s/it]
 16%|█▌        | 6081/37963 [14:39:36<69:59:23,  7.90s/it]
 16%|█▌        | 6082/37963 [14:39:44<69:03:42,  7.80s/it]
 16%|█▌        | 6083/37963 [14:39:51<68:33:07,  7.74s/it]
 16%|█▌        | 6084/37963 [14:39:59<68:09:30,  7.70s/it]
 16%|█▌        | 6085/37963 [14:40:06<67:22:00,  7.61s/it]
 16%|█▌        | 6086/37963 [14:40:14<67:04:58,  7.58s/it]
 16%|█▌        | 6087/37963 [14:40:28<84:51:54,  9.58s/it]
 16%|█▌        | 6088/37963 [14:40:36<79:42:05,  9.00s/it]
 16%|█▌        | 6089/37963 [14:40:43<76:04:37,  8.59s/it]
 16%|█▌        | 6090/37963 [14:40:51<73:17:53,  8.28s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '4.571', 'learning_rate': '1.912e-05', 'epoch': '0.1604'}

 16%|█▌        | 6090/37963 [14:40:51<73:17:53,  8.28s/it]
 16%|█▌        | 6091/37963 [14:40:58<70:57:49,  8.02s/it]
 16%|█▌        | 6092/37963 [14:41:06<69:46:43,  7.88s/it]
 16%|█▌        | 6093/37963 [14:41:13<68:03:49,  7.69s/it]
 16%|█▌        | 6094/37963 [14:41:27<84:44:42,  9.57s/it]
 16%|█▌        | 6095/37963 [14:41:35<80:08:00,  9.05s/it]
 16%|█▌        | 6096/37963 [14:41:43<76:03:43,  8.59s/it]
 16%|█▌        | 6097/37963 [14:41:50<73:21:34,  8.29s/it]
 16%|█▌        | 6098/37963 [14:41:58<71:27:43,  8.07s/it]
 16%|█▌        | 6099/37963 [14:42:05<70:00:49,  7.91s/it]
 16%|█▌        | 6100/37963 [14:42:19<85:49:31,  9.70s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '3.514', 'learning_rate': '1.912e-05', 'epoch': '0.1607'}

 16%|█▌        | 6100/37963 [14:42:19<85:49:31,  9.70s/it]
 16%|█▌        | 6101/37963 [14:42:27<80:18:27,  9.07s/it]
 16%|█▌        | 6102/37963 [14:42:34<76:44:58,  8.67s/it]
 16%|█▌        | 6103/37963 [14:42:42<73:38:40,  8.32s/it]
 16%|█▌        | 6104/37963 [14:42:50<71:45:22,  8.11s/it]
 16%|█▌        | 6105/37963 [14:42:57<70:45:17,  8.00s/it]
 16%|█▌        | 6106/37963 [14:43:05<69:36:10,  7.87s/it]
 16%|█▌        | 6107/37963 [14:43:12<68:45:39,  7.77s/it]
 16%|█▌        | 6108/37963 [14:43:26<85:26:10,  9.66s/it]
 16%|█▌        | 6109/37963 [14:43:41<98:24:31, 11.12s/it]
 16%|█▌        | 6110/37963 [14:43:49<89:15:36, 10.09s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '2.396', 'learning_rate': '1.911e-05', 'epoch': '0.1609'}

 16%|█▌        | 6110/37963 [14:43:49<89:15:36, 10.09s/it]
 16%|█▌        | 6111/37963 [14:44:03<99:24:34, 11.24s/it]
 16%|█▌        | 6112/37963 [14:44:10<89:40:33, 10.14s/it]
 16%|█▌        | 6113/37963 [14:44:18<82:46:36,  9.36s/it]
 16%|█▌        | 6114/37963 [14:44:25<77:24:54,  8.75s/it]
 16%|█▌        | 6115/37963 [14:44:33<74:08:31,  8.38s/it]
 16%|█▌        | 6116/37963 [14:44:40<71:52:32,  8.12s/it]
 16%|█▌        | 6117/37963 [14:44:47<69:55:28,  7.90s/it]
 16%|█▌        | 6118/37963 [14:44:55<69:03:26,  7.81s/it]
 16%|█▌        | 6119/37963 [14:45:09<86:20:26,  9.76s/it]
 16%|█▌        | 6120/37963 [14:45:17<80:33:04,  9.11s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '1.842', 'learning_rate': '1.911e-05', 'epoch': '0.1612'}

 16%|█▌        | 6120/37963 [14:45:17<80:33:04,  9.11s/it]
 16%|█▌        | 6121/37963 [14:45:24<76:24:13,  8.64s/it]
 16%|█▌        | 6122/37963 [14:45:32<72:44:18,  8.22s/it]
 16%|█▌        | 6123/37963 [14:45:39<70:50:21,  8.01s/it]
 16%|█▌        | 6124/37963 [14:45:53<86:18:16,  9.76s/it]
 16%|█▌        | 6125/37963 [14:46:01<80:27:03,  9.10s/it]
 16%|█▌        | 6126/37963 [14:46:08<76:20:26,  8.63s/it]
 16%|█▌        | 6127/37963 [14:46:16<73:40:45,  8.33s/it]
 16%|█▌        | 6128/37963 [14:46:23<71:41:30,  8.11s/it]
 16%|█▌        | 6129/37963 [14:46:31<70:24:17,  7.96s/it]
 16%|█▌        | 6130/37963 [14:46:38<68:38:20,  7.76s/it]
                                                          
{'loss': '0.1573', 'grad_norm': '2.753', 'learning_rate': '1.911e-05', 'epoch': '0.1615'}

 16%|█▌        | 6130/37963 [14:46:38<68:38:20,  7.76s/it]
 16%|█▌        | 6131/37963 [14:46:46<68:10:05,  7.71s/it]
 16%|█▌        | 6132/37963 [14:47:00<84:24:55,  9.55s/it]
 16%|█▌        | 6133/37963 [14:47:07<79:28:58,  8.99s/it]
 16%|█▌        | 6134/37963 [14:47:15<75:22:46,  8.53s/it]
 16%|█▌        | 6135/37963 [14:47:22<73:00:39,  8.26s/it]
 16%|█▌        | 6136/37963 [14:47:30<71:07:55,  8.05s/it]
 16%|█▌        | 6137/37963 [14:47:38<69:39:33,  7.88s/it]
 16%|█▌        | 6138/37963 [14:47:45<67:49:27,  7.67s/it]
 16%|█▌        | 6139/37963 [14:47:52<66:30:35,  7.52s/it]
 16%|█▌        | 6140/37963 [14:47:59<66:18:40,  7.50s/it]
                                                          
{'loss': '0.1711', 'grad_norm': '1.677', 'learning_rate': '1.91e-05', 'epoch': '0.1617'}

 16%|█▌        | 6140/37963 [14:47:59<66:18:40,  7.50s/it]
 16%|█▌        | 6141/37963 [14:48:06<65:06:32,  7.37s/it]
 16%|█▌        | 6142/37963 [14:48:14<64:57:40,  7.35s/it]
 16%|█▌        | 6143/37963 [14:48:21<65:41:09,  7.43s/it]
 16%|█▌        | 6144/37963 [14:48:29<66:19:57,  7.50s/it]
 16%|█▌        | 6145/37963 [14:48:37<66:21:18,  7.51s/it]
 16%|█▌        | 6146/37963 [14:48:44<65:37:38,  7.43s/it]
 16%|█▌        | 6147/37963 [14:48:51<65:59:57,  7.47s/it]
 16%|█▌        | 6148/37963 [14:49:12<100:14:05, 11.34s/it]
 16%|█▌        | 6149/37963 [14:49:19<89:24:46, 10.12s/it] 
 16%|█▌        | 6150/37963 [14:49:26<82:34:12,  9.34s/it]
                                                          
{'loss': '0.1567', 'grad_norm': '3.501', 'learning_rate': '1.91e-05', 'epoch': '0.162'}

 16%|█▌        | 6150/37963 [14:49:26<82:34:12,  9.34s/it]
 16%|█▌        | 6151/37963 [14:49:34<77:09:33,  8.73s/it]
 16%|█▌        | 6152/37963 [14:49:41<73:17:30,  8.29s/it]
 16%|█▌        | 6153/37963 [14:49:49<71:15:19,  8.06s/it]
 16%|█▌        | 6154/37963 [14:49:56<69:29:26,  7.86s/it]
 16%|█▌        | 6155/37963 [14:50:04<68:39:28,  7.77s/it]
 16%|█▌        | 6156/37963 [14:50:11<68:02:58,  7.70s/it]
 16%|█▌        | 6157/37963 [14:50:25<84:17:04,  9.54s/it]
 16%|█▌        | 6158/37963 [14:50:45<113:01:32, 12.79s/it]
 16%|█▌        | 6159/37963 [14:50:53<99:03:59, 11.21s/it] 
 16%|█▌        | 6160/37963 [14:51:00<88:53:12, 10.06s/it]
                                                          
{'loss': '0.1648', 'grad_norm': '3.075', 'learning_rate': '1.91e-05', 'epoch': '0.1623'}

 16%|█▌        | 6160/37963 [14:51:00<88:53:12, 10.06s/it]
 16%|█▌        | 6161/37963 [14:51:07<81:24:47,  9.22s/it]
 16%|█▌        | 6162/37963 [14:51:15<76:09:46,  8.62s/it]
 16%|█▌        | 6163/37963 [14:51:22<73:31:20,  8.32s/it]
 16%|█▌        | 6164/37963 [14:51:30<71:19:47,  8.08s/it]
 16%|█▌        | 6165/37963 [14:51:37<69:44:56,  7.90s/it]
 16%|█▌        | 6166/37963 [14:51:45<67:59:29,  7.70s/it]
 16%|█▌        | 6167/37963 [14:51:59<84:47:55,  9.60s/it]
 16%|█▌        | 6168/37963 [14:52:06<78:37:33,  8.90s/it]
 16%|█▋        | 6169/37963 [14:52:13<74:41:41,  8.46s/it]
 16%|█▋        | 6170/37963 [14:52:21<72:05:58,  8.16s/it]
                                                          
{'loss': '0.1581', 'grad_norm': '2.729', 'learning_rate': '1.909e-05', 'epoch': '0.1625'}

 16%|█▋        | 6170/37963 [14:52:21<72:05:58,  8.16s/it]
 16%|█▋        | 6171/37963 [14:52:28<70:31:02,  7.99s/it]
 16%|█▋        | 6172/37963 [14:52:36<69:26:45,  7.86s/it]
 16%|█▋        | 6173/37963 [14:52:43<67:57:43,  7.70s/it]
 16%|█▋        | 6174/37963 [14:52:51<67:20:27,  7.63s/it]
 16%|█▋        | 6175/37963 [14:52:58<66:28:16,  7.53s/it]
 16%|█▋        | 6176/37963 [14:53:12<83:36:46,  9.47s/it]
 16%|█▋        | 6177/37963 [14:53:20<78:40:33,  8.91s/it]
 16%|█▋        | 6178/37963 [14:53:27<74:49:52,  8.48s/it]
 16%|█▋        | 6179/37963 [14:53:35<72:20:08,  8.19s/it]
 16%|█▋        | 6180/37963 [14:53:42<70:32:28,  7.99s/it]
                                                          
{'loss': '0.1779', 'grad_norm': '2.157', 'learning_rate': '1.909e-05', 'epoch': '0.1628'}

 16%|█▋        | 6180/37963 [14:53:42<70:32:28,  7.99s/it]
 16%|█▋        | 6181/37963 [14:53:50<69:20:57,  7.86s/it]
 16%|█▋        | 6182/37963 [14:53:57<68:16:57,  7.73s/it]
 16%|█▋        | 6183/37963 [14:54:04<66:49:06,  7.57s/it]
 16%|█▋        | 6184/37963 [14:54:18<83:43:13,  9.48s/it]
 16%|█▋        | 6185/37963 [14:54:26<79:01:04,  8.95s/it]
 16%|█▋        | 6186/37963 [14:54:33<75:17:47,  8.53s/it]
 16%|█▋        | 6187/37963 [14:54:41<72:49:17,  8.25s/it]
 16%|█▋        | 6188/37963 [14:54:49<71:18:29,  8.08s/it]
 16%|█▋        | 6189/37963 [14:54:56<69:50:30,  7.91s/it]
 16%|█▋        | 6190/37963 [14:55:04<69:07:27,  7.83s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.324', 'learning_rate': '1.909e-05', 'epoch': '0.1631'}

 16%|█▋        | 6190/37963 [14:55:04<69:07:27,  7.83s/it]
 16%|█▋        | 6191/37963 [14:55:11<68:26:14,  7.75s/it]
 16%|█▋        | 6192/37963 [14:55:19<67:42:13,  7.67s/it]
 16%|█▋        | 6193/37963 [14:55:26<67:13:13,  7.62s/it]
 16%|█▋        | 6194/37963 [14:55:34<66:49:47,  7.57s/it]
 16%|█▋        | 6195/37963 [14:55:48<83:12:54,  9.43s/it]
 16%|█▋        | 6196/37963 [14:55:55<77:51:02,  8.82s/it]
 16%|█▋        | 6197/37963 [14:56:09<91:08:18, 10.33s/it]
 16%|█▋        | 6198/37963 [14:56:17<83:54:28,  9.51s/it]
 16%|█▋        | 6199/37963 [14:56:24<78:45:51,  8.93s/it]
 16%|█▋        | 6200/37963 [14:56:32<75:17:49,  8.53s/it]
                                                          
{'loss': '0.1828', 'grad_norm': '8.514', 'learning_rate': '1.908e-05', 'epoch': '0.1633'}

 16%|█▋        | 6200/37963 [14:56:32<75:17:49,  8.53s/it]
 16%|█▋        | 6201/37963 [14:56:39<72:34:28,  8.23s/it]
 16%|█▋        | 6202/37963 [14:56:47<70:47:04,  8.02s/it]
 16%|█▋        | 6203/37963 [14:56:54<69:24:34,  7.87s/it]
 16%|█▋        | 6204/37963 [14:57:08<86:04:03,  9.76s/it]
 16%|█▋        | 6205/37963 [14:57:16<80:14:17,  9.10s/it]
 16%|█▋        | 6206/37963 [14:57:30<93:16:19, 10.57s/it]
 16%|█▋        | 6207/37963 [14:57:43<100:54:12, 11.44s/it]
 16%|█▋        | 6208/37963 [14:57:51<90:46:20, 10.29s/it] 
 16%|█▋        | 6209/37963 [14:57:59<83:19:37,  9.45s/it]
 16%|█▋        | 6210/37963 [14:58:06<78:13:31,  8.87s/it]
                                                          
{'loss': '0.1729', 'grad_norm': '3.538', 'learning_rate': '1.908e-05', 'epoch': '0.1636'}

 16%|█▋        | 6210/37963 [14:58:06<78:13:31,  8.87s/it]
 16%|█▋        | 6211/37963 [14:58:14<74:42:07,  8.47s/it]
 16%|█▋        | 6212/37963 [14:58:21<72:31:10,  8.22s/it]
 16%|█▋        | 6213/37963 [14:58:29<70:38:07,  8.01s/it]
 16%|█▋        | 6214/37963 [14:58:36<69:14:30,  7.85s/it]
 16%|█▋        | 6215/37963 [14:58:50<85:56:52,  9.75s/it]
 16%|█▋        | 6216/37963 [14:58:58<80:01:27,  9.07s/it]
 16%|█▋        | 6217/37963 [14:59:05<75:32:59,  8.57s/it]
 16%|█▋        | 6218/37963 [14:59:13<72:54:57,  8.27s/it]
 16%|█▋        | 6219/37963 [14:59:21<71:40:32,  8.13s/it]
 16%|█▋        | 6220/37963 [14:59:28<70:10:36,  7.96s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '1.734', 'learning_rate': '1.908e-05', 'epoch': '0.1638'}

 16%|█▋        | 6220/37963 [14:59:28<70:10:36,  7.96s/it]
 16%|█▋        | 6221/37963 [14:59:36<69:00:02,  7.83s/it]
 16%|█▋        | 6222/37963 [14:59:43<67:43:45,  7.68s/it]
 16%|█▋        | 6223/37963 [14:59:51<67:49:31,  7.69s/it]
 16%|█▋        | 6224/37963 [15:00:05<83:53:29,  9.52s/it]
 16%|█▋        | 6225/37963 [15:00:12<79:07:21,  8.97s/it]
 16%|█▋        | 6226/37963 [15:00:20<75:46:45,  8.60s/it]
 16%|█▋        | 6227/37963 [15:00:28<72:58:34,  8.28s/it]
 16%|█▋        | 6228/37963 [15:00:35<70:54:48,  8.04s/it]
 16%|█▋        | 6229/37963 [15:00:43<69:34:03,  7.89s/it]
 16%|█▋        | 6230/37963 [15:00:50<68:34:07,  7.78s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '1.603', 'learning_rate': '1.907e-05', 'epoch': '0.1641'}

 16%|█▋        | 6230/37963 [15:00:50<68:34:07,  7.78s/it]
 16%|█▋        | 6231/37963 [15:00:58<67:53:31,  7.70s/it]
 16%|█▋        | 6232/37963 [15:01:05<67:41:39,  7.68s/it]
 16%|█▋        | 6233/37963 [15:01:13<67:54:54,  7.71s/it]
 16%|█▋        | 6234/37963 [15:01:21<67:33:42,  7.67s/it]
 16%|█▋        | 6235/37963 [15:01:28<66:19:18,  7.53s/it]
 16%|█▋        | 6236/37963 [15:01:35<65:55:27,  7.48s/it]
 16%|█▋        | 6237/37963 [15:01:43<66:02:54,  7.49s/it]
 16%|█▋        | 6238/37963 [15:01:56<82:38:24,  9.38s/it]
 16%|█▋        | 6239/37963 [15:02:04<78:06:35,  8.86s/it]
 16%|█▋        | 6240/37963 [15:02:18<91:09:09, 10.34s/it]
                                                          
{'loss': '0.1599', 'grad_norm': '1.192', 'learning_rate': '1.907e-05', 'epoch': '0.1644'}

 16%|█▋        | 6240/37963 [15:02:18<91:09:09, 10.34s/it]
 16%|█▋        | 6241/37963 [15:02:25<83:45:57,  9.51s/it]
 16%|█▋        | 6242/37963 [15:02:33<78:39:29,  8.93s/it]
 16%|█▋        | 6243/37963 [15:02:41<74:57:42,  8.51s/it]
 16%|█▋        | 6244/37963 [15:02:48<72:18:21,  8.21s/it]
 16%|█▋        | 6245/37963 [15:02:56<70:35:42,  8.01s/it]
 16%|█▋        | 6246/37963 [15:03:10<86:10:14,  9.78s/it]
 16%|█▋        | 6247/37963 [15:03:17<80:24:18,  9.13s/it]
 16%|█▋        | 6248/37963 [15:03:25<76:26:43,  8.68s/it]
 16%|█▋        | 6249/37963 [15:03:32<72:33:59,  8.24s/it]
 16%|█▋        | 6250/37963 [15:03:46<88:11:05, 10.01s/it]
                                                          
{'loss': '0.1669', 'grad_norm': '5.072', 'learning_rate': '1.906e-05', 'epoch': '0.1646'}

 16%|█▋        | 6250/37963 [15:03:46<88:11:05, 10.01s/it]
 16%|█▋        | 6251/37963 [15:03:54<81:24:49,  9.24s/it]
 16%|█▋        | 6252/37963 [15:04:01<76:28:46,  8.68s/it]
 16%|█▋        | 6253/37963 [15:04:08<73:07:44,  8.30s/it]
 16%|█▋        | 6254/37963 [15:04:16<71:14:01,  8.09s/it]
 16%|█▋        | 6255/37963 [15:04:23<69:43:39,  7.92s/it]
 16%|█▋        | 6256/37963 [15:04:37<85:46:05,  9.74s/it]
 16%|█▋        | 6257/37963 [15:04:45<79:54:32,  9.07s/it]
 16%|█▋        | 6258/37963 [15:04:59<92:30:24, 10.50s/it]
 16%|█▋        | 6259/37963 [15:05:06<84:21:16,  9.58s/it]
 16%|█▋        | 6260/37963 [15:05:14<79:13:01,  9.00s/it]
                                                          
{'loss': '0.169', 'grad_norm': '3.574', 'learning_rate': '1.906e-05', 'epoch': '0.1649'}

 16%|█▋        | 6260/37963 [15:05:14<79:13:01,  9.00s/it]
 16%|█▋        | 6261/37963 [15:05:21<75:24:16,  8.56s/it]
 16%|█▋        | 6262/37963 [15:05:29<72:12:41,  8.20s/it]
 16%|█▋        | 6263/37963 [15:05:36<70:38:47,  8.02s/it]
 17%|█▋        | 6264/37963 [15:05:44<69:57:34,  7.95s/it]
 17%|█▋        | 6265/37963 [15:05:52<68:47:52,  7.81s/it]
 17%|█▋        | 6266/37963 [15:05:59<67:55:57,  7.72s/it]
 17%|█▋        | 6267/37963 [15:06:13<84:49:05,  9.63s/it]
 17%|█▋        | 6268/37963 [15:06:21<79:27:54,  9.03s/it]
 17%|█▋        | 6269/37963 [15:06:28<74:50:16,  8.50s/it]
 17%|█▋        | 6270/37963 [15:06:36<72:11:46,  8.20s/it]
                                                          
{'loss': '0.1795', 'grad_norm': '0.9834', 'learning_rate': '1.906e-05', 'epoch': '0.1652'}

 17%|█▋        | 6270/37963 [15:06:36<72:11:46,  8.20s/it]
 17%|█▋        | 6271/37963 [15:06:49<86:46:47,  9.86s/it]
 17%|█▋        | 6272/37963 [15:06:57<81:06:52,  9.21s/it]
 17%|█▋        | 6273/37963 [15:07:05<77:16:12,  8.78s/it]
 17%|█▋        | 6274/37963 [15:07:12<73:53:59,  8.40s/it]
 17%|█▋        | 6275/37963 [15:07:20<71:29:06,  8.12s/it]
 17%|█▋        | 6276/37963 [15:07:27<69:27:14,  7.89s/it]
 17%|█▋        | 6277/37963 [15:07:35<68:18:34,  7.76s/it]
 17%|█▋        | 6278/37963 [15:07:42<67:50:33,  7.71s/it]
 17%|█▋        | 6279/37963 [15:07:50<67:20:11,  7.65s/it]
 17%|█▋        | 6280/37963 [15:07:57<67:29:04,  7.67s/it]
                                                          
{'loss': '0.1745', 'grad_norm': '1.877', 'learning_rate': '1.905e-05', 'epoch': '0.1654'}

 17%|█▋        | 6280/37963 [15:07:57<67:29:04,  7.67s/it]
 17%|█▋        | 6281/37963 [15:08:05<66:42:02,  7.58s/it]
 17%|█▋        | 6282/37963 [15:08:12<66:05:22,  7.51s/it]
 17%|█▋        | 6283/37963 [15:08:20<66:06:35,  7.51s/it]
 17%|█▋        | 6284/37963 [15:08:34<83:46:06,  9.52s/it]
 17%|█▋        | 6285/37963 [15:08:42<79:05:00,  8.99s/it]
 17%|█▋        | 6286/37963 [15:08:49<74:44:29,  8.49s/it]
 17%|█▋        | 6287/37963 [15:08:56<70:48:58,  8.05s/it]
 17%|█▋        | 6288/37963 [15:09:03<69:03:20,  7.85s/it]
 17%|█▋        | 6289/37963 [15:09:11<67:31:32,  7.67s/it]
 17%|█▋        | 6290/37963 [15:09:18<67:20:41,  7.65s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '4.018', 'learning_rate': '1.905e-05', 'epoch': '0.1657'}

 17%|█▋        | 6290/37963 [15:09:18<67:20:41,  7.65s/it]
 17%|█▋        | 6291/37963 [15:09:26<67:26:24,  7.67s/it]
 17%|█▋        | 6292/37963 [15:09:40<84:24:24,  9.59s/it]
 17%|█▋        | 6293/37963 [15:09:54<95:56:48, 10.91s/it]
 17%|█▋        | 6294/37963 [15:10:02<86:55:05,  9.88s/it]
 17%|█▋        | 6295/37963 [15:10:15<97:26:41, 11.08s/it]
 17%|█▋        | 6296/37963 [15:10:23<87:58:07, 10.00s/it]
 17%|█▋        | 6297/37963 [15:10:30<80:57:23,  9.20s/it]
 17%|█▋        | 6298/37963 [15:10:38<76:57:04,  8.75s/it]
 17%|█▋        | 6299/37963 [15:10:45<73:54:04,  8.40s/it]
 17%|█▋        | 6300/37963 [15:10:53<71:32:08,  8.13s/it]
                                                          
{'loss': '0.1585', 'grad_norm': '4.041', 'learning_rate': '1.905e-05', 'epoch': '0.166'}

 17%|█▋        | 6300/37963 [15:10:53<71:32:08,  8.13s/it]
 17%|█▋        | 6301/37963 [15:11:00<69:44:06,  7.93s/it]
 17%|█▋        | 6302/37963 [15:11:08<68:59:44,  7.85s/it]
 17%|█▋        | 6303/37963 [15:11:22<84:53:24,  9.65s/it]
 17%|█▋        | 6304/37963 [15:11:30<79:27:05,  9.03s/it]
 17%|█▋        | 6305/37963 [15:11:37<75:15:05,  8.56s/it]
 17%|█▋        | 6306/37963 [15:11:51<89:36:15, 10.19s/it]
 17%|█▋        | 6307/37963 [15:11:59<83:00:20,  9.44s/it]
 17%|█▋        | 6308/37963 [15:12:06<78:35:40,  8.94s/it]
 17%|█▋        | 6309/37963 [15:12:14<75:10:54,  8.55s/it]
 17%|█▋        | 6310/37963 [15:12:22<72:45:53,  8.28s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '3.248', 'learning_rate': '1.904e-05', 'epoch': '0.1662'}

 17%|█▋        | 6310/37963 [15:12:22<72:45:53,  8.28s/it]
 17%|█▋        | 6311/37963 [15:12:29<70:51:36,  8.06s/it]
 17%|█▋        | 6312/37963 [15:12:37<70:01:24,  7.96s/it]
 17%|█▋        | 6313/37963 [15:12:45<69:32:46,  7.91s/it]
 17%|█▋        | 6314/37963 [15:12:52<67:52:10,  7.72s/it]
 17%|█▋        | 6315/37963 [15:13:00<67:38:16,  7.69s/it]
 17%|█▋        | 6316/37963 [15:13:07<67:19:19,  7.66s/it]
 17%|█▋        | 6317/37963 [15:13:21<84:09:29,  9.57s/it]
 17%|█▋        | 6318/37963 [15:13:29<79:13:42,  9.01s/it]
 17%|█▋        | 6319/37963 [15:13:37<75:17:24,  8.57s/it]
 17%|█▋        | 6320/37963 [15:13:44<72:24:53,  8.24s/it]
                                                          
{'loss': '0.1545', 'grad_norm': '1.711', 'learning_rate': '1.904e-05', 'epoch': '0.1665'}

 17%|█▋        | 6320/37963 [15:13:44<72:24:53,  8.24s/it]
 17%|█▋        | 6321/37963 [15:13:52<70:38:31,  8.04s/it]
 17%|█▋        | 6322/37963 [15:13:59<69:20:32,  7.89s/it]
 17%|█▋        | 6323/37963 [15:14:07<68:43:04,  7.82s/it]
 17%|█▋        | 6324/37963 [15:14:14<68:19:55,  7.78s/it]
 17%|█▋        | 6325/37963 [15:14:29<85:17:07,  9.70s/it]
 17%|█▋        | 6326/37963 [15:14:36<79:32:26,  9.05s/it]
 17%|█▋        | 6327/37963 [15:14:44<75:49:47,  8.63s/it]
 17%|█▋        | 6328/37963 [15:14:52<73:27:58,  8.36s/it]
 17%|█▋        | 6329/37963 [15:14:59<70:19:28,  8.00s/it]
 17%|█▋        | 6330/37963 [15:15:06<69:20:27,  7.89s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '2.435', 'learning_rate': '1.904e-05', 'epoch': '0.1667'}

 17%|█▋        | 6330/37963 [15:15:06<69:20:27,  7.89s/it]
 17%|█▋        | 6331/37963 [15:15:14<68:06:28,  7.75s/it]
 17%|█▋        | 6332/37963 [15:15:28<85:00:13,  9.67s/it]
 17%|█▋        | 6333/37963 [15:15:36<79:30:43,  9.05s/it]
 17%|█▋        | 6334/37963 [15:15:43<75:36:04,  8.60s/it]
 17%|█▋        | 6335/37963 [15:15:51<72:56:41,  8.30s/it]
 17%|█▋        | 6336/37963 [15:16:05<87:40:48,  9.98s/it]
 17%|█▋        | 6337/37963 [15:16:12<81:01:11,  9.22s/it]
 17%|█▋        | 6338/37963 [15:16:20<76:33:13,  8.71s/it]
 17%|█▋        | 6339/37963 [15:16:27<73:18:31,  8.35s/it]
 17%|█▋        | 6340/37963 [15:16:35<71:11:27,  8.10s/it]
                                                          
{'loss': '0.1594', 'grad_norm': '3.509', 'learning_rate': '1.903e-05', 'epoch': '0.167'}

 17%|█▋        | 6340/37963 [15:16:35<71:11:27,  8.10s/it]
 17%|█▋        | 6341/37963 [15:16:42<69:34:57,  7.92s/it]
 17%|█▋        | 6342/37963 [15:16:49<68:01:37,  7.74s/it]
 17%|█▋        | 6343/37963 [15:16:57<67:33:40,  7.69s/it]
 17%|█▋        | 6344/37963 [15:17:11<83:52:18,  9.55s/it]
 17%|█▋        | 6345/37963 [15:17:18<78:25:55,  8.93s/it]
 17%|█▋        | 6346/37963 [15:17:26<73:52:03,  8.41s/it]
 17%|█▋        | 6347/37963 [15:17:33<71:24:33,  8.13s/it]
 17%|█▋        | 6348/37963 [15:17:41<69:50:31,  7.95s/it]
 17%|█▋        | 6349/37963 [15:17:54<85:23:38,  9.72s/it]
 17%|█▋        | 6350/37963 [15:18:02<79:55:30,  9.10s/it]
                                                          
{'loss': '0.1575', 'grad_norm': '1.014', 'learning_rate': '1.903e-05', 'epoch': '0.1673'}

 17%|█▋        | 6350/37963 [15:18:02<79:55:30,  9.10s/it]
 17%|█▋        | 6351/37963 [15:18:10<76:08:25,  8.67s/it]
 17%|█▋        | 6352/37963 [15:18:17<72:03:11,  8.21s/it]
 17%|█▋        | 6353/37963 [15:18:24<70:03:40,  7.98s/it]
 17%|█▋        | 6354/37963 [15:18:39<86:41:13,  9.87s/it]
 17%|█▋        | 6355/37963 [15:18:46<80:55:34,  9.22s/it]
 17%|█▋        | 6356/37963 [15:19:00<92:01:05, 10.48s/it]
 17%|█▋        | 6357/37963 [15:19:07<83:07:03,  9.47s/it]
 17%|█▋        | 6358/37963 [15:19:15<78:27:15,  8.94s/it]
 17%|█▋        | 6359/37963 [15:19:22<74:59:39,  8.54s/it]
 17%|█▋        | 6360/37963 [15:19:30<72:19:06,  8.24s/it]
                                                          
{'loss': '0.1523', 'grad_norm': '2.362', 'learning_rate': '1.902e-05', 'epoch': '0.1675'}

 17%|█▋        | 6360/37963 [15:19:30<72:19:06,  8.24s/it]
 17%|█▋        | 6361/37963 [15:19:37<70:04:29,  7.98s/it]
 17%|█▋        | 6362/37963 [15:19:45<69:50:39,  7.96s/it]
 17%|█▋        | 6363/37963 [15:19:59<85:55:12,  9.79s/it]
 17%|█▋        | 6364/37963 [15:20:07<80:20:13,  9.15s/it]
 17%|█▋        | 6365/37963 [15:20:14<76:19:46,  8.70s/it]
 17%|█▋        | 6366/37963 [15:20:22<73:23:03,  8.36s/it]
 17%|█▋        | 6367/37963 [15:20:30<71:34:21,  8.15s/it]
 17%|█▋        | 6368/37963 [15:20:37<69:50:27,  7.96s/it]
 17%|█▋        | 6369/37963 [15:20:45<68:29:38,  7.80s/it]
 17%|█▋        | 6370/37963 [15:20:59<85:21:49,  9.73s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '2.125', 'learning_rate': '1.902e-05', 'epoch': '0.1678'}

 17%|█▋        | 6370/37963 [15:20:59<85:21:49,  9.73s/it]
 17%|█▋        | 6371/37963 [15:21:06<79:52:06,  9.10s/it]
 17%|█▋        | 6372/37963 [15:21:14<76:12:23,  8.68s/it]
 17%|█▋        | 6373/37963 [15:21:22<73:27:37,  8.37s/it]
 17%|█▋        | 6374/37963 [15:21:29<71:11:16,  8.11s/it]
 17%|█▋        | 6375/37963 [15:21:37<69:37:15,  7.93s/it]
 17%|█▋        | 6376/37963 [15:21:44<68:14:00,  7.78s/it]
 17%|█▋        | 6377/37963 [15:21:52<67:27:59,  7.69s/it]
 17%|█▋        | 6378/37963 [15:22:06<84:57:40,  9.68s/it]
 17%|█▋        | 6379/37963 [15:22:13<78:55:00,  9.00s/it]
 17%|█▋        | 6380/37963 [15:22:21<75:04:57,  8.56s/it]
                                                          
{'loss': '0.1568', 'grad_norm': '3.519', 'learning_rate': '1.902e-05', 'epoch': '0.1681'}

 17%|█▋        | 6380/37963 [15:22:21<75:04:57,  8.56s/it]
 17%|█▋        | 6381/37963 [15:22:29<72:33:56,  8.27s/it]
 17%|█▋        | 6382/37963 [15:22:36<70:03:49,  7.99s/it]
 17%|█▋        | 6383/37963 [15:22:43<68:56:14,  7.86s/it]
 17%|█▋        | 6384/37963 [15:22:51<67:48:50,  7.73s/it]
 17%|█▋        | 6385/37963 [15:23:05<84:52:07,  9.68s/it]
 17%|█▋        | 6386/37963 [15:23:13<79:07:11,  9.02s/it]
 17%|█▋        | 6387/37963 [15:23:20<74:34:04,  8.50s/it]
 17%|█▋        | 6388/37963 [15:23:27<72:02:51,  8.21s/it]
 17%|█▋        | 6389/37963 [15:23:35<70:25:22,  8.03s/it]
 17%|█▋        | 6390/37963 [15:23:42<68:51:07,  7.85s/it]
                                                          
{'loss': '0.1507', 'grad_norm': '2.039', 'learning_rate': '1.901e-05', 'epoch': '0.1683'}

 17%|█▋        | 6390/37963 [15:23:42<68:51:07,  7.85s/it]
 17%|█▋        | 6391/37963 [15:23:50<68:18:29,  7.79s/it]
 17%|█▋        | 6392/37963 [15:23:57<67:10:12,  7.66s/it]
 17%|█▋        | 6393/37963 [15:24:05<67:04:56,  7.65s/it]
 17%|█▋        | 6394/37963 [15:24:19<84:02:11,  9.58s/it]
 17%|█▋        | 6395/37963 [15:24:27<78:45:27,  8.98s/it]
 17%|█▋        | 6396/37963 [15:24:34<74:33:39,  8.50s/it]
 17%|█▋        | 6397/37963 [15:24:42<71:44:21,  8.18s/it]
 17%|█▋        | 6398/37963 [15:24:49<69:43:40,  7.95s/it]
 17%|█▋        | 6399/37963 [15:24:56<68:06:11,  7.77s/it]
 17%|█▋        | 6400/37963 [15:25:04<67:29:47,  7.70s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '5.27', 'learning_rate': '1.901e-05', 'epoch': '0.1686'}

 17%|█▋        | 6400/37963 [15:25:04<67:29:47,  7.70s/it]
 17%|█▋        | 6401/37963 [15:25:18<84:10:10,  9.60s/it]
 17%|█▋        | 6402/37963 [15:25:25<77:59:15,  8.90s/it]
 17%|█▋        | 6403/37963 [15:25:32<73:53:02,  8.43s/it]
 17%|█▋        | 6404/37963 [15:25:40<71:43:42,  8.18s/it]
 17%|█▋        | 6405/37963 [15:25:54<87:30:55,  9.98s/it]
 17%|█▋        | 6406/37963 [15:26:08<97:46:21, 11.15s/it]
 17%|█▋        | 6407/37963 [15:26:22<105:30:28, 12.04s/it]
 17%|█▋        | 6408/37963 [15:26:30<93:31:49, 10.67s/it] 
 17%|█▋        | 6409/37963 [15:26:37<85:34:48,  9.76s/it]
 17%|█▋        | 6410/37963 [15:26:45<79:42:20,  9.09s/it]
                                                          
{'loss': '0.1477', 'grad_norm': '2.254', 'learning_rate': '1.901e-05', 'epoch': '0.1688'}

 17%|█▋        | 6410/37963 [15:26:45<79:42:20,  9.09s/it]
 17%|█▋        | 6411/37963 [15:26:52<75:28:18,  8.61s/it]
 17%|█▋        | 6412/37963 [15:27:00<72:52:39,  8.32s/it]
 17%|█▋        | 6413/37963 [15:27:08<70:48:24,  8.08s/it]
 17%|█▋        | 6414/37963 [15:27:15<68:57:20,  7.87s/it]
 17%|█▋        | 6415/37963 [15:27:22<67:57:30,  7.75s/it]
 17%|█▋        | 6416/37963 [15:27:30<67:42:29,  7.73s/it]
 17%|█▋        | 6417/37963 [15:27:38<67:18:38,  7.68s/it]
 17%|█▋        | 6418/37963 [15:27:45<67:08:53,  7.66s/it]
 17%|█▋        | 6419/37963 [15:27:59<84:14:44,  9.61s/it]
 17%|█▋        | 6420/37963 [15:28:07<78:49:07,  9.00s/it]
                                                          
{'loss': '0.1566', 'grad_norm': '1.422', 'learning_rate': '1.9e-05', 'epoch': '0.1691'}

 17%|█▋        | 6420/37963 [15:28:07<78:49:07,  9.00s/it]
 17%|█▋        | 6421/37963 [15:28:15<74:55:21,  8.55s/it]
 17%|█▋        | 6422/37963 [15:28:22<72:04:54,  8.23s/it]
 17%|█▋        | 6423/37963 [15:28:30<70:22:13,  8.03s/it]
 17%|█▋        | 6424/37963 [15:28:37<69:31:57,  7.94s/it]
 17%|█▋        | 6425/37963 [15:28:45<68:31:27,  7.82s/it]
 17%|█▋        | 6426/37963 [15:28:59<84:29:06,  9.64s/it]
 17%|█▋        | 6427/37963 [15:29:06<79:11:33,  9.04s/it]
 17%|█▋        | 6428/37963 [15:29:14<75:24:36,  8.61s/it]
 17%|█▋        | 6429/37963 [15:29:21<72:31:52,  8.28s/it]
 17%|█▋        | 6430/37963 [15:29:29<70:36:01,  8.06s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '4.972', 'learning_rate': '1.9e-05', 'epoch': '0.1694'}

 17%|█▋        | 6430/37963 [15:29:29<70:36:01,  8.06s/it]
 17%|█▋        | 6431/37963 [15:29:37<69:25:29,  7.93s/it]
 17%|█▋        | 6432/37963 [15:29:44<68:25:16,  7.81s/it]
 17%|█▋        | 6433/37963 [15:29:52<67:44:58,  7.74s/it]
 17%|█▋        | 6434/37963 [15:29:59<67:09:29,  7.67s/it]
 17%|█▋        | 6435/37963 [15:30:07<66:44:37,  7.62s/it]
 17%|█▋        | 6436/37963 [15:30:14<66:31:09,  7.60s/it]
 17%|█▋        | 6437/37963 [15:30:22<66:03:01,  7.54s/it]
 17%|█▋        | 6438/37963 [15:30:29<66:01:26,  7.54s/it]
 17%|█▋        | 6439/37963 [15:30:43<82:17:16,  9.40s/it]
 17%|█▋        | 6440/37963 [15:30:51<77:37:29,  8.86s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '2.08', 'learning_rate': '1.9e-05', 'epoch': '0.1696'}

 17%|█▋        | 6440/37963 [15:30:51<77:37:29,  8.86s/it]
 17%|█▋        | 6441/37963 [15:30:58<74:14:01,  8.48s/it]
 17%|█▋        | 6442/37963 [15:31:06<71:48:20,  8.20s/it]
 17%|█▋        | 6443/37963 [15:31:13<69:47:47,  7.97s/it]
 17%|█▋        | 6444/37963 [15:31:21<69:09:33,  7.90s/it]
 17%|█▋        | 6445/37963 [15:31:35<85:12:47,  9.73s/it]
 17%|█▋        | 6446/37963 [15:31:43<79:57:03,  9.13s/it]
 17%|█▋        | 6447/37963 [15:31:50<75:44:44,  8.65s/it]
 17%|█▋        | 6448/37963 [15:32:04<90:01:00, 10.28s/it]
 17%|█▋        | 6449/37963 [15:32:12<82:50:11,  9.46s/it]
 17%|█▋        | 6450/37963 [15:32:19<77:39:06,  8.87s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '4.357', 'learning_rate': '1.899e-05', 'epoch': '0.1699'}

 17%|█▋        | 6450/37963 [15:32:19<77:39:06,  8.87s/it]
 17%|█▋        | 6451/37963 [15:32:27<74:24:42,  8.50s/it]
 17%|█▋        | 6452/37963 [15:32:34<71:35:09,  8.18s/it]
 17%|█▋        | 6453/37963 [15:32:48<87:12:42,  9.96s/it]
 17%|█▋        | 6454/37963 [15:32:56<81:05:27,  9.26s/it]
 17%|█▋        | 6455/37963 [15:33:10<93:32:52, 10.69s/it]
 17%|█▋        | 6456/37963 [15:33:24<102:53:31, 11.76s/it]
 17%|█▋        | 6457/37963 [15:33:32<91:44:02, 10.48s/it] 
 17%|█▋        | 6458/37963 [15:33:39<83:14:40,  9.51s/it]
 17%|█▋        | 6459/37963 [15:33:47<77:52:34,  8.90s/it]
 17%|█▋        | 6460/37963 [15:33:54<73:49:29,  8.44s/it]
                                                          
{'loss': '0.19', 'grad_norm': '1.409', 'learning_rate': '1.899e-05', 'epoch': '0.1702'}

 17%|█▋        | 6460/37963 [15:33:54<73:49:29,  8.44s/it]
 17%|█▋        | 6461/37963 [15:34:02<71:31:12,  8.17s/it]
 17%|█▋        | 6462/37963 [15:34:09<69:50:16,  7.98s/it]
 17%|█▋        | 6463/37963 [15:34:17<68:35:27,  7.84s/it]
 17%|█▋        | 6464/37963 [15:34:24<67:42:03,  7.74s/it]
 17%|█▋        | 6465/37963 [15:34:38<84:10:15,  9.62s/it]
 17%|█▋        | 6466/37963 [15:34:46<78:52:55,  9.02s/it]
 17%|█▋        | 6467/37963 [15:34:53<75:19:16,  8.61s/it]
 17%|█▋        | 6468/37963 [15:35:01<72:27:10,  8.28s/it]
 17%|█▋        | 6469/37963 [15:35:08<70:32:11,  8.06s/it]
 17%|█▋        | 6470/37963 [15:35:16<69:13:32,  7.91s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '5.923', 'learning_rate': '1.898e-05', 'epoch': '0.1704'}

 17%|█▋        | 6470/37963 [15:35:16<69:13:32,  7.91s/it]
 17%|█▋        | 6471/37963 [15:35:24<68:33:43,  7.84s/it]
 17%|█▋        | 6472/37963 [15:35:38<84:29:49,  9.66s/it]
 17%|█▋        | 6473/37963 [15:35:45<78:29:46,  8.97s/it]
 17%|█▋        | 6474/37963 [15:35:53<74:56:55,  8.57s/it]
 17%|█▋        | 6475/37963 [15:36:00<72:51:16,  8.33s/it]
 17%|█▋        | 6476/37963 [15:36:08<70:41:02,  8.08s/it]
 17%|█▋        | 6477/37963 [15:36:15<69:30:50,  7.95s/it]
 17%|█▋        | 6478/37963 [15:36:23<67:37:16,  7.73s/it]
 17%|█▋        | 6479/37963 [15:36:30<67:27:33,  7.71s/it]
 17%|█▋        | 6480/37963 [15:36:38<66:32:39,  7.61s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '4.184', 'learning_rate': '1.898e-05', 'epoch': '0.1707'}

 17%|█▋        | 6480/37963 [15:36:38<66:32:39,  7.61s/it]
 17%|█▋        | 6481/37963 [15:36:45<66:19:47,  7.58s/it]
 17%|█▋        | 6482/37963 [15:36:53<66:38:20,  7.62s/it]
 17%|█▋        | 6483/37963 [15:37:00<66:16:11,  7.58s/it]
 17%|█▋        | 6484/37963 [15:37:08<66:27:31,  7.60s/it]
 17%|█▋        | 6485/37963 [15:37:15<65:21:22,  7.47s/it]
 17%|█▋        | 6486/37963 [15:37:23<65:36:32,  7.50s/it]
 17%|█▋        | 6487/37963 [15:37:30<65:19:30,  7.47s/it]
 17%|█▋        | 6488/37963 [15:37:44<81:21:59,  9.31s/it]
 17%|█▋        | 6489/37963 [15:37:51<75:56:39,  8.69s/it]
 17%|█▋        | 6490/37963 [15:37:59<72:53:39,  8.34s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '4.003', 'learning_rate': '1.898e-05', 'epoch': '0.171'}

 17%|█▋        | 6490/37963 [15:37:59<72:53:39,  8.34s/it]
 17%|█▋        | 6491/37963 [15:38:06<70:55:15,  8.11s/it]
 17%|█▋        | 6492/37963 [15:38:14<69:23:22,  7.94s/it]
 17%|█▋        | 6493/37963 [15:38:21<66:59:13,  7.66s/it]
 17%|█▋        | 6494/37963 [15:38:35<83:18:26,  9.53s/it]
 17%|█▋        | 6495/37963 [15:38:42<78:11:01,  8.94s/it]
 17%|█▋        | 6496/37963 [15:38:50<74:31:55,  8.53s/it]
 17%|█▋        | 6497/37963 [15:38:57<71:56:48,  8.23s/it]
 17%|█▋        | 6498/37963 [15:39:05<69:37:12,  7.97s/it]
 17%|█▋        | 6499/37963 [15:39:12<68:00:08,  7.78s/it]
 17%|█▋        | 6500/37963 [15:39:26<84:23:13,  9.66s/it]
                                                          
{'loss': '0.1706', 'grad_norm': '3.177', 'learning_rate': '1.897e-05', 'epoch': '0.1712'}

 17%|█▋        | 6500/37963 [15:39:26<84:23:13,  9.66s/it]
 17%|█▋        | 6501/37963 [15:39:34<78:42:59,  9.01s/it]
 17%|█▋        | 6502/37963 [15:39:41<75:19:39,  8.62s/it]
 17%|█▋        | 6503/37963 [15:39:49<72:24:45,  8.29s/it]
 17%|█▋        | 6504/37963 [15:39:56<70:10:08,  8.03s/it]
 17%|█▋        | 6505/37963 [15:40:10<86:08:12,  9.86s/it]
 17%|█▋        | 6506/37963 [15:40:18<79:19:08,  9.08s/it]
 17%|█▋        | 6507/37963 [15:40:31<91:12:41, 10.44s/it]
 17%|█▋        | 6508/37963 [15:40:39<83:57:13,  9.61s/it]
 17%|█▋        | 6509/37963 [15:40:46<78:26:46,  8.98s/it]
 17%|█▋        | 6510/37963 [15:40:54<74:25:32,  8.52s/it]
                                                          
{'loss': '0.1638', 'grad_norm': '6.731', 'learning_rate': '1.897e-05', 'epoch': '0.1715'}

 17%|█▋        | 6510/37963 [15:40:54<74:25:32,  8.52s/it]
 17%|█▋        | 6511/37963 [15:41:08<88:20:46, 10.11s/it]
 17%|█▋        | 6512/37963 [15:41:15<81:39:39,  9.35s/it]
 17%|█▋        | 6513/37963 [15:41:23<76:42:21,  8.78s/it]
 17%|█▋        | 6514/37963 [15:41:30<73:40:31,  8.43s/it]
 17%|█▋        | 6515/37963 [15:41:37<70:12:32,  8.04s/it]
 17%|█▋        | 6516/37963 [15:41:45<68:59:47,  7.90s/it]
 17%|█▋        | 6517/37963 [15:41:52<67:52:59,  7.77s/it]
 17%|█▋        | 6518/37963 [15:42:00<67:11:48,  7.69s/it]
 17%|█▋        | 6519/37963 [15:42:07<65:54:48,  7.55s/it]
 17%|█▋        | 6520/37963 [15:42:15<66:05:34,  7.57s/it]
                                                          
{'loss': '0.167', 'grad_norm': '1.553', 'learning_rate': '1.897e-05', 'epoch': '0.1717'}

 17%|█▋        | 6520/37963 [15:42:15<66:05:34,  7.57s/it]
 17%|█▋        | 6521/37963 [15:42:22<65:59:41,  7.56s/it]
 17%|█▋        | 6522/37963 [15:42:36<82:17:33,  9.42s/it]
 17%|█▋        | 6523/37963 [15:42:44<77:47:03,  8.91s/it]
 17%|█▋        | 6524/37963 [15:42:51<74:06:11,  8.49s/it]
 17%|█▋        | 6525/37963 [15:42:59<71:53:33,  8.23s/it]
 17%|█▋        | 6526/37963 [15:43:06<69:47:38,  7.99s/it]
 17%|█▋        | 6527/37963 [15:43:14<68:55:12,  7.89s/it]
 17%|█▋        | 6528/37963 [15:43:21<67:18:02,  7.71s/it]
 17%|█▋        | 6529/37963 [15:43:29<66:54:46,  7.66s/it]
 17%|█▋        | 6530/37963 [15:43:36<66:26:43,  7.61s/it]
                                                          
{'loss': '0.1683', 'grad_norm': '2.447', 'learning_rate': '1.896e-05', 'epoch': '0.172'}

 17%|█▋        | 6530/37963 [15:43:36<66:26:43,  7.61s/it]
 17%|█▋        | 6531/37963 [15:43:44<66:20:14,  7.60s/it]
 17%|█▋        | 6532/37963 [15:43:51<66:00:31,  7.56s/it]
 17%|█▋        | 6533/37963 [15:44:05<82:19:27,  9.43s/it]
 17%|█▋        | 6534/37963 [15:44:12<76:41:32,  8.78s/it]
 17%|█▋        | 6535/37963 [15:44:20<72:42:59,  8.33s/it]
 17%|█▋        | 6536/37963 [15:44:27<70:33:18,  8.08s/it]
 17%|█▋        | 6537/37963 [15:44:35<69:21:32,  7.95s/it]
 17%|█▋        | 6538/37963 [15:44:42<68:36:53,  7.86s/it]
 17%|█▋        | 6539/37963 [15:44:50<67:17:35,  7.71s/it]
 17%|█▋        | 6540/37963 [15:45:04<83:26:17,  9.56s/it]
                                                          
{'loss': '0.1748', 'grad_norm': '1.951', 'learning_rate': '1.896e-05', 'epoch': '0.1723'}

 17%|█▋        | 6540/37963 [15:45:04<83:26:17,  9.56s/it]
 17%|█▋        | 6541/37963 [15:45:18<95:06:55, 10.90s/it]
 17%|█▋        | 6542/37963 [15:45:25<86:17:19,  9.89s/it]
 17%|█▋        | 6543/37963 [15:45:33<79:34:57,  9.12s/it]
 17%|█▋        | 6544/37963 [15:45:40<74:37:43,  8.55s/it]
 17%|█▋        | 6545/37963 [15:45:47<71:50:24,  8.23s/it]
 17%|█▋        | 6546/37963 [15:45:55<70:27:36,  8.07s/it]
 17%|█▋        | 6547/37963 [15:46:03<69:15:28,  7.94s/it]
 17%|█▋        | 6548/37963 [15:46:10<67:56:09,  7.79s/it]
 17%|█▋        | 6549/37963 [15:46:17<66:46:19,  7.65s/it]
 17%|█▋        | 6550/37963 [15:46:31<83:17:53,  9.55s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '1.644', 'learning_rate': '1.895e-05', 'epoch': '0.1725'}

 17%|█▋        | 6550/37963 [15:46:31<83:17:53,  9.55s/it]
 17%|█▋        | 6551/37963 [15:46:39<78:13:45,  8.97s/it]
 17%|█▋        | 6552/37963 [15:46:46<74:02:03,  8.49s/it]
 17%|█▋        | 6553/37963 [15:46:54<71:12:28,  8.16s/it]
 17%|█▋        | 6554/37963 [15:47:08<86:43:38,  9.94s/it]
 17%|█▋        | 6555/37963 [15:47:22<97:07:05, 11.13s/it]
 17%|█▋        | 6556/37963 [15:47:29<87:38:41, 10.05s/it]
 17%|█▋        | 6557/37963 [15:47:37<81:20:06,  9.32s/it]
 17%|█▋        | 6558/37963 [15:47:44<76:12:13,  8.74s/it]
 17%|█▋        | 6559/37963 [15:47:52<73:13:58,  8.40s/it]
 17%|█▋        | 6560/37963 [15:47:59<71:00:45,  8.14s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '1.991', 'learning_rate': '1.895e-05', 'epoch': '0.1728'}

 17%|█▋        | 6560/37963 [15:47:59<71:00:45,  8.14s/it]
 17%|█▋        | 6561/37963 [15:48:07<69:20:26,  7.95s/it]
 17%|█▋        | 6562/37963 [15:48:15<68:30:42,  7.85s/it]
 17%|█▋        | 6563/37963 [15:48:29<85:14:04,  9.77s/it]
 17%|█▋        | 6564/37963 [15:48:37<80:15:57,  9.20s/it]
 17%|█▋        | 6565/37963 [15:48:44<75:46:06,  8.69s/it]
 17%|█▋        | 6566/37963 [15:48:52<72:28:16,  8.31s/it]
 17%|█▋        | 6567/37963 [15:48:59<70:32:38,  8.09s/it]
 17%|█▋        | 6568/37963 [15:49:13<86:46:22,  9.95s/it]
 17%|█▋        | 6569/37963 [15:49:21<81:21:11,  9.33s/it]
 17%|█▋        | 6570/37963 [15:49:29<76:55:55,  8.82s/it]
                                                          
{'loss': '0.16', 'grad_norm': '2.312', 'learning_rate': '1.895e-05', 'epoch': '0.1731'}

 17%|█▋        | 6570/37963 [15:49:29<76:55:55,  8.82s/it]
 17%|█▋        | 6571/37963 [15:49:37<73:48:57,  8.47s/it]
 17%|█▋        | 6572/37963 [15:49:44<71:59:18,  8.26s/it]
 17%|█▋        | 6573/37963 [15:49:52<70:09:17,  8.05s/it]
 17%|█▋        | 6574/37963 [15:50:00<68:55:41,  7.91s/it]
 17%|█▋        | 6575/37963 [15:50:07<67:16:18,  7.72s/it]
 17%|█▋        | 6576/37963 [15:50:14<66:46:20,  7.66s/it]
 17%|█▋        | 6577/37963 [15:50:22<66:54:42,  7.67s/it]
 17%|█▋        | 6578/37963 [15:50:30<67:36:56,  7.76s/it]
 17%|█▋        | 6579/37963 [15:50:37<67:01:40,  7.69s/it]
 17%|█▋        | 6580/37963 [15:50:45<66:34:20,  7.64s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '1.371', 'learning_rate': '1.894e-05', 'epoch': '0.1733'}

 17%|█▋        | 6580/37963 [15:50:45<66:34:20,  7.64s/it]
 17%|█▋        | 6581/37963 [15:50:53<66:16:08,  7.60s/it]
 17%|█▋        | 6582/37963 [15:51:06<82:24:29,  9.45s/it]
 17%|█▋        | 6583/37963 [15:51:14<76:52:29,  8.82s/it]
 17%|█▋        | 6584/37963 [15:51:21<73:28:14,  8.43s/it]
 17%|█▋        | 6585/37963 [15:51:29<71:04:42,  8.15s/it]
 17%|█▋        | 6586/37963 [15:51:36<69:35:58,  7.99s/it]
 17%|█▋        | 6587/37963 [15:51:44<67:56:07,  7.79s/it]
 17%|█▋        | 6588/37963 [15:51:57<83:45:30,  9.61s/it]
 17%|█▋        | 6589/37963 [15:52:11<95:00:37, 10.90s/it]
 17%|█▋        | 6590/37963 [15:52:19<86:13:59,  9.90s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '3.35', 'learning_rate': '1.894e-05', 'epoch': '0.1736'}

 17%|█▋        | 6590/37963 [15:52:19<86:13:59,  9.90s/it]
 17%|█▋        | 6591/37963 [15:52:26<79:58:11,  9.18s/it]
 17%|█▋        | 6592/37963 [15:52:34<75:31:32,  8.67s/it]
 17%|█▋        | 6593/37963 [15:52:41<72:33:06,  8.33s/it]
 17%|█▋        | 6594/37963 [15:52:49<70:20:22,  8.07s/it]
 17%|█▋        | 6595/37963 [15:52:56<68:43:55,  7.89s/it]
 17%|█▋        | 6596/37963 [15:53:04<67:47:41,  7.78s/it]
 17%|█▋        | 6597/37963 [15:53:11<67:07:15,  7.70s/it]
 17%|█▋        | 6598/37963 [15:53:19<66:19:59,  7.61s/it]
 17%|█▋        | 6599/37963 [15:53:26<66:08:29,  7.59s/it]
 17%|█▋        | 6600/37963 [15:53:34<65:53:12,  7.56s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '1.868', 'learning_rate': '1.893e-05', 'epoch': '0.1739'}

 17%|█▋        | 6600/37963 [15:53:34<65:53:12,  7.56s/it]
 17%|█▋        | 6601/37963 [15:53:48<82:57:32,  9.52s/it]
 17%|█▋        | 6602/37963 [15:53:55<77:16:29,  8.87s/it]
 17%|█▋        | 6603/37963 [15:54:10<91:15:59, 10.48s/it]
 17%|█▋        | 6604/37963 [15:54:23<99:18:56, 11.40s/it]
 17%|█▋        | 6605/37963 [15:54:31<88:56:19, 10.21s/it]
 17%|█▋        | 6606/37963 [15:54:38<81:55:00,  9.40s/it]
 17%|█▋        | 6607/37963 [15:54:45<76:04:49,  8.73s/it]
 17%|█▋        | 6608/37963 [15:54:53<72:57:49,  8.38s/it]
 17%|█▋        | 6609/37963 [15:55:00<70:20:30,  8.08s/it]
 17%|█▋        | 6610/37963 [15:55:14<86:02:50,  9.88s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '2.17', 'learning_rate': '1.893e-05', 'epoch': '0.1741'}

 17%|█▋        | 6610/37963 [15:55:14<86:02:50,  9.88s/it]
 17%|█▋        | 6611/37963 [15:55:22<80:00:49,  9.19s/it]
 17%|█▋        | 6612/37963 [15:55:29<75:39:28,  8.69s/it]
 17%|█▋        | 6613/37963 [15:55:37<72:52:39,  8.37s/it]
 17%|█▋        | 6614/37963 [15:55:45<70:45:55,  8.13s/it]
 17%|█▋        | 6615/37963 [15:55:52<69:08:32,  7.94s/it]
 17%|█▋        | 6616/37963 [15:56:00<68:09:03,  7.83s/it]
 17%|█▋        | 6617/37963 [15:56:07<67:41:31,  7.77s/it]
 17%|█▋        | 6618/37963 [15:56:15<67:03:21,  7.70s/it]
 17%|█▋        | 6619/37963 [15:56:29<83:38:24,  9.61s/it]
 17%|█▋        | 6620/37963 [15:56:36<78:25:24,  9.01s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '4.614', 'learning_rate': '1.893e-05', 'epoch': '0.1744'}

 17%|█▋        | 6620/37963 [15:56:36<78:25:24,  9.01s/it]
 17%|█▋        | 6621/37963 [15:56:44<74:26:48,  8.55s/it]
 17%|█▋        | 6622/37963 [15:56:51<71:14:58,  8.18s/it]
 17%|█▋        | 6623/37963 [15:56:59<69:26:47,  7.98s/it]
 17%|█▋        | 6624/37963 [15:57:06<68:11:40,  7.83s/it]
 17%|█▋        | 6625/37963 [15:57:20<83:27:21,  9.59s/it]
 17%|█▋        | 6626/37963 [15:57:28<78:15:02,  8.99s/it]
 17%|█▋        | 6627/37963 [15:57:35<74:28:43,  8.56s/it]
 17%|█▋        | 6628/37963 [15:57:43<71:58:02,  8.27s/it]
 17%|█▋        | 6629/37963 [15:57:50<69:30:05,  7.99s/it]
 17%|█▋        | 6630/37963 [15:57:57<68:16:25,  7.84s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '2.403', 'learning_rate': '1.892e-05', 'epoch': '0.1746'}

 17%|█▋        | 6630/37963 [15:57:57<68:16:25,  7.84s/it]
 17%|█▋        | 6631/37963 [15:58:05<67:47:30,  7.79s/it]
 17%|█▋        | 6632/37963 [15:58:13<67:20:53,  7.74s/it]
 17%|█▋        | 6633/37963 [15:58:27<84:03:14,  9.66s/it]
 17%|█▋        | 6634/37963 [15:58:41<95:37:21, 10.99s/it]
 17%|█▋        | 6635/37963 [15:58:49<86:41:29,  9.96s/it]
 17%|█▋        | 6636/37963 [15:58:56<80:22:15,  9.24s/it]
 17%|█▋        | 6637/37963 [15:59:04<76:08:49,  8.75s/it]
 17%|█▋        | 6638/37963 [15:59:11<73:09:00,  8.41s/it]
 17%|█▋        | 6639/37963 [15:59:19<70:47:35,  8.14s/it]
 17%|█▋        | 6640/37963 [15:59:26<69:10:51,  7.95s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '5.239', 'learning_rate': '1.892e-05', 'epoch': '0.1749'}

 17%|█▋        | 6640/37963 [15:59:26<69:10:51,  7.95s/it]
 17%|█▋        | 6641/37963 [15:59:34<68:11:25,  7.84s/it]
 17%|█▋        | 6642/37963 [15:59:41<66:26:40,  7.64s/it]
 17%|█▋        | 6643/37963 [15:59:49<66:02:44,  7.59s/it]
 18%|█▊        | 6644/37963 [15:59:56<65:19:49,  7.51s/it]
 18%|█▊        | 6645/37963 [16:00:03<64:20:28,  7.40s/it]
 18%|█▊        | 6646/37963 [16:00:11<64:57:35,  7.47s/it]
 18%|█▊        | 6647/37963 [16:00:18<65:02:56,  7.48s/it]
 18%|█▊        | 6648/37963 [16:00:26<64:59:14,  7.47s/it]
 18%|█▊        | 6649/37963 [16:00:33<65:06:04,  7.48s/it]
 18%|█▊        | 6650/37963 [16:00:47<82:34:35,  9.49s/it]
                                                          
{'loss': '0.1481', 'grad_norm': '0.8933', 'learning_rate': '1.892e-05', 'epoch': '0.1752'}

 18%|█▊        | 6650/37963 [16:00:47<82:34:35,  9.49s/it]
 18%|█▊        | 6651/37963 [16:01:01<94:07:54, 10.82s/it]
 18%|█▊        | 6652/37963 [16:01:09<85:11:16,  9.79s/it]
 18%|█▊        | 6653/37963 [16:01:23<96:08:25, 11.05s/it]
 18%|█▊        | 6654/37963 [16:01:30<87:04:24, 10.01s/it]
 18%|█▊        | 6655/37963 [16:01:38<81:01:34,  9.32s/it]
 18%|█▊        | 6656/37963 [16:01:52<93:06:09, 10.71s/it]
 18%|█▊        | 6657/37963 [16:01:59<84:47:27,  9.75s/it]
 18%|█▊        | 6658/37963 [16:02:07<79:02:23,  9.09s/it]
 18%|█▊        | 6659/37963 [16:02:15<75:10:16,  8.64s/it]
 18%|█▊        | 6660/37963 [16:02:22<72:22:32,  8.32s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '4.977', 'learning_rate': '1.891e-05', 'epoch': '0.1754'}

 18%|█▊        | 6660/37963 [16:02:22<72:22:32,  8.32s/it]
 18%|█▊        | 6661/37963 [16:02:30<70:17:30,  8.08s/it]
 18%|█▊        | 6662/37963 [16:02:37<68:42:19,  7.90s/it]
 18%|█▊        | 6663/37963 [16:02:45<67:45:11,  7.79s/it]
 18%|█▊        | 6664/37963 [16:02:52<66:59:07,  7.70s/it]
 18%|█▊        | 6665/37963 [16:03:06<83:33:23,  9.61s/it]
 18%|█▊        | 6666/37963 [16:03:14<77:58:37,  8.97s/it]
 18%|█▊        | 6667/37963 [16:03:21<74:22:04,  8.55s/it]
 18%|█▊        | 6668/37963 [16:03:29<71:36:11,  8.24s/it]
 18%|█▊        | 6669/37963 [16:03:36<68:55:34,  7.93s/it]
 18%|█▊        | 6670/37963 [16:03:44<68:01:08,  7.83s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '1.829', 'learning_rate': '1.891e-05', 'epoch': '0.1757'}

 18%|█▊        | 6670/37963 [16:03:44<68:01:08,  7.83s/it]
 18%|█▊        | 6671/37963 [16:03:51<67:22:01,  7.75s/it]
 18%|█▊        | 6672/37963 [16:04:05<83:43:06,  9.63s/it]
 18%|█▊        | 6673/37963 [16:04:13<78:06:53,  8.99s/it]
 18%|█▊        | 6674/37963 [16:04:20<74:20:07,  8.55s/it]
 18%|█▊        | 6675/37963 [16:04:28<71:32:56,  8.23s/it]
 18%|█▊        | 6676/37963 [16:04:35<69:44:17,  8.02s/it]
 18%|█▊        | 6677/37963 [16:04:43<68:49:34,  7.92s/it]
 18%|█▊        | 6678/37963 [16:04:50<67:59:28,  7.82s/it]
 18%|█▊        | 6679/37963 [16:04:58<67:27:12,  7.76s/it]
 18%|█▊        | 6680/37963 [16:05:06<67:13:35,  7.74s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '3.453', 'learning_rate': '1.89e-05', 'epoch': '0.176'}

 18%|█▊        | 6680/37963 [16:05:06<67:13:35,  7.74s/it]
 18%|█▊        | 6681/37963 [16:05:13<66:28:37,  7.65s/it]
 18%|█▊        | 6682/37963 [16:05:21<66:06:17,  7.61s/it]
 18%|█▊        | 6683/37963 [16:05:35<82:58:46,  9.55s/it]
 18%|█▊        | 6684/37963 [16:05:42<77:39:38,  8.94s/it]
 18%|█▊        | 6685/37963 [16:05:50<73:25:59,  8.45s/it]
 18%|█▊        | 6686/37963 [16:06:03<87:22:20, 10.06s/it]
 18%|█▊        | 6687/37963 [16:06:11<81:23:03,  9.37s/it]
 18%|█▊        | 6688/37963 [16:06:18<75:54:04,  8.74s/it]
 18%|█▊        | 6689/37963 [16:06:26<72:43:36,  8.37s/it]
 18%|█▊        | 6690/37963 [16:06:34<70:37:06,  8.13s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '4.003', 'learning_rate': '1.89e-05', 'epoch': '0.1762'}

 18%|█▊        | 6690/37963 [16:06:34<70:37:06,  8.13s/it]
 18%|█▊        | 6691/37963 [16:06:41<69:12:10,  7.97s/it]
 18%|█▊        | 6692/37963 [16:06:49<67:55:45,  7.82s/it]
 18%|█▊        | 6693/37963 [16:06:56<67:16:54,  7.75s/it]
 18%|█▊        | 6694/37963 [16:07:04<66:38:40,  7.67s/it]
 18%|█▊        | 6695/37963 [16:07:11<65:51:46,  7.58s/it]
 18%|█▊        | 6696/37963 [16:07:19<65:39:55,  7.56s/it]
 18%|█▊        | 6697/37963 [16:07:26<65:08:35,  7.50s/it]
 18%|█▊        | 6698/37963 [16:07:33<65:07:08,  7.50s/it]
 18%|█▊        | 6699/37963 [16:07:47<81:16:16,  9.36s/it]
 18%|█▊        | 6700/37963 [16:08:01<93:28:03, 10.76s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '2.938', 'learning_rate': '1.89e-05', 'epoch': '0.1765'}

 18%|█▊        | 6700/37963 [16:08:01<93:28:03, 10.76s/it]
 18%|█▊        | 6701/37963 [16:08:09<85:10:14,  9.81s/it]
 18%|█▊        | 6702/37963 [16:08:16<79:04:59,  9.11s/it]
 18%|█▊        | 6703/37963 [16:08:30<91:40:55, 10.56s/it]
 18%|█▊        | 6704/37963 [16:08:44<100:15:54, 11.55s/it]
 18%|█▊        | 6705/37963 [16:08:52<89:50:10, 10.35s/it] 
 18%|█▊        | 6706/37963 [16:08:59<82:25:52,  9.49s/it]
 18%|█▊        | 6707/37963 [16:09:07<77:18:00,  8.90s/it]
 18%|█▊        | 6708/37963 [16:09:14<73:45:38,  8.50s/it]
 18%|█▊        | 6709/37963 [16:09:22<71:11:36,  8.20s/it]
 18%|█▊        | 6710/37963 [16:09:29<69:22:01,  7.99s/it]
                                                          
{'loss': '0.1822', 'grad_norm': '2.032', 'learning_rate': '1.889e-05', 'epoch': '0.1768'}

 18%|█▊        | 6710/37963 [16:09:29<69:22:01,  7.99s/it]
 18%|█▊        | 6711/37963 [16:09:37<67:46:29,  7.81s/it]
 18%|█▊        | 6712/37963 [16:09:51<84:00:19,  9.68s/it]
 18%|█▊        | 6713/37963 [16:09:58<78:50:47,  9.08s/it]
 18%|█▊        | 6714/37963 [16:10:06<75:04:16,  8.65s/it]
 18%|█▊        | 6715/37963 [16:10:13<72:21:23,  8.34s/it]
 18%|█▊        | 6716/37963 [16:10:27<86:44:02,  9.99s/it]
 18%|█▊        | 6717/37963 [16:10:35<79:34:30,  9.17s/it]
 18%|█▊        | 6718/37963 [16:10:42<75:11:23,  8.66s/it]
 18%|█▊        | 6719/37963 [16:10:50<72:16:13,  8.33s/it]
 18%|█▊        | 6720/37963 [16:10:57<70:19:28,  8.10s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '5.938', 'learning_rate': '1.889e-05', 'epoch': '0.177'}

 18%|█▊        | 6720/37963 [16:10:57<70:19:28,  8.10s/it]
 18%|█▊        | 6721/37963 [16:11:05<68:52:44,  7.94s/it]
 18%|█▊        | 6722/37963 [16:11:12<67:44:08,  7.81s/it]
 18%|█▊        | 6723/37963 [16:11:20<66:43:08,  7.69s/it]
 18%|█▊        | 6724/37963 [16:11:27<66:19:54,  7.64s/it]
 18%|█▊        | 6725/37963 [16:11:35<66:12:14,  7.63s/it]
 18%|█▊        | 6726/37963 [16:11:42<65:54:32,  7.60s/it]
 18%|█▊        | 6727/37963 [16:11:50<65:18:55,  7.53s/it]
 18%|█▊        | 6728/37963 [16:11:57<64:32:31,  7.44s/it]
 18%|█▊        | 6729/37963 [16:12:04<64:50:26,  7.47s/it]
 18%|█▊        | 6730/37963 [16:12:12<64:47:26,  7.47s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '2.507', 'learning_rate': '1.888e-05', 'epoch': '0.1773'}

 18%|█▊        | 6730/37963 [16:12:12<64:47:26,  7.47s/it]
 18%|█▊        | 6731/37963 [16:12:19<64:33:17,  7.44s/it]
 18%|█▊        | 6732/37963 [16:12:33<81:10:06,  9.36s/it]
 18%|█▊        | 6733/37963 [16:12:41<76:43:09,  8.84s/it]
 18%|█▊        | 6734/37963 [16:12:55<90:22:18, 10.42s/it]
 18%|█▊        | 6735/37963 [16:13:02<81:53:45,  9.44s/it]
 18%|█▊        | 6736/37963 [16:13:10<76:49:34,  8.86s/it]
 18%|█▊        | 6737/37963 [16:13:17<73:42:59,  8.50s/it]
 18%|█▊        | 6738/37963 [16:13:25<71:17:48,  8.22s/it]
 18%|█▊        | 6739/37963 [16:13:32<69:40:12,  8.03s/it]
 18%|█▊        | 6740/37963 [16:13:40<67:36:17,  7.79s/it]
                                                          
{'loss': '0.162', 'grad_norm': '3.903', 'learning_rate': '1.888e-05', 'epoch': '0.1775'}

 18%|█▊        | 6740/37963 [16:13:40<67:36:17,  7.79s/it]
 18%|█▊        | 6741/37963 [16:13:47<66:58:29,  7.72s/it]
 18%|█▊        | 6742/37963 [16:13:55<66:23:51,  7.66s/it]
 18%|█▊        | 6743/37963 [16:14:02<65:39:51,  7.57s/it]
 18%|█▊        | 6744/37963 [16:14:10<65:36:35,  7.57s/it]
 18%|█▊        | 6745/37963 [16:14:17<65:33:33,  7.56s/it]
 18%|█▊        | 6746/37963 [16:14:25<65:28:33,  7.55s/it]
 18%|█▊        | 6747/37963 [16:14:32<65:44:26,  7.58s/it]
 18%|█▊        | 6748/37963 [16:14:46<82:11:30,  9.48s/it]
 18%|█▊        | 6749/37963 [16:14:54<77:16:13,  8.91s/it]
 18%|█▊        | 6750/37963 [16:15:01<73:23:20,  8.46s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '4.616', 'learning_rate': '1.888e-05', 'epoch': '0.1778'}

 18%|█▊        | 6750/37963 [16:15:01<73:23:20,  8.46s/it]
 18%|█▊        | 6751/37963 [16:15:22<104:18:53, 12.03s/it]
 18%|█▊        | 6752/37963 [16:15:29<92:49:21, 10.71s/it] 
 18%|█▊        | 6753/37963 [16:15:43<100:28:51, 11.59s/it]
 18%|█▊        | 6754/37963 [16:15:50<89:52:09, 10.37s/it] 
 18%|█▊        | 6755/37963 [16:15:58<82:23:26,  9.50s/it]
 18%|█▊        | 6756/37963 [16:16:05<77:07:19,  8.90s/it]
 18%|█▊        | 6757/37963 [16:16:13<73:34:45,  8.49s/it]
 18%|█▊        | 6758/37963 [16:16:20<71:04:27,  8.20s/it]
 18%|█▊        | 6759/37963 [16:16:28<69:19:48,  8.00s/it]
 18%|█▊        | 6760/37963 [16:16:35<68:04:03,  7.85s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.94', 'learning_rate': '1.887e-05', 'epoch': '0.1781'}

 18%|█▊        | 6760/37963 [16:16:35<68:04:03,  7.85s/it]
 18%|█▊        | 6761/37963 [16:16:49<84:10:03,  9.71s/it]
 18%|█▊        | 6762/37963 [16:16:57<78:17:04,  9.03s/it]
 18%|█▊        | 6763/37963 [16:17:04<74:03:31,  8.55s/it]
 18%|█▊        | 6764/37963 [16:17:12<71:30:55,  8.25s/it]
 18%|█▊        | 6765/37963 [16:17:19<69:41:15,  8.04s/it]
 18%|█▊        | 6766/37963 [16:17:33<84:40:15,  9.77s/it]
 18%|█▊        | 6767/37963 [16:17:41<78:34:46,  9.07s/it]
 18%|█▊        | 6768/37963 [16:17:48<74:33:40,  8.60s/it]
 18%|█▊        | 6769/37963 [16:17:56<71:42:54,  8.28s/it]
 18%|█▊        | 6770/37963 [16:18:03<69:58:51,  8.08s/it]
                                                          
{'loss': '0.1612', 'grad_norm': '2.285', 'learning_rate': '1.887e-05', 'epoch': '0.1783'}

 18%|█▊        | 6770/37963 [16:18:03<69:58:51,  8.08s/it]
 18%|█▊        | 6771/37963 [16:18:11<68:34:53,  7.92s/it]
 18%|█▊        | 6772/37963 [16:18:18<67:35:05,  7.80s/it]
 18%|█▊        | 6773/37963 [16:18:26<67:16:11,  7.76s/it]
 18%|█▊        | 6774/37963 [16:18:34<66:55:09,  7.72s/it]
 18%|█▊        | 6775/37963 [16:18:41<65:43:37,  7.59s/it]
 18%|█▊        | 6776/37963 [16:18:49<65:39:54,  7.58s/it]
 18%|█▊        | 6777/37963 [16:18:56<65:07:43,  7.52s/it]
 18%|█▊        | 6778/37963 [16:19:03<65:00:02,  7.50s/it]
 18%|█▊        | 6779/37963 [16:19:11<64:41:02,  7.47s/it]
 18%|█▊        | 6780/37963 [16:19:18<64:38:41,  7.46s/it]
                                                          
{'loss': '0.171', 'grad_norm': '3.111', 'learning_rate': '1.886e-05', 'epoch': '0.1786'}

 18%|█▊        | 6780/37963 [16:19:18<64:38:41,  7.46s/it]
 18%|█▊        | 6781/37963 [16:19:33<82:24:50,  9.51s/it]
 18%|█▊        | 6782/37963 [16:19:47<94:08:28, 10.87s/it]
 18%|█▊        | 6783/37963 [16:19:54<85:26:19,  9.86s/it]
 18%|█▊        | 6784/37963 [16:20:02<79:42:48,  9.20s/it]
 18%|█▊        | 6785/37963 [16:20:09<75:32:09,  8.72s/it]
 18%|█▊        | 6786/37963 [16:20:17<72:27:16,  8.37s/it]
 18%|█▊        | 6787/37963 [16:20:24<70:17:24,  8.12s/it]
 18%|█▊        | 6788/37963 [16:20:32<68:46:53,  7.94s/it]
 18%|█▊        | 6789/37963 [16:20:40<68:05:23,  7.86s/it]
 18%|█▊        | 6790/37963 [16:20:47<67:04:02,  7.75s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '5.512', 'learning_rate': '1.886e-05', 'epoch': '0.1789'}

 18%|█▊        | 6790/37963 [16:20:47<67:04:02,  7.75s/it]
 18%|█▊        | 6791/37963 [16:20:55<66:27:37,  7.68s/it]
 18%|█▊        | 6792/37963 [16:21:02<66:02:58,  7.63s/it]
 18%|█▊        | 6793/37963 [16:21:09<64:57:38,  7.50s/it]
 18%|█▊        | 6794/37963 [16:21:17<64:45:32,  7.48s/it]
 18%|█▊        | 6795/37963 [16:21:31<81:08:27,  9.37s/it]
 18%|█▊        | 6796/37963 [16:21:38<76:24:35,  8.83s/it]
 18%|█▊        | 6797/37963 [16:21:52<89:42:11, 10.36s/it]
 18%|█▊        | 6798/37963 [16:21:59<81:43:54,  9.44s/it]
 18%|█▊        | 6799/37963 [16:22:07<76:49:58,  8.88s/it]
 18%|█▊        | 6800/37963 [16:22:14<73:18:57,  8.47s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '2.652', 'learning_rate': '1.886e-05', 'epoch': '0.1791'}

 18%|█▊        | 6800/37963 [16:22:14<73:18:57,  8.47s/it]
 18%|█▊        | 6801/37963 [16:22:28<87:48:36, 10.14s/it]
 18%|█▊        | 6802/37963 [16:22:36<81:10:41,  9.38s/it]
 18%|█▊        | 6803/37963 [16:22:44<76:22:23,  8.82s/it]
 18%|█▊        | 6804/37963 [16:22:51<72:56:24,  8.43s/it]
 18%|█▊        | 6805/37963 [16:22:58<69:51:17,  8.07s/it]
 18%|█▊        | 6806/37963 [16:23:06<68:23:59,  7.90s/it]
 18%|█▊        | 6807/37963 [16:23:13<67:19:28,  7.78s/it]
 18%|█▊        | 6808/37963 [16:23:21<66:44:52,  7.71s/it]
 18%|█▊        | 6809/37963 [16:23:28<66:19:28,  7.66s/it]
 18%|█▊        | 6810/37963 [16:23:42<82:54:46,  9.58s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '1.934', 'learning_rate': '1.885e-05', 'epoch': '0.1794'}

 18%|█▊        | 6810/37963 [16:23:42<82:54:46,  9.58s/it]
 18%|█▊        | 6811/37963 [16:23:50<77:31:51,  8.96s/it]
 18%|█▊        | 6812/37963 [16:23:58<73:55:56,  8.54s/it]
 18%|█▊        | 6813/37963 [16:24:05<70:00:57,  8.09s/it]
 18%|█▊        | 6814/37963 [16:24:12<68:30:22,  7.92s/it]
 18%|█▊        | 6815/37963 [16:24:20<67:06:13,  7.76s/it]
 18%|█▊        | 6816/37963 [16:24:27<66:37:46,  7.70s/it]
 18%|█▊        | 6817/37963 [16:24:34<65:54:24,  7.62s/it]
 18%|█▊        | 6818/37963 [16:24:42<65:44:52,  7.60s/it]
 18%|█▊        | 6819/37963 [16:24:50<66:04:07,  7.64s/it]
 18%|█▊        | 6820/37963 [16:24:57<65:50:15,  7.61s/it]
                                                          
{'loss': '0.1708', 'grad_norm': '2.195', 'learning_rate': '1.885e-05', 'epoch': '0.1796'}

 18%|█▊        | 6820/37963 [16:24:57<65:50:15,  7.61s/it]
 18%|█▊        | 6821/37963 [16:25:11<82:03:07,  9.49s/it]
 18%|█▊        | 6822/37963 [16:25:19<77:15:12,  8.93s/it]
 18%|█▊        | 6823/37963 [16:25:26<73:36:40,  8.51s/it]
 18%|█▊        | 6824/37963 [16:25:34<70:58:58,  8.21s/it]
 18%|█▊        | 6825/37963 [16:25:47<84:45:57,  9.80s/it]
 18%|█▊        | 6826/37963 [16:25:55<79:14:34,  9.16s/it]
 18%|█▊        | 6827/37963 [16:26:03<75:02:19,  8.68s/it]
 18%|█▊        | 6828/37963 [16:26:16<88:10:09, 10.19s/it]
 18%|█▊        | 6829/37963 [16:26:24<81:25:53,  9.42s/it]
 18%|█▊        | 6830/37963 [16:26:32<76:47:24,  8.88s/it]
                                                          
{'loss': '0.1583', 'grad_norm': '1.835', 'learning_rate': '1.884e-05', 'epoch': '0.1799'}

 18%|█▊        | 6830/37963 [16:26:32<76:47:24,  8.88s/it]
 18%|█▊        | 6831/37963 [16:26:39<73:29:50,  8.50s/it]
 18%|█▊        | 6832/37963 [16:26:47<71:08:29,  8.23s/it]
 18%|█▊        | 6833/37963 [16:26:54<69:08:54,  8.00s/it]
 18%|█▊        | 6834/37963 [16:27:02<68:09:19,  7.88s/it]
 18%|█▊        | 6835/37963 [16:27:09<67:25:23,  7.80s/it]
 18%|█▊        | 6836/37963 [16:27:17<66:34:46,  7.70s/it]
 18%|█▊        | 6837/37963 [16:27:24<66:08:44,  7.65s/it]
 18%|█▊        | 6838/37963 [16:27:32<66:09:39,  7.65s/it]
 18%|█▊        | 6839/37963 [16:27:40<65:50:59,  7.62s/it]
 18%|█▊        | 6840/37963 [16:27:47<65:36:08,  7.59s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '3.125', 'learning_rate': '1.884e-05', 'epoch': '0.1802'}

 18%|█▊        | 6840/37963 [16:27:47<65:36:08,  7.59s/it]
 18%|█▊        | 6841/37963 [16:28:01<80:59:25,  9.37s/it]
 18%|█▊        | 6842/37963 [16:28:08<76:37:12,  8.86s/it]
 18%|█▊        | 6843/37963 [16:28:16<73:23:30,  8.49s/it]
 18%|█▊        | 6844/37963 [16:28:23<70:26:06,  8.15s/it]
 18%|█▊        | 6845/37963 [16:28:30<67:45:49,  7.84s/it]
 18%|█▊        | 6846/37963 [16:28:38<66:54:44,  7.74s/it]
 18%|█▊        | 6847/37963 [16:28:52<82:07:25,  9.50s/it]
 18%|█▊        | 6848/37963 [16:28:59<77:02:52,  8.91s/it]
 18%|█▊        | 6849/37963 [16:29:20<106:59:21, 12.38s/it]
 18%|█▊        | 6850/37963 [16:29:27<94:14:46, 10.90s/it] 
                                                          
{'loss': '0.1733', 'grad_norm': '4.076', 'learning_rate': '1.884e-05', 'epoch': '0.1804'}

 18%|█▊        | 6850/37963 [16:29:27<94:14:46, 10.90s/it]
 18%|█▊        | 6851/37963 [16:29:35<85:35:12,  9.90s/it]
 18%|█▊        | 6852/37963 [16:29:42<79:11:14,  9.16s/it]
 18%|█▊        | 6853/37963 [16:29:49<74:23:12,  8.61s/it]
 18%|█▊        | 6854/37963 [16:29:57<71:26:39,  8.27s/it]
 18%|█▊        | 6855/37963 [16:30:04<69:40:45,  8.06s/it]
 18%|█▊        | 6856/37963 [16:30:12<68:20:52,  7.91s/it]
 18%|█▊        | 6857/37963 [16:30:20<67:26:01,  7.80s/it]
 18%|█▊        | 6858/37963 [16:30:27<66:36:47,  7.71s/it]
 18%|█▊        | 6859/37963 [16:30:35<66:19:33,  7.68s/it]
 18%|█▊        | 6860/37963 [16:30:42<65:04:08,  7.53s/it]
                                                          
{'loss': '0.1738', 'grad_norm': '1.523', 'learning_rate': '1.883e-05', 'epoch': '0.1807'}

 18%|█▊        | 6860/37963 [16:30:42<65:04:08,  7.53s/it]
 18%|█▊        | 6861/37963 [16:30:55<80:42:17,  9.34s/it]
 18%|█▊        | 6862/37963 [16:31:03<75:38:42,  8.76s/it]
 18%|█▊        | 6863/37963 [16:31:10<72:11:58,  8.36s/it]
 18%|█▊        | 6864/37963 [16:31:18<69:41:25,  8.07s/it]
 18%|█▊        | 6865/37963 [16:31:25<68:37:10,  7.94s/it]
 18%|█▊        | 6866/37963 [16:31:33<67:31:47,  7.82s/it]
 18%|█▊        | 6867/37963 [16:31:40<66:30:09,  7.70s/it]
 18%|█▊        | 6868/37963 [16:31:54<82:42:48,  9.58s/it]
 18%|█▊        | 6869/37963 [16:32:02<77:44:50,  9.00s/it]
 18%|█▊        | 6870/37963 [16:32:09<73:54:42,  8.56s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '2.941', 'learning_rate': '1.883e-05', 'epoch': '0.181'}

 18%|█▊        | 6870/37963 [16:32:09<73:54:42,  8.56s/it]
 18%|█▊        | 6871/37963 [16:32:17<71:20:26,  8.26s/it]
 18%|█▊        | 6872/37963 [16:32:25<69:47:13,  8.08s/it]
 18%|█▊        | 6873/37963 [16:32:32<67:37:58,  7.83s/it]
 18%|█▊        | 6874/37963 [16:32:39<67:00:18,  7.76s/it]
 18%|█▊        | 6875/37963 [16:32:47<66:56:54,  7.75s/it]
 18%|█▊        | 6876/37963 [16:32:55<66:17:50,  7.68s/it]
 18%|█▊        | 6877/37963 [16:33:15<99:15:20, 11.49s/it]
 18%|█▊        | 6878/37963 [16:33:22<88:14:53, 10.22s/it]
 18%|█▊        | 6879/37963 [16:33:30<81:33:42,  9.45s/it]
 18%|█▊        | 6880/37963 [16:33:38<76:51:44,  8.90s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '0.9832', 'learning_rate': '1.882e-05', 'epoch': '0.1812'}

 18%|█▊        | 6880/37963 [16:33:38<76:51:44,  8.90s/it]
 18%|█▊        | 6881/37963 [16:33:45<73:29:11,  8.51s/it]
 18%|█▊        | 6882/37963 [16:33:53<71:20:12,  8.26s/it]
 18%|█▊        | 6883/37963 [16:34:00<69:29:09,  8.05s/it]
 18%|█▊        | 6884/37963 [16:34:08<68:37:05,  7.95s/it]
 18%|█▊        | 6885/37963 [16:34:16<67:27:07,  7.81s/it]
 18%|█▊        | 6886/37963 [16:34:23<66:46:57,  7.74s/it]
 18%|█▊        | 6887/37963 [16:34:31<66:10:46,  7.67s/it]
 18%|█▊        | 6888/37963 [16:34:38<65:42:04,  7.61s/it]
 18%|█▊        | 6889/37963 [16:34:52<81:53:41,  9.49s/it]
 18%|█▊        | 6890/37963 [16:34:59<76:31:51,  8.87s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '3.824', 'learning_rate': '1.882e-05', 'epoch': '0.1815'}

 18%|█▊        | 6890/37963 [16:34:59<76:31:51,  8.87s/it]
 18%|█▊        | 6891/37963 [16:35:07<73:11:17,  8.48s/it]
 18%|█▊        | 6892/37963 [16:35:14<70:34:16,  8.18s/it]
 18%|█▊        | 6893/37963 [16:35:29<85:49:27,  9.94s/it]
 18%|█▊        | 6894/37963 [16:35:36<79:16:07,  9.18s/it]
 18%|█▊        | 6895/37963 [16:35:50<91:59:20, 10.66s/it]
 18%|█▊        | 6896/37963 [16:35:58<83:58:06,  9.73s/it]
 18%|█▊        | 6897/37963 [16:36:12<95:03:05, 11.01s/it]
 18%|█▊        | 6898/37963 [16:36:19<86:08:01,  9.98s/it]
 18%|█▊        | 6899/37963 [16:36:26<78:50:50,  9.14s/it]
 18%|█▊        | 6900/37963 [16:36:34<73:58:02,  8.57s/it]
                                                          
{'loss': '0.1747', 'grad_norm': '2.386', 'learning_rate': '1.882e-05', 'epoch': '0.1818'}

 18%|█▊        | 6900/37963 [16:36:34<73:58:02,  8.57s/it]
 18%|█▊        | 6901/37963 [16:36:41<71:22:12,  8.27s/it]
 18%|█▊        | 6902/37963 [16:36:49<69:09:35,  8.02s/it]
 18%|█▊        | 6903/37963 [16:36:56<67:55:58,  7.87s/it]
 18%|█▊        | 6904/37963 [16:37:04<66:53:04,  7.75s/it]
 18%|█▊        | 6905/37963 [16:37:11<66:31:56,  7.71s/it]
 18%|█▊        | 6906/37963 [16:37:19<66:10:56,  7.67s/it]
 18%|█▊        | 6907/37963 [16:37:26<66:05:50,  7.66s/it]
 18%|█▊        | 6908/37963 [16:37:34<65:14:42,  7.56s/it]
 18%|█▊        | 6909/37963 [16:37:41<65:37:41,  7.61s/it]
 18%|█▊        | 6910/37963 [16:37:56<82:31:07,  9.57s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '2.288', 'learning_rate': '1.881e-05', 'epoch': '0.182'}

 18%|█▊        | 6910/37963 [16:37:56<82:31:07,  9.57s/it]
 18%|█▊        | 6911/37963 [16:38:03<76:39:48,  8.89s/it]
 18%|█▊        | 6912/37963 [16:38:10<73:11:27,  8.49s/it]
 18%|█▊        | 6913/37963 [16:38:24<87:01:58, 10.09s/it]
 18%|█▊        | 6914/37963 [16:38:32<80:43:45,  9.36s/it]
 18%|█▊        | 6915/37963 [16:38:39<75:27:45,  8.75s/it]
 18%|█▊        | 6916/37963 [16:38:47<72:10:31,  8.37s/it]
 18%|█▊        | 6917/37963 [16:38:54<69:55:57,  8.11s/it]
 18%|█▊        | 6918/37963 [16:39:02<68:42:02,  7.97s/it]
 18%|█▊        | 6919/37963 [16:39:10<67:54:01,  7.87s/it]
 18%|█▊        | 6920/37963 [16:39:17<66:40:25,  7.73s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '1.785', 'learning_rate': '1.881e-05', 'epoch': '0.1823'}

 18%|█▊        | 6920/37963 [16:39:17<66:40:25,  7.73s/it]
 18%|█▊        | 6921/37963 [16:39:25<66:10:57,  7.68s/it]
 18%|█▊        | 6922/37963 [16:39:32<64:45:37,  7.51s/it]
 18%|█▊        | 6923/37963 [16:39:45<80:42:53,  9.36s/it]
 18%|█▊        | 6924/37963 [16:39:53<75:42:30,  8.78s/it]
 18%|█▊        | 6925/37963 [16:40:00<72:01:40,  8.35s/it]
 18%|█▊        | 6926/37963 [16:40:14<86:49:48, 10.07s/it]
 18%|█▊        | 6927/37963 [16:40:22<80:12:44,  9.30s/it]
 18%|█▊        | 6928/37963 [16:40:29<75:34:50,  8.77s/it]
 18%|█▊        | 6929/37963 [16:40:37<72:31:24,  8.41s/it]
 18%|█▊        | 6930/37963 [16:40:44<70:13:53,  8.15s/it]
                                                          
{'loss': '0.172', 'grad_norm': '1.278', 'learning_rate': '1.88e-05', 'epoch': '0.1825'}

 18%|█▊        | 6930/37963 [16:40:44<70:13:53,  8.15s/it]
 18%|█▊        | 6931/37963 [16:40:52<68:38:06,  7.96s/it]
 18%|█▊        | 6932/37963 [16:40:59<67:32:30,  7.84s/it]
 18%|█▊        | 6933/37963 [16:41:07<66:45:47,  7.75s/it]
 18%|█▊        | 6934/37963 [16:41:14<66:04:06,  7.67s/it]
 18%|█▊        | 6935/37963 [16:41:22<65:51:24,  7.64s/it]
 18%|█▊        | 6936/37963 [16:41:36<82:11:59,  9.54s/it]
 18%|█▊        | 6937/37963 [16:41:44<77:07:15,  8.95s/it]
 18%|█▊        | 6938/37963 [16:41:51<73:20:39,  8.51s/it]
 18%|█▊        | 6939/37963 [16:41:59<71:01:25,  8.24s/it]
 18%|█▊        | 6940/37963 [16:42:06<69:50:04,  8.10s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '2.139', 'learning_rate': '1.88e-05', 'epoch': '0.1828'}

 18%|█▊        | 6940/37963 [16:42:06<69:50:04,  8.10s/it]
 18%|█▊        | 6941/37963 [16:42:20<84:44:41,  9.83s/it]
 18%|█▊        | 6942/37963 [16:42:28<78:48:47,  9.15s/it]
 18%|█▊        | 6943/37963 [16:42:42<90:57:48, 10.56s/it]
 18%|█▊        | 6944/37963 [16:42:56<99:34:16, 11.56s/it]
 18%|█▊        | 6945/37963 [16:43:03<89:33:06, 10.39s/it]
 18%|█▊        | 6946/37963 [16:43:11<82:09:45,  9.54s/it]
 18%|█▊        | 6947/37963 [16:43:18<76:30:40,  8.88s/it]
 18%|█▊        | 6948/37963 [16:43:26<73:09:21,  8.49s/it]
 18%|█▊        | 6949/37963 [16:43:33<71:01:17,  8.24s/it]
 18%|█▊        | 6950/37963 [16:43:41<69:18:27,  8.05s/it]
                                                          
{'loss': '0.1637', 'grad_norm': '2.012', 'learning_rate': '1.88e-05', 'epoch': '0.1831'}

 18%|█▊        | 6950/37963 [16:43:41<69:18:27,  8.05s/it]
 18%|█▊        | 6951/37963 [16:43:48<67:47:32,  7.87s/it]
 18%|█▊        | 6952/37963 [16:43:56<66:09:49,  7.68s/it]
 18%|█▊        | 6953/37963 [16:44:03<65:49:29,  7.64s/it]
 18%|█▊        | 6954/37963 [16:44:11<66:35:36,  7.73s/it]
 18%|█▊        | 6955/37963 [16:44:19<66:10:15,  7.68s/it]
 18%|█▊        | 6956/37963 [16:44:26<66:00:07,  7.66s/it]
 18%|█▊        | 6957/37963 [16:44:34<65:44:21,  7.63s/it]
 18%|█▊        | 6958/37963 [16:44:41<65:37:28,  7.62s/it]
 18%|█▊        | 6959/37963 [16:44:49<65:38:06,  7.62s/it]
 18%|█▊        | 6960/37963 [16:44:56<64:49:21,  7.53s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '3.755', 'learning_rate': '1.879e-05', 'epoch': '0.1833'}

 18%|█▊        | 6960/37963 [16:44:56<64:49:21,  7.53s/it]
 18%|█▊        | 6961/37963 [16:45:04<65:00:39,  7.55s/it]
 18%|█▊        | 6962/37963 [16:45:11<64:42:19,  7.51s/it]
 18%|█▊        | 6963/37963 [16:45:25<81:20:19,  9.45s/it]
 18%|█▊        | 6964/37963 [16:45:33<75:49:49,  8.81s/it]
 18%|█▊        | 6965/37963 [16:45:40<72:39:01,  8.44s/it]
 18%|█▊        | 6966/37963 [16:45:48<70:32:28,  8.19s/it]
 18%|█▊        | 6967/37963 [16:45:56<69:00:36,  8.02s/it]
 18%|█▊        | 6968/37963 [16:46:09<83:50:46,  9.74s/it]
 18%|█▊        | 6969/37963 [16:46:17<78:03:56,  9.07s/it]
 18%|█▊        | 6970/37963 [16:46:24<74:11:59,  8.62s/it]
                                                          
{'loss': '0.1625', 'grad_norm': '4.818', 'learning_rate': '1.879e-05', 'epoch': '0.1836'}

 18%|█▊        | 6970/37963 [16:46:24<74:11:59,  8.62s/it]
 18%|█▊        | 6971/37963 [16:46:38<88:10:16, 10.24s/it]
 18%|█▊        | 6972/37963 [16:46:46<81:23:32,  9.45s/it]
 18%|█▊        | 6973/37963 [16:46:54<76:22:09,  8.87s/it]
 18%|█▊        | 6974/37963 [16:47:07<88:49:41, 10.32s/it]
 18%|█▊        | 6975/37963 [16:47:15<81:58:22,  9.52s/it]
 18%|█▊        | 6976/37963 [16:47:22<76:47:49,  8.92s/it]
 18%|█▊        | 6977/37963 [16:47:30<73:40:30,  8.56s/it]
 18%|█▊        | 6978/37963 [16:47:37<70:37:49,  8.21s/it]
 18%|█▊        | 6979/37963 [16:47:45<68:44:53,  7.99s/it]
 18%|█▊        | 6980/37963 [16:47:53<67:47:25,  7.88s/it]
                                                          
{'loss': '0.18', 'grad_norm': '2.289', 'learning_rate': '1.878e-05', 'epoch': '0.1839'}

 18%|█▊        | 6980/37963 [16:47:53<67:47:25,  7.88s/it]
 18%|█▊        | 6981/37963 [16:48:00<66:45:00,  7.76s/it]
 18%|█▊        | 6982/37963 [16:48:08<66:06:32,  7.68s/it]
 18%|█▊        | 6983/37963 [16:48:15<65:42:15,  7.64s/it]
 18%|█▊        | 6984/37963 [16:48:23<65:36:55,  7.63s/it]
 18%|█▊        | 6985/37963 [16:48:30<65:06:46,  7.57s/it]
 18%|█▊        | 6986/37963 [16:48:38<65:27:23,  7.61s/it]
 18%|█▊        | 6987/37963 [16:48:45<64:36:49,  7.51s/it]
 18%|█▊        | 6988/37963 [16:48:59<81:18:09,  9.45s/it]
 18%|█▊        | 6989/37963 [16:49:06<75:56:50,  8.83s/it]
 18%|█▊        | 6990/37963 [16:49:27<105:45:19, 12.29s/it]
                                                           
{'loss': '0.1738', 'grad_norm': '5.466', 'learning_rate': '1.878e-05', 'epoch': '0.1841'}

 18%|█▊        | 6990/37963 [16:49:27<105:45:19, 12.29s/it]
 18%|█▊        | 6991/37963 [16:49:34<93:27:55, 10.86s/it] 
 18%|█▊        | 6992/37963 [16:49:42<85:07:25,  9.89s/it]
 18%|█▊        | 6993/37963 [16:49:50<78:59:28,  9.18s/it]
 18%|█▊        | 6994/37963 [16:49:57<73:53:50,  8.59s/it]
 18%|█▊        | 6995/37963 [16:50:04<71:11:40,  8.28s/it]
 18%|█▊        | 6996/37963 [16:50:18<86:28:19, 10.05s/it]
 18%|█▊        | 6997/37963 [16:50:26<80:21:09,  9.34s/it]
 18%|█▊        | 6998/37963 [16:50:34<75:58:14,  8.83s/it]
 18%|█▊        | 6999/37963 [16:50:41<72:45:46,  8.46s/it]
 18%|█▊        | 7000/37963 [16:50:49<69:59:25,  8.14s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '2.195', 'learning_rate': '1.878e-05', 'epoch': '0.1844'}

 18%|█▊        | 7000/37963 [16:50:49<69:59:25,  8.14s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.15s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.15s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 18%|█▊        | 7001/37963 [16:51:46<197:37:57, 22.98s/it]
 18%|█▊        | 7002/37963 [16:51:55<160:10:42, 18.62s/it]
 18%|█▊        | 7003/37963 [16:52:02<131:26:18, 15.28s/it]
 18%|█▊        | 7004/37963 [16:52:10<110:48:28, 12.89s/it]
 18%|█▊        | 7005/37963 [16:52:17<96:26:37, 11.22s/it] 
 18%|█▊        | 7006/37963 [16:52:24<86:54:25, 10.11s/it]
 18%|█▊        | 7007/37963 [16:52:32<80:00:02,  9.30s/it]
 18%|█▊        | 7008/37963 [16:52:39<75:15:54,  8.75s/it]
 18%|█▊        | 7009/37963 [16:52:47<72:19:50,  8.41s/it]
 18%|█▊        | 7010/37963 [16:53:01<87:19:18, 10.16s/it]
                                                          
{'loss': '0.1673', 'grad_norm': '3.503', 'learning_rate': '1.877e-05', 'epoch': '0.1847'}

 18%|█▊        | 7010/37963 [16:53:01<87:19:18, 10.16s/it]
 18%|█▊        | 7011/37963 [16:53:09<81:25:45,  9.47s/it]
 18%|█▊        | 7012/37963 [16:53:17<76:26:05,  8.89s/it]
 18%|█▊        | 7013/37963 [16:53:24<73:04:09,  8.50s/it]
 18%|█▊        | 7014/37963 [16:53:32<70:29:35,  8.20s/it]
 18%|█▊        | 7015/37963 [16:53:39<68:46:28,  8.00s/it]
 18%|█▊        | 7016/37963 [16:53:47<67:37:54,  7.87s/it]
 18%|█▊        | 7017/37963 [16:53:54<67:00:15,  7.79s/it]
 18%|█▊        | 7018/37963 [16:54:02<66:05:43,  7.69s/it]
 18%|█▊        | 7019/37963 [16:54:16<82:45:05,  9.63s/it]
 18%|█▊        | 7020/37963 [16:54:24<77:30:03,  9.02s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '4.96', 'learning_rate': '1.877e-05', 'epoch': '0.1849'}

 18%|█▊        | 7020/37963 [16:54:24<77:30:03,  9.02s/it]
 18%|█▊        | 7021/37963 [16:54:38<90:54:08, 10.58s/it]
 18%|█▊        | 7022/37963 [16:54:45<83:16:58,  9.69s/it]
 18%|█▊        | 7023/37963 [16:54:53<78:05:17,  9.09s/it]
 19%|█▊        | 7024/37963 [16:55:01<74:05:10,  8.62s/it]
 19%|█▊        | 7025/37963 [16:55:15<88:55:00, 10.35s/it]
 19%|█▊        | 7026/37963 [16:55:23<82:06:59,  9.56s/it]
 19%|█▊        | 7027/37963 [16:55:31<77:30:58,  9.02s/it]
 19%|█▊        | 7028/37963 [16:55:38<73:49:55,  8.59s/it]
 19%|█▊        | 7029/37963 [16:55:46<71:08:19,  8.28s/it]
 19%|█▊        | 7030/37963 [16:55:53<68:59:43,  8.03s/it]
                                                          
{'loss': '0.1786', 'grad_norm': '4.227', 'learning_rate': '1.876e-05', 'epoch': '0.1852'}

 19%|█▊        | 7030/37963 [16:55:53<68:59:43,  8.03s/it]
 19%|█▊        | 7031/37963 [16:56:01<67:46:50,  7.89s/it]
 19%|█▊        | 7032/37963 [16:56:08<66:16:10,  7.71s/it]
 19%|█▊        | 7033/37963 [16:56:16<66:01:28,  7.68s/it]
 19%|█▊        | 7034/37963 [16:56:23<65:58:18,  7.68s/it]
 19%|█▊        | 7035/37963 [16:56:31<65:44:02,  7.65s/it]
 19%|█▊        | 7036/37963 [16:56:45<81:41:31,  9.51s/it]
 19%|█▊        | 7037/37963 [16:56:52<76:52:44,  8.95s/it]
 19%|█▊        | 7038/37963 [16:57:06<90:01:16, 10.48s/it]
 19%|█▊        | 7039/37963 [16:57:21<99:28:08, 11.58s/it]
 19%|█▊        | 7040/37963 [16:57:28<88:54:33, 10.35s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.781', 'learning_rate': '1.876e-05', 'epoch': '0.1854'}

 19%|█▊        | 7040/37963 [16:57:28<88:54:33, 10.35s/it]
 19%|█▊        | 7041/37963 [16:57:35<81:32:22,  9.49s/it]
 19%|█▊        | 7042/37963 [16:57:43<76:46:20,  8.94s/it]
 19%|█▊        | 7043/37963 [16:57:51<73:08:39,  8.52s/it]
 19%|█▊        | 7044/37963 [16:58:04<85:49:09,  9.99s/it]
 19%|█▊        | 7045/37963 [16:58:12<79:31:07,  9.26s/it]
 19%|█▊        | 7046/37963 [16:58:19<74:40:42,  8.70s/it]
 19%|█▊        | 7047/37963 [16:58:26<70:48:54,  8.25s/it]
 19%|█▊        | 7048/37963 [16:58:34<69:17:46,  8.07s/it]
 19%|█▊        | 7049/37963 [16:58:41<67:44:51,  7.89s/it]
 19%|█▊        | 7050/37963 [16:58:49<66:52:58,  7.79s/it]
                                                          
{'loss': '0.1514', 'grad_norm': '1.594', 'learning_rate': '1.876e-05', 'epoch': '0.1857'}

 19%|█▊        | 7050/37963 [16:58:49<66:52:58,  7.79s/it]
 19%|█▊        | 7051/37963 [16:58:56<65:38:27,  7.64s/it]
 19%|█▊        | 7052/37963 [16:59:04<65:19:31,  7.61s/it]
 19%|█▊        | 7053/37963 [16:59:11<65:29:19,  7.63s/it]
 19%|█▊        | 7054/37963 [16:59:19<65:16:58,  7.60s/it]
 19%|█▊        | 7055/37963 [16:59:33<81:58:47,  9.55s/it]
 19%|█▊        | 7056/37963 [16:59:41<76:48:04,  8.95s/it]
 19%|█▊        | 7057/37963 [16:59:48<73:19:47,  8.54s/it]
 19%|█▊        | 7058/37963 [16:59:56<70:34:15,  8.22s/it]
 19%|█▊        | 7059/37963 [17:00:03<69:07:37,  8.05s/it]
 19%|█▊        | 7060/37963 [17:00:11<67:20:50,  7.85s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '2.056', 'learning_rate': '1.875e-05', 'epoch': '0.186'}

 19%|█▊        | 7060/37963 [17:00:11<67:20:50,  7.85s/it]
 19%|█▊        | 7061/37963 [17:00:18<66:58:02,  7.80s/it]
 19%|█▊        | 7062/37963 [17:00:26<65:30:37,  7.63s/it]
 19%|█▊        | 7063/37963 [17:00:33<65:20:52,  7.61s/it]
 19%|█▊        | 7064/37963 [17:00:41<65:07:50,  7.59s/it]
 19%|█▊        | 7065/37963 [17:00:48<65:15:17,  7.60s/it]
 19%|█▊        | 7066/37963 [17:00:56<64:54:42,  7.56s/it]
 19%|█▊        | 7067/37963 [17:01:10<81:31:41,  9.50s/it]
 19%|█▊        | 7068/37963 [17:01:17<76:35:54,  8.93s/it]
 19%|█▊        | 7069/37963 [17:01:32<89:52:44, 10.47s/it]
 19%|█▊        | 7070/37963 [17:01:39<82:23:21,  9.60s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '5.005', 'learning_rate': '1.875e-05', 'epoch': '0.1862'}

 19%|█▊        | 7070/37963 [17:01:39<82:23:21,  9.60s/it]
 19%|█▊        | 7071/37963 [17:01:47<76:55:44,  8.96s/it]
 19%|█▊        | 7072/37963 [17:01:54<73:06:34,  8.52s/it]
 19%|█▊        | 7073/37963 [17:02:02<70:57:18,  8.27s/it]
 19%|█▊        | 7074/37963 [17:02:09<68:25:02,  7.97s/it]
 19%|█▊        | 7075/37963 [17:02:16<67:10:58,  7.83s/it]
 19%|█▊        | 7076/37963 [17:02:24<66:45:36,  7.78s/it]
 19%|█▊        | 7077/37963 [17:02:31<65:28:35,  7.63s/it]
 19%|█▊        | 7078/37963 [17:02:45<81:06:34,  9.45s/it]
 19%|█▊        | 7079/37963 [17:02:53<76:27:34,  8.91s/it]
 19%|█▊        | 7080/37963 [17:03:00<72:48:48,  8.49s/it]
                                                          
{'loss': '0.1573', 'grad_norm': '0.9453', 'learning_rate': '1.874e-05', 'epoch': '0.1865'}

 19%|█▊        | 7080/37963 [17:03:00<72:48:48,  8.49s/it]
 19%|█▊        | 7081/37963 [17:03:08<70:19:46,  8.20s/it]
 19%|█▊        | 7082/37963 [17:03:15<68:45:38,  8.02s/it]
 19%|█▊        | 7083/37963 [17:03:23<67:38:21,  7.89s/it]
 19%|█▊        | 7084/37963 [17:03:31<66:42:10,  7.78s/it]
 19%|█▊        | 7085/37963 [17:03:45<82:51:41,  9.66s/it]
 19%|█▊        | 7086/37963 [17:03:52<77:35:46,  9.05s/it]
 19%|█▊        | 7087/37963 [17:04:00<73:49:33,  8.61s/it]
 19%|█▊        | 7088/37963 [17:04:14<88:33:52, 10.33s/it]
 19%|█▊        | 7089/37963 [17:04:28<97:44:54, 11.40s/it]
 19%|█▊        | 7090/37963 [17:04:35<87:11:07, 10.17s/it]
                                                          
{'loss': '0.1825', 'grad_norm': '1.395', 'learning_rate': '1.874e-05', 'epoch': '0.1868'}

 19%|█▊        | 7090/37963 [17:04:35<87:11:07, 10.17s/it]
 19%|█▊        | 7091/37963 [17:04:43<80:46:47,  9.42s/it]
 19%|█▊        | 7092/37963 [17:04:51<76:12:45,  8.89s/it]
 19%|█▊        | 7093/37963 [17:04:58<72:54:16,  8.50s/it]
 19%|█▊        | 7094/37963 [17:05:12<86:04:26, 10.04s/it]
 19%|█▊        | 7095/37963 [17:05:19<79:44:36,  9.30s/it]
 19%|█▊        | 7096/37963 [17:05:27<74:36:24,  8.70s/it]
 19%|█▊        | 7097/37963 [17:05:34<71:18:50,  8.32s/it]
 19%|█▊        | 7098/37963 [17:05:42<69:34:56,  8.12s/it]
 19%|█▊        | 7099/37963 [17:05:49<67:34:13,  7.88s/it]
 19%|█▊        | 7100/37963 [17:05:57<66:39:51,  7.78s/it]
                                                          
{'loss': '0.1633', 'grad_norm': '4.968', 'learning_rate': '1.873e-05', 'epoch': '0.187'}

 19%|█▊        | 7100/37963 [17:05:57<66:39:51,  7.78s/it]
 19%|█▊        | 7101/37963 [17:06:04<66:06:35,  7.71s/it]
 19%|█▊        | 7102/37963 [17:06:12<65:18:18,  7.62s/it]
 19%|█▊        | 7103/37963 [17:06:19<65:09:14,  7.60s/it]
 19%|█▊        | 7104/37963 [17:06:27<64:29:56,  7.52s/it]
 19%|█▊        | 7105/37963 [17:06:34<64:37:56,  7.54s/it]
 19%|█▊        | 7106/37963 [17:06:42<64:43:46,  7.55s/it]
 19%|█▊        | 7107/37963 [17:06:56<80:54:36,  9.44s/it]
 19%|█▊        | 7108/37963 [17:07:03<75:58:06,  8.86s/it]
 19%|█▊        | 7109/37963 [17:07:11<72:27:09,  8.45s/it]
 19%|█▊        | 7110/37963 [17:07:18<70:02:51,  8.17s/it]
                                                          
{'loss': '0.1712', 'grad_norm': '5.259', 'learning_rate': '1.873e-05', 'epoch': '0.1873'}

 19%|█▊        | 7110/37963 [17:07:18<70:02:51,  8.17s/it]
 19%|█▊        | 7111/37963 [17:07:26<68:34:49,  8.00s/it]
 19%|█▊        | 7112/37963 [17:07:33<66:59:37,  7.82s/it]
 19%|█▊        | 7113/37963 [17:07:47<82:37:07,  9.64s/it]
 19%|█▊        | 7114/37963 [17:07:55<77:35:18,  9.05s/it]
 19%|█▊        | 7115/37963 [17:08:02<73:37:32,  8.59s/it]
 19%|█▊        | 7116/37963 [17:08:09<70:16:05,  8.20s/it]
 19%|█▊        | 7117/37963 [17:08:17<68:23:09,  7.98s/it]
 19%|█▊        | 7118/37963 [17:08:24<66:36:49,  7.77s/it]
 19%|█▉        | 7119/37963 [17:08:38<82:30:01,  9.63s/it]
 19%|█▉        | 7120/37963 [17:08:46<76:53:31,  8.97s/it]
                                                          
{'loss': '0.1975', 'grad_norm': '2.968', 'learning_rate': '1.873e-05', 'epoch': '0.1876'}

 19%|█▉        | 7120/37963 [17:08:46<76:53:31,  8.97s/it]
 19%|█▉        | 7121/37963 [17:08:53<72:57:54,  8.52s/it]
 19%|█▉        | 7122/37963 [17:09:01<70:22:53,  8.22s/it]
 19%|█▉        | 7123/37963 [17:09:14<84:48:40,  9.90s/it]
 19%|█▉        | 7124/37963 [17:09:22<79:10:39,  9.24s/it]
 19%|█▉        | 7125/37963 [17:09:30<74:27:48,  8.69s/it]
 19%|█▉        | 7126/37963 [17:09:37<71:28:25,  8.34s/it]
 19%|█▉        | 7127/37963 [17:09:45<69:22:09,  8.10s/it]
 19%|█▉        | 7128/37963 [17:09:52<67:50:09,  7.92s/it]
 19%|█▉        | 7129/37963 [17:10:06<83:17:36,  9.72s/it]
 19%|█▉        | 7130/37963 [17:10:14<77:47:04,  9.08s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.369', 'learning_rate': '1.872e-05', 'epoch': '0.1878'}

 19%|█▉        | 7130/37963 [17:10:14<77:47:04,  9.08s/it]
 19%|█▉        | 7131/37963 [17:10:21<74:13:06,  8.67s/it]
 19%|█▉        | 7132/37963 [17:10:29<71:16:03,  8.32s/it]
 19%|█▉        | 7133/37963 [17:10:36<68:35:15,  8.01s/it]
 19%|█▉        | 7134/37963 [17:10:44<67:31:39,  7.89s/it]
 19%|█▉        | 7135/37963 [17:10:51<66:22:51,  7.75s/it]
 19%|█▉        | 7136/37963 [17:11:05<82:17:28,  9.61s/it]
 19%|█▉        | 7137/37963 [17:11:13<77:08:11,  9.01s/it]
 19%|█▉        | 7138/37963 [17:11:26<89:27:22, 10.45s/it]
 19%|█▉        | 7139/37963 [17:11:34<81:58:45,  9.57s/it]
 19%|█▉        | 7140/37963 [17:11:42<76:41:54,  8.96s/it]
                                                          
{'loss': '0.182', 'grad_norm': '2.603', 'learning_rate': '1.872e-05', 'epoch': '0.1881'}

 19%|█▉        | 7140/37963 [17:11:42<76:41:54,  8.96s/it]
 19%|█▉        | 7141/37963 [17:11:49<73:19:04,  8.56s/it]
 19%|█▉        | 7142/37963 [17:12:03<87:20:54, 10.20s/it]
 19%|█▉        | 7143/37963 [17:12:11<80:44:42,  9.43s/it]
 19%|█▉        | 7144/37963 [17:12:19<76:15:38,  8.91s/it]
 19%|█▉        | 7145/37963 [17:12:26<72:36:12,  8.48s/it]
 19%|█▉        | 7146/37963 [17:12:33<69:48:49,  8.16s/it]
 19%|█▉        | 7147/37963 [17:12:41<68:11:49,  7.97s/it]
 19%|█▉        | 7148/37963 [17:12:48<66:58:20,  7.82s/it]
 19%|█▉        | 7149/37963 [17:12:56<65:38:45,  7.67s/it]
 19%|█▉        | 7150/37963 [17:13:03<64:48:07,  7.57s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '2.782', 'learning_rate': '1.871e-05', 'epoch': '0.1883'}

 19%|█▉        | 7150/37963 [17:13:03<64:48:07,  7.57s/it]
 19%|█▉        | 7151/37963 [17:13:10<64:01:21,  7.48s/it]
 19%|█▉        | 7152/37963 [17:13:18<63:41:57,  7.44s/it]
 19%|█▉        | 7153/37963 [17:13:32<80:23:47,  9.39s/it]
 19%|█▉        | 7154/37963 [17:13:39<75:32:36,  8.83s/it]
 19%|█▉        | 7155/37963 [17:13:47<72:22:01,  8.46s/it]
 19%|█▉        | 7156/37963 [17:13:54<69:54:47,  8.17s/it]
 19%|█▉        | 7157/37963 [17:14:02<68:20:54,  7.99s/it]
 19%|█▉        | 7158/37963 [17:14:09<67:19:00,  7.87s/it]
 19%|█▉        | 7159/37963 [17:14:17<66:31:51,  7.78s/it]
 19%|█▉        | 7160/37963 [17:14:25<65:58:56,  7.71s/it]
                                                          
{'loss': '0.1814', 'grad_norm': '1.507', 'learning_rate': '1.871e-05', 'epoch': '0.1886'}

 19%|█▉        | 7160/37963 [17:14:25<65:58:56,  7.71s/it]
 19%|█▉        | 7161/37963 [17:14:39<82:09:14,  9.60s/it]
 19%|█▉        | 7162/37963 [17:14:46<76:51:18,  8.98s/it]
 19%|█▉        | 7163/37963 [17:14:54<73:11:15,  8.55s/it]
 19%|█▉        | 7164/37963 [17:15:01<70:47:25,  8.27s/it]
 19%|█▉        | 7165/37963 [17:15:08<68:06:14,  7.96s/it]
 19%|█▉        | 7166/37963 [17:15:16<67:16:03,  7.86s/it]
 19%|█▉        | 7167/37963 [17:15:23<65:50:43,  7.70s/it]
 19%|█▉        | 7168/37963 [17:15:37<81:41:44,  9.55s/it]
 19%|█▉        | 7169/37963 [17:15:45<76:28:25,  8.94s/it]
 19%|█▉        | 7170/37963 [17:15:52<72:51:10,  8.52s/it]
                                                          
{'loss': '0.17', 'grad_norm': '4.562', 'learning_rate': '1.871e-05', 'epoch': '0.1889'}

 19%|█▉        | 7170/37963 [17:15:52<72:51:10,  8.52s/it]
 19%|█▉        | 7171/37963 [17:16:00<69:54:51,  8.17s/it]
 19%|█▉        | 7172/37963 [17:16:14<84:55:27,  9.93s/it]
 19%|█▉        | 7173/37963 [17:16:21<78:26:12,  9.17s/it]
 19%|█▉        | 7174/37963 [17:16:29<74:00:59,  8.65s/it]
 19%|█▉        | 7175/37963 [17:16:36<71:04:34,  8.31s/it]
 19%|█▉        | 7176/37963 [17:16:44<69:26:04,  8.12s/it]
 19%|█▉        | 7177/37963 [17:16:51<68:15:39,  7.98s/it]
 19%|█▉        | 7178/37963 [17:16:59<66:20:18,  7.76s/it]
 19%|█▉        | 7179/37963 [17:17:13<82:21:55,  9.63s/it]
 19%|█▉        | 7180/37963 [17:17:20<77:00:19,  9.01s/it]
                                                          
{'loss': '0.1642', 'grad_norm': '3.424', 'learning_rate': '1.87e-05', 'epoch': '0.1891'}

 19%|█▉        | 7180/37963 [17:17:20<77:00:19,  9.01s/it]
 19%|█▉        | 7181/37963 [17:17:28<73:25:08,  8.59s/it]
 19%|█▉        | 7182/37963 [17:17:35<70:45:06,  8.27s/it]
 19%|█▉        | 7183/37963 [17:17:43<68:58:35,  8.07s/it]
 19%|█▉        | 7184/37963 [17:17:50<67:14:44,  7.87s/it]
 19%|█▉        | 7185/37963 [17:17:58<66:34:29,  7.79s/it]
 19%|█▉        | 7186/37963 [17:18:05<65:42:43,  7.69s/it]
 19%|█▉        | 7187/37963 [17:18:19<81:09:23,  9.49s/it]
 19%|█▉        | 7188/37963 [17:18:27<76:17:58,  8.93s/it]
 19%|█▉        | 7189/37963 [17:18:41<88:56:35, 10.40s/it]
 19%|█▉        | 7190/37963 [17:18:48<81:33:27,  9.54s/it]
                                                          
{'loss': '0.1719', 'grad_norm': '3.703', 'learning_rate': '1.87e-05', 'epoch': '0.1894'}

 19%|█▉        | 7190/37963 [17:18:48<81:33:27,  9.54s/it]
 19%|█▉        | 7191/37963 [17:19:02<92:35:33, 10.83s/it]
 19%|█▉        | 7192/37963 [17:19:10<84:22:04,  9.87s/it]
 19%|█▉        | 7193/37963 [17:19:17<77:42:34,  9.09s/it]
 19%|█▉        | 7194/37963 [17:19:24<73:27:06,  8.59s/it]
 19%|█▉        | 7195/37963 [17:19:32<71:01:17,  8.31s/it]
 19%|█▉        | 7196/37963 [17:19:40<69:22:11,  8.12s/it]
 19%|█▉        | 7197/37963 [17:19:47<67:41:40,  7.92s/it]
 19%|█▉        | 7198/37963 [17:19:55<66:42:56,  7.81s/it]
 19%|█▉        | 7199/37963 [17:20:02<65:48:54,  7.70s/it]
 19%|█▉        | 7200/37963 [17:20:10<65:18:21,  7.64s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '2.716', 'learning_rate': '1.869e-05', 'epoch': '0.1897'}

 19%|█▉        | 7200/37963 [17:20:10<65:18:21,  7.64s/it]
 19%|█▉        | 7201/37963 [17:20:17<64:58:58,  7.60s/it]
 19%|█▉        | 7202/37963 [17:20:25<64:52:22,  7.59s/it]
 19%|█▉        | 7203/37963 [17:20:32<64:42:57,  7.57s/it]
 19%|█▉        | 7204/37963 [17:20:46<81:14:39,  9.51s/it]
 19%|█▉        | 7205/37963 [17:20:54<76:15:40,  8.93s/it]
 19%|█▉        | 7206/37963 [17:21:01<72:17:28,  8.46s/it]
 19%|█▉        | 7207/37963 [17:21:09<70:19:45,  8.23s/it]
 19%|█▉        | 7208/37963 [17:21:16<68:31:52,  8.02s/it]
 19%|█▉        | 7209/37963 [17:21:24<67:28:10,  7.90s/it]
 19%|█▉        | 7210/37963 [17:21:31<66:00:43,  7.73s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '2.945', 'learning_rate': '1.869e-05', 'epoch': '0.1899'}

 19%|█▉        | 7210/37963 [17:21:31<66:00:43,  7.73s/it]
 19%|█▉        | 7211/37963 [17:21:39<65:47:13,  7.70s/it]
 19%|█▉        | 7212/37963 [17:21:53<82:32:22,  9.66s/it]
 19%|█▉        | 7213/37963 [17:22:01<76:48:18,  8.99s/it]
 19%|█▉        | 7214/37963 [17:22:15<90:23:46, 10.58s/it]
 19%|█▉        | 7215/37963 [17:22:22<82:33:52,  9.67s/it]
 19%|█▉        | 7216/37963 [17:22:30<76:20:31,  8.94s/it]
 19%|█▉        | 7217/37963 [17:22:37<72:29:27,  8.49s/it]
 19%|█▉        | 7218/37963 [17:22:45<70:04:17,  8.20s/it]
 19%|█▉        | 7219/37963 [17:22:52<68:17:32,  8.00s/it]
 19%|█▉        | 7220/37963 [17:23:06<83:55:24,  9.83s/it]
                                                          
{'loss': '0.1736', 'grad_norm': '1.187', 'learning_rate': '1.868e-05', 'epoch': '0.1902'}

 19%|█▉        | 7220/37963 [17:23:06<83:55:24,  9.83s/it]
 19%|█▉        | 7221/37963 [17:23:14<78:15:07,  9.16s/it]
 19%|█▉        | 7222/37963 [17:23:21<73:35:47,  8.62s/it]
 19%|█▉        | 7223/37963 [17:23:29<70:54:15,  8.30s/it]
 19%|█▉        | 7224/37963 [17:23:36<68:58:00,  8.08s/it]
 19%|█▉        | 7225/37963 [17:23:44<68:17:10,  8.00s/it]
 19%|█▉        | 7226/37963 [17:23:52<66:48:42,  7.83s/it]
 19%|█▉        | 7227/37963 [17:23:59<66:08:25,  7.75s/it]
 19%|█▉        | 7228/37963 [17:24:07<65:34:21,  7.68s/it]
 19%|█▉        | 7229/37963 [17:24:14<65:15:58,  7.64s/it]
 19%|█▉        | 7230/37963 [17:24:22<64:53:23,  7.60s/it]
                                                          
{'loss': '0.1688', 'grad_norm': '1.887', 'learning_rate': '1.868e-05', 'epoch': '0.1904'}

 19%|█▉        | 7230/37963 [17:24:22<64:53:23,  7.60s/it]
 19%|█▉        | 7231/37963 [17:24:36<81:53:01,  9.59s/it]
 19%|█▉        | 7232/37963 [17:24:50<92:11:57, 10.80s/it]
 19%|█▉        | 7233/37963 [17:24:57<83:38:36,  9.80s/it]
 19%|█▉        | 7234/37963 [17:25:12<95:37:24, 11.20s/it]
 19%|█▉        | 7235/37963 [17:25:25<102:42:26, 12.03s/it]
 19%|█▉        | 7236/37963 [17:25:33<91:15:04, 10.69s/it] 
 19%|█▉        | 7237/37963 [17:25:40<82:49:20,  9.70s/it]
 19%|█▉        | 7238/37963 [17:25:48<77:31:35,  9.08s/it]
 19%|█▉        | 7239/37963 [17:25:55<72:46:44,  8.53s/it]
 19%|█▉        | 7240/37963 [17:26:03<70:15:39,  8.23s/it]
                                                          
{'loss': '0.17', 'grad_norm': '1.927', 'learning_rate': '1.868e-05', 'epoch': '0.1907'}

 19%|█▉        | 7240/37963 [17:26:03<70:15:39,  8.23s/it]
 19%|█▉        | 7241/37963 [17:26:10<68:08:37,  7.99s/it]
 19%|█▉        | 7242/37963 [17:26:18<66:55:37,  7.84s/it]
 19%|█▉        | 7243/37963 [17:26:25<66:23:58,  7.78s/it]
 19%|█▉        | 7244/37963 [17:26:33<65:49:20,  7.71s/it]
 19%|█▉        | 7245/37963 [17:26:41<65:31:38,  7.68s/it]
 19%|█▉        | 7246/37963 [17:26:48<65:14:40,  7.65s/it]
 19%|█▉        | 7247/37963 [17:26:56<65:00:26,  7.62s/it]
 19%|█▉        | 7248/37963 [17:27:03<64:36:09,  7.57s/it]
 19%|█▉        | 7249/37963 [17:27:11<64:26:40,  7.55s/it]
 19%|█▉        | 7250/37963 [17:27:18<64:13:01,  7.53s/it]
                                                          
{'loss': '0.169', 'grad_norm': '2.091', 'learning_rate': '1.867e-05', 'epoch': '0.191'}

 19%|█▉        | 7250/37963 [17:27:18<64:13:01,  7.53s/it]
 19%|█▉        | 7251/37963 [17:27:32<81:08:14,  9.51s/it]
 19%|█▉        | 7252/37963 [17:27:40<75:18:27,  8.83s/it]
 19%|█▉        | 7253/37963 [17:27:47<71:57:54,  8.44s/it]
 19%|█▉        | 7254/37963 [17:27:55<69:45:48,  8.18s/it]
 19%|█▉        | 7255/37963 [17:28:02<68:11:44,  7.99s/it]
 19%|█▉        | 7256/37963 [17:28:10<66:51:27,  7.84s/it]
 19%|█▉        | 7257/37963 [17:28:24<82:53:39,  9.72s/it]
 19%|█▉        | 7258/37963 [17:28:31<77:04:50,  9.04s/it]
 19%|█▉        | 7259/37963 [17:28:39<73:22:26,  8.60s/it]
 19%|█▉        | 7260/37963 [17:28:46<70:27:53,  8.26s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '4.667', 'learning_rate': '1.867e-05', 'epoch': '0.1912'}

 19%|█▉        | 7260/37963 [17:28:46<70:27:53,  8.26s/it]
 19%|█▉        | 7261/37963 [17:28:54<68:49:39,  8.07s/it]
 19%|█▉        | 7262/37963 [17:29:08<83:33:34,  9.80s/it]
 19%|█▉        | 7263/37963 [17:29:15<77:56:55,  9.14s/it]
 19%|█▉        | 7264/37963 [17:29:23<74:06:49,  8.69s/it]
 19%|█▉        | 7265/37963 [17:29:31<71:30:56,  8.39s/it]
 19%|█▉        | 7266/37963 [17:29:38<68:16:22,  8.01s/it]
 19%|█▉        | 7267/37963 [17:29:45<66:55:45,  7.85s/it]
 19%|█▉        | 7268/37963 [17:29:53<66:10:58,  7.76s/it]
 19%|█▉        | 7269/37963 [17:30:07<82:51:32,  9.72s/it]
 19%|█▉        | 7270/37963 [17:30:15<77:14:28,  9.06s/it]
                                                          
{'loss': '0.1671', 'grad_norm': '2.751', 'learning_rate': '1.866e-05', 'epoch': '0.1915'}

 19%|█▉        | 7270/37963 [17:30:15<77:14:28,  9.06s/it]
 19%|█▉        | 7271/37963 [17:30:22<73:18:51,  8.60s/it]
 19%|█▉        | 7272/37963 [17:30:30<70:31:31,  8.27s/it]
 19%|█▉        | 7273/37963 [17:30:37<67:57:51,  7.97s/it]
 19%|█▉        | 7274/37963 [17:30:44<66:17:24,  7.78s/it]
 19%|█▉        | 7275/37963 [17:30:52<65:28:00,  7.68s/it]
 19%|█▉        | 7276/37963 [17:30:59<65:08:02,  7.64s/it]
 19%|█▉        | 7277/37963 [17:31:06<63:44:03,  7.48s/it]
 19%|█▉        | 7278/37963 [17:31:14<63:42:36,  7.47s/it]
 19%|█▉        | 7279/37963 [17:31:34<96:51:39, 11.36s/it]
 19%|█▉        | 7280/37963 [17:31:42<87:00:35, 10.21s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '1.148', 'learning_rate': '1.866e-05', 'epoch': '0.1918'}

 19%|█▉        | 7280/37963 [17:31:42<87:00:35, 10.21s/it]
 19%|█▉        | 7281/37963 [17:31:56<96:47:34, 11.36s/it]
 19%|█▉        | 7282/37963 [17:32:03<86:49:35, 10.19s/it]
 19%|█▉        | 7283/37963 [17:32:11<80:07:11,  9.40s/it]
 19%|█▉        | 7284/37963 [17:32:18<75:27:47,  8.86s/it]
 19%|█▉        | 7285/37963 [17:32:33<89:00:40, 10.45s/it]
 19%|█▉        | 7286/37963 [17:32:40<80:49:41,  9.49s/it]
 19%|█▉        | 7287/37963 [17:32:47<75:38:14,  8.88s/it]
 19%|█▉        | 7288/37963 [17:32:55<72:09:40,  8.47s/it]
 19%|█▉        | 7289/37963 [17:33:02<69:40:03,  8.18s/it]
 19%|█▉        | 7290/37963 [17:33:10<67:55:14,  7.97s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '1.84', 'learning_rate': '1.865e-05', 'epoch': '0.192'}

 19%|█▉        | 7290/37963 [17:33:10<67:55:14,  7.97s/it]
 19%|█▉        | 7291/37963 [17:33:17<67:00:18,  7.86s/it]
 19%|█▉        | 7292/37963 [17:33:25<66:19:17,  7.78s/it]
 19%|█▉        | 7293/37963 [17:33:32<65:35:51,  7.70s/it]
 19%|█▉        | 7294/37963 [17:33:40<64:23:43,  7.56s/it]
 19%|█▉        | 7295/37963 [17:33:47<63:44:16,  7.48s/it]
 19%|█▉        | 7296/37963 [17:33:55<64:05:35,  7.52s/it]
 19%|█▉        | 7297/37963 [17:34:02<63:26:19,  7.45s/it]
 19%|█▉        | 7298/37963 [17:34:09<63:00:55,  7.40s/it]
 19%|█▉        | 7299/37963 [17:34:17<63:16:23,  7.43s/it]
 19%|█▉        | 7300/37963 [17:34:24<63:31:59,  7.46s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '1.791', 'learning_rate': '1.865e-05', 'epoch': '0.1923'}

 19%|█▉        | 7300/37963 [17:34:24<63:31:59,  7.46s/it]
 19%|█▉        | 7301/37963 [17:34:38<80:53:45,  9.50s/it]
 19%|█▉        | 7302/37963 [17:34:46<75:55:03,  8.91s/it]
 19%|█▉        | 7303/37963 [17:34:54<72:20:15,  8.49s/it]
 19%|█▉        | 7304/37963 [17:35:01<70:04:04,  8.23s/it]
 19%|█▉        | 7305/37963 [17:35:08<67:48:21,  7.96s/it]
 19%|█▉        | 7306/37963 [17:35:16<66:39:02,  7.83s/it]
 19%|█▉        | 7307/37963 [17:35:30<81:29:48,  9.57s/it]
 19%|█▉        | 7308/37963 [17:35:43<92:16:44, 10.84s/it]
 19%|█▉        | 7309/37963 [17:35:51<83:59:29,  9.86s/it]
 19%|█▉        | 7310/37963 [17:35:59<78:09:19,  9.18s/it]
                                                          
{'loss': '0.1527', 'grad_norm': '2.98', 'learning_rate': '1.865e-05', 'epoch': '0.1926'}

 19%|█▉        | 7310/37963 [17:35:59<78:09:19,  9.18s/it]
 19%|█▉        | 7311/37963 [17:36:06<74:05:00,  8.70s/it]
 19%|█▉        | 7312/37963 [17:36:14<71:03:13,  8.35s/it]
 19%|█▉        | 7313/37963 [17:36:21<69:00:53,  8.11s/it]
 19%|█▉        | 7314/37963 [17:36:28<66:41:15,  7.83s/it]
 19%|█▉        | 7315/37963 [17:36:36<66:12:07,  7.78s/it]
 19%|█▉        | 7316/37963 [17:36:44<66:08:39,  7.77s/it]
 19%|█▉        | 7317/37963 [17:36:58<81:42:19,  9.60s/it]
 19%|█▉        | 7318/37963 [17:37:05<76:30:12,  8.99s/it]
 19%|█▉        | 7319/37963 [17:37:13<72:51:01,  8.56s/it]
 19%|█▉        | 7320/37963 [17:37:20<70:15:40,  8.25s/it]
                                                          
{'loss': '0.1514', 'grad_norm': '6.746', 'learning_rate': '1.864e-05', 'epoch': '0.1928'}

 19%|█▉        | 7320/37963 [17:37:20<70:15:40,  8.25s/it]
 19%|█▉        | 7321/37963 [17:37:28<68:24:13,  8.04s/it]
 19%|█▉        | 7322/37963 [17:37:35<67:11:42,  7.89s/it]
 19%|█▉        | 7323/37963 [17:37:43<65:46:05,  7.73s/it]
 19%|█▉        | 7324/37963 [17:37:50<65:15:50,  7.67s/it]
 19%|█▉        | 7325/37963 [17:38:04<80:47:57,  9.49s/it]
 19%|█▉        | 7326/37963 [17:38:12<75:52:13,  8.92s/it]
 19%|█▉        | 7327/37963 [17:38:19<72:30:18,  8.52s/it]
 19%|█▉        | 7328/37963 [17:38:33<86:25:48, 10.16s/it]
 19%|█▉        | 7329/37963 [17:38:47<96:18:48, 11.32s/it]
 19%|█▉        | 7330/37963 [17:39:01<103:10:36, 12.13s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.285', 'learning_rate': '1.864e-05', 'epoch': '0.1931'}

 19%|█▉        | 7330/37963 [17:39:01<103:10:36, 12.13s/it]
 19%|█▉        | 7331/37963 [17:39:09<91:32:50, 10.76s/it] 
 19%|█▉        | 7332/37963 [17:39:16<83:28:31,  9.81s/it]
 19%|█▉        | 7333/37963 [17:39:24<77:50:48,  9.15s/it]
 19%|█▉        | 7334/37963 [17:39:32<73:43:29,  8.67s/it]
 19%|█▉        | 7335/37963 [17:39:39<70:50:43,  8.33s/it]
 19%|█▉        | 7336/37963 [17:39:47<68:56:32,  8.10s/it]
 19%|█▉        | 7337/37963 [17:39:54<67:31:23,  7.94s/it]
 19%|█▉        | 7338/37963 [17:40:02<66:26:40,  7.81s/it]
 19%|█▉        | 7339/37963 [17:40:09<65:52:50,  7.74s/it]
 19%|█▉        | 7340/37963 [17:40:17<65:42:55,  7.73s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '0.7615', 'learning_rate': '1.863e-05', 'epoch': '0.1933'}

 19%|█▉        | 7340/37963 [17:40:17<65:42:55,  7.73s/it]
 19%|█▉        | 7341/37963 [17:40:24<64:59:58,  7.64s/it]
 19%|█▉        | 7342/37963 [17:40:32<64:43:13,  7.61s/it]
 19%|█▉        | 7343/37963 [17:40:40<64:33:27,  7.59s/it]
 19%|█▉        | 7344/37963 [17:40:47<64:18:49,  7.56s/it]
 19%|█▉        | 7345/37963 [17:40:55<64:18:02,  7.56s/it]
 19%|█▉        | 7346/37963 [17:41:02<64:17:11,  7.56s/it]
 19%|█▉        | 7347/37963 [17:41:10<64:08:52,  7.54s/it]
 19%|█▉        | 7348/37963 [17:41:17<64:16:42,  7.56s/it]
 19%|█▉        | 7349/37963 [17:41:25<64:07:25,  7.54s/it]
 19%|█▉        | 7350/37963 [17:41:38<79:47:19,  9.38s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '3.643', 'learning_rate': '1.863e-05', 'epoch': '0.1936'}

 19%|█▉        | 7350/37963 [17:41:38<79:47:19,  9.38s/it]
 19%|█▉        | 7351/37963 [17:41:46<76:01:25,  8.94s/it]
 19%|█▉        | 7352/37963 [17:41:54<71:45:51,  8.44s/it]
 19%|█▉        | 7353/37963 [17:42:08<85:57:10, 10.11s/it]
 19%|█▉        | 7354/37963 [17:42:15<79:34:35,  9.36s/it]
 19%|█▉        | 7355/37963 [17:42:23<74:50:53,  8.80s/it]
 19%|█▉        | 7356/37963 [17:42:37<87:52:35, 10.34s/it]
 19%|█▉        | 7357/37963 [17:42:44<80:14:24,  9.44s/it]
 19%|█▉        | 7358/37963 [17:42:52<75:38:22,  8.90s/it]
 19%|█▉        | 7359/37963 [17:42:59<72:10:40,  8.49s/it]
 19%|█▉        | 7360/37963 [17:43:07<69:38:05,  8.19s/it]
                                                          
{'loss': '0.1475', 'grad_norm': '3.222', 'learning_rate': '1.862e-05', 'epoch': '0.1939'}

 19%|█▉        | 7360/37963 [17:43:07<69:38:05,  8.19s/it]
 19%|█▉        | 7361/37963 [17:43:14<67:53:27,  7.99s/it]
 19%|█▉        | 7362/37963 [17:43:22<66:59:17,  7.88s/it]
 19%|█▉        | 7363/37963 [17:43:29<65:15:51,  7.68s/it]
 19%|█▉        | 7364/37963 [17:43:37<64:54:16,  7.64s/it]
 19%|█▉        | 7365/37963 [17:43:44<65:04:46,  7.66s/it]
 19%|█▉        | 7366/37963 [17:43:52<64:21:32,  7.57s/it]
 19%|█▉        | 7367/37963 [17:43:59<64:15:50,  7.56s/it]
 19%|█▉        | 7368/37963 [17:44:13<80:38:21,  9.49s/it]
 19%|█▉        | 7369/37963 [17:44:21<75:56:51,  8.94s/it]
 19%|█▉        | 7370/37963 [17:44:28<72:19:55,  8.51s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '3.866', 'learning_rate': '1.862e-05', 'epoch': '0.1941'}

 19%|█▉        | 7370/37963 [17:44:28<72:19:55,  8.51s/it]
 19%|█▉        | 7371/37963 [17:44:36<69:42:59,  8.20s/it]
 19%|█▉        | 7372/37963 [17:44:43<68:15:05,  8.03s/it]
 19%|█▉        | 7373/37963 [17:44:51<66:58:33,  7.88s/it]
 19%|█▉        | 7374/37963 [17:44:59<66:18:53,  7.80s/it]
 19%|█▉        | 7375/37963 [17:45:06<65:19:09,  7.69s/it]
 19%|█▉        | 7376/37963 [17:45:20<81:46:05,  9.62s/it]
 19%|█▉        | 7377/37963 [17:45:34<93:04:12, 10.95s/it]
 19%|█▉        | 7378/37963 [17:45:48<100:08:39, 11.79s/it]
 19%|█▉        | 7379/37963 [17:45:56<89:42:53, 10.56s/it] 
 19%|█▉        | 7380/37963 [17:46:10<98:16:01, 11.57s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '3.077', 'learning_rate': '1.862e-05', 'epoch': '0.1944'}

 19%|█▉        | 7380/37963 [17:46:10<98:16:01, 11.57s/it]
 19%|█▉        | 7381/37963 [17:46:17<87:42:46, 10.33s/it]
 19%|█▉        | 7382/37963 [17:46:24<79:55:30,  9.41s/it]
 19%|█▉        | 7383/37963 [17:46:31<74:26:44,  8.76s/it]
 19%|█▉        | 7384/37963 [17:46:39<71:18:36,  8.40s/it]
 19%|█▉        | 7385/37963 [17:46:47<69:17:12,  8.16s/it]
 19%|█▉        | 7386/37963 [17:46:54<67:41:29,  7.97s/it]
 19%|█▉        | 7387/37963 [17:47:02<66:44:42,  7.86s/it]
 19%|█▉        | 7388/37963 [17:47:09<66:12:14,  7.80s/it]
 19%|█▉        | 7389/37963 [17:47:17<65:28:00,  7.71s/it]
 19%|█▉        | 7390/37963 [17:47:24<65:05:59,  7.67s/it]
                                                          
{'loss': '0.1715', 'grad_norm': '1.533', 'learning_rate': '1.861e-05', 'epoch': '0.1947'}

 19%|█▉        | 7390/37963 [17:47:24<65:05:59,  7.67s/it]
 19%|█▉        | 7391/37963 [17:47:32<64:08:16,  7.55s/it]
 19%|█▉        | 7392/37963 [17:47:39<64:07:22,  7.55s/it]
 19%|█▉        | 7393/37963 [17:47:47<63:33:18,  7.48s/it]
 19%|█▉        | 7394/37963 [17:47:54<63:24:09,  7.47s/it]
 19%|█▉        | 7395/37963 [17:48:02<63:35:01,  7.49s/it]
 19%|█▉        | 7396/37963 [17:48:09<63:55:35,  7.53s/it]
 19%|█▉        | 7397/37963 [17:48:23<79:58:47,  9.42s/it]
 19%|█▉        | 7398/37963 [17:48:31<75:44:51,  8.92s/it]
 19%|█▉        | 7399/37963 [17:48:45<87:55:17, 10.36s/it]
 19%|█▉        | 7400/37963 [17:48:52<80:36:21,  9.49s/it]
                                                          
{'loss': '0.1553', 'grad_norm': '1.309', 'learning_rate': '1.861e-05', 'epoch': '0.1949'}

 19%|█▉        | 7400/37963 [17:48:52<80:36:21,  9.49s/it]
 19%|█▉        | 7401/37963 [17:48:59<75:13:43,  8.86s/it]
 19%|█▉        | 7402/37963 [17:49:13<86:57:56, 10.24s/it]
 20%|█▉        | 7403/37963 [17:49:20<79:52:26,  9.41s/it]
 20%|█▉        | 7404/37963 [17:49:28<74:52:51,  8.82s/it]
 20%|█▉        | 7405/37963 [17:49:35<70:47:59,  8.34s/it]
 20%|█▉        | 7406/37963 [17:49:42<68:34:13,  8.08s/it]
 20%|█▉        | 7407/37963 [17:49:50<67:04:52,  7.90s/it]
 20%|█▉        | 7408/37963 [17:49:57<66:00:54,  7.78s/it]
 20%|█▉        | 7409/37963 [17:50:05<64:53:49,  7.65s/it]
 20%|█▉        | 7410/37963 [17:50:12<64:31:40,  7.60s/it]
                                                          
{'loss': '0.1672', 'grad_norm': '1.405', 'learning_rate': '1.86e-05', 'epoch': '0.1952'}

 20%|█▉        | 7410/37963 [17:50:12<64:31:40,  7.60s/it]
 20%|█▉        | 7411/37963 [17:50:20<64:20:06,  7.58s/it]
 20%|█▉        | 7412/37963 [17:50:27<64:03:53,  7.55s/it]
 20%|█▉        | 7413/37963 [17:50:35<64:00:36,  7.54s/it]
 20%|█▉        | 7414/37963 [17:50:42<63:37:30,  7.50s/it]
 20%|█▉        | 7415/37963 [17:50:50<63:45:30,  7.51s/it]
 20%|█▉        | 7416/37963 [17:50:57<63:50:06,  7.52s/it]
 20%|█▉        | 7417/37963 [17:51:11<79:38:17,  9.39s/it]
 20%|█▉        | 7418/37963 [17:51:18<74:26:57,  8.77s/it]
 20%|█▉        | 7419/37963 [17:51:26<71:16:48,  8.40s/it]
 20%|█▉        | 7420/37963 [17:51:33<68:34:07,  8.08s/it]
                                                          
{'loss': '0.1539', 'grad_norm': '2.705', 'learning_rate': '1.86e-05', 'epoch': '0.1955'}

 20%|█▉        | 7420/37963 [17:51:33<68:34:07,  8.08s/it]
 20%|█▉        | 7421/37963 [17:51:41<67:11:04,  7.92s/it]
 20%|█▉        | 7422/37963 [17:51:48<66:08:03,  7.80s/it]
 20%|█▉        | 7423/37963 [17:52:02<80:54:46,  9.54s/it]
 20%|█▉        | 7424/37963 [17:52:09<75:41:26,  8.92s/it]
 20%|█▉        | 7425/37963 [17:52:17<72:00:17,  8.49s/it]
 20%|█▉        | 7426/37963 [17:52:24<68:45:29,  8.11s/it]
 20%|█▉        | 7427/37963 [17:52:32<67:11:48,  7.92s/it]
 20%|█▉        | 7428/37963 [17:52:45<81:32:15,  9.61s/it]
 20%|█▉        | 7429/37963 [17:52:59<92:35:57, 10.92s/it]
 20%|█▉        | 7430/37963 [17:53:13<100:16:31, 11.82s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '1.46', 'learning_rate': '1.859e-05', 'epoch': '0.1957'}

 20%|█▉        | 7430/37963 [17:53:13<100:16:31, 11.82s/it]
 20%|█▉        | 7431/37963 [17:53:21<89:19:21, 10.53s/it] 
 20%|█▉        | 7432/37963 [17:53:28<81:43:40,  9.64s/it]
 20%|█▉        | 7433/37963 [17:53:35<75:54:02,  8.95s/it]
 20%|█▉        | 7434/37963 [17:53:43<72:20:29,  8.53s/it]
 20%|█▉        | 7435/37963 [17:53:51<69:48:42,  8.23s/it]
 20%|█▉        | 7436/37963 [17:53:58<68:31:39,  8.08s/it]
 20%|█▉        | 7437/37963 [17:54:06<67:24:52,  7.95s/it]
 20%|█▉        | 7438/37963 [17:54:13<66:29:05,  7.84s/it]
 20%|█▉        | 7439/37963 [17:54:21<65:37:07,  7.74s/it]
 20%|█▉        | 7440/37963 [17:54:29<65:07:12,  7.68s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '1.423', 'learning_rate': '1.859e-05', 'epoch': '0.196'}

 20%|█▉        | 7440/37963 [17:54:29<65:07:12,  7.68s/it]
 20%|█▉        | 7441/37963 [17:54:36<64:36:17,  7.62s/it]
 20%|█▉        | 7442/37963 [17:54:44<64:21:38,  7.59s/it]
 20%|█▉        | 7443/37963 [17:54:51<63:47:16,  7.52s/it]
 20%|█▉        | 7444/37963 [17:55:05<79:42:17,  9.40s/it]
 20%|█▉        | 7445/37963 [17:55:12<74:48:37,  8.82s/it]
 20%|█▉        | 7446/37963 [17:55:26<87:30:31, 10.32s/it]
 20%|█▉        | 7447/37963 [17:55:33<80:18:38,  9.47s/it]
 20%|█▉        | 7448/37963 [17:55:41<75:25:30,  8.90s/it]
 20%|█▉        | 7449/37963 [17:55:48<71:45:26,  8.47s/it]
 20%|█▉        | 7450/37963 [17:55:56<69:51:15,  8.24s/it]
                                                          
{'loss': '0.1622', 'grad_norm': '1.024', 'learning_rate': '1.859e-05', 'epoch': '0.1962'}

 20%|█▉        | 7450/37963 [17:55:56<69:51:15,  8.24s/it]
 20%|█▉        | 7451/37963 [17:56:04<68:19:58,  8.06s/it]
 20%|█▉        | 7452/37963 [17:56:11<66:25:55,  7.84s/it]
 20%|█▉        | 7453/37963 [17:56:19<65:20:03,  7.71s/it]
 20%|█▉        | 7454/37963 [17:56:26<64:35:39,  7.62s/it]
 20%|█▉        | 7455/37963 [17:56:34<64:32:44,  7.62s/it]
 20%|█▉        | 7456/37963 [17:56:47<80:06:34,  9.45s/it]
 20%|█▉        | 7457/37963 [17:56:55<75:17:36,  8.89s/it]
 20%|█▉        | 7458/37963 [17:57:02<71:55:05,  8.49s/it]
 20%|█▉        | 7459/37963 [17:57:10<69:24:49,  8.19s/it]
 20%|█▉        | 7460/37963 [17:57:18<67:55:03,  8.02s/it]
                                                          
{'loss': '0.1669', 'grad_norm': '1.409', 'learning_rate': '1.858e-05', 'epoch': '0.1965'}

 20%|█▉        | 7460/37963 [17:57:18<67:55:03,  8.02s/it]
 20%|█▉        | 7461/37963 [17:57:25<66:59:57,  7.91s/it]
 20%|█▉        | 7462/37963 [17:57:33<65:53:56,  7.78s/it]
 20%|█▉        | 7463/37963 [17:57:40<65:30:06,  7.73s/it]
 20%|█▉        | 7464/37963 [17:57:48<64:18:50,  7.59s/it]
 20%|█▉        | 7465/37963 [17:57:55<64:09:47,  7.57s/it]
 20%|█▉        | 7466/37963 [17:58:02<63:28:52,  7.49s/it]
 20%|█▉        | 7467/37963 [17:58:10<63:37:03,  7.51s/it]
 20%|█▉        | 7468/37963 [17:58:17<63:25:19,  7.49s/it]
 20%|█▉        | 7469/37963 [17:58:25<63:33:30,  7.50s/it]
 20%|█▉        | 7470/37963 [17:58:39<80:07:46,  9.46s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '4.508', 'learning_rate': '1.858e-05', 'epoch': '0.1968'}

 20%|█▉        | 7470/37963 [17:58:39<80:07:46,  9.46s/it]
 20%|█▉        | 7471/37963 [17:58:46<74:48:17,  8.83s/it]
 20%|█▉        | 7472/37963 [17:58:54<71:18:39,  8.42s/it]
 20%|█▉        | 7473/37963 [17:59:01<68:59:30,  8.15s/it]
 20%|█▉        | 7474/37963 [17:59:15<83:56:11,  9.91s/it]
 20%|█▉        | 7475/37963 [17:59:23<78:02:09,  9.21s/it]
 20%|█▉        | 7476/37963 [17:59:37<89:34:54, 10.58s/it]
 20%|█▉        | 7477/37963 [17:59:57<114:28:46, 13.52s/it]
 20%|█▉        | 7478/37963 [18:00:05<99:27:24, 11.74s/it] 
 20%|█▉        | 7479/37963 [18:00:12<88:01:21, 10.40s/it]
 20%|█▉        | 7480/37963 [18:00:19<80:16:15,  9.48s/it]
                                                          
{'loss': '0.1601', 'grad_norm': '1.844', 'learning_rate': '1.857e-05', 'epoch': '0.197'}

 20%|█▉        | 7480/37963 [18:00:19<80:16:15,  9.48s/it]
 20%|█▉        | 7481/37963 [18:00:27<75:16:21,  8.89s/it]
 20%|█▉        | 7482/37963 [18:00:34<71:42:38,  8.47s/it]
 20%|█▉        | 7483/37963 [18:00:42<69:27:59,  8.20s/it]
 20%|█▉        | 7484/37963 [18:00:49<67:56:50,  8.03s/it]
 20%|█▉        | 7485/37963 [18:00:57<65:50:05,  7.78s/it]
 20%|█▉        | 7486/37963 [18:01:04<65:13:46,  7.71s/it]
 20%|█▉        | 7487/37963 [18:01:11<64:11:27,  7.58s/it]
 20%|█▉        | 7488/37963 [18:01:19<64:01:11,  7.56s/it]
 20%|█▉        | 7489/37963 [18:01:26<63:14:59,  7.47s/it]
 20%|█▉        | 7490/37963 [18:01:34<63:26:43,  7.50s/it]
                                                          
{'loss': '0.1533', 'grad_norm': '0.8665', 'learning_rate': '1.857e-05', 'epoch': '0.1973'}

 20%|█▉        | 7490/37963 [18:01:34<63:26:43,  7.50s/it]
 20%|█▉        | 7491/37963 [18:01:47<79:08:01,  9.35s/it]
 20%|█▉        | 7492/37963 [18:01:55<74:47:01,  8.84s/it]
 20%|█▉        | 7493/37963 [18:02:03<71:28:21,  8.44s/it]
 20%|█▉        | 7494/37963 [18:02:10<68:52:20,  8.14s/it]
 20%|█▉        | 7495/37963 [18:02:18<67:26:11,  7.97s/it]
 20%|█▉        | 7496/37963 [18:02:25<66:17:52,  7.83s/it]
 20%|█▉        | 7497/37963 [18:02:33<65:30:14,  7.74s/it]
 20%|█▉        | 7498/37963 [18:02:40<65:03:55,  7.69s/it]
 20%|█▉        | 7499/37963 [18:02:54<80:57:16,  9.57s/it]
 20%|█▉        | 7500/37963 [18:03:02<76:22:38,  9.03s/it]
                                                          
{'loss': '0.1756', 'grad_norm': '2.036', 'learning_rate': '1.856e-05', 'epoch': '0.1976'}

 20%|█▉        | 7500/37963 [18:03:02<76:22:38,  9.03s/it]
 20%|█▉        | 7501/37963 [18:03:09<72:25:05,  8.56s/it]
 20%|█▉        | 7502/37963 [18:03:17<69:49:57,  8.25s/it]
 20%|█▉        | 7503/37963 [18:03:24<67:43:43,  8.00s/it]
 20%|█▉        | 7504/37963 [18:03:38<81:59:33,  9.69s/it]
 20%|█▉        | 7505/37963 [18:03:46<76:39:44,  9.06s/it]
 20%|█▉        | 7506/37963 [18:03:53<72:51:19,  8.61s/it]
 20%|█▉        | 7507/37963 [18:04:01<70:07:00,  8.29s/it]
 20%|█▉        | 7508/37963 [18:04:08<68:20:45,  8.08s/it]
 20%|█▉        | 7509/37963 [18:04:16<66:50:51,  7.90s/it]
 20%|█▉        | 7510/37963 [18:04:23<66:06:02,  7.81s/it]
                                                          
{'loss': '0.1662', 'grad_norm': '4.339', 'learning_rate': '1.856e-05', 'epoch': '0.1978'}

 20%|█▉        | 7510/37963 [18:04:23<66:06:02,  7.81s/it]
 20%|█▉        | 7511/37963 [18:04:31<65:18:05,  7.72s/it]
 20%|█▉        | 7512/37963 [18:04:39<65:02:14,  7.69s/it]
 20%|█▉        | 7513/37963 [18:04:46<64:32:23,  7.63s/it]
 20%|█▉        | 7514/37963 [18:04:54<64:20:06,  7.61s/it]
 20%|█▉        | 7515/37963 [18:05:01<64:29:38,  7.63s/it]
 20%|█▉        | 7516/37963 [18:05:09<64:27:13,  7.62s/it]
 20%|█▉        | 7517/37963 [18:05:23<80:19:57,  9.50s/it]
 20%|█▉        | 7518/37963 [18:05:30<75:07:05,  8.88s/it]
 20%|█▉        | 7519/37963 [18:05:38<71:38:56,  8.47s/it]
 20%|█▉        | 7520/37963 [18:05:45<69:20:18,  8.20s/it]
                                                          
{'loss': '0.1557', 'grad_norm': '1.819', 'learning_rate': '1.855e-05', 'epoch': '0.1981'}

 20%|█▉        | 7520/37963 [18:05:45<69:20:18,  8.20s/it]
 20%|█▉        | 7521/37963 [18:05:53<67:12:58,  7.95s/it]
 20%|█▉        | 7522/37963 [18:06:00<66:10:53,  7.83s/it]
 20%|█▉        | 7523/37963 [18:06:14<82:41:36,  9.78s/it]
 20%|█▉        | 7524/37963 [18:06:28<93:22:50, 11.04s/it]
 20%|█▉        | 7525/37963 [18:06:36<84:35:52, 10.01s/it]
 20%|█▉        | 7526/37963 [18:06:56<110:48:14, 13.11s/it]
 20%|█▉        | 7527/37963 [18:07:04<96:46:22, 11.45s/it] 
 20%|█▉        | 7528/37963 [18:07:11<85:47:12, 10.15s/it]
 20%|█▉        | 7529/37963 [18:07:19<79:08:00,  9.36s/it]
 20%|█▉        | 7530/37963 [18:07:26<74:28:03,  8.81s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '2.267', 'learning_rate': '1.855e-05', 'epoch': '0.1984'}

 20%|█▉        | 7530/37963 [18:07:26<74:28:03,  8.81s/it]
 20%|█▉        | 7531/37963 [18:07:34<71:35:44,  8.47s/it]
 20%|█▉        | 7532/37963 [18:07:41<69:16:49,  8.20s/it]
 20%|█▉        | 7533/37963 [18:07:49<66:54:47,  7.92s/it]
 20%|█▉        | 7534/37963 [18:07:56<65:57:20,  7.80s/it]
 20%|█▉        | 7535/37963 [18:08:10<81:59:26,  9.70s/it]
 20%|█▉        | 7536/37963 [18:08:18<76:30:11,  9.05s/it]
 20%|█▉        | 7537/37963 [18:08:25<72:33:58,  8.59s/it]
 20%|█▉        | 7538/37963 [18:08:33<69:45:10,  8.25s/it]
 20%|█▉        | 7539/37963 [18:08:40<67:18:10,  7.96s/it]
 20%|█▉        | 7540/37963 [18:08:47<65:30:18,  7.75s/it]
                                                          
{'loss': '0.1706', 'grad_norm': '1.689', 'learning_rate': '1.855e-05', 'epoch': '0.1986'}

 20%|█▉        | 7540/37963 [18:08:47<65:30:18,  7.75s/it]
 20%|█▉        | 7541/37963 [18:08:55<64:49:29,  7.67s/it]
 20%|█▉        | 7542/37963 [18:09:02<64:25:43,  7.62s/it]
 20%|█▉        | 7543/37963 [18:09:10<64:03:41,  7.58s/it]
 20%|█▉        | 7544/37963 [18:09:18<64:15:53,  7.61s/it]
 20%|█▉        | 7545/37963 [18:09:25<64:09:54,  7.59s/it]
 20%|█▉        | 7546/37963 [18:09:33<63:52:50,  7.56s/it]
 20%|█▉        | 7547/37963 [18:09:47<80:26:01,  9.52s/it]
 20%|█▉        | 7548/37963 [18:09:54<75:31:58,  8.94s/it]
 20%|█▉        | 7549/37963 [18:10:02<71:38:37,  8.48s/it]
 20%|█▉        | 7550/37963 [18:10:09<68:31:54,  8.11s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '2.011', 'learning_rate': '1.854e-05', 'epoch': '0.1989'}

 20%|█▉        | 7550/37963 [18:10:09<68:31:54,  8.11s/it]
 20%|█▉        | 7551/37963 [18:10:16<66:56:48,  7.92s/it]
 20%|█▉        | 7552/37963 [18:10:24<65:52:04,  7.80s/it]
 20%|█▉        | 7553/37963 [18:10:31<65:11:36,  7.72s/it]
 20%|█▉        | 7554/37963 [18:10:45<80:44:16,  9.56s/it]
 20%|█▉        | 7555/37963 [18:10:53<75:41:13,  8.96s/it]
 20%|█▉        | 7556/37963 [18:11:00<72:15:08,  8.55s/it]
 20%|█▉        | 7557/37963 [18:11:08<69:50:43,  8.27s/it]
 20%|█▉        | 7558/37963 [18:11:15<66:56:57,  7.93s/it]
 20%|█▉        | 7559/37963 [18:11:23<65:45:50,  7.79s/it]
 20%|█▉        | 7560/37963 [18:11:30<64:28:54,  7.64s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '2.558', 'learning_rate': '1.854e-05', 'epoch': '0.1991'}

 20%|█▉        | 7560/37963 [18:11:30<64:28:54,  7.64s/it]
 20%|█▉        | 7561/37963 [18:11:37<64:15:57,  7.61s/it]
 20%|█▉        | 7562/37963 [18:11:45<63:59:29,  7.58s/it]
 20%|█▉        | 7563/37963 [18:11:59<80:18:13,  9.51s/it]
 20%|█▉        | 7564/37963 [18:12:06<74:44:10,  8.85s/it]
 20%|█▉        | 7565/37963 [18:12:14<71:14:21,  8.44s/it]
 20%|█▉        | 7566/37963 [18:12:21<68:22:37,  8.10s/it]
 20%|█▉        | 7567/37963 [18:12:29<66:58:15,  7.93s/it]
 20%|█▉        | 7568/37963 [18:12:36<65:58:47,  7.81s/it]
 20%|█▉        | 7569/37963 [18:12:44<65:27:40,  7.75s/it]
 20%|█▉        | 7570/37963 [18:12:51<64:26:25,  7.63s/it]
                                                          
{'loss': '0.1743', 'grad_norm': '1.435', 'learning_rate': '1.853e-05', 'epoch': '0.1994'}

 20%|█▉        | 7570/37963 [18:12:51<64:26:25,  7.63s/it]
 20%|█▉        | 7571/37963 [18:13:12<97:40:51, 11.57s/it]
 20%|█▉        | 7572/37963 [18:13:19<87:24:33, 10.35s/it]
 20%|█▉        | 7573/37963 [18:13:33<96:26:36, 11.42s/it]
 20%|█▉        | 7574/37963 [18:13:41<86:37:03, 10.26s/it]
 20%|█▉        | 7575/37963 [18:13:55<95:44:15, 11.34s/it]
 20%|█▉        | 7576/37963 [18:14:02<86:05:39, 10.20s/it]
 20%|█▉        | 7577/37963 [18:14:10<79:14:03,  9.39s/it]
 20%|█▉        | 7578/37963 [18:14:17<74:29:24,  8.83s/it]
 20%|█▉        | 7579/37963 [18:14:25<71:12:35,  8.44s/it]
 20%|█▉        | 7580/37963 [18:14:32<68:47:57,  8.15s/it]
                                                          
{'loss': '0.165', 'grad_norm': '1.53', 'learning_rate': '1.853e-05', 'epoch': '0.1997'}

 20%|█▉        | 7580/37963 [18:14:32<68:47:57,  8.15s/it]
 20%|█▉        | 7581/37963 [18:14:40<66:36:30,  7.89s/it]
 20%|█▉        | 7582/37963 [18:14:47<65:37:07,  7.78s/it]
 20%|█▉        | 7583/37963 [18:14:55<64:59:48,  7.70s/it]
 20%|█▉        | 7584/37963 [18:15:02<64:43:19,  7.67s/it]
 20%|█▉        | 7585/37963 [18:15:10<64:13:31,  7.61s/it]
 20%|█▉        | 7586/37963 [18:15:24<80:16:14,  9.51s/it]
 20%|█▉        | 7587/37963 [18:15:31<75:34:42,  8.96s/it]
 20%|█▉        | 7588/37963 [18:15:39<72:07:00,  8.55s/it]
 20%|█▉        | 7589/37963 [18:15:47<69:52:55,  8.28s/it]
 20%|█▉        | 7590/37963 [18:15:54<67:11:52,  7.96s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '1.655', 'learning_rate': '1.852e-05', 'epoch': '0.1999'}

 20%|█▉        | 7590/37963 [18:15:54<67:11:52,  7.96s/it]
 20%|█▉        | 7591/37963 [18:16:01<66:22:29,  7.87s/it]
 20%|█▉        | 7592/37963 [18:16:09<65:32:47,  7.77s/it]
 20%|██        | 7593/37963 [18:16:17<64:58:22,  7.70s/it]
 20%|██        | 7594/37963 [18:16:24<64:28:46,  7.64s/it]
 20%|██        | 7595/37963 [18:16:32<64:14:03,  7.61s/it]
 20%|██        | 7596/37963 [18:16:46<80:47:20,  9.58s/it]
 20%|██        | 7597/37963 [18:16:53<75:42:54,  8.98s/it]
 20%|██        | 7598/37963 [18:17:01<72:56:35,  8.65s/it]
 20%|██        | 7599/37963 [18:17:09<70:13:38,  8.33s/it]
 20%|██        | 7600/37963 [18:17:16<68:14:53,  8.09s/it]
                                                          
{'loss': '0.1574', 'grad_norm': '1.218', 'learning_rate': '1.852e-05', 'epoch': '0.2002'}

 20%|██        | 7600/37963 [18:17:16<68:14:53,  8.09s/it]
 20%|██        | 7601/37963 [18:17:24<66:58:52,  7.94s/it]
 20%|██        | 7602/37963 [18:17:31<65:53:34,  7.81s/it]
 20%|██        | 7603/37963 [18:17:45<81:09:50,  9.62s/it]
 20%|██        | 7604/37963 [18:17:53<75:34:58,  8.96s/it]
 20%|██        | 7605/37963 [18:18:00<71:53:39,  8.53s/it]
 20%|██        | 7606/37963 [18:18:08<69:18:04,  8.22s/it]
 20%|██        | 7607/37963 [18:18:15<67:37:09,  8.02s/it]
 20%|██        | 7608/37963 [18:18:23<66:43:06,  7.91s/it]
 20%|██        | 7609/37963 [18:18:30<65:54:32,  7.82s/it]
 20%|██        | 7610/37963 [18:18:38<65:10:37,  7.73s/it]
                                                          
{'loss': '0.1823', 'grad_norm': '2.322', 'learning_rate': '1.851e-05', 'epoch': '0.2005'}

 20%|██        | 7610/37963 [18:18:38<65:10:37,  7.73s/it]
 20%|██        | 7611/37963 [18:18:52<80:36:26,  9.56s/it]
 20%|██        | 7612/37963 [18:18:59<74:51:14,  8.88s/it]
 20%|██        | 7613/37963 [18:19:07<71:48:45,  8.52s/it]
 20%|██        | 7614/37963 [18:19:15<69:48:14,  8.28s/it]
 20%|██        | 7615/37963 [18:19:22<68:03:27,  8.07s/it]
 20%|██        | 7616/37963 [18:19:30<66:57:08,  7.94s/it]
 20%|██        | 7617/37963 [18:19:37<65:51:42,  7.81s/it]
 20%|██        | 7618/37963 [18:19:45<64:58:37,  7.71s/it]
 20%|██        | 7619/37963 [18:19:59<80:32:45,  9.56s/it]
 20%|██        | 7620/37963 [18:20:06<75:33:32,  8.96s/it]
                                                          
{'loss': '0.1749', 'grad_norm': '1.797', 'learning_rate': '1.851e-05', 'epoch': '0.2007'}

 20%|██        | 7620/37963 [18:20:06<75:33:32,  8.96s/it]
 20%|██        | 7621/37963 [18:20:14<71:56:33,  8.54s/it]
 20%|██        | 7622/37963 [18:20:28<85:54:34, 10.19s/it]
 20%|██        | 7623/37963 [18:20:35<79:05:42,  9.39s/it]
 20%|██        | 7624/37963 [18:20:49<90:54:11, 10.79s/it]
 20%|██        | 7625/37963 [18:21:03<98:45:01, 11.72s/it]
 20%|██        | 7626/37963 [18:21:11<88:28:08, 10.50s/it]
 20%|██        | 7627/37963 [18:21:18<81:02:23,  9.62s/it]
 20%|██        | 7628/37963 [18:21:26<75:22:35,  8.95s/it]
 20%|██        | 7629/37963 [18:21:33<71:45:58,  8.52s/it]
 20%|██        | 7630/37963 [18:21:48<86:19:03, 10.24s/it]
                                                          
{'loss': '0.162', 'grad_norm': '5.872', 'learning_rate': '1.851e-05', 'epoch': '0.201'}

 20%|██        | 7630/37963 [18:21:48<86:19:03, 10.24s/it]
 20%|██        | 7631/37963 [18:21:55<79:39:51,  9.46s/it]
 20%|██        | 7632/37963 [18:22:03<74:40:51,  8.86s/it]
 20%|██        | 7633/37963 [18:22:10<71:27:20,  8.48s/it]
 20%|██        | 7634/37963 [18:22:18<68:56:00,  8.18s/it]
 20%|██        | 7635/37963 [18:22:25<67:17:27,  7.99s/it]
 20%|██        | 7636/37963 [18:22:33<66:05:52,  7.85s/it]
 20%|██        | 7637/37963 [18:22:40<65:14:44,  7.75s/it]
 20%|██        | 7638/37963 [18:22:48<64:58:06,  7.71s/it]
 20%|██        | 7639/37963 [18:22:55<64:26:22,  7.65s/it]
 20%|██        | 7640/37963 [18:23:03<64:07:09,  7.61s/it]
                                                          
{'loss': '0.1588', 'grad_norm': '2.928', 'learning_rate': '1.85e-05', 'epoch': '0.2012'}

 20%|██        | 7640/37963 [18:23:03<64:07:09,  7.61s/it]
 20%|██        | 7641/37963 [18:23:11<64:03:51,  7.61s/it]
 20%|██        | 7642/37963 [18:23:25<80:00:22,  9.50s/it]
 20%|██        | 7643/37963 [18:23:32<75:06:05,  8.92s/it]
 20%|██        | 7644/37963 [18:23:40<71:40:00,  8.51s/it]
 20%|██        | 7645/37963 [18:23:47<69:13:53,  8.22s/it]
 20%|██        | 7646/37963 [18:23:55<67:20:34,  8.00s/it]
 20%|██        | 7647/37963 [18:24:02<66:09:28,  7.86s/it]
 20%|██        | 7648/37963 [18:24:10<65:27:05,  7.77s/it]
 20%|██        | 7649/37963 [18:24:17<64:16:45,  7.63s/it]
 20%|██        | 7650/37963 [18:24:25<64:12:53,  7.63s/it]
                                                          
{'loss': '0.1606', 'grad_norm': '1.921', 'learning_rate': '1.85e-05', 'epoch': '0.2015'}

 20%|██        | 7650/37963 [18:24:25<64:12:53,  7.63s/it]
 20%|██        | 7651/37963 [18:24:32<63:54:15,  7.59s/it]
 20%|██        | 7652/37963 [18:24:40<64:06:03,  7.61s/it]
 20%|██        | 7653/37963 [18:24:47<63:14:09,  7.51s/it]
 20%|██        | 7654/37963 [18:24:55<63:27:25,  7.54s/it]
 20%|██        | 7655/37963 [18:25:09<79:54:51,  9.49s/it]
 20%|██        | 7656/37963 [18:25:16<74:30:08,  8.85s/it]
 20%|██        | 7657/37963 [18:25:30<87:31:16, 10.40s/it]
 20%|██        | 7658/37963 [18:25:38<80:36:06,  9.57s/it]
 20%|██        | 7659/37963 [18:25:45<75:06:54,  8.92s/it]
 20%|██        | 7660/37963 [18:25:53<71:09:45,  8.45s/it]
                                                          
{'loss': '0.172', 'grad_norm': '1.908', 'learning_rate': '1.849e-05', 'epoch': '0.2018'}

 20%|██        | 7660/37963 [18:25:53<71:09:45,  8.45s/it]
 20%|██        | 7661/37963 [18:26:00<68:23:13,  8.12s/it]
 20%|██        | 7662/37963 [18:26:07<66:53:00,  7.95s/it]
 20%|██        | 7663/37963 [18:26:15<65:08:51,  7.74s/it]
 20%|██        | 7664/37963 [18:26:22<64:38:48,  7.68s/it]
 20%|██        | 7665/37963 [18:26:30<64:21:10,  7.65s/it]
 20%|██        | 7666/37963 [18:26:37<64:06:01,  7.62s/it]
 20%|██        | 7667/37963 [18:26:45<63:50:29,  7.59s/it]
 20%|██        | 7668/37963 [18:26:52<63:56:18,  7.60s/it]
 20%|██        | 7669/37963 [18:27:00<63:42:47,  7.57s/it]
 20%|██        | 7670/37963 [18:27:14<80:00:23,  9.51s/it]
                                                          
{'loss': '0.1617', 'grad_norm': '1.875', 'learning_rate': '1.849e-05', 'epoch': '0.202'}

 20%|██        | 7670/37963 [18:27:14<80:00:23,  9.51s/it]
 20%|██        | 7671/37963 [18:27:28<91:54:42, 10.92s/it]
 20%|██        | 7672/37963 [18:27:36<83:24:36,  9.91s/it]
 20%|██        | 7673/37963 [18:27:43<77:14:00,  9.18s/it]
 20%|██        | 7674/37963 [18:27:51<72:49:19,  8.66s/it]
 20%|██        | 7675/37963 [18:27:58<69:04:04,  8.21s/it]
 20%|██        | 7676/37963 [18:28:12<83:42:25,  9.95s/it]
 20%|██        | 7677/37963 [18:28:19<77:24:06,  9.20s/it]
 20%|██        | 7678/37963 [18:28:33<88:06:46, 10.47s/it]
 20%|██        | 7679/37963 [18:28:47<97:09:53, 11.55s/it]
 20%|██        | 7680/37963 [18:28:54<86:39:36, 10.30s/it]
                                                          
{'loss': '0.1573', 'grad_norm': '1.093', 'learning_rate': '1.848e-05', 'epoch': '0.2023'}

 20%|██        | 7680/37963 [18:28:54<86:39:36, 10.30s/it]
 20%|██        | 7681/37963 [18:29:02<79:33:27,  9.46s/it]
 20%|██        | 7682/37963 [18:29:09<74:48:47,  8.89s/it]
 20%|██        | 7683/37963 [18:29:17<71:05:59,  8.45s/it]
 20%|██        | 7684/37963 [18:29:24<68:42:26,  8.17s/it]
 20%|██        | 7685/37963 [18:29:32<67:03:43,  7.97s/it]
 20%|██        | 7686/37963 [18:29:39<65:47:04,  7.82s/it]
 20%|██        | 7687/37963 [18:29:47<64:42:08,  7.69s/it]
 20%|██        | 7688/37963 [18:29:54<64:40:58,  7.69s/it]
 20%|██        | 7689/37963 [18:30:02<64:19:14,  7.65s/it]
 20%|██        | 7690/37963 [18:30:16<80:12:23,  9.54s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '1.137', 'learning_rate': '1.848e-05', 'epoch': '0.2026'}

 20%|██        | 7690/37963 [18:30:16<80:12:23,  9.54s/it]
 20%|██        | 7691/37963 [18:30:23<75:06:10,  8.93s/it]
 20%|██        | 7692/37963 [18:30:31<71:30:31,  8.50s/it]
 20%|██        | 7693/37963 [18:30:38<69:02:57,  8.21s/it]
 20%|██        | 7694/37963 [18:30:46<67:15:35,  8.00s/it]
 20%|██        | 7695/37963 [18:30:53<66:13:28,  7.88s/it]
 20%|██        | 7696/37963 [18:31:01<65:14:30,  7.76s/it]
 20%|██        | 7697/37963 [18:31:09<65:05:52,  7.74s/it]
 20%|██        | 7698/37963 [18:31:16<64:33:47,  7.68s/it]
 20%|██        | 7699/37963 [18:31:24<64:36:42,  7.69s/it]
 20%|██        | 7700/37963 [18:31:31<64:10:32,  7.63s/it]
                                                          
{'loss': '0.1664', 'grad_norm': '1.816', 'learning_rate': '1.847e-05', 'epoch': '0.2028'}

 20%|██        | 7700/37963 [18:31:31<64:10:32,  7.63s/it]
 20%|██        | 7701/37963 [18:31:39<63:23:16,  7.54s/it]
 20%|██        | 7702/37963 [18:31:53<80:03:14,  9.52s/it]
 20%|██        | 7703/37963 [18:32:00<75:03:17,  8.93s/it]
 20%|██        | 7704/37963 [18:32:08<71:26:55,  8.50s/it]
 20%|██        | 7705/37963 [18:32:15<68:31:11,  8.15s/it]
 20%|██        | 7706/37963 [18:32:30<84:05:01, 10.00s/it]
 20%|██        | 7707/37963 [18:32:37<77:59:50,  9.28s/it]
 20%|██        | 7708/37963 [18:32:45<73:34:17,  8.75s/it]
 20%|██        | 7709/37963 [18:32:52<69:56:49,  8.32s/it]
 20%|██        | 7710/37963 [18:33:00<67:51:49,  8.08s/it]
                                                          
{'loss': '0.174', 'grad_norm': '3.214', 'learning_rate': '1.847e-05', 'epoch': '0.2031'}

 20%|██        | 7710/37963 [18:33:00<67:51:49,  8.08s/it]
 20%|██        | 7711/37963 [18:33:07<65:56:10,  7.85s/it]
 20%|██        | 7712/37963 [18:33:14<65:13:56,  7.76s/it]
 20%|██        | 7713/37963 [18:33:22<64:49:47,  7.72s/it]
 20%|██        | 7714/37963 [18:33:30<64:30:14,  7.68s/it]
 20%|██        | 7715/37963 [18:33:37<63:59:40,  7.62s/it]
 20%|██        | 7716/37963 [18:33:45<63:46:29,  7.59s/it]
 20%|██        | 7717/37963 [18:33:52<62:49:04,  7.48s/it]
 20%|██        | 7718/37963 [18:34:12<95:47:43, 11.40s/it]
 20%|██        | 7719/37963 [18:34:20<86:04:09, 10.24s/it]
 20%|██        | 7720/37963 [18:34:27<79:14:51,  9.43s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '2.219', 'learning_rate': '1.847e-05', 'epoch': '0.2034'}

 20%|██        | 7720/37963 [18:34:27<79:14:51,  9.43s/it]
 20%|██        | 7721/37963 [18:34:35<74:07:13,  8.82s/it]
 20%|██        | 7722/37963 [18:34:42<71:03:18,  8.46s/it]
 20%|██        | 7723/37963 [18:34:50<68:38:07,  8.17s/it]
 20%|██        | 7724/37963 [18:35:04<82:37:36,  9.84s/it]
 20%|██        | 7725/37963 [18:35:11<77:01:49,  9.17s/it]
 20%|██        | 7726/37963 [18:35:19<72:29:28,  8.63s/it]
 20%|██        | 7727/37963 [18:35:26<70:14:59,  8.36s/it]
 20%|██        | 7728/37963 [18:35:34<68:12:47,  8.12s/it]
 20%|██        | 7729/37963 [18:35:48<83:51:20,  9.98s/it]
 20%|██        | 7730/37963 [18:36:02<93:19:24, 11.11s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '1.865', 'learning_rate': '1.846e-05', 'epoch': '0.2036'}

 20%|██        | 7730/37963 [18:36:02<93:19:24, 11.11s/it]
 20%|██        | 7731/37963 [18:36:10<84:23:30, 10.05s/it]
 20%|██        | 7732/37963 [18:36:17<78:11:26,  9.31s/it]
 20%|██        | 7733/37963 [18:36:25<74:07:27,  8.83s/it]
 20%|██        | 7734/37963 [18:36:33<71:07:27,  8.47s/it]
 20%|██        | 7735/37963 [18:36:40<68:40:43,  8.18s/it]
 20%|██        | 7736/37963 [18:36:48<67:05:44,  7.99s/it]
 20%|██        | 7737/37963 [18:36:55<65:57:59,  7.86s/it]
 20%|██        | 7738/37963 [18:37:03<64:59:23,  7.74s/it]
 20%|██        | 7739/37963 [18:37:10<64:15:47,  7.65s/it]
 20%|██        | 7740/37963 [18:37:24<80:08:13,  9.55s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '2.693', 'learning_rate': '1.846e-05', 'epoch': '0.2039'}

 20%|██        | 7740/37963 [18:37:24<80:08:13,  9.55s/it]
 20%|██        | 7741/37963 [18:37:31<74:24:57,  8.86s/it]
 20%|██        | 7742/37963 [18:37:39<70:59:36,  8.46s/it]
 20%|██        | 7743/37963 [18:37:46<68:12:15,  8.12s/it]
 20%|██        | 7744/37963 [18:37:54<66:29:18,  7.92s/it]
 20%|██        | 7745/37963 [18:38:01<64:52:03,  7.73s/it]
 20%|██        | 7746/37963 [18:38:08<64:27:20,  7.68s/it]
 20%|██        | 7747/37963 [18:38:16<63:51:59,  7.61s/it]
 20%|██        | 7748/37963 [18:38:23<63:41:44,  7.59s/it]
 20%|██        | 7749/37963 [18:38:31<63:24:13,  7.55s/it]
 20%|██        | 7750/37963 [18:38:38<63:30:05,  7.57s/it]
                                                          
{'loss': '0.1703', 'grad_norm': '3.095', 'learning_rate': '1.845e-05', 'epoch': '0.2041'}

 20%|██        | 7750/37963 [18:38:38<63:30:05,  7.57s/it]
 20%|██        | 7751/37963 [18:38:46<63:36:07,  7.58s/it]
 20%|██        | 7752/37963 [18:38:53<62:54:14,  7.50s/it]
 20%|██        | 7753/37963 [18:39:08<79:48:26,  9.51s/it]
 20%|██        | 7754/37963 [18:39:15<74:47:33,  8.91s/it]
 20%|██        | 7755/37963 [18:39:22<70:54:09,  8.45s/it]
 20%|██        | 7756/37963 [18:39:36<84:14:46, 10.04s/it]
 20%|██        | 7757/37963 [18:39:44<77:22:26,  9.22s/it]
 20%|██        | 7758/37963 [18:39:51<73:13:39,  8.73s/it]
 20%|██        | 7759/37963 [18:39:59<70:28:08,  8.40s/it]
 20%|██        | 7760/37963 [18:40:06<67:59:46,  8.10s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '1.794', 'learning_rate': '1.845e-05', 'epoch': '0.2044'}

 20%|██        | 7760/37963 [18:40:06<67:59:46,  8.10s/it]
 20%|██        | 7761/37963 [18:40:14<66:35:02,  7.94s/it]
 20%|██        | 7762/37963 [18:40:21<65:29:20,  7.81s/it]
 20%|██        | 7763/37963 [18:40:29<64:56:30,  7.74s/it]
 20%|██        | 7764/37963 [18:40:36<63:51:54,  7.61s/it]
 20%|██        | 7765/37963 [18:40:44<63:50:52,  7.61s/it]
 20%|██        | 7766/37963 [18:41:04<95:50:10, 11.43s/it]
 20%|██        | 7767/37963 [18:41:12<85:58:12, 10.25s/it]
 20%|██        | 7768/37963 [18:41:19<78:29:06,  9.36s/it]
 20%|██        | 7769/37963 [18:41:26<73:50:09,  8.80s/it]
 20%|██        | 7770/37963 [18:41:34<70:22:57,  8.39s/it]
                                                          
{'loss': '0.1612', 'grad_norm': '3.132', 'learning_rate': '1.844e-05', 'epoch': '0.2047'}

 20%|██        | 7770/37963 [18:41:34<70:22:57,  8.39s/it]
 20%|██        | 7771/37963 [18:41:41<68:18:29,  8.14s/it]
 20%|██        | 7772/37963 [18:41:49<66:17:44,  7.91s/it]
 20%|██        | 7773/37963 [18:41:56<65:21:38,  7.79s/it]
 20%|██        | 7774/37963 [18:42:04<64:38:07,  7.71s/it]
 20%|██        | 7775/37963 [18:42:18<80:40:10,  9.62s/it]
 20%|██        | 7776/37963 [18:42:25<75:28:10,  9.00s/it]
 20%|██        | 7777/37963 [18:42:39<87:42:42, 10.46s/it]
 20%|██        | 7778/37963 [18:42:47<80:20:07,  9.58s/it]
 20%|██        | 7779/37963 [18:42:54<75:20:21,  8.99s/it]
 20%|██        | 7780/37963 [18:43:08<87:23:14, 10.42s/it]
                                                          
{'loss': '0.1768', 'grad_norm': '2.255', 'learning_rate': '1.844e-05', 'epoch': '0.2049'}

 20%|██        | 7780/37963 [18:43:08<87:23:14, 10.42s/it]
 20%|██        | 7781/37963 [18:43:16<79:56:23,  9.53s/it]
 20%|██        | 7782/37963 [18:43:23<75:09:56,  8.97s/it]
 21%|██        | 7783/37963 [18:43:31<71:39:33,  8.55s/it]
 21%|██        | 7784/37963 [18:43:38<69:17:09,  8.26s/it]
 21%|██        | 7785/37963 [18:43:46<67:09:15,  8.01s/it]
 21%|██        | 7786/37963 [18:43:53<66:09:35,  7.89s/it]
 21%|██        | 7787/37963 [18:44:01<64:58:33,  7.75s/it]
 21%|██        | 7788/37963 [18:44:15<80:15:40,  9.58s/it]
 21%|██        | 7789/37963 [18:44:22<74:41:18,  8.91s/it]
 21%|██        | 7790/37963 [18:44:29<70:28:14,  8.41s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '5.418', 'learning_rate': '1.843e-05', 'epoch': '0.2052'}

 21%|██        | 7790/37963 [18:44:29<70:28:14,  8.41s/it]
 21%|██        | 7791/37963 [18:44:37<68:00:10,  8.11s/it]
 21%|██        | 7792/37963 [18:44:44<66:24:35,  7.92s/it]
 21%|██        | 7793/37963 [18:44:52<65:33:10,  7.82s/it]
 21%|██        | 7794/37963 [18:44:59<64:50:11,  7.74s/it]
 21%|██        | 7795/37963 [18:45:07<64:38:45,  7.71s/it]
 21%|██        | 7796/37963 [18:45:14<63:52:10,  7.62s/it]
 21%|██        | 7797/37963 [18:45:22<64:00:51,  7.64s/it]
 21%|██        | 7798/37963 [18:45:36<79:56:45,  9.54s/it]
 21%|██        | 7799/37963 [18:45:44<74:49:53,  8.93s/it]
 21%|██        | 7800/37963 [18:45:51<71:11:08,  8.50s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '4.76', 'learning_rate': '1.843e-05', 'epoch': '0.2055'}

 21%|██        | 7800/37963 [18:45:51<71:11:08,  8.50s/it]
 21%|██        | 7801/37963 [18:45:59<68:35:30,  8.19s/it]
 21%|██        | 7802/37963 [18:46:06<67:03:44,  8.00s/it]
 21%|██        | 7803/37963 [18:46:14<65:58:02,  7.87s/it]
 21%|██        | 7804/37963 [18:46:21<65:04:38,  7.77s/it]
 21%|██        | 7805/37963 [18:46:35<80:47:45,  9.64s/it]
 21%|██        | 7806/37963 [18:46:42<74:41:53,  8.92s/it]
 21%|██        | 7807/37963 [18:46:50<71:01:45,  8.48s/it]
 21%|██        | 7808/37963 [18:46:57<68:29:16,  8.18s/it]
 21%|██        | 7809/37963 [18:47:05<66:15:40,  7.91s/it]
 21%|██        | 7810/37963 [18:47:12<64:55:04,  7.75s/it]
                                                          
{'loss': '0.1704', 'grad_norm': '6.134', 'learning_rate': '1.842e-05', 'epoch': '0.2057'}

 21%|██        | 7810/37963 [18:47:12<64:55:04,  7.75s/it]
 21%|██        | 7811/37963 [18:47:26<80:40:23,  9.63s/it]
 21%|██        | 7812/37963 [18:47:40<91:58:10, 10.98s/it]
 21%|██        | 7813/37963 [18:47:48<83:24:41,  9.96s/it]
 21%|██        | 7814/37963 [18:47:55<77:17:45,  9.23s/it]
 21%|██        | 7815/37963 [18:48:03<72:21:34,  8.64s/it]
 21%|██        | 7816/37963 [18:48:10<69:53:45,  8.35s/it]
 21%|██        | 7817/37963 [18:48:18<67:24:06,  8.05s/it]
 21%|██        | 7818/37963 [18:48:25<66:24:00,  7.93s/it]
 21%|██        | 7819/37963 [18:48:33<65:27:23,  7.82s/it]
 21%|██        | 7820/37963 [18:48:40<64:34:09,  7.71s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '3.863', 'learning_rate': '1.842e-05', 'epoch': '0.206'}

 21%|██        | 7820/37963 [18:48:40<64:34:09,  7.71s/it]
 21%|██        | 7821/37963 [18:48:48<64:10:07,  7.66s/it]
 21%|██        | 7822/37963 [18:48:55<63:51:08,  7.63s/it]
 21%|██        | 7823/37963 [18:49:03<63:30:55,  7.59s/it]
 21%|██        | 7824/37963 [18:49:10<63:27:02,  7.58s/it]
 21%|██        | 7825/37963 [18:49:18<63:26:49,  7.58s/it]
 21%|██        | 7826/37963 [18:49:25<63:15:36,  7.56s/it]
 21%|██        | 7827/37963 [18:49:33<62:41:16,  7.49s/it]
 21%|██        | 7828/37963 [18:49:40<62:39:03,  7.48s/it]
 21%|██        | 7829/37963 [18:49:54<79:08:46,  9.46s/it]
 21%|██        | 7830/37963 [18:50:08<89:56:01, 10.74s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '1.378', 'learning_rate': '1.841e-05', 'epoch': '0.2063'}

 21%|██        | 7830/37963 [18:50:08<89:56:01, 10.74s/it]
 21%|██        | 7831/37963 [18:50:15<81:23:49,  9.72s/it]
 21%|██        | 7832/37963 [18:50:29<92:11:30, 11.01s/it]
 21%|██        | 7833/37963 [18:50:37<83:35:45,  9.99s/it]
 21%|██        | 7834/37963 [18:50:45<77:20:46,  9.24s/it]
 21%|██        | 7835/37963 [18:50:52<73:00:02,  8.72s/it]
 21%|██        | 7836/37963 [18:51:06<86:32:46, 10.34s/it]
 21%|██        | 7837/37963 [18:51:14<79:34:16,  9.51s/it]
 21%|██        | 7838/37963 [18:51:21<74:48:06,  8.94s/it]
 21%|██        | 7839/37963 [18:51:29<71:33:57,  8.55s/it]
 21%|██        | 7840/37963 [18:51:37<69:07:53,  8.26s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '5.218', 'learning_rate': '1.841e-05', 'epoch': '0.2065'}

 21%|██        | 7840/37963 [18:51:37<69:07:53,  8.26s/it]
 21%|██        | 7841/37963 [18:51:44<67:25:20,  8.06s/it]
 21%|██        | 7842/37963 [18:51:58<82:19:15,  9.84s/it]
 21%|██        | 7843/37963 [18:52:06<76:39:36,  9.16s/it]
 21%|██        | 7844/37963 [18:52:13<72:39:01,  8.68s/it]
 21%|██        | 7845/37963 [18:52:21<69:46:12,  8.34s/it]
 21%|██        | 7846/37963 [18:52:28<67:50:30,  8.11s/it]
 21%|██        | 7847/37963 [18:52:36<66:23:58,  7.94s/it]
 21%|██        | 7848/37963 [18:52:43<65:24:24,  7.82s/it]
 21%|██        | 7849/37963 [18:52:51<64:05:40,  7.66s/it]
 21%|██        | 7850/37963 [18:52:58<63:42:17,  7.62s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '1.207', 'learning_rate': '1.841e-05', 'epoch': '0.2068'}

 21%|██        | 7850/37963 [18:52:58<63:42:17,  7.62s/it]
 21%|██        | 7851/37963 [18:53:06<63:39:30,  7.61s/it]
 21%|██        | 7852/37963 [18:53:13<63:12:15,  7.56s/it]
 21%|██        | 7853/37963 [18:53:27<79:45:13,  9.54s/it]
 21%|██        | 7854/37963 [18:53:35<74:52:25,  8.95s/it]
 21%|██        | 7855/37963 [18:53:43<71:04:26,  8.50s/it]
 21%|██        | 7856/37963 [18:53:50<68:43:04,  8.22s/it]
 21%|██        | 7857/37963 [18:53:58<67:12:06,  8.04s/it]
 21%|██        | 7858/37963 [18:54:11<81:08:28,  9.70s/it]
 21%|██        | 7859/37963 [18:54:19<75:32:49,  9.03s/it]
 21%|██        | 7860/37963 [18:54:26<71:42:19,  8.58s/it]
                                                          
{'loss': '0.1765', 'grad_norm': '1.76', 'learning_rate': '1.84e-05', 'epoch': '0.207'}

 21%|██        | 7860/37963 [18:54:26<71:42:19,  8.58s/it]
 21%|██        | 7861/37963 [18:54:34<68:58:40,  8.25s/it]
 21%|██        | 7862/37963 [18:54:41<66:50:09,  7.99s/it]
 21%|██        | 7863/37963 [18:54:55<82:06:55,  9.82s/it]
 21%|██        | 7864/37963 [18:55:03<76:47:50,  9.19s/it]
 21%|██        | 7865/37963 [18:55:10<72:35:52,  8.68s/it]
 21%|██        | 7866/37963 [18:55:18<69:15:45,  8.28s/it]
 21%|██        | 7867/37963 [18:55:25<67:07:16,  8.03s/it]
 21%|██        | 7868/37963 [18:55:33<65:48:30,  7.87s/it]
 21%|██        | 7869/37963 [18:55:40<65:14:49,  7.81s/it]
 21%|██        | 7870/37963 [18:55:48<64:06:09,  7.67s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '3.694', 'learning_rate': '1.84e-05', 'epoch': '0.2073'}

 21%|██        | 7870/37963 [18:55:48<64:06:09,  7.67s/it]
 21%|██        | 7871/37963 [18:55:55<63:39:53,  7.62s/it]
 21%|██        | 7872/37963 [18:56:03<63:20:23,  7.58s/it]
 21%|██        | 7873/37963 [18:56:10<63:19:25,  7.58s/it]
 21%|██        | 7874/37963 [18:56:18<62:58:52,  7.54s/it]
 21%|██        | 7875/37963 [18:56:25<62:40:37,  7.50s/it]
 21%|██        | 7876/37963 [18:56:33<62:40:48,  7.50s/it]
 21%|██        | 7877/37963 [18:56:46<78:22:43,  9.38s/it]
 21%|██        | 7878/37963 [18:57:00<89:38:04, 10.73s/it]
 21%|██        | 7879/37963 [18:57:08<81:34:48,  9.76s/it]
 21%|██        | 7880/37963 [18:57:15<75:46:17,  9.07s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '2.703', 'learning_rate': '1.839e-05', 'epoch': '0.2076'}

 21%|██        | 7880/37963 [18:57:15<75:46:17,  9.07s/it]
 21%|██        | 7881/37963 [18:57:29<87:31:38, 10.47s/it]
 21%|██        | 7882/37963 [18:57:36<79:50:10,  9.55s/it]
 21%|██        | 7883/37963 [18:57:44<74:50:50,  8.96s/it]
 21%|██        | 7884/37963 [18:57:51<70:43:43,  8.47s/it]
 21%|██        | 7885/37963 [18:57:59<68:30:03,  8.20s/it]
 21%|██        | 7886/37963 [18:58:13<82:56:40,  9.93s/it]
 21%|██        | 7887/37963 [18:58:20<76:37:47,  9.17s/it]
 21%|██        | 7888/37963 [18:58:28<72:37:50,  8.69s/it]
 21%|██        | 7889/37963 [18:58:41<85:02:30, 10.18s/it]
 21%|██        | 7890/37963 [18:58:49<78:33:39,  9.40s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '1.255', 'learning_rate': '1.839e-05', 'epoch': '0.2078'}

 21%|██        | 7890/37963 [18:58:49<78:33:39,  9.40s/it]
 21%|██        | 7891/37963 [18:58:57<74:08:10,  8.88s/it]
 21%|██        | 7892/37963 [18:59:04<69:56:09,  8.37s/it]
 21%|██        | 7893/37963 [18:59:11<67:05:07,  8.03s/it]
 21%|██        | 7894/37963 [18:59:19<65:57:18,  7.90s/it]
 21%|██        | 7895/37963 [18:59:26<65:03:33,  7.79s/it]
 21%|██        | 7896/37963 [18:59:34<64:26:31,  7.72s/it]
 21%|██        | 7897/37963 [18:59:41<63:49:49,  7.64s/it]
 21%|██        | 7898/37963 [18:59:48<62:49:12,  7.52s/it]
 21%|██        | 7899/37963 [18:59:56<62:55:20,  7.53s/it]
 21%|██        | 7900/37963 [19:00:04<62:47:58,  7.52s/it]
                                                          
{'loss': '0.1568', 'grad_norm': '5.703', 'learning_rate': '1.838e-05', 'epoch': '0.2081'}

 21%|██        | 7900/37963 [19:00:04<62:47:58,  7.52s/it]
 21%|██        | 7901/37963 [19:00:11<62:11:53,  7.45s/it]
 21%|██        | 7902/37963 [19:00:25<78:48:31,  9.44s/it]
 21%|██        | 7903/37963 [19:00:39<90:47:58, 10.87s/it]
 21%|██        | 7904/37963 [19:00:47<82:41:23,  9.90s/it]
 21%|██        | 7905/37963 [19:00:54<76:42:16,  9.19s/it]
 21%|██        | 7906/37963 [19:01:02<72:55:16,  8.73s/it]
 21%|██        | 7907/37963 [19:01:09<69:50:17,  8.36s/it]
 21%|██        | 7908/37963 [19:01:17<67:43:49,  8.11s/it]
 21%|██        | 7909/37963 [19:01:25<66:17:08,  7.94s/it]
 21%|██        | 7910/37963 [19:01:38<80:18:31,  9.62s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '1.969', 'learning_rate': '1.838e-05', 'epoch': '0.2084'}

 21%|██        | 7910/37963 [19:01:38<80:18:31,  9.62s/it]
 21%|██        | 7911/37963 [19:01:46<75:16:33,  9.02s/it]
 21%|██        | 7912/37963 [19:01:53<71:36:12,  8.58s/it]
 21%|██        | 7913/37963 [19:02:01<68:51:11,  8.25s/it]
 21%|██        | 7914/37963 [19:02:08<67:01:56,  8.03s/it]
 21%|██        | 7915/37963 [19:02:16<65:57:11,  7.90s/it]
 21%|██        | 7916/37963 [19:02:23<64:57:54,  7.78s/it]
 21%|██        | 7917/37963 [19:02:31<63:59:08,  7.67s/it]
 21%|██        | 7918/37963 [19:02:38<62:53:24,  7.54s/it]
 21%|██        | 7919/37963 [19:02:45<62:32:09,  7.49s/it]
 21%|██        | 7920/37963 [19:02:53<62:36:11,  7.50s/it]
                                                          
{'loss': '0.157', 'grad_norm': '6.527', 'learning_rate': '1.837e-05', 'epoch': '0.2086'}

 21%|██        | 7920/37963 [19:02:53<62:36:11,  7.50s/it]
 21%|██        | 7921/37963 [19:03:07<79:07:25,  9.48s/it]
 21%|██        | 7922/37963 [19:03:21<89:30:23, 10.73s/it]
 21%|██        | 7923/37963 [19:03:28<81:29:49,  9.77s/it]
 21%|██        | 7924/37963 [19:03:36<76:06:48,  9.12s/it]
 21%|██        | 7925/37963 [19:03:43<72:04:52,  8.64s/it]
 21%|██        | 7926/37963 [19:03:51<69:28:17,  8.33s/it]
 21%|██        | 7927/37963 [19:03:58<67:33:38,  8.10s/it]
 21%|██        | 7928/37963 [19:04:06<65:42:45,  7.88s/it]
 21%|██        | 7929/37963 [19:04:13<64:47:37,  7.77s/it]
 21%|██        | 7930/37963 [19:04:21<63:50:40,  7.65s/it]
                                                          
{'loss': '0.161', 'grad_norm': '4.027', 'learning_rate': '1.837e-05', 'epoch': '0.2089'}

 21%|██        | 7930/37963 [19:04:21<63:50:40,  7.65s/it]
 21%|██        | 7931/37963 [19:04:41<95:27:36, 11.44s/it]
 21%|██        | 7932/37963 [19:04:49<86:05:29, 10.32s/it]
 21%|██        | 7933/37963 [19:04:56<78:40:59,  9.43s/it]
 21%|██        | 7934/37963 [19:05:04<74:18:09,  8.91s/it]
 21%|██        | 7935/37963 [19:05:11<70:08:43,  8.41s/it]
 21%|██        | 7936/37963 [19:05:18<67:44:32,  8.12s/it]
 21%|██        | 7937/37963 [19:05:26<66:16:41,  7.95s/it]
 21%|██        | 7938/37963 [19:05:33<64:43:30,  7.76s/it]
 21%|██        | 7939/37963 [19:05:41<63:37:09,  7.63s/it]
 21%|██        | 7940/37963 [19:05:48<63:24:06,  7.60s/it]
                                                          
{'loss': '0.17', 'grad_norm': '2.787', 'learning_rate': '1.836e-05', 'epoch': '0.2092'}

 21%|██        | 7940/37963 [19:05:48<63:24:06,  7.60s/it]
 21%|██        | 7941/37963 [19:06:02<79:21:54,  9.52s/it]
 21%|██        | 7942/37963 [19:06:10<74:13:06,  8.90s/it]
 21%|██        | 7943/37963 [19:06:17<70:49:20,  8.49s/it]
 21%|██        | 7944/37963 [19:06:25<68:41:52,  8.24s/it]
 21%|██        | 7945/37963 [19:06:32<66:40:10,  8.00s/it]
 21%|██        | 7946/37963 [19:06:40<65:24:43,  7.85s/it]
 21%|██        | 7947/37963 [19:06:47<64:28:11,  7.73s/it]
 21%|██        | 7948/37963 [19:06:55<64:01:22,  7.68s/it]
 21%|██        | 7949/37963 [19:07:02<63:35:16,  7.63s/it]
 21%|██        | 7950/37963 [19:07:16<79:33:15,  9.54s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '6.197', 'learning_rate': '1.836e-05', 'epoch': '0.2094'}

 21%|██        | 7950/37963 [19:07:16<79:33:15,  9.54s/it]
 21%|██        | 7951/37963 [19:07:24<74:34:39,  8.95s/it]
 21%|██        | 7952/37963 [19:07:31<70:59:01,  8.51s/it]
 21%|██        | 7953/37963 [19:07:39<68:38:30,  8.23s/it]
 21%|██        | 7954/37963 [19:07:46<66:14:26,  7.95s/it]
 21%|██        | 7955/37963 [19:07:54<65:26:27,  7.85s/it]
 21%|██        | 7956/37963 [19:08:01<64:48:25,  7.78s/it]
 21%|██        | 7957/37963 [19:08:15<79:32:47,  9.54s/it]
 21%|██        | 7958/37963 [19:08:23<74:22:37,  8.92s/it]
 21%|██        | 7959/37963 [19:08:36<86:57:45, 10.43s/it]
 21%|██        | 7960/37963 [19:08:44<79:51:04,  9.58s/it]
                                                          
{'loss': '0.1725', 'grad_norm': '1.106', 'learning_rate': '1.835e-05', 'epoch': '0.2097'}

 21%|██        | 7960/37963 [19:08:44<79:51:04,  9.58s/it]
 21%|██        | 7961/37963 [19:08:52<74:34:10,  8.95s/it]
 21%|██        | 7962/37963 [19:08:59<70:56:57,  8.51s/it]
 21%|██        | 7963/37963 [19:09:06<67:33:55,  8.11s/it]
 21%|██        | 7964/37963 [19:09:14<65:52:41,  7.91s/it]
 21%|██        | 7965/37963 [19:09:21<64:37:26,  7.76s/it]
 21%|██        | 7966/37963 [19:09:29<64:07:14,  7.70s/it]
 21%|██        | 7967/37963 [19:09:36<63:32:19,  7.63s/it]
 21%|██        | 7968/37963 [19:09:44<63:12:51,  7.59s/it]
 21%|██        | 7969/37963 [19:09:51<62:27:13,  7.50s/it]
 21%|██        | 7970/37963 [19:09:58<62:38:28,  7.52s/it]
                                                          
{'loss': '0.1519', 'grad_norm': '3.517', 'learning_rate': '1.835e-05', 'epoch': '0.2099'}

 21%|██        | 7970/37963 [19:09:58<62:38:28,  7.52s/it]
 21%|██        | 7971/37963 [19:10:06<61:53:38,  7.43s/it]
 21%|██        | 7972/37963 [19:10:13<61:51:37,  7.43s/it]
 21%|██        | 7973/37963 [19:10:21<62:06:28,  7.46s/it]
 21%|██        | 7974/37963 [19:10:28<62:24:27,  7.49s/it]
 21%|██        | 7975/37963 [19:10:42<78:19:22,  9.40s/it]
 21%|██        | 7976/37963 [19:10:56<90:53:04, 10.91s/it]
 21%|██        | 7977/37963 [19:11:04<82:20:02,  9.88s/it]
 21%|██        | 7978/37963 [19:11:12<76:31:54,  9.19s/it]
 21%|██        | 7979/37963 [19:11:19<71:43:03,  8.61s/it]
 21%|██        | 7980/37963 [19:11:26<68:22:02,  8.21s/it]
                                                          
{'loss': '0.1697', 'grad_norm': '2.911', 'learning_rate': '1.835e-05', 'epoch': '0.2102'}

 21%|██        | 7980/37963 [19:11:26<68:22:02,  8.21s/it]
 21%|██        | 7981/37963 [19:11:34<66:35:38,  8.00s/it]
 21%|██        | 7982/37963 [19:11:41<65:29:47,  7.86s/it]
 21%|██        | 7983/37963 [19:11:55<80:46:35,  9.70s/it]
 21%|██        | 7984/37963 [19:12:09<92:04:28, 11.06s/it]
 21%|██        | 7985/37963 [19:12:17<83:36:53, 10.04s/it]
 21%|██        | 7986/37963 [19:12:24<77:16:00,  9.28s/it]
 21%|██        | 7987/37963 [19:12:32<72:51:25,  8.75s/it]
 21%|██        | 7988/37963 [19:12:39<69:33:07,  8.35s/it]
 21%|██        | 7989/37963 [19:12:47<67:24:04,  8.10s/it]
 21%|██        | 7990/37963 [19:12:55<66:11:32,  7.95s/it]
                                                          
{'loss': '0.1718', 'grad_norm': '3.425', 'learning_rate': '1.834e-05', 'epoch': '0.2105'}

 21%|██        | 7990/37963 [19:12:55<66:11:32,  7.95s/it]
 21%|██        | 7991/37963 [19:13:02<65:11:35,  7.83s/it]
 21%|██        | 7992/37963 [19:13:16<79:45:20,  9.58s/it]
 21%|██        | 7993/37963 [19:13:23<74:51:05,  8.99s/it]
 21%|██        | 7994/37963 [19:13:31<71:11:47,  8.55s/it]
 21%|██        | 7995/37963 [19:13:38<68:33:15,  8.24s/it]
 21%|██        | 7996/37963 [19:13:46<65:50:33,  7.91s/it]
 21%|██        | 7997/37963 [19:13:59<80:20:45,  9.65s/it]
 21%|██        | 7998/37963 [19:14:07<75:15:52,  9.04s/it]
 21%|██        | 7999/37963 [19:14:14<71:26:42,  8.58s/it]
 21%|██        | 8000/37963 [19:14:22<69:02:08,  8.29s/it]
                                                          
{'loss': '0.1763', 'grad_norm': '3.835', 'learning_rate': '1.834e-05', 'epoch': '0.2107'}

 21%|██        | 8000/37963 [19:14:22<69:02:08,  8.29s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.44s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.45s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 21%|██        | 8001/37963 [19:15:19<190:17:30, 22.86s/it]
 21%|██        | 8002/37963 [19:15:27<152:39:42, 18.34s/it]
 21%|██        | 8003/37963 [19:15:34<125:04:09, 15.03s/it]
 21%|██        | 8004/37963 [19:15:41<105:42:47, 12.70s/it]
 21%|██        | 8005/37963 [19:15:55<108:57:05, 13.09s/it]
 21%|██        | 8006/37963 [19:16:09<111:54:14, 13.45s/it]
 21%|██        | 8007/37963 [19:16:17<97:15:41, 11.69s/it] 
 21%|██        | 8008/37963 [19:16:24<86:30:26, 10.40s/it]
 21%|██        | 8009/37963 [19:16:32<79:25:26,  9.55s/it]
 21%|██        | 8010/37963 [19:16:40<74:27:01,  8.95s/it]
                                                          
{'loss': '0.1693', 'grad_norm': '0.8516', 'learning_rate': '1.833e-05', 'epoch': '0.211'}

 21%|██        | 8010/37963 [19:16:40<74:27:01,  8.95s/it]
 21%|██        | 8011/37963 [19:16:47<71:05:07,  8.54s/it]
 21%|██        | 8012/37963 [19:16:55<68:03:45,  8.18s/it]
 21%|██        | 8013/37963 [19:17:02<66:38:36,  8.01s/it]
 21%|██        | 8014/37963 [19:17:10<65:10:18,  7.83s/it]
 21%|██        | 8015/37963 [19:17:17<64:21:32,  7.74s/it]
 21%|██        | 8016/37963 [19:17:25<63:57:23,  7.69s/it]
 21%|██        | 8017/37963 [19:17:32<63:57:45,  7.69s/it]
 21%|██        | 8018/37963 [19:17:46<80:02:41,  9.62s/it]
 21%|██        | 8019/37963 [19:17:54<74:32:24,  8.96s/it]
 21%|██        | 8020/37963 [19:18:01<71:11:17,  8.56s/it]
                                                          
{'loss': '0.1773', 'grad_norm': '3.068', 'learning_rate': '1.833e-05', 'epoch': '0.2113'}

 21%|██        | 8020/37963 [19:18:01<71:11:17,  8.56s/it]
 21%|██        | 8021/37963 [19:18:09<68:38:58,  8.25s/it]
 21%|██        | 8022/37963 [19:18:23<82:25:01,  9.91s/it]
 21%|██        | 8023/37963 [19:18:30<76:38:11,  9.21s/it]
 21%|██        | 8024/37963 [19:18:38<72:18:23,  8.69s/it]
 21%|██        | 8025/37963 [19:18:45<69:24:47,  8.35s/it]
 21%|██        | 8026/37963 [19:18:53<67:34:36,  8.13s/it]
 21%|██        | 8027/37963 [19:19:01<65:59:40,  7.94s/it]
 21%|██        | 8028/37963 [19:19:08<65:17:50,  7.85s/it]
 21%|██        | 8029/37963 [19:19:16<64:09:26,  7.72s/it]
 21%|██        | 8030/37963 [19:19:23<63:58:44,  7.69s/it]
                                                          
{'loss': '0.1872', 'grad_norm': '2.484', 'learning_rate': '1.832e-05', 'epoch': '0.2115'}

 21%|██        | 8030/37963 [19:19:23<63:58:44,  7.69s/it]
 21%|██        | 8031/37963 [19:19:31<63:28:33,  7.63s/it]
 21%|██        | 8032/37963 [19:19:45<79:12:57,  9.53s/it]
 21%|██        | 8033/37963 [19:19:52<74:04:15,  8.91s/it]
 21%|██        | 8034/37963 [19:20:06<86:46:42, 10.44s/it]
 21%|██        | 8035/37963 [19:20:14<79:35:12,  9.57s/it]
 21%|██        | 8036/37963 [19:20:21<74:46:39,  9.00s/it]
 21%|██        | 8037/37963 [19:20:29<71:11:24,  8.56s/it]
 21%|██        | 8038/37963 [19:20:36<68:37:47,  8.26s/it]
 21%|██        | 8039/37963 [19:20:44<65:50:16,  7.92s/it]
 21%|██        | 8040/37963 [19:20:51<65:04:19,  7.83s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '3.503', 'learning_rate': '1.832e-05', 'epoch': '0.2118'}

 21%|██        | 8040/37963 [19:20:51<65:04:19,  7.83s/it]
 21%|██        | 8041/37963 [19:21:05<80:07:21,  9.64s/it]
 21%|██        | 8042/37963 [19:21:19<90:39:14, 10.91s/it]
 21%|██        | 8043/37963 [19:21:26<81:45:10,  9.84s/it]
 21%|██        | 8044/37963 [19:21:34<75:53:41,  9.13s/it]
 21%|██        | 8045/37963 [19:21:41<71:41:03,  8.63s/it]
 21%|██        | 8046/37963 [19:21:49<69:17:39,  8.34s/it]
 21%|██        | 8047/37963 [19:21:56<66:59:54,  8.06s/it]
 21%|██        | 8048/37963 [19:22:04<65:55:16,  7.93s/it]
 21%|██        | 8049/37963 [19:22:11<64:46:42,  7.80s/it]
 21%|██        | 8050/37963 [19:22:19<64:19:01,  7.74s/it]
                                                          
{'loss': '0.174', 'grad_norm': '1.861', 'learning_rate': '1.831e-05', 'epoch': '0.212'}

 21%|██        | 8050/37963 [19:22:19<64:19:01,  7.74s/it]
 21%|██        | 8051/37963 [19:22:27<63:46:27,  7.68s/it]
 21%|██        | 8052/37963 [19:22:40<78:54:51,  9.50s/it]
 21%|██        | 8053/37963 [19:22:54<90:38:28, 10.91s/it]
 21%|██        | 8054/37963 [19:23:02<81:26:41,  9.80s/it]
 21%|██        | 8055/37963 [19:23:09<75:07:21,  9.04s/it]
 21%|██        | 8056/37963 [19:23:16<71:03:20,  8.55s/it]
 21%|██        | 8057/37963 [19:23:24<68:37:54,  8.26s/it]
 21%|██        | 8058/37963 [19:23:31<66:42:38,  8.03s/it]
 21%|██        | 8059/37963 [19:23:39<65:22:27,  7.87s/it]
 21%|██        | 8060/37963 [19:23:46<64:14:13,  7.73s/it]
                                                          
{'loss': '0.162', 'grad_norm': '1.694', 'learning_rate': '1.831e-05', 'epoch': '0.2123'}

 21%|██        | 8060/37963 [19:23:46<64:14:13,  7.73s/it]
 21%|██        | 8061/37963 [19:23:54<63:55:29,  7.70s/it]
 21%|██        | 8062/37963 [19:24:01<63:02:39,  7.59s/it]
 21%|██        | 8063/37963 [19:24:09<62:52:22,  7.57s/it]
 21%|██        | 8064/37963 [19:24:16<62:37:30,  7.54s/it]
 21%|██        | 8065/37963 [19:24:24<62:29:13,  7.52s/it]
 21%|██        | 8066/37963 [19:24:31<62:30:43,  7.53s/it]
 21%|██        | 8067/37963 [19:24:45<77:58:12,  9.39s/it]
 21%|██▏       | 8068/37963 [19:24:53<73:13:21,  8.82s/it]
 21%|██▏       | 8069/37963 [19:25:00<69:35:37,  8.38s/it]
 21%|██▏       | 8070/37963 [19:25:07<66:42:05,  8.03s/it]
                                                          
{'loss': '0.1521', 'grad_norm': '2.412', 'learning_rate': '1.83e-05', 'epoch': '0.2126'}

 21%|██▏       | 8070/37963 [19:25:07<66:42:05,  8.03s/it]
 21%|██▏       | 8071/37963 [19:25:15<65:14:56,  7.86s/it]
 21%|██▏       | 8072/37963 [19:25:28<80:09:09,  9.65s/it]
 21%|██▏       | 8073/37963 [19:25:36<75:12:08,  9.06s/it]
 21%|██▏       | 8074/37963 [19:25:44<71:18:08,  8.59s/it]
 21%|██▏       | 8075/37963 [19:25:51<69:00:50,  8.31s/it]
 21%|██▏       | 8076/37963 [19:25:59<66:55:46,  8.06s/it]
 21%|██▏       | 8077/37963 [19:26:06<65:19:07,  7.87s/it]
 21%|██▏       | 8078/37963 [19:26:20<80:17:54,  9.67s/it]
 21%|██▏       | 8079/37963 [19:26:28<74:59:13,  9.03s/it]
 21%|██▏       | 8080/37963 [19:26:35<71:10:32,  8.57s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '1.192', 'learning_rate': '1.83e-05', 'epoch': '0.2128'}

 21%|██▏       | 8080/37963 [19:26:35<71:10:32,  8.57s/it]
 21%|██▏       | 8081/37963 [19:26:43<68:52:14,  8.30s/it]
 21%|██▏       | 8082/37963 [19:26:50<66:48:17,  8.05s/it]
 21%|██▏       | 8083/37963 [19:26:58<65:25:54,  7.88s/it]
 21%|██▏       | 8084/37963 [19:27:05<64:30:17,  7.77s/it]
 21%|██▏       | 8085/37963 [19:27:13<64:01:20,  7.71s/it]
 21%|██▏       | 8086/37963 [19:27:27<79:22:44,  9.56s/it]
 21%|██▏       | 8087/37963 [19:27:34<74:15:46,  8.95s/it]
 21%|██▏       | 8088/37963 [19:27:42<70:45:29,  8.53s/it]
 21%|██▏       | 8089/37963 [19:27:49<68:11:27,  8.22s/it]
 21%|██▏       | 8090/37963 [19:27:57<66:54:01,  8.06s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.26', 'learning_rate': '1.829e-05', 'epoch': '0.2131'}

 21%|██▏       | 8090/37963 [19:27:57<66:54:01,  8.06s/it]
 21%|██▏       | 8091/37963 [19:28:11<81:23:40,  9.81s/it]
 21%|██▏       | 8092/37963 [19:28:18<76:00:58,  9.16s/it]
 21%|██▏       | 8093/37963 [19:28:26<71:46:42,  8.65s/it]
 21%|██▏       | 8094/37963 [19:28:40<84:43:42, 10.21s/it]
 21%|██▏       | 8095/37963 [19:28:47<77:29:32,  9.34s/it]
 21%|██▏       | 8096/37963 [19:28:55<73:26:27,  8.85s/it]
 21%|██▏       | 8097/37963 [19:29:02<69:49:11,  8.42s/it]
 21%|██▏       | 8098/37963 [19:29:10<67:28:43,  8.13s/it]
 21%|██▏       | 8099/37963 [19:29:24<82:42:41,  9.97s/it]
 21%|██▏       | 8100/37963 [19:29:37<91:38:15, 11.05s/it]
                                                          
{'loss': '0.189', 'grad_norm': '1.407', 'learning_rate': '1.829e-05', 'epoch': '0.2134'}

 21%|██▏       | 8100/37963 [19:29:37<91:38:15, 11.05s/it]
 21%|██▏       | 8101/37963 [19:29:45<82:47:11,  9.98s/it]
 21%|██▏       | 8102/37963 [19:29:52<76:06:34,  9.18s/it]
 21%|██▏       | 8103/37963 [19:30:00<71:32:29,  8.63s/it]
 21%|██▏       | 8104/37963 [19:30:07<69:04:32,  8.33s/it]
 21%|██▏       | 8105/37963 [19:30:14<66:25:56,  8.01s/it]
 21%|██▏       | 8106/37963 [19:30:22<65:11:36,  7.86s/it]
 21%|██▏       | 8107/37963 [19:30:30<64:20:10,  7.76s/it]
 21%|██▏       | 8108/37963 [19:30:37<63:35:17,  7.67s/it]
 21%|██▏       | 8109/37963 [19:30:45<63:13:27,  7.62s/it]
 21%|██▏       | 8110/37963 [19:30:52<62:31:14,  7.54s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '3.216', 'learning_rate': '1.828e-05', 'epoch': '0.2136'}

 21%|██▏       | 8110/37963 [19:30:52<62:31:14,  7.54s/it]
 21%|██▏       | 8111/37963 [19:31:00<62:54:15,  7.59s/it]
 21%|██▏       | 8112/37963 [19:31:07<62:51:46,  7.58s/it]
 21%|██▏       | 8113/37963 [19:31:15<62:40:48,  7.56s/it]
 21%|██▏       | 8114/37963 [19:31:22<62:39:01,  7.56s/it]
 21%|██▏       | 8115/37963 [19:31:30<62:40:38,  7.56s/it]
 21%|██▏       | 8116/37963 [19:31:37<62:35:04,  7.55s/it]
 21%|██▏       | 8117/37963 [19:31:51<78:49:10,  9.51s/it]
 21%|██▏       | 8118/37963 [19:31:59<73:59:24,  8.92s/it]
 21%|██▏       | 8119/37963 [19:32:06<70:27:13,  8.50s/it]
 21%|██▏       | 8120/37963 [19:32:20<83:49:23, 10.11s/it]
                                                          
{'loss': '0.1523', 'grad_norm': '1.13', 'learning_rate': '1.828e-05', 'epoch': '0.2139'}

 21%|██▏       | 8120/37963 [19:32:20<83:49:23, 10.11s/it]
 21%|██▏       | 8121/37963 [19:32:28<77:10:08,  9.31s/it]
 21%|██▏       | 8122/37963 [19:32:35<72:10:35,  8.71s/it]
 21%|██▏       | 8123/37963 [19:32:42<68:32:11,  8.27s/it]
 21%|██▏       | 8124/37963 [19:32:50<66:45:27,  8.05s/it]
 21%|██▏       | 8125/37963 [19:32:57<65:10:40,  7.86s/it]
 21%|██▏       | 8126/37963 [19:33:05<64:28:35,  7.78s/it]
 21%|██▏       | 8127/37963 [19:33:19<79:32:59,  9.60s/it]
 21%|██▏       | 8128/37963 [19:33:26<74:33:09,  9.00s/it]
 21%|██▏       | 8129/37963 [19:33:34<71:11:02,  8.59s/it]
 21%|██▏       | 8130/37963 [19:33:41<68:36:57,  8.28s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '0.9595', 'learning_rate': '1.827e-05', 'epoch': '0.2142'}

 21%|██▏       | 8130/37963 [19:33:41<68:36:57,  8.28s/it]
 21%|██▏       | 8131/37963 [19:33:49<66:48:24,  8.06s/it]
 21%|██▏       | 8132/37963 [19:33:57<65:30:20,  7.91s/it]
 21%|██▏       | 8133/37963 [19:34:04<64:37:55,  7.80s/it]
 21%|██▏       | 8134/37963 [19:34:18<79:26:28,  9.59s/it]
 21%|██▏       | 8135/37963 [19:34:25<73:49:14,  8.91s/it]
 21%|██▏       | 8136/37963 [19:34:33<70:23:32,  8.50s/it]
 21%|██▏       | 8137/37963 [19:34:40<68:03:55,  8.22s/it]
 21%|██▏       | 8138/37963 [19:34:48<66:14:46,  8.00s/it]
 21%|██▏       | 8139/37963 [19:34:55<65:02:17,  7.85s/it]
 21%|██▏       | 8140/37963 [19:35:03<64:08:51,  7.74s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '4.006', 'learning_rate': '1.827e-05', 'epoch': '0.2144'}

 21%|██▏       | 8140/37963 [19:35:03<64:08:51,  7.74s/it]
 21%|██▏       | 8141/37963 [19:35:23<96:02:24, 11.59s/it]
 21%|██▏       | 8142/37963 [19:35:31<86:01:04, 10.38s/it]
 21%|██▏       | 8143/37963 [19:35:38<78:58:04,  9.53s/it]
 21%|██▏       | 8144/37963 [19:35:46<73:56:05,  8.93s/it]
 21%|██▏       | 8145/37963 [19:36:00<86:17:36, 10.42s/it]
 21%|██▏       | 8146/37963 [19:36:07<79:05:03,  9.55s/it]
 21%|██▏       | 8147/37963 [19:36:15<74:20:55,  8.98s/it]
 21%|██▏       | 8148/37963 [19:36:23<70:41:53,  8.54s/it]
 21%|██▏       | 8149/37963 [19:36:36<83:52:44, 10.13s/it]
 21%|██▏       | 8150/37963 [19:36:44<77:27:31,  9.35s/it]
                                                          
{'loss': '0.1656', 'grad_norm': '3.845', 'learning_rate': '1.826e-05', 'epoch': '0.2147'}

 21%|██▏       | 8150/37963 [19:36:44<77:27:31,  9.35s/it]
 21%|██▏       | 8151/37963 [19:36:52<73:11:11,  8.84s/it]
 21%|██▏       | 8152/37963 [19:36:59<69:55:58,  8.45s/it]
 21%|██▏       | 8153/37963 [19:37:06<67:02:28,  8.10s/it]
 21%|██▏       | 8154/37963 [19:37:14<64:51:02,  7.83s/it]
 21%|██▏       | 8155/37963 [19:37:21<63:39:11,  7.69s/it]
 21%|██▏       | 8156/37963 [19:37:28<63:20:41,  7.65s/it]
 21%|██▏       | 8157/37963 [19:37:36<63:11:19,  7.63s/it]
 21%|██▏       | 8158/37963 [19:37:44<63:20:21,  7.65s/it]
 21%|██▏       | 8159/37963 [19:37:51<63:07:38,  7.63s/it]
 21%|██▏       | 8160/37963 [19:37:59<62:53:07,  7.60s/it]
                                                          
{'loss': '0.1622', 'grad_norm': '1.255', 'learning_rate': '1.826e-05', 'epoch': '0.2149'}

 21%|██▏       | 8160/37963 [19:37:59<62:53:07,  7.60s/it]
 21%|██▏       | 8161/37963 [19:38:06<61:34:20,  7.44s/it]
 21%|██▏       | 8162/37963 [19:38:13<61:48:31,  7.47s/it]
 22%|██▏       | 8163/37963 [19:38:21<62:04:27,  7.50s/it]
 22%|██▏       | 8164/37963 [19:38:29<62:11:04,  7.51s/it]
 22%|██▏       | 8165/37963 [19:38:42<78:01:28,  9.43s/it]
 22%|██▏       | 8166/37963 [19:38:50<73:55:23,  8.93s/it]
 22%|██▏       | 8167/37963 [19:38:58<70:27:15,  8.51s/it]
 22%|██▏       | 8168/37963 [19:39:05<67:52:03,  8.20s/it]
 22%|██▏       | 8169/37963 [19:39:13<66:21:28,  8.02s/it]
 22%|██▏       | 8170/37963 [19:39:20<65:03:41,  7.86s/it]
                                                          
{'loss': '0.1615', 'grad_norm': '1.745', 'learning_rate': '1.825e-05', 'epoch': '0.2152'}

 22%|██▏       | 8170/37963 [19:39:20<65:03:41,  7.86s/it]
 22%|██▏       | 8171/37963 [19:39:28<63:58:46,  7.73s/it]
 22%|██▏       | 8172/37963 [19:39:42<79:04:11,  9.55s/it]
 22%|██▏       | 8173/37963 [19:39:49<74:22:21,  8.99s/it]
 22%|██▏       | 8174/37963 [19:39:57<71:00:21,  8.58s/it]
 22%|██▏       | 8175/37963 [19:40:11<83:53:56, 10.14s/it]
 22%|██▏       | 8176/37963 [19:40:18<77:58:40,  9.42s/it]
 22%|██▏       | 8177/37963 [19:40:26<73:11:53,  8.85s/it]
 22%|██▏       | 8178/37963 [19:40:33<69:14:30,  8.37s/it]
 22%|██▏       | 8179/37963 [19:40:41<67:21:16,  8.14s/it]
 22%|██▏       | 8180/37963 [19:40:48<65:44:56,  7.95s/it]
                                                          
{'loss': '0.159', 'grad_norm': '1.758', 'learning_rate': '1.825e-05', 'epoch': '0.2155'}

 22%|██▏       | 8180/37963 [19:40:48<65:44:56,  7.95s/it]
 22%|██▏       | 8181/37963 [19:40:56<64:57:38,  7.85s/it]
 22%|██▏       | 8182/37963 [19:41:04<64:28:07,  7.79s/it]
 22%|██▏       | 8183/37963 [19:41:11<63:45:52,  7.71s/it]
 22%|██▏       | 8184/37963 [19:41:25<79:12:45,  9.58s/it]
 22%|██▏       | 8185/37963 [19:41:39<90:26:17, 10.93s/it]
 22%|██▏       | 8186/37963 [19:41:47<81:53:31,  9.90s/it]
 22%|██▏       | 8187/37963 [19:41:54<75:57:04,  9.18s/it]
 22%|██▏       | 8188/37963 [19:42:02<71:58:12,  8.70s/it]
 22%|██▏       | 8189/37963 [19:42:09<69:01:39,  8.35s/it]
 22%|██▏       | 8190/37963 [19:42:17<67:17:21,  8.14s/it]
                                                          
{'loss': '0.1733', 'grad_norm': '3.21', 'learning_rate': '1.825e-05', 'epoch': '0.2157'}

 22%|██▏       | 8190/37963 [19:42:17<67:17:21,  8.14s/it]
 22%|██▏       | 8191/37963 [19:42:31<82:07:19,  9.93s/it]
 22%|██▏       | 8192/37963 [19:42:38<75:34:27,  9.14s/it]
 22%|██▏       | 8193/37963 [19:42:46<71:34:03,  8.65s/it]
 22%|██▏       | 8194/37963 [19:43:00<84:45:28, 10.25s/it]
 22%|██▏       | 8195/37963 [19:43:14<94:26:12, 11.42s/it]
 22%|██▏       | 8196/37963 [19:43:21<84:53:23, 10.27s/it]
 22%|██▏       | 8197/37963 [19:43:29<77:34:51,  9.38s/it]
 22%|██▏       | 8198/37963 [19:43:36<72:56:08,  8.82s/it]
 22%|██▏       | 8199/37963 [19:43:44<69:44:45,  8.44s/it]
 22%|██▏       | 8200/37963 [19:43:51<67:21:49,  8.15s/it]
                                                          
{'loss': '0.1791', 'grad_norm': '4.256', 'learning_rate': '1.824e-05', 'epoch': '0.216'}

 22%|██▏       | 8200/37963 [19:43:51<67:21:49,  8.15s/it]
 22%|██▏       | 8201/37963 [19:43:59<65:46:21,  7.96s/it]
 22%|██▏       | 8202/37963 [19:44:06<64:02:42,  7.75s/it]
 22%|██▏       | 8203/37963 [19:44:14<63:29:53,  7.68s/it]
 22%|██▏       | 8204/37963 [19:44:21<62:28:08,  7.56s/it]
 22%|██▏       | 8205/37963 [19:44:29<62:37:24,  7.58s/it]
 22%|██▏       | 8206/37963 [19:44:36<62:35:28,  7.57s/it]
 22%|██▏       | 8207/37963 [19:44:44<62:30:05,  7.56s/it]
 22%|██▏       | 8208/37963 [19:44:51<62:29:28,  7.56s/it]
 22%|██▏       | 8209/37963 [19:44:59<62:53:44,  7.61s/it]
 22%|██▏       | 8210/37963 [19:45:13<78:19:14,  9.48s/it]
                                                          
{'loss': '0.1782', 'grad_norm': '4.239', 'learning_rate': '1.824e-05', 'epoch': '0.2163'}

 22%|██▏       | 8210/37963 [19:45:13<78:19:14,  9.48s/it]
 22%|██▏       | 8211/37963 [19:45:20<73:27:29,  8.89s/it]
 22%|██▏       | 8212/37963 [19:45:28<70:17:21,  8.51s/it]
 22%|██▏       | 8213/37963 [19:45:35<67:55:02,  8.22s/it]
 22%|██▏       | 8214/37963 [19:45:43<65:53:58,  7.97s/it]
 22%|██▏       | 8215/37963 [19:45:50<64:21:09,  7.79s/it]
 22%|██▏       | 8216/37963 [19:46:04<79:26:18,  9.61s/it]
 22%|██▏       | 8217/37963 [19:46:12<74:51:18,  9.06s/it]
 22%|██▏       | 8218/37963 [19:46:19<70:39:28,  8.55s/it]
 22%|██▏       | 8219/37963 [19:46:27<68:08:54,  8.25s/it]
 22%|██▏       | 8220/37963 [19:46:34<66:23:13,  8.04s/it]
                                                          
{'loss': '0.1771', 'grad_norm': '1.124', 'learning_rate': '1.823e-05', 'epoch': '0.2165'}

 22%|██▏       | 8220/37963 [19:46:34<66:23:13,  8.04s/it]
 22%|██▏       | 8221/37963 [19:46:42<65:25:30,  7.92s/it]
 22%|██▏       | 8222/37963 [19:46:49<64:13:29,  7.77s/it]
 22%|██▏       | 8223/37963 [19:46:57<63:38:11,  7.70s/it]
 22%|██▏       | 8224/37963 [19:47:04<62:34:43,  7.58s/it]
 22%|██▏       | 8225/37963 [19:47:18<78:25:32,  9.49s/it]
 22%|██▏       | 8226/37963 [19:47:26<73:30:21,  8.90s/it]
 22%|██▏       | 8227/37963 [19:47:33<70:02:03,  8.48s/it]
 22%|██▏       | 8228/37963 [19:47:41<67:53:43,  8.22s/it]
 22%|██▏       | 8229/37963 [19:47:48<66:10:37,  8.01s/it]
 22%|██▏       | 8230/37963 [19:48:03<81:47:30,  9.90s/it]
                                                          
{'loss': '0.1626', 'grad_norm': '1.685', 'learning_rate': '1.823e-05', 'epoch': '0.2168'}

 22%|██▏       | 8230/37963 [19:48:03<81:47:30,  9.90s/it]
 22%|██▏       | 8231/37963 [19:48:10<76:03:55,  9.21s/it]
 22%|██▏       | 8232/37963 [19:48:18<71:51:23,  8.70s/it]
 22%|██▏       | 8233/37963 [19:48:25<69:09:49,  8.38s/it]
 22%|██▏       | 8234/37963 [19:48:33<67:07:10,  8.13s/it]
 22%|██▏       | 8235/37963 [19:48:41<65:59:55,  7.99s/it]
 22%|██▏       | 8236/37963 [19:48:48<64:54:04,  7.86s/it]
 22%|██▏       | 8237/37963 [19:49:02<80:20:03,  9.73s/it]
 22%|██▏       | 8238/37963 [19:49:10<74:43:19,  9.05s/it]
 22%|██▏       | 8239/37963 [19:49:24<86:47:00, 10.51s/it]
 22%|██▏       | 8240/37963 [19:49:31<79:37:54,  9.64s/it]
                                                          
{'loss': '0.1604', 'grad_norm': '0.5752', 'learning_rate': '1.822e-05', 'epoch': '0.2171'}

 22%|██▏       | 8240/37963 [19:49:31<79:37:54,  9.64s/it]
 22%|██▏       | 8241/37963 [19:49:39<74:39:22,  9.04s/it]
 22%|██▏       | 8242/37963 [19:49:47<71:22:18,  8.65s/it]
 22%|██▏       | 8243/37963 [19:49:54<68:35:00,  8.31s/it]
 22%|██▏       | 8244/37963 [19:50:08<82:33:22, 10.00s/it]
 22%|██▏       | 8245/37963 [19:50:16<77:08:27,  9.34s/it]
 22%|██▏       | 8246/37963 [19:50:23<72:30:18,  8.78s/it]
 22%|██▏       | 8247/37963 [19:50:31<69:16:48,  8.39s/it]
 22%|██▏       | 8248/37963 [19:50:45<83:36:55, 10.13s/it]
 22%|██▏       | 8249/37963 [19:50:52<77:05:58,  9.34s/it]
 22%|██▏       | 8250/37963 [19:51:00<71:45:12,  8.69s/it]
                                                          
{'loss': '0.1605', 'grad_norm': '1.537', 'learning_rate': '1.822e-05', 'epoch': '0.2173'}

 22%|██▏       | 8250/37963 [19:51:00<71:45:12,  8.69s/it]
 22%|██▏       | 8251/37963 [19:51:07<68:30:15,  8.30s/it]
 22%|██▏       | 8252/37963 [19:51:14<66:26:41,  8.05s/it]
 22%|██▏       | 8253/37963 [19:51:22<65:00:52,  7.88s/it]
 22%|██▏       | 8254/37963 [19:51:30<64:17:20,  7.79s/it]
 22%|██▏       | 8255/37963 [19:51:37<63:07:31,  7.65s/it]
 22%|██▏       | 8256/37963 [19:51:44<63:00:37,  7.64s/it]
 22%|██▏       | 8257/37963 [19:51:52<62:43:45,  7.60s/it]
 22%|██▏       | 8258/37963 [19:52:00<62:43:41,  7.60s/it]
 22%|██▏       | 8259/37963 [19:52:07<62:45:10,  7.61s/it]
 22%|██▏       | 8260/37963 [19:52:14<61:54:41,  7.50s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '1.513', 'learning_rate': '1.821e-05', 'epoch': '0.2176'}

 22%|██▏       | 8260/37963 [19:52:14<61:54:41,  7.50s/it]
 22%|██▏       | 8261/37963 [19:52:28<77:57:11,  9.45s/it]
 22%|██▏       | 8262/37963 [19:52:36<73:31:15,  8.91s/it]
 22%|██▏       | 8263/37963 [19:52:44<69:55:54,  8.48s/it]
 22%|██▏       | 8264/37963 [19:52:51<67:30:11,  8.18s/it]
 22%|██▏       | 8265/37963 [19:52:59<65:37:59,  7.96s/it]
 22%|██▏       | 8266/37963 [19:53:06<64:39:43,  7.84s/it]
 22%|██▏       | 8267/37963 [19:53:14<64:16:57,  7.79s/it]
 22%|██▏       | 8268/37963 [19:53:21<63:47:59,  7.73s/it]
 22%|██▏       | 8269/37963 [19:53:29<62:39:32,  7.60s/it]
 22%|██▏       | 8270/37963 [19:53:42<77:46:22,  9.43s/it]
                                                          
{'loss': '0.1512', 'grad_norm': '0.9536', 'learning_rate': '1.821e-05', 'epoch': '0.2178'}

 22%|██▏       | 8270/37963 [19:53:42<77:46:22,  9.43s/it]
 22%|██▏       | 8271/37963 [19:53:50<72:28:25,  8.79s/it]
 22%|██▏       | 8272/37963 [19:53:57<69:29:53,  8.43s/it]
 22%|██▏       | 8273/37963 [19:54:11<83:05:32, 10.08s/it]
 22%|██▏       | 8274/37963 [19:54:19<77:00:22,  9.34s/it]
 22%|██▏       | 8275/37963 [19:54:26<72:20:10,  8.77s/it]
 22%|██▏       | 8276/37963 [19:54:34<69:21:35,  8.41s/it]
 22%|██▏       | 8277/37963 [19:54:41<67:14:49,  8.15s/it]
 22%|██▏       | 8278/37963 [19:54:49<65:43:53,  7.97s/it]
 22%|██▏       | 8279/37963 [19:55:03<80:09:59,  9.72s/it]
 22%|██▏       | 8280/37963 [19:55:10<75:05:27,  9.11s/it]
                                                          
{'loss': '0.1543', 'grad_norm': '2.671', 'learning_rate': '1.82e-05', 'epoch': '0.2181'}

 22%|██▏       | 8280/37963 [19:55:10<75:05:27,  9.11s/it]
 22%|██▏       | 8281/37963 [19:55:18<70:42:06,  8.58s/it]
 22%|██▏       | 8282/37963 [19:55:25<68:04:45,  8.26s/it]
 22%|██▏       | 8283/37963 [19:55:33<65:52:55,  7.99s/it]
 22%|██▏       | 8284/37963 [19:55:40<64:50:06,  7.86s/it]
 22%|██▏       | 8285/37963 [19:55:47<63:33:11,  7.71s/it]
 22%|██▏       | 8286/37963 [19:56:02<79:07:47,  9.60s/it]
 22%|██▏       | 8287/37963 [19:56:09<74:36:58,  9.05s/it]
 22%|██▏       | 8288/37963 [19:56:17<71:04:34,  8.62s/it]
 22%|██▏       | 8289/37963 [19:56:24<68:12:46,  8.28s/it]
 22%|██▏       | 8290/37963 [19:56:32<66:31:27,  8.07s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.136', 'learning_rate': '1.82e-05', 'epoch': '0.2184'}

 22%|██▏       | 8290/37963 [19:56:32<66:31:27,  8.07s/it]
 22%|██▏       | 8291/37963 [19:56:39<65:05:54,  7.90s/it]
 22%|██▏       | 8292/37963 [19:56:53<79:01:10,  9.59s/it]
 22%|██▏       | 8293/37963 [19:57:01<73:57:18,  8.97s/it]
 22%|██▏       | 8294/37963 [19:57:08<70:14:09,  8.52s/it]
 22%|██▏       | 8295/37963 [19:57:15<67:10:34,  8.15s/it]
 22%|██▏       | 8296/37963 [19:57:29<82:05:26,  9.96s/it]
 22%|██▏       | 8297/37963 [19:57:37<76:33:05,  9.29s/it]
 22%|██▏       | 8298/37963 [19:57:45<72:20:11,  8.78s/it]
 22%|██▏       | 8299/37963 [19:57:52<69:11:11,  8.40s/it]
 22%|██▏       | 8300/37963 [19:58:00<67:06:32,  8.14s/it]
                                                          
{'loss': '0.1599', 'grad_norm': '2.099', 'learning_rate': '1.819e-05', 'epoch': '0.2186'}

 22%|██▏       | 8300/37963 [19:58:00<67:06:32,  8.14s/it]
 22%|██▏       | 8301/37963 [19:58:07<65:43:58,  7.98s/it]
 22%|██▏       | 8302/37963 [19:58:15<64:59:09,  7.89s/it]
 22%|██▏       | 8303/37963 [19:58:23<64:09:28,  7.79s/it]
 22%|██▏       | 8304/37963 [19:58:30<63:35:03,  7.72s/it]
 22%|██▏       | 8305/37963 [19:58:38<63:19:25,  7.69s/it]
 22%|██▏       | 8306/37963 [19:58:45<63:14:36,  7.68s/it]
 22%|██▏       | 8307/37963 [19:58:53<62:58:22,  7.64s/it]
 22%|██▏       | 8308/37963 [19:59:00<62:29:05,  7.59s/it]
 22%|██▏       | 8309/37963 [19:59:14<77:16:11,  9.38s/it]
 22%|██▏       | 8310/37963 [19:59:22<72:50:30,  8.84s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '1.262', 'learning_rate': '1.819e-05', 'epoch': '0.2189'}

 22%|██▏       | 8310/37963 [19:59:22<72:50:30,  8.84s/it]
 22%|██▏       | 8311/37963 [19:59:29<69:23:09,  8.42s/it]
 22%|██▏       | 8312/37963 [19:59:37<67:09:33,  8.15s/it]
 22%|██▏       | 8313/37963 [19:59:44<65:56:13,  8.01s/it]
 22%|██▏       | 8314/37963 [19:59:58<80:32:02,  9.78s/it]
 22%|██▏       | 8315/37963 [20:00:06<75:00:40,  9.11s/it]
 22%|██▏       | 8316/37963 [20:00:13<71:28:28,  8.68s/it]
 22%|██▏       | 8317/37963 [20:00:21<69:07:59,  8.40s/it]
 22%|██▏       | 8318/37963 [20:00:29<66:55:40,  8.13s/it]
 22%|██▏       | 8319/37963 [20:00:36<65:25:43,  7.95s/it]
 22%|██▏       | 8320/37963 [20:00:44<64:20:46,  7.81s/it]
                                                          
{'loss': '0.164', 'grad_norm': '1.813', 'learning_rate': '1.818e-05', 'epoch': '0.2192'}

 22%|██▏       | 8320/37963 [20:00:44<64:20:46,  7.81s/it]
 22%|██▏       | 8321/37963 [20:00:58<79:25:33,  9.65s/it]
 22%|██▏       | 8322/37963 [20:01:05<74:14:12,  9.02s/it]
 22%|██▏       | 8323/37963 [20:01:13<70:42:41,  8.59s/it]
 22%|██▏       | 8324/37963 [20:01:27<84:44:53, 10.29s/it]
 22%|██▏       | 8325/37963 [20:01:35<78:00:42,  9.48s/it]
 22%|██▏       | 8326/37963 [20:01:42<73:11:50,  8.89s/it]
 22%|██▏       | 8327/37963 [20:01:49<69:07:43,  8.40s/it]
 22%|██▏       | 8328/37963 [20:01:57<66:46:18,  8.11s/it]
 22%|██▏       | 8329/37963 [20:02:04<65:20:54,  7.94s/it]
 22%|██▏       | 8330/37963 [20:02:12<63:33:39,  7.72s/it]
                                                          
{'loss': '0.159', 'grad_norm': '2.702', 'learning_rate': '1.818e-05', 'epoch': '0.2194'}

 22%|██▏       | 8330/37963 [20:02:12<63:33:39,  7.72s/it]
 22%|██▏       | 8331/37963 [20:02:19<63:22:05,  7.70s/it]
 22%|██▏       | 8332/37963 [20:02:26<62:12:03,  7.56s/it]
 22%|██▏       | 8333/37963 [20:02:41<78:28:11,  9.53s/it]
 22%|██▏       | 8334/37963 [20:02:48<74:03:24,  9.00s/it]
 22%|██▏       | 8335/37963 [20:02:56<70:37:28,  8.58s/it]
 22%|██▏       | 8336/37963 [20:03:10<84:25:48, 10.26s/it]
 22%|██▏       | 8337/37963 [20:03:18<77:43:16,  9.44s/it]
 22%|██▏       | 8338/37963 [20:03:32<88:45:58, 10.79s/it]
 22%|██▏       | 8339/37963 [20:03:39<80:58:41,  9.84s/it]
 22%|██▏       | 8340/37963 [20:03:53<91:08:45, 11.08s/it]
                                                          
{'loss': '0.1871', 'grad_norm': '3.823', 'learning_rate': '1.817e-05', 'epoch': '0.2197'}

 22%|██▏       | 8340/37963 [20:03:53<91:08:45, 11.08s/it]
 22%|██▏       | 8341/37963 [20:04:01<82:46:22, 10.06s/it]
 22%|██▏       | 8342/37963 [20:04:08<75:45:25,  9.21s/it]
 22%|██▏       | 8343/37963 [20:04:16<71:33:00,  8.70s/it]
 22%|██▏       | 8344/37963 [20:04:23<67:57:53,  8.26s/it]
 22%|██▏       | 8345/37963 [20:04:30<66:14:34,  8.05s/it]
 22%|██▏       | 8346/37963 [20:04:38<64:34:07,  7.85s/it]
 22%|██▏       | 8347/37963 [20:04:45<63:41:17,  7.74s/it]
 22%|██▏       | 8348/37963 [20:04:53<62:40:06,  7.62s/it]
 22%|██▏       | 8349/37963 [20:05:00<62:28:58,  7.60s/it]
 22%|██▏       | 8350/37963 [20:05:08<62:19:02,  7.58s/it]
                                                          
{'loss': '0.1816', 'grad_norm': '1.356', 'learning_rate': '1.817e-05', 'epoch': '0.22'}

 22%|██▏       | 8350/37963 [20:05:08<62:19:02,  7.58s/it]
 22%|██▏       | 8351/37963 [20:05:15<62:15:40,  7.57s/it]
 22%|██▏       | 8352/37963 [20:05:23<62:16:46,  7.57s/it]
 22%|██▏       | 8353/37963 [20:05:30<62:06:37,  7.55s/it]
 22%|██▏       | 8354/37963 [20:05:38<62:00:49,  7.54s/it]
 22%|██▏       | 8355/37963 [20:05:45<61:40:27,  7.50s/it]
 22%|██▏       | 8356/37963 [20:05:53<61:58:08,  7.53s/it]
 22%|██▏       | 8357/37963 [20:06:00<61:52:08,  7.52s/it]
 22%|██▏       | 8358/37963 [20:06:08<62:10:12,  7.56s/it]
 22%|██▏       | 8359/37963 [20:06:22<77:59:22,  9.48s/it]
 22%|██▏       | 8360/37963 [20:06:36<88:26:05, 10.75s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.588', 'learning_rate': '1.816e-05', 'epoch': '0.2202'}

 22%|██▏       | 8360/37963 [20:06:36<88:26:05, 10.75s/it]
 22%|██▏       | 8361/37963 [20:06:43<80:31:26,  9.79s/it]
 22%|██▏       | 8362/37963 [20:06:51<74:48:14,  9.10s/it]
 22%|██▏       | 8363/37963 [20:06:58<70:55:38,  8.63s/it]
 22%|██▏       | 8364/37963 [20:07:06<68:23:32,  8.32s/it]
 22%|██▏       | 8365/37963 [20:07:13<66:21:48,  8.07s/it]
 22%|██▏       | 8366/37963 [20:07:20<64:12:52,  7.81s/it]
 22%|██▏       | 8367/37963 [20:07:28<63:17:22,  7.70s/it]
 22%|██▏       | 8368/37963 [20:07:35<62:55:22,  7.65s/it]
 22%|██▏       | 8369/37963 [20:07:43<62:03:28,  7.55s/it]
 22%|██▏       | 8370/37963 [20:07:50<62:01:20,  7.55s/it]
                                                          
{'loss': '0.1544', 'grad_norm': '1.437', 'learning_rate': '1.816e-05', 'epoch': '0.2205'}

 22%|██▏       | 8370/37963 [20:07:50<62:01:20,  7.55s/it]
 22%|██▏       | 8371/37963 [20:08:04<77:43:41,  9.46s/it]
 22%|██▏       | 8372/37963 [20:08:12<72:51:20,  8.86s/it]
 22%|██▏       | 8373/37963 [20:08:25<84:40:20, 10.30s/it]
 22%|██▏       | 8374/37963 [20:08:33<78:17:53,  9.53s/it]
 22%|██▏       | 8375/37963 [20:08:40<72:53:10,  8.87s/it]
 22%|██▏       | 8376/37963 [20:08:48<69:10:33,  8.42s/it]
 22%|██▏       | 8377/37963 [20:08:55<67:03:20,  8.16s/it]
 22%|██▏       | 8378/37963 [20:09:03<64:56:33,  7.90s/it]
 22%|██▏       | 8379/37963 [20:09:10<64:09:43,  7.81s/it]
 22%|██▏       | 8380/37963 [20:09:17<62:44:17,  7.63s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '1.203', 'learning_rate': '1.815e-05', 'epoch': '0.2207'}

 22%|██▏       | 8380/37963 [20:09:17<62:44:17,  7.63s/it]
 22%|██▏       | 8381/37963 [20:09:25<62:34:15,  7.61s/it]
 22%|██▏       | 8382/37963 [20:09:39<78:47:24,  9.59s/it]
 22%|██▏       | 8383/37963 [20:09:53<89:57:08, 10.95s/it]
 22%|██▏       | 8384/37963 [20:10:01<81:31:03,  9.92s/it]
 22%|██▏       | 8385/37963 [20:10:08<75:45:36,  9.22s/it]
 22%|██▏       | 8386/37963 [20:10:16<71:39:11,  8.72s/it]
 22%|██▏       | 8387/37963 [20:10:37<100:44:08, 12.26s/it]
 22%|██▏       | 8388/37963 [20:10:44<89:08:18, 10.85s/it] 
 22%|██▏       | 8389/37963 [20:10:52<81:03:16,  9.87s/it]
 22%|██▏       | 8390/37963 [20:10:59<75:14:00,  9.16s/it]
                                                          
{'loss': '0.1797', 'grad_norm': '1.091', 'learning_rate': '1.815e-05', 'epoch': '0.221'}

 22%|██▏       | 8390/37963 [20:10:59<75:14:00,  9.16s/it]
 22%|██▏       | 8391/37963 [20:11:07<71:28:56,  8.70s/it]
 22%|██▏       | 8392/37963 [20:11:14<68:08:32,  8.30s/it]
 22%|██▏       | 8393/37963 [20:11:22<66:05:28,  8.05s/it]
 22%|██▏       | 8394/37963 [20:11:29<64:40:46,  7.87s/it]
 22%|██▏       | 8395/37963 [20:11:37<63:55:44,  7.78s/it]
 22%|██▏       | 8396/37963 [20:11:44<63:18:56,  7.71s/it]
 22%|██▏       | 8397/37963 [20:11:52<62:37:18,  7.62s/it]
 22%|██▏       | 8398/37963 [20:11:59<62:24:23,  7.60s/it]
 22%|██▏       | 8399/37963 [20:12:07<62:27:02,  7.60s/it]
 22%|██▏       | 8400/37963 [20:12:14<62:29:01,  7.61s/it]
                                                          
{'loss': '0.1585', 'grad_norm': '1.036', 'learning_rate': '1.814e-05', 'epoch': '0.2213'}

 22%|██▏       | 8400/37963 [20:12:14<62:29:01,  7.61s/it]
 22%|██▏       | 8401/37963 [20:12:22<62:49:05,  7.65s/it]
 22%|██▏       | 8402/37963 [20:12:30<62:35:09,  7.62s/it]
 22%|██▏       | 8403/37963 [20:12:37<62:15:54,  7.58s/it]
 22%|██▏       | 8404/37963 [20:12:45<62:00:37,  7.55s/it]
 22%|██▏       | 8405/37963 [20:12:52<62:06:54,  7.57s/it]
 22%|██▏       | 8406/37963 [20:13:12<92:50:51, 11.31s/it]
 22%|██▏       | 8407/37963 [20:13:20<82:49:54, 10.09s/it]
 22%|██▏       | 8408/37963 [20:13:27<76:34:57,  9.33s/it]
 22%|██▏       | 8409/37963 [20:13:35<72:16:36,  8.80s/it]
 22%|██▏       | 8410/37963 [20:13:42<69:19:00,  8.44s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '1.567', 'learning_rate': '1.814e-05', 'epoch': '0.2215'}

 22%|██▏       | 8410/37963 [20:13:42<69:19:00,  8.44s/it]
 22%|██▏       | 8411/37963 [20:13:50<66:58:46,  8.16s/it]
 22%|██▏       | 8412/37963 [20:13:57<65:28:12,  7.98s/it]
 22%|██▏       | 8413/37963 [20:14:05<64:19:19,  7.84s/it]
 22%|██▏       | 8414/37963 [20:14:12<63:37:42,  7.75s/it]
 22%|██▏       | 8415/37963 [20:14:20<63:15:05,  7.71s/it]
 22%|██▏       | 8416/37963 [20:14:28<62:45:52,  7.65s/it]
 22%|██▏       | 8417/37963 [20:14:35<62:33:37,  7.62s/it]
 22%|██▏       | 8418/37963 [20:14:55<93:16:03, 11.36s/it]
 22%|██▏       | 8419/37963 [20:15:03<84:12:51, 10.26s/it]
 22%|██▏       | 8420/37963 [20:15:10<77:39:58,  9.46s/it]
                                                          
{'loss': '0.1598', 'grad_norm': '1.415', 'learning_rate': '1.813e-05', 'epoch': '0.2218'}

 22%|██▏       | 8420/37963 [20:15:10<77:39:58,  9.46s/it]
 22%|██▏       | 8421/37963 [20:15:18<72:58:25,  8.89s/it]
 22%|██▏       | 8422/37963 [20:15:26<69:40:45,  8.49s/it]
 22%|██▏       | 8423/37963 [20:15:33<67:25:56,  8.22s/it]
 22%|██▏       | 8424/37963 [20:15:41<65:46:18,  8.02s/it]
 22%|██▏       | 8425/37963 [20:15:55<80:46:14,  9.84s/it]
 22%|██▏       | 8426/37963 [20:16:03<75:47:04,  9.24s/it]
 22%|██▏       | 8427/37963 [20:16:10<71:43:30,  8.74s/it]
 22%|██▏       | 8428/37963 [20:16:24<83:38:34, 10.20s/it]
 22%|██▏       | 8429/37963 [20:16:31<76:59:00,  9.38s/it]
 22%|██▏       | 8430/37963 [20:16:39<72:23:15,  8.82s/it]
                                                          
{'loss': '0.1716', 'grad_norm': '0.874', 'learning_rate': '1.813e-05', 'epoch': '0.2221'}

 22%|██▏       | 8430/37963 [20:16:39<72:23:15,  8.82s/it]
 22%|██▏       | 8431/37963 [20:16:46<69:21:57,  8.46s/it]
 22%|██▏       | 8432/37963 [20:16:54<67:23:07,  8.21s/it]
 22%|██▏       | 8433/37963 [20:17:02<65:31:33,  7.99s/it]
 22%|██▏       | 8434/37963 [20:17:09<64:47:35,  7.90s/it]
 22%|██▏       | 8435/37963 [20:17:17<63:51:49,  7.79s/it]
 22%|██▏       | 8436/37963 [20:17:30<77:52:02,  9.49s/it]
 22%|██▏       | 8437/37963 [20:17:44<89:01:21, 10.85s/it]
 22%|██▏       | 8438/37963 [20:17:52<80:40:16,  9.84s/it]
 22%|██▏       | 8439/37963 [20:17:59<74:31:49,  9.09s/it]
 22%|██▏       | 8440/37963 [20:18:07<70:44:15,  8.63s/it]
                                                          
{'loss': '0.1714', 'grad_norm': '2.887', 'learning_rate': '1.812e-05', 'epoch': '0.2223'}

 22%|██▏       | 8440/37963 [20:18:07<70:44:15,  8.63s/it]
 22%|██▏       | 8441/37963 [20:18:14<67:48:45,  8.27s/it]
 22%|██▏       | 8442/37963 [20:18:22<65:54:48,  8.04s/it]
 22%|██▏       | 8443/37963 [20:18:29<64:38:25,  7.88s/it]
 22%|██▏       | 8444/37963 [20:18:37<63:50:23,  7.79s/it]
 22%|██▏       | 8445/37963 [20:18:44<63:03:52,  7.69s/it]
 22%|██▏       | 8446/37963 [20:18:52<62:44:35,  7.65s/it]
 22%|██▏       | 8447/37963 [20:18:59<62:38:29,  7.64s/it]
 22%|██▏       | 8448/37963 [20:19:07<62:19:38,  7.60s/it]
 22%|██▏       | 8449/37963 [20:19:14<61:52:34,  7.55s/it]
 22%|██▏       | 8450/37963 [20:19:22<61:49:52,  7.54s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '3.187', 'learning_rate': '1.812e-05', 'epoch': '0.2226'}

 22%|██▏       | 8450/37963 [20:19:22<61:49:52,  7.54s/it]
 22%|██▏       | 8451/37963 [20:19:29<61:51:02,  7.54s/it]
 22%|██▏       | 8452/37963 [20:19:37<61:23:58,  7.49s/it]
 22%|██▏       | 8453/37963 [20:19:51<78:14:18,  9.54s/it]
 22%|██▏       | 8454/37963 [20:19:58<72:56:16,  8.90s/it]
 22%|██▏       | 8455/37963 [20:20:06<69:16:45,  8.45s/it]
 22%|██▏       | 8456/37963 [20:20:13<67:01:19,  8.18s/it]
 22%|██▏       | 8457/37963 [20:20:21<65:29:43,  7.99s/it]
 22%|██▏       | 8458/37963 [20:20:28<64:33:44,  7.88s/it]
 22%|██▏       | 8459/37963 [20:20:42<79:27:14,  9.69s/it]
 22%|██▏       | 8460/37963 [20:20:50<74:20:27,  9.07s/it]
                                                          
{'loss': '0.1641', 'grad_norm': '1.775', 'learning_rate': '1.811e-05', 'epoch': '0.2228'}

 22%|██▏       | 8460/37963 [20:20:50<74:20:27,  9.07s/it]
 22%|██▏       | 8461/37963 [20:20:58<70:37:25,  8.62s/it]
 22%|██▏       | 8462/37963 [20:21:05<67:57:26,  8.29s/it]
 22%|██▏       | 8463/37963 [20:21:13<66:10:12,  8.07s/it]
 22%|██▏       | 8464/37963 [20:21:20<64:22:27,  7.86s/it]
 22%|██▏       | 8465/37963 [20:21:34<79:17:40,  9.68s/it]
 22%|██▏       | 8466/37963 [20:21:48<89:52:16, 10.97s/it]
 22%|██▏       | 8467/37963 [20:21:56<81:43:47,  9.98s/it]
 22%|██▏       | 8468/37963 [20:22:03<75:29:06,  9.21s/it]
 22%|██▏       | 8469/37963 [20:22:11<71:30:14,  8.73s/it]
 22%|██▏       | 8470/37963 [20:22:18<68:19:44,  8.34s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '0.6799', 'learning_rate': '1.811e-05', 'epoch': '0.2231'}

 22%|██▏       | 8470/37963 [20:22:18<68:19:44,  8.34s/it]
 22%|██▏       | 8471/37963 [20:22:25<66:03:39,  8.06s/it]
 22%|██▏       | 8472/37963 [20:22:33<64:41:34,  7.90s/it]
 22%|██▏       | 8473/37963 [20:22:41<63:48:32,  7.79s/it]
 22%|██▏       | 8474/37963 [20:22:48<62:33:04,  7.64s/it]
 22%|██▏       | 8475/37963 [20:22:55<62:27:21,  7.62s/it]
 22%|██▏       | 8476/37963 [20:23:09<77:29:17,  9.46s/it]
 22%|██▏       | 8477/37963 [20:23:17<72:31:34,  8.85s/it]
 22%|██▏       | 8478/37963 [20:23:24<68:59:29,  8.42s/it]
 22%|██▏       | 8479/37963 [20:23:38<82:48:32, 10.11s/it]
 22%|██▏       | 8480/37963 [20:23:46<76:29:19,  9.34s/it]
                                                          
{'loss': '0.1694', 'grad_norm': '4.414', 'learning_rate': '1.81e-05', 'epoch': '0.2234'}

 22%|██▏       | 8480/37963 [20:23:46<76:29:19,  9.34s/it]
 22%|██▏       | 8481/37963 [20:23:53<71:58:06,  8.79s/it]
 22%|██▏       | 8482/37963 [20:24:01<69:25:10,  8.48s/it]
 22%|██▏       | 8483/37963 [20:24:09<67:33:11,  8.25s/it]
 22%|██▏       | 8484/37963 [20:24:23<81:48:00,  9.99s/it]
 22%|██▏       | 8485/37963 [20:24:30<75:06:49,  9.17s/it]
 22%|██▏       | 8486/37963 [20:24:37<70:23:00,  8.60s/it]
 22%|██▏       | 8487/37963 [20:24:45<67:48:25,  8.28s/it]
 22%|██▏       | 8488/37963 [20:24:52<65:28:39,  8.00s/it]
 22%|██▏       | 8489/37963 [20:25:00<64:17:39,  7.85s/it]
 22%|██▏       | 8490/37963 [20:25:07<63:26:26,  7.75s/it]
                                                          
{'loss': '0.1595', 'grad_norm': '3.833', 'learning_rate': '1.81e-05', 'epoch': '0.2236'}

 22%|██▏       | 8490/37963 [20:25:07<63:26:26,  7.75s/it]
 22%|██▏       | 8491/37963 [20:25:21<78:47:46,  9.62s/it]
 22%|██▏       | 8492/37963 [20:25:28<73:25:48,  8.97s/it]
 22%|██▏       | 8493/37963 [20:25:36<69:51:01,  8.53s/it]
 22%|██▏       | 8494/37963 [20:25:43<67:17:44,  8.22s/it]
 22%|██▏       | 8495/37963 [20:25:51<65:28:09,  8.00s/it]
 22%|██▏       | 8496/37963 [20:25:58<64:02:15,  7.82s/it]
 22%|██▏       | 8497/37963 [20:26:06<62:31:52,  7.64s/it]
 22%|██▏       | 8498/37963 [20:26:13<62:14:42,  7.61s/it]
 22%|██▏       | 8499/37963 [20:26:20<61:18:04,  7.49s/it]
 22%|██▏       | 8500/37963 [20:26:28<61:22:00,  7.50s/it]
                                                          
{'loss': '0.162', 'grad_norm': '3.928', 'learning_rate': '1.809e-05', 'epoch': '0.2239'}

 22%|██▏       | 8500/37963 [20:26:28<61:22:00,  7.50s/it]
 22%|██▏       | 8501/37963 [20:26:35<61:07:10,  7.47s/it]
 22%|██▏       | 8502/37963 [20:26:43<61:18:53,  7.49s/it]
 22%|██▏       | 8503/37963 [20:26:56<76:24:08,  9.34s/it]
 22%|██▏       | 8504/37963 [20:27:04<71:50:12,  8.78s/it]
 22%|██▏       | 8505/37963 [20:27:11<68:36:53,  8.39s/it]
 22%|██▏       | 8506/37963 [20:27:19<66:25:18,  8.12s/it]
 22%|██▏       | 8507/37963 [20:27:26<65:04:37,  7.95s/it]
 22%|██▏       | 8508/37963 [20:27:40<79:45:02,  9.75s/it]
 22%|██▏       | 8509/37963 [20:27:48<74:26:00,  9.10s/it]
 22%|██▏       | 8510/37963 [20:28:02<86:12:07, 10.54s/it]
                                                          
{'loss': '0.1639', 'grad_norm': '1.73', 'learning_rate': '1.809e-05', 'epoch': '0.2242'}

 22%|██▏       | 8510/37963 [20:28:02<86:12:07, 10.54s/it]
 22%|██▏       | 8511/37963 [20:28:10<79:10:19,  9.68s/it]
 22%|██▏       | 8512/37963 [20:28:17<74:18:29,  9.08s/it]
 22%|██▏       | 8513/37963 [20:28:25<70:38:39,  8.64s/it]
 22%|██▏       | 8514/37963 [20:28:32<67:31:05,  8.25s/it]
 22%|██▏       | 8515/37963 [20:28:40<65:42:44,  8.03s/it]
 22%|██▏       | 8516/37963 [20:28:47<64:02:16,  7.83s/it]
 22%|██▏       | 8517/37963 [20:28:55<63:09:51,  7.72s/it]
 22%|██▏       | 8518/37963 [20:29:08<78:20:06,  9.58s/it]
 22%|██▏       | 8519/37963 [20:29:16<73:29:43,  8.99s/it]
 22%|██▏       | 8520/37963 [20:29:23<69:19:52,  8.48s/it]
                                                          
{'loss': '0.1702', 'grad_norm': '3.354', 'learning_rate': '1.808e-05', 'epoch': '0.2244'}

 22%|██▏       | 8520/37963 [20:29:23<69:19:52,  8.48s/it]
 22%|██▏       | 8521/37963 [20:29:31<66:36:00,  8.14s/it]
 22%|██▏       | 8522/37963 [20:29:38<65:05:43,  7.96s/it]
 22%|██▏       | 8523/37963 [20:29:46<64:24:40,  7.88s/it]
 22%|██▏       | 8524/37963 [20:29:53<63:16:36,  7.74s/it]
 22%|██▏       | 8525/37963 [20:30:01<62:49:49,  7.68s/it]
 22%|██▏       | 8526/37963 [20:30:08<62:30:12,  7.64s/it]
 22%|██▏       | 8527/37963 [20:30:29<93:51:27, 11.48s/it]
 22%|██▏       | 8528/37963 [20:30:36<84:22:54, 10.32s/it]
 22%|██▏       | 8529/37963 [20:30:44<76:34:30,  9.37s/it]
 22%|██▏       | 8530/37963 [20:30:51<72:09:24,  8.83s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '1.138', 'learning_rate': '1.808e-05', 'epoch': '0.2247'}

 22%|██▏       | 8530/37963 [20:30:51<72:09:24,  8.83s/it]
 22%|██▏       | 8531/37963 [20:30:59<68:55:06,  8.43s/it]
 22%|██▏       | 8532/37963 [20:31:13<82:35:55, 10.10s/it]
 22%|██▏       | 8533/37963 [20:31:20<76:00:35,  9.30s/it]
 22%|██▏       | 8534/37963 [20:31:28<71:20:12,  8.73s/it]
 22%|██▏       | 8535/37963 [20:31:35<68:20:56,  8.36s/it]
 22%|██▏       | 8536/37963 [20:31:43<66:33:12,  8.14s/it]
 22%|██▏       | 8537/37963 [20:31:50<64:36:39,  7.90s/it]
 22%|██▏       | 8538/37963 [20:31:58<63:55:17,  7.82s/it]
 22%|██▏       | 8539/37963 [20:32:05<62:22:52,  7.63s/it]
 22%|██▏       | 8540/37963 [20:32:12<62:00:24,  7.59s/it]
                                                          
{'loss': '0.1544', 'grad_norm': '2.76', 'learning_rate': '1.807e-05', 'epoch': '0.225'}

 22%|██▏       | 8540/37963 [20:32:12<62:00:24,  7.59s/it]
 22%|██▏       | 8541/37963 [20:32:20<61:47:36,  7.56s/it]
 23%|██▎       | 8542/37963 [20:32:27<61:24:45,  7.51s/it]
 23%|██▎       | 8543/37963 [20:32:35<60:52:54,  7.45s/it]
 23%|██▎       | 8544/37963 [20:32:42<61:26:14,  7.52s/it]
 23%|██▎       | 8545/37963 [20:32:56<78:04:13,  9.55s/it]
 23%|██▎       | 8546/37963 [20:33:04<73:09:35,  8.95s/it]
 23%|██▎       | 8547/37963 [20:33:12<69:39:29,  8.52s/it]
 23%|██▎       | 8548/37963 [20:33:19<66:34:34,  8.15s/it]
 23%|██▎       | 8549/37963 [20:33:26<65:03:24,  7.96s/it]
 23%|██▎       | 8550/37963 [20:33:34<63:57:00,  7.83s/it]
                                                          
{'loss': '0.1681', 'grad_norm': '2.759', 'learning_rate': '1.807e-05', 'epoch': '0.2252'}

 23%|██▎       | 8550/37963 [20:33:34<63:57:00,  7.83s/it]
 23%|██▎       | 8551/37963 [20:33:41<63:21:43,  7.76s/it]
 23%|██▎       | 8552/37963 [20:33:49<62:50:48,  7.69s/it]
 23%|██▎       | 8553/37963 [20:33:56<62:21:07,  7.63s/it]
 23%|██▎       | 8554/37963 [20:34:11<78:12:29,  9.57s/it]
 23%|██▎       | 8555/37963 [20:34:25<89:13:20, 10.92s/it]
 23%|██▎       | 8556/37963 [20:34:38<96:01:44, 11.76s/it]
 23%|██▎       | 8557/37963 [20:34:46<85:42:49, 10.49s/it]
 23%|██▎       | 8558/37963 [20:34:53<78:27:29,  9.61s/it]
 23%|██▎       | 8559/37963 [20:35:01<73:27:18,  8.99s/it]
 23%|██▎       | 8560/37963 [20:35:08<69:28:17,  8.51s/it]
                                                          
{'loss': '0.1678', 'grad_norm': '2.462', 'learning_rate': '1.806e-05', 'epoch': '0.2255'}

 23%|██▎       | 8560/37963 [20:35:08<69:28:17,  8.51s/it]
 23%|██▎       | 8561/37963 [20:35:16<67:12:29,  8.23s/it]
 23%|██▎       | 8562/37963 [20:35:24<65:30:10,  8.02s/it]
 23%|██▎       | 8563/37963 [20:35:31<64:06:58,  7.85s/it]
 23%|██▎       | 8564/37963 [20:35:39<63:24:16,  7.76s/it]
 23%|██▎       | 8565/37963 [20:35:46<62:44:56,  7.68s/it]
 23%|██▎       | 8566/37963 [20:36:00<78:01:28,  9.56s/it]
 23%|██▎       | 8567/37963 [20:36:07<73:05:08,  8.95s/it]
 23%|██▎       | 8568/37963 [20:36:15<69:35:41,  8.52s/it]
 23%|██▎       | 8569/37963 [20:36:22<67:03:04,  8.21s/it]
 23%|██▎       | 8570/37963 [20:36:30<65:24:00,  8.01s/it]
                                                          
{'loss': '0.1536', 'grad_norm': '1.609', 'learning_rate': '1.806e-05', 'epoch': '0.2257'}

 23%|██▎       | 8570/37963 [20:36:30<65:24:00,  8.01s/it]
 23%|██▎       | 8571/37963 [20:36:38<64:04:58,  7.85s/it]
 23%|██▎       | 8572/37963 [20:36:45<63:37:03,  7.79s/it]
 23%|██▎       | 8573/37963 [20:36:59<78:37:08,  9.63s/it]
 23%|██▎       | 8574/37963 [20:37:13<89:48:45, 11.00s/it]
 23%|██▎       | 8575/37963 [20:37:21<81:30:23,  9.98s/it]
 23%|██▎       | 8576/37963 [20:37:28<75:35:28,  9.26s/it]
 23%|██▎       | 8577/37963 [20:37:36<71:03:26,  8.71s/it]
 23%|██▎       | 8578/37963 [20:37:43<68:18:59,  8.37s/it]
 23%|██▎       | 8579/37963 [20:37:51<65:14:32,  7.99s/it]
 23%|██▎       | 8580/37963 [20:37:58<64:04:05,  7.85s/it]
                                                          
{'loss': '0.174', 'grad_norm': '2.94', 'learning_rate': '1.805e-05', 'epoch': '0.226'}

 23%|██▎       | 8580/37963 [20:37:58<64:04:05,  7.85s/it]
 23%|██▎       | 8581/37963 [20:38:06<63:21:26,  7.76s/it]
 23%|██▎       | 8582/37963 [20:38:13<62:42:04,  7.68s/it]
 23%|██▎       | 8583/37963 [20:38:27<78:25:11,  9.61s/it]
 23%|██▎       | 8584/37963 [20:38:35<73:23:24,  8.99s/it]
 23%|██▎       | 8585/37963 [20:38:42<69:42:49,  8.54s/it]
 23%|██▎       | 8586/37963 [20:38:50<67:11:11,  8.23s/it]
 23%|██▎       | 8587/37963 [20:38:57<65:34:09,  8.04s/it]
 23%|██▎       | 8588/37963 [20:39:05<64:03:23,  7.85s/it]
 23%|██▎       | 8589/37963 [20:39:12<63:17:53,  7.76s/it]
 23%|██▎       | 8590/37963 [20:39:20<62:22:03,  7.64s/it]
                                                          
{'loss': '0.1616', 'grad_norm': '2.415', 'learning_rate': '1.805e-05', 'epoch': '0.2263'}

 23%|██▎       | 8590/37963 [20:39:20<62:22:03,  7.64s/it]
 23%|██▎       | 8591/37963 [20:39:27<62:13:36,  7.63s/it]
 23%|██▎       | 8592/37963 [20:39:41<77:53:45,  9.55s/it]
 23%|██▎       | 8593/37963 [20:39:49<73:00:37,  8.95s/it]
 23%|██▎       | 8594/37963 [20:39:56<69:39:13,  8.54s/it]
 23%|██▎       | 8595/37963 [20:40:04<66:54:58,  8.20s/it]
 23%|██▎       | 8596/37963 [20:40:11<65:13:50,  8.00s/it]
 23%|██▎       | 8597/37963 [20:40:19<64:04:51,  7.86s/it]
 23%|██▎       | 8598/37963 [20:40:39<94:32:58, 11.59s/it]
 23%|██▎       | 8599/37963 [20:40:47<84:44:30, 10.39s/it]
 23%|██▎       | 8600/37963 [20:40:54<77:41:21,  9.52s/it]
                                                          
{'loss': '0.1798', 'grad_norm': '2.12', 'learning_rate': '1.804e-05', 'epoch': '0.2265'}

 23%|██▎       | 8600/37963 [20:40:54<77:41:21,  9.52s/it]
 23%|██▎       | 8601/37963 [20:41:02<72:51:40,  8.93s/it]
 23%|██▎       | 8602/37963 [20:41:09<68:44:55,  8.43s/it]
 23%|██▎       | 8603/37963 [20:41:17<66:17:08,  8.13s/it]
 23%|██▎       | 8604/37963 [20:41:24<64:36:28,  7.92s/it]
 23%|██▎       | 8605/37963 [20:41:38<79:35:21,  9.76s/it]
 23%|██▎       | 8606/37963 [20:41:46<74:07:44,  9.09s/it]
 23%|██▎       | 8607/37963 [20:41:53<70:17:00,  8.62s/it]
 23%|██▎       | 8608/37963 [20:42:01<67:45:47,  8.31s/it]
 23%|██▎       | 8609/37963 [20:42:08<65:42:41,  8.06s/it]
 23%|██▎       | 8610/37963 [20:42:16<64:27:54,  7.91s/it]
                                                          
{'loss': '0.1635', 'grad_norm': '0.5468', 'learning_rate': '1.804e-05', 'epoch': '0.2268'}

 23%|██▎       | 8610/37963 [20:42:16<64:27:54,  7.91s/it]
 23%|██▎       | 8611/37963 [20:42:23<63:38:24,  7.81s/it]
 23%|██▎       | 8612/37963 [20:42:31<62:54:39,  7.72s/it]
 23%|██▎       | 8613/37963 [20:42:38<62:16:07,  7.64s/it]
 23%|██▎       | 8614/37963 [20:42:46<61:58:54,  7.60s/it]
 23%|██▎       | 8615/37963 [20:43:00<77:14:00,  9.47s/it]
 23%|██▎       | 8616/37963 [20:43:07<72:38:14,  8.91s/it]
 23%|██▎       | 8617/37963 [20:43:15<69:30:21,  8.53s/it]
 23%|██▎       | 8618/37963 [20:43:22<67:16:14,  8.25s/it]
 23%|██▎       | 8619/37963 [20:43:30<64:38:04,  7.93s/it]
 23%|██▎       | 8620/37963 [20:43:43<78:23:20,  9.62s/it]
                                                          
{'loss': '0.1581', 'grad_norm': '1.793', 'learning_rate': '1.803e-05', 'epoch': '0.2271'}

 23%|██▎       | 8620/37963 [20:43:43<78:23:20,  9.62s/it]
 23%|██▎       | 8621/37963 [20:43:58<89:57:11, 11.04s/it]
 23%|██▎       | 8622/37963 [20:44:05<81:29:52, 10.00s/it]
 23%|██▎       | 8623/37963 [20:44:12<74:53:28,  9.19s/it]
 23%|██▎       | 8624/37963 [20:44:20<71:02:50,  8.72s/it]
 23%|██▎       | 8625/37963 [20:44:27<67:49:16,  8.32s/it]
 23%|██▎       | 8626/37963 [20:44:35<65:34:02,  8.05s/it]
 23%|██▎       | 8627/37963 [20:44:42<63:42:58,  7.82s/it]
 23%|██▎       | 8628/37963 [20:44:49<62:04:42,  7.62s/it]
 23%|██▎       | 8629/37963 [20:44:57<61:48:41,  7.59s/it]
 23%|██▎       | 8630/37963 [20:45:04<61:43:45,  7.58s/it]
                                                          
{'loss': '0.1577', 'grad_norm': '4.018', 'learning_rate': '1.803e-05', 'epoch': '0.2273'}

 23%|██▎       | 8630/37963 [20:45:04<61:43:45,  7.58s/it]
 23%|██▎       | 8631/37963 [20:45:12<61:35:13,  7.56s/it]
 23%|██▎       | 8632/37963 [20:45:19<60:46:29,  7.46s/it]
 23%|██▎       | 8633/37963 [20:45:26<60:30:19,  7.43s/it]
 23%|██▎       | 8634/37963 [20:45:34<60:32:02,  7.43s/it]
 23%|██▎       | 8635/37963 [20:45:48<76:06:33,  9.34s/it]
 23%|██▎       | 8636/37963 [20:45:55<72:16:40,  8.87s/it]
 23%|██▎       | 8637/37963 [20:46:09<84:43:58, 10.40s/it]
 23%|██▎       | 8638/37963 [20:46:17<77:49:36,  9.55s/it]
 23%|██▎       | 8639/37963 [20:46:25<72:52:50,  8.95s/it]
 23%|██▎       | 8640/37963 [20:46:32<69:50:38,  8.57s/it]
                                                          
{'loss': '0.1651', 'grad_norm': '1.886', 'learning_rate': '1.802e-05', 'epoch': '0.2276'}

 23%|██▎       | 8640/37963 [20:46:32<69:50:38,  8.57s/it]
 23%|██▎       | 8641/37963 [20:46:40<67:09:38,  8.25s/it]
 23%|██▎       | 8642/37963 [20:46:47<65:26:03,  8.03s/it]
 23%|██▎       | 8643/37963 [20:46:55<64:12:35,  7.88s/it]
 23%|██▎       | 8644/37963 [20:47:02<63:18:04,  7.77s/it]
 23%|██▎       | 8645/37963 [20:47:16<78:21:19,  9.62s/it]
 23%|██▎       | 8646/37963 [20:47:24<72:39:53,  8.92s/it]
 23%|██▎       | 8647/37963 [20:47:31<68:34:44,  8.42s/it]
 23%|██▎       | 8648/37963 [20:47:38<65:44:26,  8.07s/it]
 23%|██▎       | 8649/37963 [20:47:46<64:19:46,  7.90s/it]
 23%|██▎       | 8650/37963 [20:47:53<62:28:28,  7.67s/it]
                                                          
{'loss': '0.173', 'grad_norm': '2.904', 'learning_rate': '1.802e-05', 'epoch': '0.2279'}

 23%|██▎       | 8650/37963 [20:47:53<62:28:28,  7.67s/it]
 23%|██▎       | 8651/37963 [20:48:00<62:13:26,  7.64s/it]
 23%|██▎       | 8652/37963 [20:48:14<77:07:05,  9.47s/it]
 23%|██▎       | 8653/37963 [20:48:28<88:40:33, 10.89s/it]
 23%|██▎       | 8654/37963 [20:48:36<80:29:45,  9.89s/it]
 23%|██▎       | 8655/37963 [20:48:43<74:55:44,  9.20s/it]
 23%|██▎       | 8656/37963 [20:48:51<70:48:23,  8.70s/it]
 23%|██▎       | 8657/37963 [20:48:58<67:54:52,  8.34s/it]
 23%|██▎       | 8658/37963 [20:49:06<66:05:46,  8.12s/it]
 23%|██▎       | 8659/37963 [20:49:13<64:37:29,  7.94s/it]
 23%|██▎       | 8660/37963 [20:49:21<63:49:58,  7.84s/it]
                                                          
{'loss': '0.1726', 'grad_norm': '1.554', 'learning_rate': '1.801e-05', 'epoch': '0.2281'}

 23%|██▎       | 8660/37963 [20:49:21<63:49:58,  7.84s/it]
 23%|██▎       | 8661/37963 [20:49:29<63:05:54,  7.75s/it]
 23%|██▎       | 8662/37963 [20:49:36<62:50:39,  7.72s/it]
 23%|██▎       | 8663/37963 [20:49:50<77:34:49,  9.53s/it]
 23%|██▎       | 8664/37963 [20:49:58<72:44:27,  8.94s/it]
 23%|██▎       | 8665/37963 [20:50:05<69:27:16,  8.53s/it]
 23%|██▎       | 8666/37963 [20:50:12<66:25:25,  8.16s/it]
 23%|██▎       | 8667/37963 [20:50:20<65:04:36,  8.00s/it]
 23%|██▎       | 8668/37963 [20:50:34<79:50:06,  9.81s/it]
 23%|██▎       | 8669/37963 [20:50:48<90:03:46, 11.07s/it]
 23%|██▎       | 8670/37963 [20:50:55<80:40:57,  9.92s/it]
                                                          
{'loss': '0.1646', 'grad_norm': '1.833', 'learning_rate': '1.801e-05', 'epoch': '0.2284'}

 23%|██▎       | 8670/37963 [20:50:55<80:40:57,  9.92s/it]
 23%|██▎       | 8671/37963 [20:51:03<74:57:23,  9.21s/it]
 23%|██▎       | 8672/37963 [20:51:10<70:52:53,  8.71s/it]
 23%|██▎       | 8673/37963 [20:51:18<67:55:05,  8.35s/it]
 23%|██▎       | 8674/37963 [20:51:25<65:25:22,  8.04s/it]
 23%|██▎       | 8675/37963 [20:51:33<63:49:02,  7.84s/it]
 23%|██▎       | 8676/37963 [20:51:40<63:03:31,  7.75s/it]
 23%|██▎       | 8677/37963 [20:51:48<62:19:07,  7.66s/it]
 23%|██▎       | 8678/37963 [20:51:55<62:01:23,  7.62s/it]
 23%|██▎       | 8679/37963 [20:52:03<61:52:49,  7.61s/it]
 23%|██▎       | 8680/37963 [20:52:10<61:48:43,  7.60s/it]
                                                          
{'loss': '0.1639', 'grad_norm': '2.31', 'learning_rate': '1.8e-05', 'epoch': '0.2286'}

 23%|██▎       | 8680/37963 [20:52:10<61:48:43,  7.60s/it]
 23%|██▎       | 8681/37963 [20:52:18<61:37:44,  7.58s/it]
 23%|██▎       | 8682/37963 [20:52:25<61:30:28,  7.56s/it]
 23%|██▎       | 8683/37963 [20:52:33<61:14:44,  7.53s/it]
 23%|██▎       | 8684/37963 [20:52:40<61:25:14,  7.55s/it]
 23%|██▎       | 8685/37963 [20:52:48<61:13:35,  7.53s/it]
 23%|██▎       | 8686/37963 [20:53:02<76:39:36,  9.43s/it]
 23%|██▎       | 8687/37963 [20:53:16<87:30:18, 10.76s/it]
 23%|██▎       | 8688/37963 [20:53:23<79:51:53,  9.82s/it]
 23%|██▎       | 8689/37963 [20:53:31<74:13:54,  9.13s/it]
 23%|██▎       | 8690/37963 [20:53:38<70:24:32,  8.66s/it]
                                                          
{'loss': '0.1656', 'grad_norm': '1.911', 'learning_rate': '1.8e-05', 'epoch': '0.2289'}

 23%|██▎       | 8690/37963 [20:53:38<70:24:32,  8.66s/it]
 23%|██▎       | 8691/37963 [20:53:52<83:28:01, 10.27s/it]
 23%|██▎       | 8692/37963 [20:54:00<76:36:20,  9.42s/it]
 23%|██▎       | 8693/37963 [20:54:08<72:18:08,  8.89s/it]
 23%|██▎       | 8694/37963 [20:54:15<69:07:19,  8.50s/it]
 23%|██▎       | 8695/37963 [20:54:22<65:53:40,  8.11s/it]
 23%|██▎       | 8696/37963 [20:54:30<64:26:00,  7.93s/it]
 23%|██▎       | 8697/37963 [20:54:37<63:31:36,  7.81s/it]
 23%|██▎       | 8698/37963 [20:54:45<62:01:17,  7.63s/it]
 23%|██▎       | 8699/37963 [20:54:52<61:31:03,  7.57s/it]
 23%|██▎       | 8700/37963 [20:55:00<61:32:59,  7.57s/it]
                                                          
{'loss': '0.1617', 'grad_norm': '1.115', 'learning_rate': '1.799e-05', 'epoch': '0.2292'}

 23%|██▎       | 8700/37963 [20:55:00<61:32:59,  7.57s/it]
 23%|██▎       | 8701/37963 [20:55:13<77:07:25,  9.49s/it]
 23%|██▎       | 8702/37963 [20:55:21<72:18:08,  8.90s/it]
 23%|██▎       | 8703/37963 [20:55:35<85:16:18, 10.49s/it]
 23%|██▎       | 8704/37963 [20:55:43<78:10:11,  9.62s/it]
 23%|██▎       | 8705/37963 [20:55:50<73:19:37,  9.02s/it]
 23%|██▎       | 8706/37963 [20:55:58<69:39:52,  8.57s/it]
 23%|██▎       | 8707/37963 [20:56:06<67:09:10,  8.26s/it]
 23%|██▎       | 8708/37963 [20:56:13<65:11:21,  8.02s/it]
 23%|██▎       | 8709/37963 [20:56:21<64:09:38,  7.90s/it]
 23%|██▎       | 8710/37963 [20:56:28<63:09:30,  7.77s/it]
                                                          
{'loss': '0.1631', 'grad_norm': '1.922', 'learning_rate': '1.799e-05', 'epoch': '0.2294'}

 23%|██▎       | 8710/37963 [20:56:28<63:09:30,  7.77s/it]
 23%|██▎       | 8711/37963 [20:56:36<62:23:07,  7.68s/it]
 23%|██▎       | 8712/37963 [20:56:43<62:09:29,  7.65s/it]
 23%|██▎       | 8713/37963 [20:56:57<77:37:32,  9.55s/it]
 23%|██▎       | 8714/37963 [20:57:04<71:41:35,  8.82s/it]
 23%|██▎       | 8715/37963 [20:57:12<68:44:43,  8.46s/it]
 23%|██▎       | 8716/37963 [20:57:26<82:09:23, 10.11s/it]
 23%|██▎       | 8717/37963 [20:57:34<76:18:39,  9.39s/it]
 23%|██▎       | 8718/37963 [20:57:48<87:36:31, 10.78s/it]
 23%|██▎       | 8719/37963 [20:57:55<79:11:56,  9.75s/it]
 23%|██▎       | 8720/37963 [20:58:02<73:50:52,  9.09s/it]
                                                          
{'loss': '0.1618', 'grad_norm': '1.029', 'learning_rate': '1.798e-05', 'epoch': '0.2297'}

 23%|██▎       | 8720/37963 [20:58:02<73:50:52,  9.09s/it]
 23%|██▎       | 8721/37963 [20:58:10<70:04:06,  8.63s/it]
 23%|██▎       | 8722/37963 [20:58:17<66:43:28,  8.21s/it]
 23%|██▎       | 8723/37963 [20:58:25<64:42:23,  7.97s/it]
 23%|██▎       | 8724/37963 [20:58:32<63:42:50,  7.84s/it]
 23%|██▎       | 8725/37963 [20:58:40<63:18:25,  7.79s/it]
 23%|██▎       | 8726/37963 [20:58:47<62:27:10,  7.69s/it]
 23%|██▎       | 8727/37963 [20:58:55<62:13:55,  7.66s/it]
 23%|██▎       | 8728/37963 [20:59:03<62:19:52,  7.68s/it]
 23%|██▎       | 8729/37963 [20:59:10<61:55:25,  7.63s/it]
 23%|██▎       | 8730/37963 [20:59:18<61:40:53,  7.60s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '1.184', 'learning_rate': '1.798e-05', 'epoch': '0.23'}

 23%|██▎       | 8730/37963 [20:59:18<61:40:53,  7.60s/it]
 23%|██▎       | 8731/37963 [20:59:25<61:27:15,  7.57s/it]
 23%|██▎       | 8732/37963 [20:59:33<61:22:22,  7.56s/it]
 23%|██▎       | 8733/37963 [20:59:40<61:07:52,  7.53s/it]
 23%|██▎       | 8734/37963 [20:59:54<75:33:45,  9.31s/it]
 23%|██▎       | 8735/37963 [21:00:01<70:49:26,  8.72s/it]
 23%|██▎       | 8736/37963 [21:00:15<83:33:28, 10.29s/it]
 23%|██▎       | 8737/37963 [21:00:22<76:43:42,  9.45s/it]
 23%|██▎       | 8738/37963 [21:00:36<87:57:19, 10.83s/it]
 23%|██▎       | 8739/37963 [21:00:44<80:25:04,  9.91s/it]
 23%|██▎       | 8740/37963 [21:00:52<74:39:06,  9.20s/it]
                                                          
{'loss': '0.1687', 'grad_norm': '1.942', 'learning_rate': '1.797e-05', 'epoch': '0.2302'}

 23%|██▎       | 8740/37963 [21:00:52<74:39:06,  9.20s/it]
 23%|██▎       | 8741/37963 [21:00:59<70:19:54,  8.66s/it]
 23%|██▎       | 8742/37963 [21:01:07<67:35:53,  8.33s/it]
 23%|██▎       | 8743/37963 [21:01:14<65:58:30,  8.13s/it]
 23%|██▎       | 8744/37963 [21:01:22<64:29:46,  7.95s/it]
 23%|██▎       | 8745/37963 [21:01:29<63:33:09,  7.83s/it]
 23%|██▎       | 8746/37963 [21:01:37<62:46:21,  7.73s/it]
 23%|██▎       | 8747/37963 [21:01:44<62:18:03,  7.68s/it]
 23%|██▎       | 8748/37963 [21:01:52<61:36:54,  7.59s/it]
 23%|██▎       | 8749/37963 [21:01:59<60:42:54,  7.48s/it]
 23%|██▎       | 8750/37963 [21:02:13<77:13:15,  9.52s/it]
                                                          
{'loss': '0.1658', 'grad_norm': '2.026', 'learning_rate': '1.797e-05', 'epoch': '0.2305'}

 23%|██▎       | 8750/37963 [21:02:13<77:13:15,  9.52s/it]
 23%|██▎       | 8751/37963 [21:02:27<87:19:24, 10.76s/it]
 23%|██▎       | 8752/37963 [21:02:35<79:27:24,  9.79s/it]
 23%|██▎       | 8753/37963 [21:02:42<73:54:37,  9.11s/it]
 23%|██▎       | 8754/37963 [21:02:50<70:02:48,  8.63s/it]
 23%|██▎       | 8755/37963 [21:02:57<67:20:32,  8.30s/it]
 23%|██▎       | 8756/37963 [21:03:05<65:24:38,  8.06s/it]
 23%|██▎       | 8757/37963 [21:03:12<64:13:01,  7.92s/it]
 23%|██▎       | 8758/37963 [21:03:20<63:18:46,  7.80s/it]
 23%|██▎       | 8759/37963 [21:03:27<62:41:28,  7.73s/it]
 23%|██▎       | 8760/37963 [21:03:41<77:41:49,  9.58s/it]
                                                          
{'loss': '0.1655', 'grad_norm': '1.073', 'learning_rate': '1.796e-05', 'epoch': '0.2308'}

 23%|██▎       | 8760/37963 [21:03:41<77:41:49,  9.58s/it]
 23%|██▎       | 8761/37963 [21:03:49<72:36:31,  8.95s/it]
 23%|██▎       | 8762/37963 [21:03:56<69:35:20,  8.58s/it]
 23%|██▎       | 8763/37963 [21:04:04<67:13:28,  8.29s/it]
 23%|██▎       | 8764/37963 [21:04:12<65:20:36,  8.06s/it]
 23%|██▎       | 8765/37963 [21:04:19<63:33:16,  7.84s/it]
 23%|██▎       | 8766/37963 [21:04:26<62:50:52,  7.75s/it]
 23%|██▎       | 8767/37963 [21:04:41<78:21:04,  9.66s/it]
 23%|██▎       | 8768/37963 [21:04:48<73:20:55,  9.04s/it]
 23%|██▎       | 8769/37963 [21:05:02<84:49:34, 10.46s/it]
 23%|██▎       | 8770/37963 [21:05:10<78:17:06,  9.65s/it]
                                                          
{'loss': '0.168', 'grad_norm': '1.876', 'learning_rate': '1.796e-05', 'epoch': '0.231'}

 23%|██▎       | 8770/37963 [21:05:10<78:17:06,  9.65s/it]
 23%|██▎       | 8771/37963 [21:05:17<73:18:39,  9.04s/it]
 23%|██▎       | 8772/37963 [21:05:25<69:49:48,  8.61s/it]
 23%|██▎       | 8773/37963 [21:05:32<67:06:48,  8.28s/it]
 23%|██▎       | 8774/37963 [21:05:40<65:15:47,  8.05s/it]
 23%|██▎       | 8775/37963 [21:05:47<64:03:45,  7.90s/it]
 23%|██▎       | 8776/37963 [21:05:55<63:16:32,  7.80s/it]
 23%|██▎       | 8777/37963 [21:06:03<62:41:31,  7.73s/it]
 23%|██▎       | 8778/37963 [21:06:10<62:31:39,  7.71s/it]
 23%|██▎       | 8779/37963 [21:06:18<62:18:29,  7.69s/it]
 23%|██▎       | 8780/37963 [21:06:25<61:54:06,  7.64s/it]
                                                          
{'loss': '0.1513', 'grad_norm': '0.7168', 'learning_rate': '1.795e-05', 'epoch': '0.2313'}

 23%|██▎       | 8780/37963 [21:06:25<61:54:06,  7.64s/it]
 23%|██▎       | 8781/37963 [21:06:33<61:20:02,  7.57s/it]
 23%|██▎       | 8782/37963 [21:06:47<77:22:39,  9.55s/it]
 23%|██▎       | 8783/37963 [21:07:01<87:30:51, 10.80s/it]
 23%|██▎       | 8784/37963 [21:07:08<79:37:04,  9.82s/it]
 23%|██▎       | 8785/37963 [21:07:22<90:03:22, 11.11s/it]
 23%|██▎       | 8786/37963 [21:07:30<80:42:42,  9.96s/it]
 23%|██▎       | 8787/37963 [21:07:37<74:01:11,  9.13s/it]
 23%|██▎       | 8788/37963 [21:07:44<70:09:05,  8.66s/it]
 23%|██▎       | 8789/37963 [21:07:52<67:27:34,  8.32s/it]
 23%|██▎       | 8790/37963 [21:07:59<64:53:33,  8.01s/it]
                                                          
{'loss': '0.1727', 'grad_norm': '0.8263', 'learning_rate': '1.794e-05', 'epoch': '0.2315'}

 23%|██▎       | 8790/37963 [21:07:59<64:53:33,  8.01s/it]
 23%|██▎       | 8791/37963 [21:08:07<63:37:57,  7.85s/it]
 23%|██▎       | 8792/37963 [21:08:14<62:52:06,  7.76s/it]
 23%|██▎       | 8793/37963 [21:08:22<62:17:31,  7.69s/it]
 23%|██▎       | 8794/37963 [21:08:29<61:53:04,  7.64s/it]
 23%|██▎       | 8795/37963 [21:08:37<61:37:27,  7.61s/it]
 23%|██▎       | 8796/37963 [21:08:51<76:59:02,  9.50s/it]
 23%|██▎       | 8797/37963 [21:08:58<72:00:23,  8.89s/it]
 23%|██▎       | 8798/37963 [21:09:06<68:23:13,  8.44s/it]
 23%|██▎       | 8799/37963 [21:09:13<66:26:34,  8.20s/it]
 23%|██▎       | 8800/37963 [21:09:21<64:47:27,  8.00s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '3.627', 'learning_rate': '1.794e-05', 'epoch': '0.2318'}

 23%|██▎       | 8800/37963 [21:09:21<64:47:27,  8.00s/it]
 23%|██▎       | 8801/37963 [21:09:28<63:51:01,  7.88s/it]
 23%|██▎       | 8802/37963 [21:09:36<63:07:03,  7.79s/it]
 23%|██▎       | 8803/37963 [21:09:44<62:35:24,  7.73s/it]
 23%|██▎       | 8804/37963 [21:09:51<62:07:06,  7.67s/it]
 23%|██▎       | 8805/37963 [21:10:05<77:31:31,  9.57s/it]
 23%|██▎       | 8806/37963 [21:10:12<72:01:28,  8.89s/it]
 23%|██▎       | 8807/37963 [21:10:20<68:46:22,  8.49s/it]
 23%|██▎       | 8808/37963 [21:10:34<81:31:53, 10.07s/it]
 23%|██▎       | 8809/37963 [21:10:41<75:30:08,  9.32s/it]
 23%|██▎       | 8810/37963 [21:10:49<71:16:46,  8.80s/it]
                                                          
{'loss': '0.198', 'grad_norm': '2.565', 'learning_rate': '1.793e-05', 'epoch': '0.2321'}

 23%|██▎       | 8810/37963 [21:10:49<71:16:46,  8.80s/it]
 23%|██▎       | 8811/37963 [21:10:56<68:07:20,  8.41s/it]
 23%|██▎       | 8812/37963 [21:11:04<66:02:59,  8.16s/it]
 23%|██▎       | 8813/37963 [21:11:12<64:47:56,  8.00s/it]
 23%|██▎       | 8814/37963 [21:11:19<63:50:46,  7.89s/it]
 23%|██▎       | 8815/37963 [21:11:33<78:24:06,  9.68s/it]
 23%|██▎       | 8816/37963 [21:11:41<73:12:13,  9.04s/it]
 23%|██▎       | 8817/37963 [21:11:48<69:10:04,  8.54s/it]
 23%|██▎       | 8818/37963 [21:11:56<66:59:06,  8.27s/it]
 23%|██▎       | 8819/37963 [21:12:03<64:50:58,  8.01s/it]
 23%|██▎       | 8820/37963 [21:12:10<63:31:05,  7.85s/it]
                                                          
{'loss': '0.1624', 'grad_norm': '1.577', 'learning_rate': '1.793e-05', 'epoch': '0.2323'}

 23%|██▎       | 8820/37963 [21:12:10<63:31:05,  7.85s/it]
 23%|██▎       | 8821/37963 [21:12:18<62:44:19,  7.75s/it]
 23%|██▎       | 8822/37963 [21:12:32<77:12:44,  9.54s/it]
 23%|██▎       | 8823/37963 [21:12:39<72:22:52,  8.94s/it]
 23%|██▎       | 8824/37963 [21:12:47<69:11:56,  8.55s/it]
 23%|██▎       | 8825/37963 [21:12:54<66:45:39,  8.25s/it]
 23%|██▎       | 8826/37963 [21:13:02<65:04:33,  8.04s/it]
 23%|██▎       | 8827/37963 [21:13:09<63:34:37,  7.86s/it]
 23%|██▎       | 8828/37963 [21:13:17<62:31:42,  7.73s/it]
 23%|██▎       | 8829/37963 [21:13:30<76:37:21,  9.47s/it]
 23%|██▎       | 8830/37963 [21:13:38<72:04:58,  8.91s/it]
                                                          
{'loss': '0.156', 'grad_norm': '1.43', 'learning_rate': '1.792e-05', 'epoch': '0.2326'}

 23%|██▎       | 8830/37963 [21:13:38<72:04:58,  8.91s/it]
 23%|██▎       | 8831/37963 [21:13:45<68:19:01,  8.44s/it]
 23%|██▎       | 8832/37963 [21:13:59<82:00:01, 10.13s/it]
 23%|██▎       | 8833/37963 [21:14:07<75:29:14,  9.33s/it]
 23%|██▎       | 8834/37963 [21:14:14<70:52:50,  8.76s/it]
 23%|██▎       | 8835/37963 [21:14:22<68:06:23,  8.42s/it]
 23%|██▎       | 8836/37963 [21:14:36<81:07:27, 10.03s/it]
 23%|██▎       | 8837/37963 [21:14:43<75:14:27,  9.30s/it]
 23%|██▎       | 8838/37963 [21:14:51<70:34:05,  8.72s/it]
 23%|██▎       | 8839/37963 [21:14:58<67:43:35,  8.37s/it]
 23%|██▎       | 8840/37963 [21:15:05<64:59:48,  8.03s/it]
                                                          
{'loss': '0.1609', 'grad_norm': '6.252', 'learning_rate': '1.792e-05', 'epoch': '0.2329'}

 23%|██▎       | 8840/37963 [21:15:05<64:59:48,  8.03s/it]
 23%|██▎       | 8841/37963 [21:15:13<63:39:12,  7.87s/it]
 23%|██▎       | 8842/37963 [21:15:20<62:17:46,  7.70s/it]
 23%|██▎       | 8843/37963 [21:15:28<61:59:46,  7.66s/it]
 23%|██▎       | 8844/37963 [21:15:35<61:43:52,  7.63s/it]
 23%|██▎       | 8845/37963 [21:15:49<76:43:42,  9.49s/it]
 23%|██▎       | 8846/37963 [21:15:57<71:43:30,  8.87s/it]
 23%|██▎       | 8847/37963 [21:16:04<68:14:27,  8.44s/it]
 23%|██▎       | 8848/37963 [21:16:12<66:06:22,  8.17s/it]
 23%|██▎       | 8849/37963 [21:16:26<80:37:37,  9.97s/it]
 23%|██▎       | 8850/37963 [21:16:33<74:58:33,  9.27s/it]
                                                          
{'loss': '0.1677', 'grad_norm': '0.7925', 'learning_rate': '1.791e-05', 'epoch': '0.2331'}

 23%|██▎       | 8850/37963 [21:16:33<74:58:33,  9.27s/it]
 23%|██▎       | 8851/37963 [21:16:41<70:39:25,  8.74s/it]
 23%|██▎       | 8852/37963 [21:16:48<67:36:02,  8.36s/it]
 23%|██▎       | 8853/37963 [21:16:56<65:37:14,  8.12s/it]
 23%|██▎       | 8854/37963 [21:17:10<79:42:42,  9.86s/it]
 23%|██▎       | 8855/37963 [21:17:17<73:47:59,  9.13s/it]
 23%|██▎       | 8856/37963 [21:17:25<69:30:07,  8.60s/it]
 23%|██▎       | 8857/37963 [21:17:32<66:41:18,  8.25s/it]
 23%|██▎       | 8858/37963 [21:17:40<64:49:03,  8.02s/it]
 23%|██▎       | 8859/37963 [21:17:47<63:38:13,  7.87s/it]
 23%|██▎       | 8860/37963 [21:17:55<63:07:40,  7.81s/it]
                                                          
{'loss': '0.1707', 'grad_norm': '4.478', 'learning_rate': '1.791e-05', 'epoch': '0.2334'}

 23%|██▎       | 8860/37963 [21:17:55<63:07:40,  7.81s/it]
 23%|██▎       | 8861/37963 [21:18:02<62:17:26,  7.71s/it]
 23%|██▎       | 8862/37963 [21:18:10<61:49:23,  7.65s/it]
 23%|██▎       | 8863/37963 [21:18:17<61:29:14,  7.61s/it]
 23%|██▎       | 8864/37963 [21:18:25<61:11:37,  7.57s/it]
 23%|██▎       | 8865/37963 [21:18:32<61:12:24,  7.57s/it]
 23%|██▎       | 8866/37963 [21:18:46<76:37:42,  9.48s/it]
 23%|██▎       | 8867/37963 [21:18:54<71:53:38,  8.90s/it]
 23%|██▎       | 8868/37963 [21:19:08<84:17:49, 10.43s/it]
 23%|██▎       | 8869/37963 [21:19:15<77:13:39,  9.56s/it]
 23%|██▎       | 8870/37963 [21:19:23<72:19:10,  8.95s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '3.106', 'learning_rate': '1.79e-05', 'epoch': '0.2336'}

 23%|██▎       | 8870/37963 [21:19:23<72:19:10,  8.95s/it]
 23%|██▎       | 8871/37963 [21:19:30<69:03:02,  8.54s/it]
 23%|██▎       | 8872/37963 [21:19:38<65:54:25,  8.16s/it]
 23%|██▎       | 8873/37963 [21:19:45<64:20:38,  7.96s/it]
 23%|██▎       | 8874/37963 [21:19:53<63:17:13,  7.83s/it]
 23%|██▎       | 8875/37963 [21:20:00<62:34:25,  7.74s/it]
 23%|██▎       | 8876/37963 [21:20:14<77:24:09,  9.58s/it]
 23%|██▎       | 8877/37963 [21:20:22<72:31:49,  8.98s/it]
 23%|██▎       | 8878/37963 [21:20:36<84:26:26, 10.45s/it]
 23%|██▎       | 8879/37963 [21:20:43<77:22:58,  9.58s/it]
 23%|██▎       | 8880/37963 [21:20:51<72:09:08,  8.93s/it]
                                                          
{'loss': '0.169', 'grad_norm': '4.917', 'learning_rate': '1.79e-05', 'epoch': '0.2339'}

 23%|██▎       | 8880/37963 [21:20:51<72:09:08,  8.93s/it]
 23%|██▎       | 8881/37963 [21:20:58<69:00:11,  8.54s/it]
 23%|██▎       | 8882/37963 [21:21:12<82:08:53, 10.17s/it]
 23%|██▎       | 8883/37963 [21:21:20<76:04:16,  9.42s/it]
 23%|██▎       | 8884/37963 [21:21:27<71:06:22,  8.80s/it]
 23%|██▎       | 8885/37963 [21:21:35<68:07:20,  8.43s/it]
 23%|██▎       | 8886/37963 [21:21:42<65:00:54,  8.05s/it]
 23%|██▎       | 8887/37963 [21:21:49<63:47:31,  7.90s/it]
 23%|██▎       | 8888/37963 [21:21:57<62:52:05,  7.78s/it]
 23%|██▎       | 8889/37963 [21:22:05<62:20:52,  7.72s/it]
 23%|██▎       | 8890/37963 [21:22:12<61:41:30,  7.64s/it]
                                                          
{'loss': '0.1583', 'grad_norm': '6.279', 'learning_rate': '1.789e-05', 'epoch': '0.2342'}

 23%|██▎       | 8890/37963 [21:22:12<61:41:30,  7.64s/it]
 23%|██▎       | 8891/37963 [21:22:20<61:26:24,  7.61s/it]
 23%|██▎       | 8892/37963 [21:22:27<61:09:49,  7.57s/it]
 23%|██▎       | 8893/37963 [21:22:34<60:01:50,  7.43s/it]
 23%|██▎       | 8894/37963 [21:22:41<59:50:02,  7.41s/it]
 23%|██▎       | 8895/37963 [21:22:49<60:10:46,  7.45s/it]
 23%|██▎       | 8896/37963 [21:22:57<60:19:56,  7.47s/it]
 23%|██▎       | 8897/37963 [21:23:11<76:01:32,  9.42s/it]
 23%|██▎       | 8898/37963 [21:23:18<71:30:57,  8.86s/it]
 23%|██▎       | 8899/37963 [21:23:32<84:02:34, 10.41s/it]
 23%|██▎       | 8900/37963 [21:23:40<77:17:00,  9.57s/it]
                                                          
{'loss': '0.1744', 'grad_norm': '1.421', 'learning_rate': '1.789e-05', 'epoch': '0.2344'}

 23%|██▎       | 8900/37963 [21:23:40<77:17:00,  9.57s/it]
 23%|██▎       | 8901/37963 [21:23:47<72:30:09,  8.98s/it]
 23%|██▎       | 8902/37963 [21:23:55<69:11:29,  8.57s/it]
 23%|██▎       | 8903/37963 [21:24:09<82:09:49, 10.18s/it]
 23%|██▎       | 8904/37963 [21:24:16<75:52:45,  9.40s/it]
 23%|██▎       | 8905/37963 [21:24:24<71:31:33,  8.86s/it]
 23%|██▎       | 8906/37963 [21:24:32<68:18:19,  8.46s/it]
 23%|██▎       | 8907/37963 [21:24:39<66:05:21,  8.19s/it]
 23%|██▎       | 8908/37963 [21:24:47<64:45:05,  8.02s/it]
 23%|██▎       | 8909/37963 [21:24:54<63:39:38,  7.89s/it]
 23%|██▎       | 8910/37963 [21:25:02<62:55:56,  7.80s/it]
                                                          
{'loss': '0.1789', 'grad_norm': '5.997', 'learning_rate': '1.788e-05', 'epoch': '0.2347'}

 23%|██▎       | 8910/37963 [21:25:02<62:55:56,  7.80s/it]
 23%|██▎       | 8911/37963 [21:25:16<78:00:33,  9.67s/it]
 23%|██▎       | 8912/37963 [21:25:24<73:18:55,  9.09s/it]
 23%|██▎       | 8913/37963 [21:25:31<69:42:32,  8.64s/it]
 23%|██▎       | 8914/37963 [21:25:45<81:25:22, 10.09s/it]
 23%|██▎       | 8915/37963 [21:25:52<75:23:47,  9.34s/it]
 23%|██▎       | 8916/37963 [21:26:00<70:59:38,  8.80s/it]
 23%|██▎       | 8917/37963 [21:26:07<67:20:26,  8.35s/it]
 23%|██▎       | 8918/37963 [21:26:15<65:22:10,  8.10s/it]
 23%|██▎       | 8919/37963 [21:26:22<63:55:03,  7.92s/it]
 23%|██▎       | 8920/37963 [21:26:30<62:56:08,  7.80s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '2.923', 'learning_rate': '1.788e-05', 'epoch': '0.235'}

 23%|██▎       | 8920/37963 [21:26:30<62:56:08,  7.80s/it]
 23%|██▎       | 8921/37963 [21:26:37<62:26:06,  7.74s/it]
 24%|██▎       | 8922/37963 [21:26:45<61:56:13,  7.68s/it]
 24%|██▎       | 8923/37963 [21:26:59<77:21:44,  9.59s/it]
 24%|██▎       | 8924/37963 [21:27:06<71:49:36,  8.90s/it]
 24%|██▎       | 8925/37963 [21:27:13<67:36:49,  8.38s/it]
 24%|██▎       | 8926/37963 [21:27:21<65:31:22,  8.12s/it]
 24%|██▎       | 8927/37963 [21:27:28<63:49:43,  7.91s/it]
 24%|██▎       | 8928/37963 [21:27:36<63:11:45,  7.84s/it]
 24%|██▎       | 8929/37963 [21:27:44<62:51:40,  7.79s/it]
 24%|██▎       | 8930/37963 [21:27:58<78:35:36,  9.75s/it]
                                                          
{'loss': '0.1616', 'grad_norm': '1.896', 'learning_rate': '1.787e-05', 'epoch': '0.2352'}

 24%|██▎       | 8930/37963 [21:27:58<78:35:36,  9.75s/it]
 24%|██▎       | 8931/37963 [21:28:05<73:08:36,  9.07s/it]
 24%|██▎       | 8932/37963 [21:28:13<69:33:58,  8.63s/it]
 24%|██▎       | 8933/37963 [21:28:21<67:04:51,  8.32s/it]
 24%|██▎       | 8934/37963 [21:28:34<80:05:08,  9.93s/it]
 24%|██▎       | 8935/37963 [21:28:42<74:25:00,  9.23s/it]
 24%|██▎       | 8936/37963 [21:28:49<70:00:08,  8.68s/it]
 24%|██▎       | 8937/37963 [21:28:57<67:19:04,  8.35s/it]
 24%|██▎       | 8938/37963 [21:29:04<64:28:35,  8.00s/it]
 24%|██▎       | 8939/37963 [21:29:12<63:12:14,  7.84s/it]
 24%|██▎       | 8940/37963 [21:29:19<62:35:01,  7.76s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '6.601', 'learning_rate': '1.787e-05', 'epoch': '0.2355'}

 24%|██▎       | 8940/37963 [21:29:19<62:35:01,  7.76s/it]
 24%|██▎       | 8941/37963 [21:29:27<62:10:30,  7.71s/it]
 24%|██▎       | 8942/37963 [21:29:34<61:35:36,  7.64s/it]
 24%|██▎       | 8943/37963 [21:29:48<76:45:43,  9.52s/it]
 24%|██▎       | 8944/37963 [21:29:56<72:03:24,  8.94s/it]
 24%|██▎       | 8945/37963 [21:30:03<68:43:34,  8.53s/it]
 24%|██▎       | 8946/37963 [21:30:11<65:45:26,  8.16s/it]
 24%|██▎       | 8947/37963 [21:30:18<64:16:14,  7.97s/it]
 24%|██▎       | 8948/37963 [21:30:32<79:36:10,  9.88s/it]
 24%|██▎       | 8949/37963 [21:30:40<73:58:46,  9.18s/it]
 24%|██▎       | 8950/37963 [21:30:47<69:13:42,  8.59s/it]
                                                          
{'loss': '0.1818', 'grad_norm': '1.302', 'learning_rate': '1.786e-05', 'epoch': '0.2358'}

 24%|██▎       | 8950/37963 [21:30:47<69:13:42,  8.59s/it]
 24%|██▎       | 8951/37963 [21:30:55<66:47:00,  8.29s/it]
 24%|██▎       | 8952/37963 [21:31:09<80:35:49, 10.00s/it]
 24%|██▎       | 8953/37963 [21:31:16<74:39:02,  9.26s/it]
 24%|██▎       | 8954/37963 [21:31:24<70:03:53,  8.69s/it]
 24%|██▎       | 8955/37963 [21:31:31<67:11:20,  8.34s/it]
 24%|██▎       | 8956/37963 [21:31:39<65:20:33,  8.11s/it]
 24%|██▎       | 8957/37963 [21:31:46<63:52:29,  7.93s/it]
 24%|██▎       | 8958/37963 [21:31:54<62:57:05,  7.81s/it]
 24%|██▎       | 8959/37963 [21:32:08<77:20:16,  9.60s/it]
 24%|██▎       | 8960/37963 [21:32:15<72:34:26,  9.01s/it]
                                                          
{'loss': '0.1593', 'grad_norm': '2.519', 'learning_rate': '1.786e-05', 'epoch': '0.236'}

 24%|██▎       | 8960/37963 [21:32:15<72:34:26,  9.01s/it]
 24%|██▎       | 8961/37963 [21:32:23<68:27:23,  8.50s/it]
 24%|██▎       | 8962/37963 [21:32:30<66:04:50,  8.20s/it]
 24%|██▎       | 8963/37963 [21:32:44<79:18:20,  9.84s/it]
 24%|██▎       | 8964/37963 [21:32:51<73:12:04,  9.09s/it]
 24%|██▎       | 8965/37963 [21:32:59<69:37:06,  8.64s/it]
 24%|██▎       | 8966/37963 [21:33:06<66:53:10,  8.30s/it]
 24%|██▎       | 8967/37963 [21:33:14<64:48:23,  8.05s/it]
 24%|██▎       | 8968/37963 [21:33:27<77:58:10,  9.68s/it]
 24%|██▎       | 8969/37963 [21:33:35<73:14:13,  9.09s/it]
 24%|██▎       | 8970/37963 [21:33:42<69:21:31,  8.61s/it]
                                                          
{'loss': '0.1684', 'grad_norm': '2.768', 'learning_rate': '1.785e-05', 'epoch': '0.2363'}

 24%|██▎       | 8970/37963 [21:33:42<69:21:31,  8.61s/it]
 24%|██▎       | 8971/37963 [21:33:50<66:31:45,  8.26s/it]
 24%|██▎       | 8972/37963 [21:33:57<64:42:59,  8.04s/it]
 24%|██▎       | 8973/37963 [21:34:05<63:33:58,  7.89s/it]
 24%|██▎       | 8974/37963 [21:34:12<62:27:20,  7.76s/it]
 24%|██▎       | 8975/37963 [21:34:20<62:01:12,  7.70s/it]
 24%|██▎       | 8976/37963 [21:34:27<61:31:32,  7.64s/it]
 24%|██▎       | 8977/37963 [21:34:35<60:50:50,  7.56s/it]
 24%|██▎       | 8978/37963 [21:34:48<75:33:32,  9.38s/it]
 24%|██▎       | 8979/37963 [21:34:56<71:11:22,  8.84s/it]
 24%|██▎       | 8980/37963 [21:35:04<68:16:43,  8.48s/it]
                                                          
{'loss': '0.1855', 'grad_norm': '4.033', 'learning_rate': '1.785e-05', 'epoch': '0.2365'}

 24%|██▎       | 8980/37963 [21:35:04<68:16:43,  8.48s/it]
 24%|██▎       | 8981/37963 [21:35:11<65:59:46,  8.20s/it]
 24%|██▎       | 8982/37963 [21:35:19<64:10:44,  7.97s/it]
 24%|██▎       | 8983/37963 [21:35:33<78:54:30,  9.80s/it]
 24%|██▎       | 8984/37963 [21:35:40<73:27:17,  9.13s/it]
 24%|██▎       | 8985/37963 [21:35:48<69:22:46,  8.62s/it]
 24%|██▎       | 8986/37963 [21:35:55<67:01:34,  8.33s/it]
 24%|██▎       | 8987/37963 [21:36:02<64:11:14,  7.97s/it]
 24%|██▎       | 8988/37963 [21:36:10<62:59:47,  7.83s/it]
 24%|██▎       | 8989/37963 [21:36:17<62:10:44,  7.73s/it]
 24%|██▎       | 8990/37963 [21:36:25<61:22:02,  7.63s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '1.77', 'learning_rate': '1.784e-05', 'epoch': '0.2368'}

 24%|██▎       | 8990/37963 [21:36:25<61:22:02,  7.63s/it]
 24%|██▎       | 8991/37963 [21:36:32<60:33:45,  7.53s/it]
 24%|██▎       | 8992/37963 [21:36:39<60:16:45,  7.49s/it]
 24%|██▎       | 8993/37963 [21:36:47<60:04:42,  7.47s/it]
 24%|██▎       | 8994/37963 [21:36:54<60:09:09,  7.48s/it]
 24%|██▎       | 8995/37963 [21:37:08<75:53:01,  9.43s/it]
 24%|██▎       | 8996/37963 [21:37:22<86:45:45, 10.78s/it]
 24%|██▎       | 8997/37963 [21:37:30<78:55:01,  9.81s/it]
 24%|██▎       | 8998/37963 [21:37:37<73:05:36,  9.08s/it]
 24%|██▎       | 8999/37963 [21:37:45<69:15:26,  8.61s/it]
 24%|██▎       | 9000/37963 [21:37:59<82:20:39, 10.24s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '6.348', 'learning_rate': '1.783e-05', 'epoch': '0.2371'}

 24%|██▎       | 9000/37963 [21:37:59<82:20:39, 10.24s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.72s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 24%|██▎       | 9001/37963 [21:38:57<197:37:03, 24.56s/it]
 24%|██▎       | 9002/37963 [21:39:05<158:31:42, 19.71s/it]
 24%|██▎       | 9003/37963 [21:39:13<129:07:53, 16.05s/it]
 24%|██▎       | 9004/37963 [21:39:27<124:07:50, 15.43s/it]
 24%|██▎       | 9005/37963 [21:39:34<105:19:14, 13.09s/it]
 24%|██▎       | 9006/37963 [21:39:42<92:15:05, 11.47s/it] 
 24%|██▎       | 9007/37963 [21:39:49<82:36:33, 10.27s/it]
 24%|██▎       | 9008/37963 [21:39:57<75:07:11,  9.34s/it]
 24%|██▎       | 9009/37963 [21:40:04<70:42:32,  8.79s/it]
 24%|██▎       | 9010/37963 [21:40:12<67:43:17,  8.42s/it]
                                                          
{'loss': '0.1653', 'grad_norm': '1.472', 'learning_rate': '1.783e-05', 'epoch': '0.2373'}

 24%|██▎       | 9010/37963 [21:40:12<67:43:17,  8.42s/it]
 24%|██▎       | 9011/37963 [21:40:19<65:44:53,  8.18s/it]
 24%|██▎       | 9012/37963 [21:40:33<79:42:15,  9.91s/it]
 24%|██▎       | 9013/37963 [21:40:47<90:08:42, 11.21s/it]
 24%|██▎       | 9014/37963 [21:40:55<81:41:04, 10.16s/it]
 24%|██▎       | 9015/37963 [21:41:03<75:26:54,  9.38s/it]
 24%|██▎       | 9016/37963 [21:41:10<71:17:55,  8.87s/it]
 24%|██▍       | 9017/37963 [21:41:18<68:25:15,  8.51s/it]
 24%|██▍       | 9018/37963 [21:41:26<66:06:35,  8.22s/it]
 24%|██▍       | 9019/37963 [21:41:33<64:21:54,  8.01s/it]
 24%|██▍       | 9020/37963 [21:41:41<63:18:41,  7.87s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '3.016', 'learning_rate': '1.782e-05', 'epoch': '0.2376'}

 24%|██▍       | 9020/37963 [21:41:41<63:18:41,  7.87s/it]
 24%|██▍       | 9021/37963 [21:41:48<62:32:54,  7.78s/it]
 24%|██▍       | 9022/37963 [21:42:02<76:54:37,  9.57s/it]
 24%|██▍       | 9023/37963 [21:42:10<72:01:39,  8.96s/it]
 24%|██▍       | 9024/37963 [21:42:17<68:34:15,  8.53s/it]
 24%|██▍       | 9025/37963 [21:42:25<66:14:23,  8.24s/it]
 24%|██▍       | 9026/37963 [21:42:32<64:18:01,  8.00s/it]
 24%|██▍       | 9027/37963 [21:42:40<63:07:36,  7.85s/it]
 24%|██▍       | 9028/37963 [21:42:47<62:32:46,  7.78s/it]
 24%|██▍       | 9029/37963 [21:42:55<61:57:18,  7.71s/it]
 24%|██▍       | 9030/37963 [21:43:02<61:23:37,  7.64s/it]
                                                          
{'loss': '0.1705', 'grad_norm': '4.688', 'learning_rate': '1.782e-05', 'epoch': '0.2379'}

 24%|██▍       | 9030/37963 [21:43:02<61:23:37,  7.64s/it]
 24%|██▍       | 9031/37963 [21:43:10<61:25:30,  7.64s/it]
 24%|██▍       | 9032/37963 [21:43:24<77:25:32,  9.63s/it]
 24%|██▍       | 9033/37963 [21:43:32<72:19:02,  9.00s/it]
 24%|██▍       | 9034/37963 [21:43:39<68:46:02,  8.56s/it]
 24%|██▍       | 9035/37963 [21:43:47<66:12:26,  8.24s/it]
 24%|██▍       | 9036/37963 [21:43:54<63:59:38,  7.96s/it]
 24%|██▍       | 9037/37963 [21:44:01<62:29:04,  7.78s/it]
 24%|██▍       | 9038/37963 [21:44:09<61:53:19,  7.70s/it]
 24%|██▍       | 9039/37963 [21:44:16<61:20:04,  7.63s/it]
 24%|██▍       | 9040/37963 [21:44:24<61:10:48,  7.61s/it]
                                                          
{'loss': '0.14', 'grad_norm': '0.8875', 'learning_rate': '1.781e-05', 'epoch': '0.2381'}

 24%|██▍       | 9040/37963 [21:44:24<61:10:48,  7.61s/it]
 24%|██▍       | 9041/37963 [21:44:31<60:14:55,  7.50s/it]
 24%|██▍       | 9042/37963 [21:44:38<59:51:16,  7.45s/it]
 24%|██▍       | 9043/37963 [21:44:52<74:49:47,  9.31s/it]
 24%|██▍       | 9044/37963 [21:45:00<70:26:54,  8.77s/it]
 24%|██▍       | 9045/37963 [21:45:07<67:06:30,  8.35s/it]
 24%|██▍       | 9046/37963 [21:45:21<80:39:05, 10.04s/it]
 24%|██▍       | 9047/37963 [21:45:29<74:39:16,  9.29s/it]
 24%|██▍       | 9048/37963 [21:45:36<70:32:03,  8.78s/it]
 24%|██▍       | 9049/37963 [21:45:43<66:53:57,  8.33s/it]
 24%|██▍       | 9050/37963 [21:45:57<80:13:15,  9.99s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '2.256', 'learning_rate': '1.781e-05', 'epoch': '0.2384'}

 24%|██▍       | 9050/37963 [21:45:57<80:13:15,  9.99s/it]
 24%|██▍       | 9051/37963 [21:46:05<74:28:49,  9.27s/it]
 24%|██▍       | 9052/37963 [21:46:19<86:12:35, 10.73s/it]
 24%|██▍       | 9053/37963 [21:46:26<77:48:44,  9.69s/it]
 24%|██▍       | 9054/37963 [21:46:34<72:37:58,  9.04s/it]
 24%|██▍       | 9055/37963 [21:46:41<69:00:52,  8.59s/it]
 24%|██▍       | 9056/37963 [21:46:49<66:45:31,  8.31s/it]
 24%|██▍       | 9057/37963 [21:46:56<64:40:38,  8.06s/it]
 24%|██▍       | 9058/37963 [21:47:11<79:06:27,  9.85s/it]
 24%|██▍       | 9059/37963 [21:47:24<88:25:30, 11.01s/it]
 24%|██▍       | 9060/37963 [21:47:32<80:16:29, 10.00s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '1.18', 'learning_rate': '1.78e-05', 'epoch': '0.2387'}

 24%|██▍       | 9060/37963 [21:47:32<80:16:29, 10.00s/it]
 24%|██▍       | 9061/37963 [21:47:39<73:41:14,  9.18s/it]
 24%|██▍       | 9062/37963 [21:47:47<69:40:44,  8.68s/it]
 24%|██▍       | 9063/37963 [21:47:54<66:34:32,  8.29s/it]
 24%|██▍       | 9064/37963 [21:48:02<64:48:24,  8.07s/it]
 24%|██▍       | 9065/37963 [21:48:09<63:48:27,  7.95s/it]
 24%|██▍       | 9066/37963 [21:48:23<77:43:27,  9.68s/it]
 24%|██▍       | 9067/37963 [21:48:31<72:51:18,  9.08s/it]
 24%|██▍       | 9068/37963 [21:48:38<69:01:39,  8.60s/it]
 24%|██▍       | 9069/37963 [21:48:46<66:07:26,  8.24s/it]
 24%|██▍       | 9070/37963 [21:48:53<64:11:54,  8.00s/it]
                                                          
{'loss': '0.1641', 'grad_norm': '2.654', 'learning_rate': '1.78e-05', 'epoch': '0.2389'}

 24%|██▍       | 9070/37963 [21:48:53<64:11:54,  8.00s/it]
 24%|██▍       | 9071/37963 [21:49:00<62:48:44,  7.83s/it]
 24%|██▍       | 9072/37963 [21:49:08<62:12:06,  7.75s/it]
 24%|██▍       | 9073/37963 [21:49:16<61:39:30,  7.68s/it]
 24%|██▍       | 9074/37963 [21:49:23<60:31:59,  7.54s/it]
 24%|██▍       | 9075/37963 [21:49:30<60:12:40,  7.50s/it]
 24%|██▍       | 9076/37963 [21:49:38<60:11:33,  7.50s/it]
 24%|██▍       | 9077/37963 [21:49:45<59:48:23,  7.45s/it]
 24%|██▍       | 9078/37963 [21:49:52<59:50:33,  7.46s/it]
 24%|██▍       | 9079/37963 [21:50:00<60:01:40,  7.48s/it]
 24%|██▍       | 9080/37963 [21:50:07<60:05:35,  7.49s/it]
                                                          
{'loss': '0.1679', 'grad_norm': '3.157', 'learning_rate': '1.779e-05', 'epoch': '0.2392'}

 24%|██▍       | 9080/37963 [21:50:07<60:05:35,  7.49s/it]
 24%|██▍       | 9081/37963 [21:50:21<75:12:15,  9.37s/it]
 24%|██▍       | 9082/37963 [21:50:29<71:14:34,  8.88s/it]
 24%|██▍       | 9083/37963 [21:50:36<67:28:32,  8.41s/it]
 24%|██▍       | 9084/37963 [21:50:44<65:34:08,  8.17s/it]
 24%|██▍       | 9085/37963 [21:50:51<63:56:43,  7.97s/it]
 24%|██▍       | 9086/37963 [21:50:59<62:51:55,  7.84s/it]
 24%|██▍       | 9087/37963 [21:51:06<62:04:15,  7.74s/it]
 24%|██▍       | 9088/37963 [21:51:21<78:02:07,  9.73s/it]
 24%|██▍       | 9089/37963 [21:51:28<72:58:21,  9.10s/it]
 24%|██▍       | 9090/37963 [21:51:36<68:55:48,  8.59s/it]
                                                          
{'loss': '0.172', 'grad_norm': '1.328', 'learning_rate': '1.779e-05', 'epoch': '0.2394'}

 24%|██▍       | 9090/37963 [21:51:36<68:55:48,  8.59s/it]
 24%|██▍       | 9091/37963 [21:51:43<65:45:51,  8.20s/it]
 24%|██▍       | 9092/37963 [21:51:51<64:05:41,  7.99s/it]
 24%|██▍       | 9093/37963 [21:51:58<63:26:41,  7.91s/it]
 24%|██▍       | 9094/37963 [21:52:06<62:39:22,  7.81s/it]
 24%|██▍       | 9095/37963 [21:52:14<62:00:42,  7.73s/it]
 24%|██▍       | 9096/37963 [21:52:21<60:48:47,  7.58s/it]
 24%|██▍       | 9097/37963 [21:52:35<76:13:17,  9.51s/it]
 24%|██▍       | 9098/37963 [21:52:42<71:31:25,  8.92s/it]
 24%|██▍       | 9099/37963 [21:52:50<68:14:11,  8.51s/it]
 24%|██▍       | 9100/37963 [21:52:57<66:00:35,  8.23s/it]
                                                          
{'loss': '0.1696', 'grad_norm': '2.323', 'learning_rate': '1.778e-05', 'epoch': '0.2397'}

 24%|██▍       | 9100/37963 [21:52:57<66:00:35,  8.23s/it]
 24%|██▍       | 9101/37963 [21:53:05<63:54:03,  7.97s/it]
 24%|██▍       | 9102/37963 [21:53:12<62:47:33,  7.83s/it]
 24%|██▍       | 9103/37963 [21:53:26<77:19:26,  9.65s/it]
 24%|██▍       | 9104/37963 [21:53:47<103:48:59, 12.95s/it]
 24%|██▍       | 9105/37963 [21:53:54<90:20:02, 11.27s/it] 
 24%|██▍       | 9106/37963 [21:54:08<97:05:22, 12.11s/it]
 24%|██▍       | 9107/37963 [21:54:16<86:01:35, 10.73s/it]
 24%|██▍       | 9108/37963 [21:54:23<78:11:59,  9.76s/it]
 24%|██▍       | 9109/37963 [21:54:31<72:15:28,  9.02s/it]
 24%|██▍       | 9110/37963 [21:54:38<68:38:13,  8.56s/it]
                                                          
{'loss': '0.1668', 'grad_norm': '1.133', 'learning_rate': '1.778e-05', 'epoch': '0.24'}

 24%|██▍       | 9110/37963 [21:54:38<68:38:13,  8.56s/it]
 24%|██▍       | 9111/37963 [21:54:46<66:04:37,  8.24s/it]
 24%|██▍       | 9112/37963 [21:54:53<64:30:22,  8.05s/it]
 24%|██▍       | 9113/37963 [21:55:01<63:23:20,  7.91s/it]
 24%|██▍       | 9114/37963 [21:55:08<62:46:11,  7.83s/it]
 24%|██▍       | 9115/37963 [21:55:22<77:15:35,  9.64s/it]
 24%|██▍       | 9116/37963 [21:55:30<72:13:25,  9.01s/it]
 24%|██▍       | 9117/37963 [21:55:37<68:43:33,  8.58s/it]
 24%|██▍       | 9118/37963 [21:55:45<65:24:52,  8.16s/it]
 24%|██▍       | 9119/37963 [21:55:52<63:39:07,  7.94s/it]
 24%|██▍       | 9120/37963 [21:56:00<62:48:43,  7.84s/it]
                                                          
{'loss': '0.1454', 'grad_norm': '1.895', 'learning_rate': '1.777e-05', 'epoch': '0.2402'}

 24%|██▍       | 9120/37963 [21:56:00<62:48:43,  7.84s/it]
 24%|██▍       | 9121/37963 [21:56:07<62:17:38,  7.78s/it]
 24%|██▍       | 9122/37963 [21:56:15<61:10:29,  7.64s/it]
 24%|██▍       | 9123/37963 [21:56:22<60:58:09,  7.61s/it]
 24%|██▍       | 9124/37963 [21:56:29<60:23:38,  7.54s/it]
 24%|██▍       | 9125/37963 [21:56:37<59:29:37,  7.43s/it]
 24%|██▍       | 9126/37963 [21:56:44<59:46:05,  7.46s/it]
 24%|██▍       | 9127/37963 [21:56:58<75:30:49,  9.43s/it]
 24%|██▍       | 9128/37963 [21:57:06<71:28:12,  8.92s/it]
 24%|██▍       | 9129/37963 [21:57:14<68:18:57,  8.53s/it]
 24%|██▍       | 9130/37963 [21:57:21<65:43:47,  8.21s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '3.08', 'learning_rate': '1.777e-05', 'epoch': '0.2405'}

 24%|██▍       | 9130/37963 [21:57:21<65:43:47,  8.21s/it]
 24%|██▍       | 9131/37963 [21:57:29<64:17:05,  8.03s/it]
 24%|██▍       | 9132/37963 [21:57:36<62:59:32,  7.87s/it]
 24%|██▍       | 9133/37963 [21:57:44<62:12:58,  7.77s/it]
 24%|██▍       | 9134/37963 [21:57:51<61:44:30,  7.71s/it]
 24%|██▍       | 9135/37963 [21:57:59<61:04:11,  7.63s/it]
 24%|██▍       | 9136/37963 [21:58:06<60:47:49,  7.59s/it]
 24%|██▍       | 9137/37963 [21:58:20<75:59:43,  9.49s/it]
 24%|██▍       | 9138/37963 [21:58:28<71:34:53,  8.94s/it]
 24%|██▍       | 9139/37963 [21:58:35<68:16:47,  8.53s/it]
 24%|██▍       | 9140/37963 [21:58:43<66:21:07,  8.29s/it]
                                                          
{'loss': '0.1739', 'grad_norm': '1.807', 'learning_rate': '1.776e-05', 'epoch': '0.2408'}

 24%|██▍       | 9140/37963 [21:58:43<66:21:07,  8.29s/it]
 24%|██▍       | 9141/37963 [21:58:51<64:37:03,  8.07s/it]
 24%|██▍       | 9142/37963 [21:58:58<63:25:53,  7.92s/it]
 24%|██▍       | 9143/37963 [21:59:06<62:14:23,  7.77s/it]
 24%|██▍       | 9144/37963 [21:59:13<61:38:50,  7.70s/it]
 24%|██▍       | 9145/37963 [21:59:20<60:52:13,  7.60s/it]
 24%|██▍       | 9146/37963 [21:59:34<75:28:06,  9.43s/it]
 24%|██▍       | 9147/37963 [21:59:42<71:27:28,  8.93s/it]
 24%|██▍       | 9148/37963 [21:59:56<83:05:12, 10.38s/it]
 24%|██▍       | 9149/37963 [22:00:10<91:38:20, 11.45s/it]
 24%|██▍       | 9150/37963 [22:00:17<82:07:40, 10.26s/it]
                                                          
{'loss': '0.161', 'grad_norm': '1.893', 'learning_rate': '1.775e-05', 'epoch': '0.241'}

 24%|██▍       | 9150/37963 [22:00:17<82:07:40, 10.26s/it]
 24%|██▍       | 9151/37963 [22:00:25<75:38:50,  9.45s/it]
 24%|██▍       | 9152/37963 [22:00:39<86:35:21, 10.82s/it]
 24%|██▍       | 9153/37963 [22:00:46<78:58:30,  9.87s/it]
 24%|██▍       | 9154/37963 [22:00:54<73:30:16,  9.19s/it]
 24%|██▍       | 9155/37963 [22:01:01<69:08:56,  8.64s/it]
 24%|██▍       | 9156/37963 [22:01:09<66:33:09,  8.32s/it]
 24%|██▍       | 9157/37963 [22:01:16<64:34:22,  8.07s/it]
 24%|██▍       | 9158/37963 [22:01:30<77:36:46,  9.70s/it]
 24%|██▍       | 9159/37963 [22:01:37<72:09:24,  9.02s/it]
 24%|██▍       | 9160/37963 [22:01:51<83:53:41, 10.49s/it]
                                                          
{'loss': '0.1557', 'grad_norm': '3.451', 'learning_rate': '1.775e-05', 'epoch': '0.2413'}

 24%|██▍       | 9160/37963 [22:01:51<83:53:41, 10.49s/it]
 24%|██▍       | 9161/37963 [22:01:59<77:08:19,  9.64s/it]
 24%|██▍       | 9162/37963 [22:02:06<71:41:36,  8.96s/it]
 24%|██▍       | 9163/37963 [22:02:14<67:42:00,  8.46s/it]
 24%|██▍       | 9164/37963 [22:02:21<65:08:07,  8.14s/it]
 24%|██▍       | 9165/37963 [22:02:29<63:48:16,  7.98s/it]
 24%|██▍       | 9166/37963 [22:02:36<62:07:55,  7.77s/it]
 24%|██▍       | 9167/37963 [22:02:43<61:23:37,  7.68s/it]
 24%|██▍       | 9168/37963 [22:02:51<61:08:26,  7.64s/it]
 24%|██▍       | 9169/37963 [22:02:58<61:02:37,  7.63s/it]
 24%|██▍       | 9170/37963 [22:03:06<60:40:16,  7.59s/it]
                                                          
{'loss': '0.1793', 'grad_norm': '1.299', 'learning_rate': '1.774e-05', 'epoch': '0.2416'}

 24%|██▍       | 9170/37963 [22:03:06<60:40:16,  7.59s/it]
 24%|██▍       | 9171/37963 [22:03:14<60:53:04,  7.61s/it]
 24%|██▍       | 9172/37963 [22:03:21<60:34:49,  7.57s/it]
 24%|██▍       | 9173/37963 [22:03:29<60:17:10,  7.54s/it]
 24%|██▍       | 9174/37963 [22:03:42<75:12:03,  9.40s/it]
 24%|██▍       | 9175/37963 [22:03:50<70:40:29,  8.84s/it]
 24%|██▍       | 9176/37963 [22:03:57<67:08:28,  8.40s/it]
 24%|██▍       | 9177/37963 [22:04:05<65:21:00,  8.17s/it]
 24%|██▍       | 9178/37963 [22:04:12<63:51:15,  7.99s/it]
 24%|██▍       | 9179/37963 [22:04:20<63:10:19,  7.90s/it]
 24%|██▍       | 9180/37963 [22:04:28<62:25:12,  7.81s/it]
                                                          
{'loss': '0.1717', 'grad_norm': '2.867', 'learning_rate': '1.774e-05', 'epoch': '0.2418'}

 24%|██▍       | 9180/37963 [22:04:28<62:25:12,  7.81s/it]
 24%|██▍       | 9181/37963 [22:04:35<61:33:19,  7.70s/it]
 24%|██▍       | 9182/37963 [22:04:43<60:53:36,  7.62s/it]
 24%|██▍       | 9183/37963 [22:04:50<60:24:01,  7.56s/it]
 24%|██▍       | 9184/37963 [22:04:58<60:27:13,  7.56s/it]
 24%|██▍       | 9185/37963 [22:05:05<60:26:44,  7.56s/it]
 24%|██▍       | 9186/37963 [22:05:13<60:39:34,  7.59s/it]
 24%|██▍       | 9187/37963 [22:05:27<75:51:49,  9.49s/it]
 24%|██▍       | 9188/37963 [22:05:34<70:54:15,  8.87s/it]
 24%|██▍       | 9189/37963 [22:05:42<67:46:50,  8.48s/it]
 24%|██▍       | 9190/37963 [22:05:49<65:33:31,  8.20s/it]
                                                          
{'loss': '0.162', 'grad_norm': '1.581', 'learning_rate': '1.773e-05', 'epoch': '0.2421'}

 24%|██▍       | 9190/37963 [22:05:49<65:33:31,  8.20s/it]
 24%|██▍       | 9191/37963 [22:05:57<63:47:22,  7.98s/it]
 24%|██▍       | 9192/37963 [22:06:04<62:50:16,  7.86s/it]
 24%|██▍       | 9193/37963 [22:06:18<77:33:46,  9.71s/it]
 24%|██▍       | 9194/37963 [22:06:32<88:20:31, 11.05s/it]
 24%|██▍       | 9195/37963 [22:06:40<80:14:20, 10.04s/it]
 24%|██▍       | 9196/37963 [22:06:47<73:40:50,  9.22s/it]
 24%|██▍       | 9197/37963 [22:07:01<84:23:47, 10.56s/it]
 24%|██▍       | 9198/37963 [22:07:09<77:04:07,  9.65s/it]
 24%|██▍       | 9199/37963 [22:07:16<71:54:44,  9.00s/it]
 24%|██▍       | 9200/37963 [22:07:24<68:25:58,  8.57s/it]
                                                          
{'loss': '0.1507', 'grad_norm': '1.4', 'learning_rate': '1.773e-05', 'epoch': '0.2423'}

 24%|██▍       | 9200/37963 [22:07:24<68:25:58,  8.57s/it]
 24%|██▍       | 9201/37963 [22:07:38<80:57:57, 10.13s/it]
 24%|██▍       | 9202/37963 [22:07:45<74:48:22,  9.36s/it]
 24%|██▍       | 9203/37963 [22:07:52<69:46:12,  8.73s/it]
 24%|██▍       | 9204/37963 [22:08:00<66:45:31,  8.36s/it]
 24%|██▍       | 9205/37963 [22:08:07<64:48:12,  8.11s/it]
 24%|██▍       | 9206/37963 [22:08:15<63:46:38,  7.98s/it]
 24%|██▍       | 9207/37963 [22:08:23<62:46:33,  7.86s/it]
 24%|██▍       | 9208/37963 [22:08:30<62:17:57,  7.80s/it]
 24%|██▍       | 9209/37963 [22:08:38<61:38:31,  7.72s/it]
 24%|██▍       | 9210/37963 [22:08:52<77:10:06,  9.66s/it]
                                                          
{'loss': '0.1801', 'grad_norm': '1.213', 'learning_rate': '1.772e-05', 'epoch': '0.2426'}

 24%|██▍       | 9210/37963 [22:08:52<77:10:06,  9.66s/it]
 24%|██▍       | 9211/37963 [22:09:00<72:26:41,  9.07s/it]
 24%|██▍       | 9212/37963 [22:09:07<68:08:59,  8.53s/it]
 24%|██▍       | 9213/37963 [22:09:21<81:35:33, 10.22s/it]
 24%|██▍       | 9214/37963 [22:09:29<75:21:00,  9.44s/it]
 24%|██▍       | 9215/37963 [22:09:36<70:47:14,  8.86s/it]
 24%|██▍       | 9216/37963 [22:09:44<67:35:15,  8.46s/it]
 24%|██▍       | 9217/37963 [22:09:51<65:22:18,  8.19s/it]
 24%|██▍       | 9218/37963 [22:09:59<63:10:17,  7.91s/it]
 24%|██▍       | 9219/37963 [22:10:06<62:17:01,  7.80s/it]
 24%|██▍       | 9220/37963 [22:10:13<60:56:02,  7.63s/it]
                                                          
{'loss': '0.1582', 'grad_norm': '1.988', 'learning_rate': '1.772e-05', 'epoch': '0.2429'}

 24%|██▍       | 9220/37963 [22:10:13<60:56:02,  7.63s/it]
 24%|██▍       | 9221/37963 [22:10:27<76:24:46,  9.57s/it]
 24%|██▍       | 9222/37963 [22:10:35<71:58:28,  9.02s/it]
 24%|██▍       | 9223/37963 [22:10:43<68:28:44,  8.58s/it]
 24%|██▍       | 9224/37963 [22:10:50<66:16:09,  8.30s/it]
 24%|██▍       | 9225/37963 [22:10:58<64:56:02,  8.13s/it]
 24%|██▍       | 9226/37963 [22:11:06<63:28:20,  7.95s/it]
 24%|██▍       | 9227/37963 [22:11:13<62:26:16,  7.82s/it]
 24%|██▍       | 9228/37963 [22:11:21<62:02:36,  7.77s/it]
 24%|██▍       | 9229/37963 [22:11:28<61:32:58,  7.71s/it]
 24%|██▍       | 9230/37963 [22:11:36<61:16:08,  7.68s/it]
                                                          
{'loss': '0.1752', 'grad_norm': '2.859', 'learning_rate': '1.771e-05', 'epoch': '0.2431'}

 24%|██▍       | 9230/37963 [22:11:36<61:16:08,  7.68s/it]
 24%|██▍       | 9231/37963 [22:11:43<60:35:54,  7.59s/it]
 24%|██▍       | 9232/37963 [22:11:51<60:24:52,  7.57s/it]
 24%|██▍       | 9233/37963 [22:11:58<60:13:50,  7.55s/it]
 24%|██▍       | 9234/37963 [22:12:06<59:33:36,  7.46s/it]
 24%|██▍       | 9235/37963 [22:12:13<59:37:22,  7.47s/it]
 24%|██▍       | 9236/37963 [22:12:27<74:46:39,  9.37s/it]
 24%|██▍       | 9237/37963 [22:12:34<70:04:19,  8.78s/it]
 24%|██▍       | 9238/37963 [22:12:42<67:06:39,  8.41s/it]
 24%|██▍       | 9239/37963 [22:12:49<64:43:14,  8.11s/it]
 24%|██▍       | 9240/37963 [22:12:57<63:15:40,  7.93s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '2.631', 'learning_rate': '1.771e-05', 'epoch': '0.2434'}

 24%|██▍       | 9240/37963 [22:12:57<63:15:40,  7.93s/it]
 24%|██▍       | 9241/37963 [22:13:04<62:19:19,  7.81s/it]
 24%|██▍       | 9242/37963 [22:13:12<61:44:11,  7.74s/it]
 24%|██▍       | 9243/37963 [22:13:26<77:07:23,  9.67s/it]
 24%|██▍       | 9244/37963 [22:13:34<72:01:01,  9.03s/it]
 24%|██▍       | 9245/37963 [22:13:54<99:12:46, 12.44s/it]
 24%|██▍       | 9246/37963 [22:14:02<87:51:23, 11.01s/it]
 24%|██▍       | 9247/37963 [22:14:15<94:20:28, 11.83s/it]
 24%|██▍       | 9248/37963 [22:14:23<84:07:45, 10.55s/it]
 24%|██▍       | 9249/37963 [22:14:31<76:48:43,  9.63s/it]
 24%|██▍       | 9250/37963 [22:14:38<71:34:56,  8.97s/it]
                                                          
{'loss': '0.1685', 'grad_norm': '1.795', 'learning_rate': '1.77e-05', 'epoch': '0.2437'}

 24%|██▍       | 9250/37963 [22:14:38<71:34:56,  8.97s/it]
 24%|██▍       | 9251/37963 [22:14:45<67:56:05,  8.52s/it]
 24%|██▍       | 9252/37963 [22:14:53<65:40:05,  8.23s/it]
 24%|██▍       | 9253/37963 [22:15:01<64:48:49,  8.13s/it]
 24%|██▍       | 9254/37963 [22:15:08<63:22:52,  7.95s/it]
 24%|██▍       | 9255/37963 [22:15:16<61:55:25,  7.77s/it]
 24%|██▍       | 9256/37963 [22:15:23<61:41:04,  7.74s/it]
 24%|██▍       | 9257/37963 [22:15:37<75:54:04,  9.52s/it]
 24%|██▍       | 9258/37963 [22:15:51<86:19:50, 10.83s/it]
 24%|██▍       | 9259/37963 [22:15:58<78:18:45,  9.82s/it]
 24%|██▍       | 9260/37963 [22:16:06<73:07:34,  9.17s/it]
                                                          
{'loss': '0.1615', 'grad_norm': '1.137', 'learning_rate': '1.769e-05', 'epoch': '0.2439'}

 24%|██▍       | 9260/37963 [22:16:06<73:07:34,  9.17s/it]
 24%|██▍       | 9261/37963 [22:16:13<68:27:07,  8.59s/it]
 24%|██▍       | 9262/37963 [22:16:21<66:01:48,  8.28s/it]
 24%|██▍       | 9263/37963 [22:16:28<64:20:16,  8.07s/it]
 24%|██▍       | 9264/37963 [22:16:36<62:35:30,  7.85s/it]
 24%|██▍       | 9265/37963 [22:16:43<61:53:38,  7.76s/it]
 24%|██▍       | 9266/37963 [22:16:51<61:22:20,  7.70s/it]
 24%|██▍       | 9267/37963 [22:16:58<60:41:13,  7.61s/it]
 24%|██▍       | 9268/37963 [22:17:06<60:32:23,  7.60s/it]
 24%|██▍       | 9269/37963 [22:17:13<60:14:08,  7.56s/it]
 24%|██▍       | 9270/37963 [22:17:21<59:27:39,  7.46s/it]
                                                          
{'loss': '0.1554', 'grad_norm': '1.726', 'learning_rate': '1.769e-05', 'epoch': '0.2442'}

 24%|██▍       | 9270/37963 [22:17:21<59:27:39,  7.46s/it]
 24%|██▍       | 9271/37963 [22:17:28<59:33:20,  7.47s/it]
 24%|██▍       | 9272/37963 [22:17:42<75:10:13,  9.43s/it]
 24%|██▍       | 9273/37963 [22:17:49<70:06:55,  8.80s/it]
 24%|██▍       | 9274/37963 [22:17:57<67:16:45,  8.44s/it]
 24%|██▍       | 9275/37963 [22:18:05<65:12:06,  8.18s/it]
 24%|██▍       | 9276/37963 [22:18:12<63:01:11,  7.91s/it]
 24%|██▍       | 9277/37963 [22:18:19<62:21:32,  7.83s/it]
 24%|██▍       | 9278/37963 [22:18:27<61:38:10,  7.74s/it]
 24%|██▍       | 9279/37963 [22:18:35<61:10:29,  7.68s/it]
 24%|██▍       | 9280/37963 [22:18:42<60:50:58,  7.64s/it]
                                                          
{'loss': '0.1531', 'grad_norm': '1.666', 'learning_rate': '1.768e-05', 'epoch': '0.2444'}

 24%|██▍       | 9280/37963 [22:18:42<60:50:58,  7.64s/it]
 24%|██▍       | 9281/37963 [22:18:50<60:46:12,  7.63s/it]
 24%|██▍       | 9282/37963 [22:18:57<60:43:41,  7.62s/it]
 24%|██▍       | 9283/37963 [22:19:05<60:25:57,  7.59s/it]
 24%|██▍       | 9284/37963 [22:19:12<60:01:59,  7.54s/it]
 24%|██▍       | 9285/37963 [22:19:20<59:56:21,  7.52s/it]
 24%|██▍       | 9286/37963 [22:19:33<74:21:29,  9.33s/it]
 24%|██▍       | 9287/37963 [22:19:41<69:57:55,  8.78s/it]
 24%|██▍       | 9288/37963 [22:19:48<67:04:48,  8.42s/it]
 24%|██▍       | 9289/37963 [22:19:56<64:36:21,  8.11s/it]
 24%|██▍       | 9290/37963 [22:20:10<78:38:20,  9.87s/it]
                                                          
{'loss': '0.1682', 'grad_norm': '5.894', 'learning_rate': '1.768e-05', 'epoch': '0.2447'}

 24%|██▍       | 9290/37963 [22:20:10<78:38:20,  9.87s/it]
 24%|██▍       | 9291/37963 [22:20:24<88:29:04, 11.11s/it]
 24%|██▍       | 9292/37963 [22:20:31<79:28:32,  9.98s/it]
 24%|██▍       | 9293/37963 [22:20:39<73:42:27,  9.26s/it]
 24%|██▍       | 9294/37963 [22:20:46<68:36:34,  8.62s/it]
 24%|██▍       | 9295/37963 [22:20:53<65:55:46,  8.28s/it]
 24%|██▍       | 9296/37963 [22:21:01<63:48:05,  8.01s/it]
 24%|██▍       | 9297/37963 [22:21:08<62:41:30,  7.87s/it]
 24%|██▍       | 9298/37963 [22:21:28<92:07:19, 11.57s/it]
 24%|██▍       | 9299/37963 [22:21:36<82:26:19, 10.35s/it]
 24%|██▍       | 9300/37963 [22:21:43<74:58:43,  9.42s/it]
                                                          
{'loss': '0.1647', 'grad_norm': '4.417', 'learning_rate': '1.767e-05', 'epoch': '0.245'}

 24%|██▍       | 9300/37963 [22:21:43<74:58:43,  9.42s/it]
 25%|██▍       | 9301/37963 [22:21:51<70:27:35,  8.85s/it]
 25%|██▍       | 9302/37963 [22:21:58<67:17:18,  8.45s/it]
 25%|██▍       | 9303/37963 [22:22:06<65:08:43,  8.18s/it]
 25%|██▍       | 9304/37963 [22:22:20<79:09:29,  9.94s/it]
 25%|██▍       | 9305/37963 [22:22:27<73:29:23,  9.23s/it]
 25%|██▍       | 9306/37963 [22:22:35<69:41:54,  8.76s/it]
 25%|██▍       | 9307/37963 [22:22:43<67:00:11,  8.42s/it]
 25%|██▍       | 9308/37963 [22:22:57<80:09:50, 10.07s/it]
 25%|██▍       | 9309/37963 [22:23:04<74:32:04,  9.36s/it]
 25%|██▍       | 9310/37963 [22:23:12<70:30:33,  8.86s/it]
                                                          
{'loss': '0.1567', 'grad_norm': '2.043', 'learning_rate': '1.767e-05', 'epoch': '0.2452'}

 25%|██▍       | 9310/37963 [22:23:12<70:30:33,  8.86s/it]
 25%|██▍       | 9311/37963 [22:23:19<67:15:27,  8.45s/it]
 25%|██▍       | 9312/37963 [22:23:27<64:32:58,  8.11s/it]
 25%|██▍       | 9313/37963 [22:23:34<63:11:16,  7.94s/it]
 25%|██▍       | 9314/37963 [22:23:42<62:15:56,  7.82s/it]
 25%|██▍       | 9315/37963 [22:23:50<61:52:04,  7.77s/it]
 25%|██▍       | 9316/37963 [22:23:57<61:15:00,  7.70s/it]
 25%|██▍       | 9317/37963 [22:24:05<61:05:07,  7.68s/it]
 25%|██▍       | 9318/37963 [22:24:12<60:37:26,  7.62s/it]
 25%|██▍       | 9319/37963 [22:24:20<60:20:05,  7.58s/it]
 25%|██▍       | 9320/37963 [22:24:34<75:40:49,  9.51s/it]
                                                          
{'loss': '0.1593', 'grad_norm': '1.719', 'learning_rate': '1.766e-05', 'epoch': '0.2455'}

 25%|██▍       | 9320/37963 [22:24:34<75:40:49,  9.51s/it]
 25%|██▍       | 9321/37963 [22:24:41<70:59:27,  8.92s/it]
 25%|██▍       | 9322/37963 [22:24:49<68:01:09,  8.55s/it]
 25%|██▍       | 9323/37963 [22:24:56<65:22:47,  8.22s/it]
 25%|██▍       | 9324/37963 [22:25:04<63:48:30,  8.02s/it]
 25%|██▍       | 9325/37963 [22:25:12<63:12:31,  7.95s/it]
 25%|██▍       | 9326/37963 [22:25:19<62:32:15,  7.86s/it]
 25%|██▍       | 9327/37963 [22:25:27<61:56:58,  7.79s/it]
 25%|██▍       | 9328/37963 [22:25:34<61:21:56,  7.71s/it]
 25%|██▍       | 9329/37963 [22:25:42<60:56:45,  7.66s/it]
 25%|██▍       | 9330/37963 [22:25:50<60:40:49,  7.63s/it]
                                                          
{'loss': '0.1659', 'grad_norm': '1.059', 'learning_rate': '1.766e-05', 'epoch': '0.2458'}

 25%|██▍       | 9330/37963 [22:25:50<60:40:49,  7.63s/it]
 25%|██▍       | 9331/37963 [22:25:57<60:26:58,  7.60s/it]
 25%|██▍       | 9332/37963 [22:26:05<60:20:54,  7.59s/it]
 25%|██▍       | 9333/37963 [22:26:12<60:22:12,  7.59s/it]
 25%|██▍       | 9334/37963 [22:26:20<60:03:55,  7.55s/it]
 25%|██▍       | 9335/37963 [22:26:34<75:26:30,  9.49s/it]
 25%|██▍       | 9336/37963 [22:26:41<70:41:34,  8.89s/it]
 25%|██▍       | 9337/37963 [22:26:49<67:32:15,  8.49s/it]
 25%|██▍       | 9338/37963 [22:27:03<81:16:57, 10.22s/it]
 25%|██▍       | 9339/37963 [22:27:11<75:08:56,  9.45s/it]
 25%|██▍       | 9340/37963 [22:27:18<70:26:43,  8.86s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '1.402', 'learning_rate': '1.765e-05', 'epoch': '0.246'}

 25%|██▍       | 9340/37963 [22:27:18<70:26:43,  8.86s/it]
 25%|██▍       | 9341/37963 [22:27:32<83:02:22, 10.44s/it]
 25%|██▍       | 9342/37963 [22:27:40<75:55:10,  9.55s/it]
 25%|██▍       | 9343/37963 [22:27:47<71:06:09,  8.94s/it]
 25%|██▍       | 9344/37963 [22:27:55<67:40:47,  8.51s/it]
 25%|██▍       | 9345/37963 [22:28:02<65:31:03,  8.24s/it]
 25%|██▍       | 9346/37963 [22:28:16<79:17:53,  9.98s/it]
 25%|██▍       | 9347/37963 [22:28:24<73:23:54,  9.23s/it]
 25%|██▍       | 9348/37963 [22:28:32<69:26:35,  8.74s/it]
 25%|██▍       | 9349/37963 [22:28:39<66:27:10,  8.36s/it]
 25%|██▍       | 9350/37963 [22:28:53<79:52:07, 10.05s/it]
                                                          
{'loss': '0.1624', 'grad_norm': '7.005', 'learning_rate': '1.765e-05', 'epoch': '0.2463'}

 25%|██▍       | 9350/37963 [22:28:53<79:52:07, 10.05s/it]
 25%|██▍       | 9351/37963 [22:29:01<73:51:08,  9.29s/it]
 25%|██▍       | 9352/37963 [22:29:08<69:36:31,  8.76s/it]
 25%|██▍       | 9353/37963 [22:29:16<66:27:40,  8.36s/it]
 25%|██▍       | 9354/37963 [22:29:23<64:30:13,  8.12s/it]
 25%|██▍       | 9355/37963 [22:29:37<78:24:21,  9.87s/it]
 25%|██▍       | 9356/37963 [22:29:45<73:01:25,  9.19s/it]
 25%|██▍       | 9357/37963 [22:29:52<69:10:01,  8.70s/it]
 25%|██▍       | 9358/37963 [22:30:00<66:23:47,  8.36s/it]
 25%|██▍       | 9359/37963 [22:30:14<80:09:13, 10.09s/it]
 25%|██▍       | 9360/37963 [22:30:21<73:59:50,  9.31s/it]
                                                          
{'loss': '0.1611', 'grad_norm': '2.989', 'learning_rate': '1.764e-05', 'epoch': '0.2466'}

 25%|██▍       | 9360/37963 [22:30:21<73:59:50,  9.31s/it]
 25%|██▍       | 9361/37963 [22:30:29<70:01:22,  8.81s/it]
 25%|██▍       | 9362/37963 [22:30:36<66:20:14,  8.35s/it]
 25%|██▍       | 9363/37963 [22:30:44<64:19:54,  8.10s/it]
 25%|██▍       | 9364/37963 [22:30:58<77:57:40,  9.81s/it]
 25%|██▍       | 9365/37963 [22:31:05<72:47:42,  9.16s/it]
 25%|██▍       | 9366/37963 [22:31:13<69:08:15,  8.70s/it]
 25%|██▍       | 9367/37963 [22:31:20<66:32:49,  8.38s/it]
 25%|██▍       | 9368/37963 [22:31:28<65:04:09,  8.19s/it]
 25%|██▍       | 9369/37963 [22:31:36<63:31:19,  8.00s/it]
 25%|██▍       | 9370/37963 [22:31:43<61:43:46,  7.77s/it]
                                                          
{'loss': '0.1783', 'grad_norm': '1.27', 'learning_rate': '1.763e-05', 'epoch': '0.2468'}

 25%|██▍       | 9370/37963 [22:31:43<61:43:46,  7.77s/it]
 25%|██▍       | 9371/37963 [22:31:51<61:05:33,  7.69s/it]
 25%|██▍       | 9372/37963 [22:31:58<60:02:44,  7.56s/it]
 25%|██▍       | 9373/37963 [22:32:05<59:37:09,  7.51s/it]
 25%|██▍       | 9374/37963 [22:32:12<59:03:03,  7.44s/it]
 25%|██▍       | 9375/37963 [22:32:20<59:13:59,  7.46s/it]
 25%|██▍       | 9376/37963 [22:32:27<58:39:04,  7.39s/it]
 25%|██▍       | 9377/37963 [22:32:35<59:05:51,  7.44s/it]
 25%|██▍       | 9378/37963 [22:32:42<59:08:06,  7.45s/it]
 25%|██▍       | 9379/37963 [22:32:50<59:17:25,  7.47s/it]
 25%|██▍       | 9380/37963 [22:32:57<59:22:31,  7.48s/it]
                                                          
{'loss': '0.1567', 'grad_norm': '1.88', 'learning_rate': '1.763e-05', 'epoch': '0.2471'}

 25%|██▍       | 9380/37963 [22:32:57<59:22:31,  7.48s/it]
 25%|██▍       | 9381/37963 [22:33:05<59:25:22,  7.48s/it]
 25%|██▍       | 9382/37963 [22:33:19<74:38:05,  9.40s/it]
 25%|██▍       | 9383/37963 [22:33:26<70:04:53,  8.83s/it]
 25%|██▍       | 9384/37963 [22:33:34<67:09:44,  8.46s/it]
 25%|██▍       | 9385/37963 [22:33:41<64:44:34,  8.16s/it]
 25%|██▍       | 9386/37963 [22:33:49<62:50:46,  7.92s/it]
 25%|██▍       | 9387/37963 [22:33:56<61:51:39,  7.79s/it]
 25%|██▍       | 9388/37963 [22:34:04<61:15:26,  7.72s/it]
 25%|██▍       | 9389/37963 [22:34:17<75:49:32,  9.55s/it]
 25%|██▍       | 9390/37963 [22:34:31<86:27:36, 10.89s/it]
                                                          
{'loss': '0.1571', 'grad_norm': '1.057', 'learning_rate': '1.762e-05', 'epoch': '0.2473'}

 25%|██▍       | 9390/37963 [22:34:31<86:27:36, 10.89s/it]
 25%|██▍       | 9391/37963 [22:34:39<78:18:15,  9.87s/it]
 25%|██▍       | 9392/37963 [22:34:46<72:34:15,  9.14s/it]
 25%|██▍       | 9393/37963 [22:34:54<68:40:59,  8.65s/it]
 25%|██▍       | 9394/37963 [22:35:01<66:03:33,  8.32s/it]
 25%|██▍       | 9395/37963 [22:35:15<78:54:18,  9.94s/it]
 25%|██▍       | 9396/37963 [22:35:23<73:30:38,  9.26s/it]
 25%|██▍       | 9397/37963 [22:35:30<69:18:10,  8.73s/it]
 25%|██▍       | 9398/37963 [22:35:38<66:19:26,  8.36s/it]
 25%|██▍       | 9399/37963 [22:35:45<64:12:23,  8.09s/it]
 25%|██▍       | 9400/37963 [22:35:59<78:20:42,  9.87s/it]
                                                          
{'loss': '0.1676', 'grad_norm': '5.104', 'learning_rate': '1.762e-05', 'epoch': '0.2476'}

 25%|██▍       | 9400/37963 [22:35:59<78:20:42,  9.87s/it]
 25%|██▍       | 9401/37963 [22:36:07<72:45:11,  9.17s/it]
 25%|██▍       | 9402/37963 [22:36:14<68:49:09,  8.67s/it]
 25%|██▍       | 9403/37963 [22:36:22<66:02:14,  8.32s/it]
 25%|██▍       | 9404/37963 [22:36:36<79:48:55, 10.06s/it]
 25%|██▍       | 9405/37963 [22:36:43<73:23:55,  9.25s/it]
 25%|██▍       | 9406/37963 [22:36:51<68:37:13,  8.65s/it]
 25%|██▍       | 9407/37963 [22:36:58<65:54:59,  8.31s/it]
 25%|██▍       | 9408/37963 [22:37:05<63:33:47,  8.01s/it]
 25%|██▍       | 9409/37963 [22:37:13<61:59:12,  7.82s/it]
 25%|██▍       | 9410/37963 [22:37:20<61:17:38,  7.73s/it]
                                                          
{'loss': '0.1444', 'grad_norm': '1.27', 'learning_rate': '1.761e-05', 'epoch': '0.2479'}

 25%|██▍       | 9410/37963 [22:37:20<61:17:38,  7.73s/it]
 25%|██▍       | 9411/37963 [22:37:28<60:55:19,  7.68s/it]
 25%|██▍       | 9412/37963 [22:37:35<60:33:47,  7.64s/it]
 25%|██▍       | 9413/37963 [22:37:50<76:03:33,  9.59s/it]
 25%|██▍       | 9414/37963 [22:37:57<71:20:56,  9.00s/it]
 25%|██▍       | 9415/37963 [22:38:05<67:30:34,  8.51s/it]
 25%|██▍       | 9416/37963 [22:38:12<65:20:16,  8.24s/it]
 25%|██▍       | 9417/37963 [22:38:20<63:31:55,  8.01s/it]
 25%|██▍       | 9418/37963 [22:38:34<78:12:02,  9.86s/it]
 25%|██▍       | 9419/37963 [22:38:41<72:45:34,  9.18s/it]
 25%|██▍       | 9420/37963 [22:38:49<68:42:52,  8.67s/it]
                                                          
{'loss': '0.1675', 'grad_norm': '2.84', 'learning_rate': '1.761e-05', 'epoch': '0.2481'}

 25%|██▍       | 9420/37963 [22:38:49<68:42:52,  8.67s/it]
 25%|██▍       | 9421/37963 [22:38:56<66:10:10,  8.35s/it]
 25%|██▍       | 9422/37963 [22:39:04<64:11:35,  8.10s/it]
 25%|██▍       | 9423/37963 [22:39:12<63:05:53,  7.96s/it]
 25%|██▍       | 9424/37963 [22:39:19<62:15:11,  7.85s/it]
 25%|██▍       | 9425/37963 [22:39:27<61:29:03,  7.76s/it]
 25%|██▍       | 9426/37963 [22:39:41<76:12:20,  9.61s/it]
 25%|██▍       | 9427/37963 [22:39:48<71:14:27,  8.99s/it]
 25%|██▍       | 9428/37963 [22:39:56<67:53:52,  8.57s/it]
 25%|██▍       | 9429/37963 [22:40:03<64:58:11,  8.20s/it]
 25%|██▍       | 9430/37963 [22:40:11<63:17:07,  7.98s/it]
                                                          
{'loss': '0.1805', 'grad_norm': '3.846', 'learning_rate': '1.76e-05', 'epoch': '0.2484'}

 25%|██▍       | 9430/37963 [22:40:11<63:17:07,  7.98s/it]
 25%|██▍       | 9431/37963 [22:40:18<61:55:08,  7.81s/it]
 25%|██▍       | 9432/37963 [22:40:26<61:16:28,  7.73s/it]
 25%|██▍       | 9433/37963 [22:40:33<60:29:13,  7.63s/it]
 25%|██▍       | 9434/37963 [22:40:41<60:44:08,  7.66s/it]
 25%|██▍       | 9435/37963 [22:40:55<75:34:46,  9.54s/it]
 25%|██▍       | 9436/37963 [22:41:02<70:49:07,  8.94s/it]
 25%|██▍       | 9437/37963 [22:41:10<67:31:43,  8.52s/it]
 25%|██▍       | 9438/37963 [22:41:17<64:54:35,  8.19s/it]
 25%|██▍       | 9439/37963 [22:41:25<63:17:29,  7.99s/it]
 25%|██▍       | 9440/37963 [22:41:32<61:41:45,  7.79s/it]
                                                          
{'loss': '0.1612', 'grad_norm': '0.8584', 'learning_rate': '1.76e-05', 'epoch': '0.2487'}

 25%|██▍       | 9440/37963 [22:41:32<61:41:45,  7.79s/it]
 25%|██▍       | 9441/37963 [22:41:46<76:38:07,  9.67s/it]
 25%|██▍       | 9442/37963 [22:42:00<87:39:50, 11.07s/it]
 25%|██▍       | 9443/37963 [22:42:08<78:51:29,  9.95s/it]
 25%|██▍       | 9444/37963 [22:42:15<72:59:39,  9.21s/it]
 25%|██▍       | 9445/37963 [22:42:23<68:57:48,  8.71s/it]
 25%|██▍       | 9446/37963 [22:42:30<65:56:23,  8.32s/it]
 25%|██▍       | 9447/37963 [22:42:38<64:00:38,  8.08s/it]
 25%|██▍       | 9448/37963 [22:42:52<78:21:22,  9.89s/it]
 25%|██▍       | 9449/37963 [22:42:59<72:33:54,  9.16s/it]
 25%|██▍       | 9450/37963 [22:43:07<68:34:20,  8.66s/it]
                                                          
{'loss': '0.173', 'grad_norm': '3.806', 'learning_rate': '1.759e-05', 'epoch': '0.2489'}

 25%|██▍       | 9450/37963 [22:43:07<68:34:20,  8.66s/it]
 25%|██▍       | 9451/37963 [22:43:14<65:51:56,  8.32s/it]
 25%|██▍       | 9452/37963 [22:43:29<80:03:00, 10.11s/it]
 25%|██▍       | 9453/37963 [22:43:36<73:45:40,  9.31s/it]
 25%|██▍       | 9454/37963 [22:43:43<69:17:25,  8.75s/it]
 25%|██▍       | 9455/37963 [22:43:51<66:16:50,  8.37s/it]
 25%|██▍       | 9456/37963 [22:43:59<64:28:42,  8.14s/it]
 25%|██▍       | 9457/37963 [22:44:06<63:09:09,  7.98s/it]
 25%|██▍       | 9458/37963 [22:44:14<62:14:44,  7.86s/it]
 25%|██▍       | 9459/37963 [22:44:21<61:38:51,  7.79s/it]
 25%|██▍       | 9460/37963 [22:44:29<61:01:24,  7.71s/it]
                                                          
{'loss': '0.1591', 'grad_norm': '1.322', 'learning_rate': '1.758e-05', 'epoch': '0.2492'}

 25%|██▍       | 9460/37963 [22:44:29<61:01:24,  7.71s/it]
 25%|██▍       | 9461/37963 [22:44:36<59:56:55,  7.57s/it]
 25%|██▍       | 9462/37963 [22:44:50<74:51:38,  9.46s/it]
 25%|██▍       | 9463/37963 [22:44:58<70:26:20,  8.90s/it]
 25%|██▍       | 9464/37963 [22:45:05<67:27:51,  8.52s/it]
 25%|██▍       | 9465/37963 [22:45:19<80:44:27, 10.20s/it]
 25%|██▍       | 9466/37963 [22:45:27<74:15:58,  9.38s/it]
 25%|██▍       | 9467/37963 [22:45:34<69:54:31,  8.83s/it]
 25%|██▍       | 9468/37963 [22:45:42<67:04:11,  8.47s/it]
 25%|██▍       | 9469/37963 [22:45:56<80:10:38, 10.13s/it]
 25%|██▍       | 9470/37963 [22:46:04<74:11:22,  9.37s/it]
                                                          
{'loss': '0.1661', 'grad_norm': '1.046', 'learning_rate': '1.758e-05', 'epoch': '0.2495'}

 25%|██▍       | 9470/37963 [22:46:04<74:11:22,  9.37s/it]
 25%|██▍       | 9471/37963 [22:46:11<69:48:04,  8.82s/it]
 25%|██▍       | 9472/37963 [22:46:19<66:38:44,  8.42s/it]
 25%|██▍       | 9473/37963 [22:46:26<64:17:09,  8.12s/it]
 25%|██▍       | 9474/37963 [22:46:33<62:33:57,  7.91s/it]
 25%|██▍       | 9475/37963 [22:46:41<61:42:06,  7.80s/it]
 25%|██▍       | 9476/37963 [22:46:48<60:35:15,  7.66s/it]
 25%|██▍       | 9477/37963 [22:46:56<60:23:30,  7.63s/it]
 25%|██▍       | 9478/37963 [22:47:03<59:03:50,  7.46s/it]
 25%|██▍       | 9479/37963 [22:47:17<74:37:01,  9.43s/it]
 25%|██▍       | 9480/37963 [22:47:24<70:05:58,  8.86s/it]
                                                          
{'loss': '0.1608', 'grad_norm': '1.472', 'learning_rate': '1.757e-05', 'epoch': '0.2497'}

 25%|██▍       | 9480/37963 [22:47:24<70:05:58,  8.86s/it]
 25%|██▍       | 9481/37963 [22:47:32<66:42:11,  8.43s/it]
 25%|██▍       | 9482/37963 [22:47:40<64:53:15,  8.20s/it]
 25%|██▍       | 9483/37963 [22:47:47<63:14:40,  7.99s/it]
 25%|██▍       | 9484/37963 [22:47:54<61:21:10,  7.76s/it]
 25%|██▍       | 9485/37963 [22:48:02<60:58:12,  7.71s/it]
 25%|██▍       | 9486/37963 [22:48:09<60:37:14,  7.66s/it]
 25%|██▍       | 9487/37963 [22:48:17<59:59:52,  7.59s/it]
 25%|██▍       | 9488/37963 [22:48:31<75:11:34,  9.51s/it]
 25%|██▍       | 9489/37963 [22:48:38<70:23:27,  8.90s/it]
 25%|██▍       | 9490/37963 [22:48:46<66:32:07,  8.41s/it]
                                                          
{'loss': '0.1614', 'grad_norm': '3.037', 'learning_rate': '1.757e-05', 'epoch': '0.25'}

 25%|██▍       | 9490/37963 [22:48:46<66:32:07,  8.41s/it]
 25%|██▌       | 9491/37963 [22:48:59<79:26:31, 10.04s/it]
 25%|██▌       | 9492/37963 [22:49:07<73:26:27,  9.29s/it]
 25%|██▌       | 9493/37963 [22:49:15<69:23:58,  8.78s/it]
 25%|██▌       | 9494/37963 [22:49:28<81:18:19, 10.28s/it]
 25%|██▌       | 9495/37963 [22:49:36<74:48:19,  9.46s/it]
 25%|██▌       | 9496/37963 [22:49:43<70:10:52,  8.88s/it]
 25%|██▌       | 9497/37963 [22:49:51<67:07:19,  8.49s/it]
 25%|██▌       | 9498/37963 [22:49:58<64:32:26,  8.16s/it]
 25%|██▌       | 9499/37963 [22:50:06<63:01:18,  7.97s/it]
 25%|██▌       | 9500/37963 [22:50:13<62:09:20,  7.86s/it]
                                                          
{'loss': '0.1572', 'grad_norm': '1.381', 'learning_rate': '1.756e-05', 'epoch': '0.2502'}

 25%|██▌       | 9500/37963 [22:50:13<62:09:20,  7.86s/it]
 25%|██▌       | 9501/37963 [22:50:21<61:24:19,  7.77s/it]
 25%|██▌       | 9502/37963 [22:50:29<60:48:46,  7.69s/it]
 25%|██▌       | 9503/37963 [22:50:42<75:24:31,  9.54s/it]
 25%|██▌       | 9504/37963 [22:50:50<70:52:28,  8.97s/it]
 25%|██▌       | 9505/37963 [22:50:58<67:31:08,  8.54s/it]
 25%|██▌       | 9506/37963 [22:51:05<64:36:20,  8.17s/it]
 25%|██▌       | 9507/37963 [22:51:12<63:11:50,  8.00s/it]
 25%|██▌       | 9508/37963 [22:51:20<62:06:56,  7.86s/it]
 25%|██▌       | 9509/37963 [22:51:28<61:31:20,  7.78s/it]
 25%|██▌       | 9510/37963 [22:51:35<61:07:48,  7.73s/it]
                                                          
{'loss': '0.1665', 'grad_norm': '1.121', 'learning_rate': '1.756e-05', 'epoch': '0.2505'}

 25%|██▌       | 9510/37963 [22:51:35<61:07:48,  7.73s/it]
 25%|██▌       | 9511/37963 [22:51:43<60:42:00,  7.68s/it]
 25%|██▌       | 9512/37963 [22:52:03<91:01:02, 11.52s/it]
 25%|██▌       | 9513/37963 [22:52:11<81:51:20, 10.36s/it]
 25%|██▌       | 9514/37963 [22:52:18<75:06:28,  9.50s/it]
 25%|██▌       | 9515/37963 [22:52:26<70:12:07,  8.88s/it]
 25%|██▌       | 9516/37963 [22:52:33<67:12:45,  8.51s/it]
 25%|██▌       | 9517/37963 [22:52:41<64:57:32,  8.22s/it]
 25%|██▌       | 9518/37963 [22:52:49<63:09:27,  7.99s/it]
 25%|██▌       | 9519/37963 [22:52:56<62:14:09,  7.88s/it]
 25%|██▌       | 9520/37963 [22:53:03<60:26:11,  7.65s/it]
                                                          
{'loss': '0.1634', 'grad_norm': '2.675', 'learning_rate': '1.755e-05', 'epoch': '0.2508'}

 25%|██▌       | 9520/37963 [22:53:03<60:26:11,  7.65s/it]
 25%|██▌       | 9521/37963 [22:53:11<59:41:47,  7.56s/it]
 25%|██▌       | 9522/37963 [22:53:18<59:32:29,  7.54s/it]
 25%|██▌       | 9523/37963 [22:53:26<59:29:00,  7.53s/it]
 25%|██▌       | 9524/37963 [22:53:39<74:12:06,  9.39s/it]
 25%|██▌       | 9525/37963 [22:53:47<69:46:23,  8.83s/it]
 25%|██▌       | 9526/37963 [22:53:54<66:20:24,  8.40s/it]
 25%|██▌       | 9527/37963 [22:54:02<64:25:04,  8.16s/it]
 25%|██▌       | 9528/37963 [22:54:09<63:08:04,  7.99s/it]
 25%|██▌       | 9529/37963 [22:54:17<62:00:24,  7.85s/it]
 25%|██▌       | 9530/37963 [22:54:30<75:26:09,  9.55s/it]
                                                          
{'loss': '0.1757', 'grad_norm': '5.764', 'learning_rate': '1.755e-05', 'epoch': '0.251'}

 25%|██▌       | 9530/37963 [22:54:30<75:26:09,  9.55s/it]
 25%|██▌       | 9531/37963 [22:54:38<70:33:34,  8.93s/it]
 25%|██▌       | 9532/37963 [22:54:45<67:10:02,  8.50s/it]
 25%|██▌       | 9533/37963 [22:54:59<79:51:30, 10.11s/it]
 25%|██▌       | 9534/37963 [22:55:07<73:21:36,  9.29s/it]
 25%|██▌       | 9535/37963 [22:55:14<69:08:42,  8.76s/it]
 25%|██▌       | 9536/37963 [22:55:22<65:59:51,  8.36s/it]
 25%|██▌       | 9537/37963 [22:55:29<64:00:15,  8.11s/it]
 25%|██▌       | 9538/37963 [22:55:36<61:51:32,  7.83s/it]
 25%|██▌       | 9539/37963 [22:55:44<61:05:15,  7.74s/it]
 25%|██▌       | 9540/37963 [22:55:51<60:36:11,  7.68s/it]
                                                          
{'loss': '0.1686', 'grad_norm': '1.253', 'learning_rate': '1.754e-05', 'epoch': '0.2513'}

 25%|██▌       | 9540/37963 [22:55:51<60:36:11,  7.68s/it]
 25%|██▌       | 9541/37963 [22:55:59<60:02:19,  7.60s/it]
 25%|██▌       | 9542/37963 [22:56:06<59:43:14,  7.56s/it]
 25%|██▌       | 9543/37963 [22:56:20<74:22:10,  9.42s/it]
 25%|██▌       | 9544/37963 [22:56:28<70:01:40,  8.87s/it]
 25%|██▌       | 9545/37963 [22:56:42<82:38:18, 10.47s/it]
 25%|██▌       | 9546/37963 [22:56:49<74:54:14,  9.49s/it]
 25%|██▌       | 9547/37963 [22:56:57<70:12:02,  8.89s/it]
 25%|██▌       | 9548/37963 [22:57:04<66:54:49,  8.48s/it]
 25%|██▌       | 9549/37963 [22:57:11<63:56:00,  8.10s/it]
 25%|██▌       | 9550/37963 [22:57:19<62:34:19,  7.93s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '1.409', 'learning_rate': '1.753e-05', 'epoch': '0.2516'}

 25%|██▌       | 9550/37963 [22:57:19<62:34:19,  7.93s/it]
 25%|██▌       | 9551/37963 [22:57:26<61:08:01,  7.75s/it]
 25%|██▌       | 9552/37963 [22:57:34<60:40:54,  7.69s/it]
 25%|██▌       | 9553/37963 [22:57:41<60:26:03,  7.66s/it]
 25%|██▌       | 9554/37963 [22:57:49<60:10:59,  7.63s/it]
 25%|██▌       | 9555/37963 [22:57:56<59:46:45,  7.58s/it]
 25%|██▌       | 9556/37963 [22:58:11<75:38:33,  9.59s/it]
 25%|██▌       | 9557/37963 [22:58:18<70:29:17,  8.93s/it]
 25%|██▌       | 9558/37963 [22:58:26<67:14:55,  8.52s/it]
 25%|██▌       | 9559/37963 [22:58:33<65:10:09,  8.26s/it]
 25%|██▌       | 9560/37963 [22:58:48<79:32:54, 10.08s/it]
                                                          
{'loss': '0.1642', 'grad_norm': '4.919', 'learning_rate': '1.753e-05', 'epoch': '0.2518'}

 25%|██▌       | 9560/37963 [22:58:48<79:32:54, 10.08s/it]
 25%|██▌       | 9561/37963 [22:58:55<74:24:35,  9.43s/it]
 25%|██▌       | 9562/37963 [22:59:10<86:01:24, 10.90s/it]
 25%|██▌       | 9563/37963 [22:59:17<77:57:22,  9.88s/it]
 25%|██▌       | 9564/37963 [22:59:25<72:10:39,  9.15s/it]
 25%|██▌       | 9565/37963 [22:59:32<68:03:32,  8.63s/it]
 25%|██▌       | 9566/37963 [22:59:40<65:57:42,  8.36s/it]
 25%|██▌       | 9567/37963 [22:59:47<64:04:58,  8.12s/it]
 25%|██▌       | 9568/37963 [22:59:55<62:52:10,  7.97s/it]
 25%|██▌       | 9569/37963 [23:00:02<61:27:29,  7.79s/it]
 25%|██▌       | 9570/37963 [23:00:10<60:56:04,  7.73s/it]
                                                          
{'loss': '0.1587', 'grad_norm': '3.194', 'learning_rate': '1.752e-05', 'epoch': '0.2521'}

 25%|██▌       | 9570/37963 [23:00:10<60:56:04,  7.73s/it]
 25%|██▌       | 9571/37963 [23:00:17<60:16:20,  7.64s/it]
 25%|██▌       | 9572/37963 [23:00:31<74:56:29,  9.50s/it]
 25%|██▌       | 9573/37963 [23:00:39<70:43:24,  8.97s/it]
 25%|██▌       | 9574/37963 [23:00:47<67:21:49,  8.54s/it]
 25%|██▌       | 9575/37963 [23:00:54<65:01:48,  8.25s/it]
 25%|██▌       | 9576/37963 [23:01:02<63:37:55,  8.07s/it]
 25%|██▌       | 9577/37963 [23:01:09<62:40:59,  7.95s/it]
 25%|██▌       | 9578/37963 [23:01:23<76:07:23,  9.65s/it]
 25%|██▌       | 9579/37963 [23:01:31<71:06:07,  9.02s/it]
 25%|██▌       | 9580/37963 [23:01:38<67:50:34,  8.60s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '2.316', 'learning_rate': '1.752e-05', 'epoch': '0.2524'}

 25%|██▌       | 9580/37963 [23:01:38<67:50:34,  8.60s/it]
 25%|██▌       | 9581/37963 [23:01:46<64:40:46,  8.20s/it]
 25%|██▌       | 9582/37963 [23:01:53<62:38:38,  7.95s/it]
 25%|██▌       | 9583/37963 [23:02:07<76:56:19,  9.76s/it]
 25%|██▌       | 9584/37963 [23:02:14<71:44:50,  9.10s/it]
 25%|██▌       | 9585/37963 [23:02:22<68:01:40,  8.63s/it]
 25%|██▌       | 9586/37963 [23:02:29<65:25:41,  8.30s/it]
 25%|██▌       | 9587/37963 [23:02:37<63:38:02,  8.07s/it]
 25%|██▌       | 9588/37963 [23:02:45<62:23:01,  7.91s/it]
 25%|██▌       | 9589/37963 [23:02:52<61:40:42,  7.83s/it]
 25%|██▌       | 9590/37963 [23:03:00<61:03:19,  7.75s/it]
                                                          
{'loss': '0.1692', 'grad_norm': '1.492', 'learning_rate': '1.751e-05', 'epoch': '0.2526'}

 25%|██▌       | 9590/37963 [23:03:00<61:03:19,  7.75s/it]
 25%|██▌       | 9591/37963 [23:03:07<60:34:56,  7.69s/it]
 25%|██▌       | 9592/37963 [23:03:28<91:06:37, 11.56s/it]
 25%|██▌       | 9593/37963 [23:03:35<81:35:04, 10.35s/it]
 25%|██▌       | 9594/37963 [23:03:43<74:50:20,  9.50s/it]
 25%|██▌       | 9595/37963 [23:03:50<70:17:26,  8.92s/it]
 25%|██▌       | 9596/37963 [23:03:58<67:13:06,  8.53s/it]
 25%|██▌       | 9597/37963 [23:04:06<64:56:21,  8.24s/it]
 25%|██▌       | 9598/37963 [23:04:13<63:14:27,  8.03s/it]
 25%|██▌       | 9599/37963 [23:04:21<61:58:13,  7.87s/it]
 25%|██▌       | 9600/37963 [23:04:28<61:02:46,  7.75s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '4.861', 'learning_rate': '1.751e-05', 'epoch': '0.2529'}

 25%|██▌       | 9600/37963 [23:04:28<61:02:46,  7.75s/it]
 25%|██▌       | 9601/37963 [23:04:36<60:18:46,  7.66s/it]
 25%|██▌       | 9602/37963 [23:04:43<59:17:14,  7.53s/it]
 25%|██▌       | 9603/37963 [23:04:50<59:13:25,  7.52s/it]
 25%|██▌       | 9604/37963 [23:05:04<73:58:59,  9.39s/it]
 25%|██▌       | 9605/37963 [23:05:12<70:00:54,  8.89s/it]
 25%|██▌       | 9606/37963 [23:05:19<66:49:21,  8.48s/it]
 25%|██▌       | 9607/37963 [23:05:33<79:20:15, 10.07s/it]
 25%|██▌       | 9608/37963 [23:05:47<88:14:57, 11.20s/it]
 25%|██▌       | 9609/37963 [23:05:55<79:48:35, 10.13s/it]
 25%|██▌       | 9610/37963 [23:06:02<73:34:38,  9.34s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '4.899', 'learning_rate': '1.75e-05', 'epoch': '0.2531'}

 25%|██▌       | 9610/37963 [23:06:02<73:34:38,  9.34s/it]
 25%|██▌       | 9611/37963 [23:06:10<69:30:51,  8.83s/it]
 25%|██▌       | 9612/37963 [23:06:17<66:03:44,  8.39s/it]
 25%|██▌       | 9613/37963 [23:06:25<64:32:16,  8.20s/it]
 25%|██▌       | 9614/37963 [23:06:32<62:32:35,  7.94s/it]
 25%|██▌       | 9615/37963 [23:06:40<61:39:46,  7.83s/it]
 25%|██▌       | 9616/37963 [23:06:47<61:00:19,  7.75s/it]
 25%|██▌       | 9617/37963 [23:06:55<60:25:55,  7.67s/it]
 25%|██▌       | 9618/37963 [23:07:02<60:12:56,  7.65s/it]
 25%|██▌       | 9619/37963 [23:07:10<59:52:35,  7.60s/it]
 25%|██▌       | 9620/37963 [23:07:24<74:56:59,  9.52s/it]
                                                          
{'loss': '0.1769', 'grad_norm': '2.858', 'learning_rate': '1.75e-05', 'epoch': '0.2534'}

 25%|██▌       | 9620/37963 [23:07:24<74:56:59,  9.52s/it]
 25%|██▌       | 9621/37963 [23:07:31<70:12:05,  8.92s/it]
 25%|██▌       | 9622/37963 [23:07:39<66:54:40,  8.50s/it]
 25%|██▌       | 9623/37963 [23:07:46<64:40:01,  8.21s/it]
 25%|██▌       | 9624/37963 [23:07:54<62:41:57,  7.96s/it]
 25%|██▌       | 9625/37963 [23:08:08<77:20:31,  9.83s/it]
 25%|██▌       | 9626/37963 [23:08:16<72:12:25,  9.17s/it]
 25%|██▌       | 9627/37963 [23:08:23<67:46:36,  8.61s/it]
 25%|██▌       | 9628/37963 [23:08:31<65:18:40,  8.30s/it]
 25%|██▌       | 9629/37963 [23:08:38<63:26:24,  8.06s/it]
 25%|██▌       | 9630/37963 [23:08:46<62:11:56,  7.90s/it]
                                                          
{'loss': '0.1666', 'grad_norm': '4.259', 'learning_rate': '1.749e-05', 'epoch': '0.2537'}

 25%|██▌       | 9630/37963 [23:08:46<62:11:56,  7.90s/it]
 25%|██▌       | 9631/37963 [23:08:53<61:24:58,  7.80s/it]
 25%|██▌       | 9632/37963 [23:09:07<76:21:12,  9.70s/it]
 25%|██▌       | 9633/37963 [23:09:15<70:36:37,  8.97s/it]
 25%|██▌       | 9634/37963 [23:09:22<67:02:28,  8.52s/it]
 25%|██▌       | 9635/37963 [23:09:30<64:50:10,  8.24s/it]
 25%|██▌       | 9636/37963 [23:09:37<63:08:14,  8.02s/it]
 25%|██▌       | 9637/37963 [23:09:45<61:55:15,  7.87s/it]
 25%|██▌       | 9638/37963 [23:09:52<60:50:53,  7.73s/it]
 25%|██▌       | 9639/37963 [23:10:06<75:24:35,  9.58s/it]
 25%|██▌       | 9640/37963 [23:10:14<70:52:31,  9.01s/it]
                                                          
{'loss': '0.1734', 'grad_norm': '1.047', 'learning_rate': '1.748e-05', 'epoch': '0.2539'}

 25%|██▌       | 9640/37963 [23:10:14<70:52:31,  9.01s/it]
 25%|██▌       | 9641/37963 [23:10:27<81:57:36, 10.42s/it]
 25%|██▌       | 9642/37963 [23:10:35<75:23:05,  9.58s/it]
 25%|██▌       | 9643/37963 [23:10:43<70:42:53,  8.99s/it]
 25%|██▌       | 9644/37963 [23:10:50<67:14:32,  8.55s/it]
 25%|██▌       | 9645/37963 [23:10:57<64:17:14,  8.17s/it]
 25%|██▌       | 9646/37963 [23:11:05<62:59:51,  8.01s/it]
 25%|██▌       | 9647/37963 [23:11:13<61:48:17,  7.86s/it]
 25%|██▌       | 9648/37963 [23:11:20<61:38:25,  7.84s/it]
 25%|██▌       | 9649/37963 [23:11:28<60:55:13,  7.75s/it]
 25%|██▌       | 9650/37963 [23:11:35<60:21:54,  7.68s/it]
                                                          
{'loss': '0.1529', 'grad_norm': '2.983', 'learning_rate': '1.748e-05', 'epoch': '0.2542'}

 25%|██▌       | 9650/37963 [23:11:35<60:21:54,  7.68s/it]
 25%|██▌       | 9651/37963 [23:11:43<59:40:09,  7.59s/it]
 25%|██▌       | 9652/37963 [23:11:50<59:38:01,  7.58s/it]
 25%|██▌       | 9653/37963 [23:11:58<59:23:18,  7.55s/it]
 25%|██▌       | 9654/37963 [23:12:05<59:24:05,  7.55s/it]
 25%|██▌       | 9655/37963 [23:12:19<74:48:39,  9.51s/it]
 25%|██▌       | 9656/37963 [23:12:27<70:05:18,  8.91s/it]
 25%|██▌       | 9657/37963 [23:12:41<82:41:27, 10.52s/it]
 25%|██▌       | 9658/37963 [23:12:55<91:04:49, 11.58s/it]
 25%|██▌       | 9659/37963 [23:13:03<81:27:01, 10.36s/it]
 25%|██▌       | 9660/37963 [23:13:10<74:35:03,  9.49s/it]
                                                          
{'loss': '0.1623', 'grad_norm': '1.973', 'learning_rate': '1.747e-05', 'epoch': '0.2545'}

 25%|██▌       | 9660/37963 [23:13:10<74:35:03,  9.49s/it]
 25%|██▌       | 9661/37963 [23:13:18<69:37:44,  8.86s/it]
 25%|██▌       | 9662/37963 [23:13:25<66:33:29,  8.47s/it]
 25%|██▌       | 9663/37963 [23:13:33<64:19:07,  8.18s/it]
 25%|██▌       | 9664/37963 [23:13:40<62:54:11,  8.00s/it]
 25%|██▌       | 9665/37963 [23:13:48<61:45:28,  7.86s/it]
 25%|██▌       | 9666/37963 [23:13:55<60:45:38,  7.73s/it]
 25%|██▌       | 9667/37963 [23:14:03<60:15:43,  7.67s/it]
 25%|██▌       | 9668/37963 [23:14:11<60:31:00,  7.70s/it]
 25%|██▌       | 9669/37963 [23:14:25<75:22:13,  9.59s/it]
 25%|██▌       | 9670/37963 [23:14:32<70:39:04,  8.99s/it]
                                                          
{'loss': '0.1631', 'grad_norm': '4.898', 'learning_rate': '1.747e-05', 'epoch': '0.2547'}

 25%|██▌       | 9670/37963 [23:14:32<70:39:04,  8.99s/it]
 25%|██▌       | 9671/37963 [23:14:40<67:22:15,  8.57s/it]
 25%|██▌       | 9672/37963 [23:14:47<65:09:16,  8.29s/it]
 25%|██▌       | 9673/37963 [23:14:55<63:24:27,  8.07s/it]
 25%|██▌       | 9674/37963 [23:15:09<77:04:51,  9.81s/it]
 25%|██▌       | 9675/37963 [23:15:16<71:55:08,  9.15s/it]
 25%|██▌       | 9676/37963 [23:15:31<84:03:49, 10.70s/it]
 25%|██▌       | 9677/37963 [23:15:38<76:12:13,  9.70s/it]
 25%|██▌       | 9678/37963 [23:15:46<71:11:19,  9.06s/it]
 25%|██▌       | 9679/37963 [23:15:53<67:25:41,  8.58s/it]
 25%|██▌       | 9680/37963 [23:16:01<65:01:46,  8.28s/it]
                                                          
{'loss': '0.1652', 'grad_norm': '1.273', 'learning_rate': '1.746e-05', 'epoch': '0.255'}

 25%|██▌       | 9680/37963 [23:16:01<65:01:46,  8.28s/it]
 26%|██▌       | 9681/37963 [23:16:08<63:37:43,  8.10s/it]
 26%|██▌       | 9682/37963 [23:16:16<62:26:32,  7.95s/it]
 26%|██▌       | 9683/37963 [23:16:23<61:24:01,  7.82s/it]
 26%|██▌       | 9684/37963 [23:16:31<61:03:18,  7.77s/it]
 26%|██▌       | 9685/37963 [23:16:39<60:56:54,  7.76s/it]
 26%|██▌       | 9686/37963 [23:16:46<60:20:08,  7.68s/it]
 26%|██▌       | 9687/37963 [23:17:00<75:09:33,  9.57s/it]
 26%|██▌       | 9688/37963 [23:17:08<70:31:08,  8.98s/it]
 26%|██▌       | 9689/37963 [23:17:22<82:48:18, 10.54s/it]
 26%|██▌       | 9690/37963 [23:17:30<75:36:31,  9.63s/it]
                                                          
{'loss': '0.1741', 'grad_norm': '4.574', 'learning_rate': '1.746e-05', 'epoch': '0.2552'}

 26%|██▌       | 9690/37963 [23:17:30<75:36:31,  9.63s/it]
 26%|██▌       | 9691/37963 [23:17:37<70:17:40,  8.95s/it]
 26%|██▌       | 9692/37963 [23:17:44<66:16:16,  8.44s/it]
 26%|██▌       | 9693/37963 [23:17:52<64:27:36,  8.21s/it]
 26%|██▌       | 9694/37963 [23:17:59<62:57:54,  8.02s/it]
 26%|██▌       | 9695/37963 [23:18:07<61:45:28,  7.87s/it]
 26%|██▌       | 9696/37963 [23:18:15<61:08:24,  7.79s/it]
 26%|██▌       | 9697/37963 [23:18:22<60:31:05,  7.71s/it]
 26%|██▌       | 9698/37963 [23:18:30<60:13:59,  7.67s/it]
 26%|██▌       | 9699/37963 [23:18:37<59:32:25,  7.58s/it]
 26%|██▌       | 9700/37963 [23:18:45<59:25:48,  7.57s/it]
                                                          
{'loss': '0.1713', 'grad_norm': '1.206', 'learning_rate': '1.745e-05', 'epoch': '0.2555'}

 26%|██▌       | 9700/37963 [23:18:45<59:25:48,  7.57s/it]
 26%|██▌       | 9701/37963 [23:18:52<59:20:19,  7.56s/it]
 26%|██▌       | 9702/37963 [23:19:00<59:17:40,  7.55s/it]
 26%|██▌       | 9703/37963 [23:19:13<73:30:11,  9.36s/it]
 26%|██▌       | 9704/37963 [23:19:21<69:26:28,  8.85s/it]
 26%|██▌       | 9705/37963 [23:19:28<66:26:00,  8.46s/it]
 26%|██▌       | 9706/37963 [23:19:36<64:08:10,  8.17s/it]
 26%|██▌       | 9707/37963 [23:19:43<62:33:38,  7.97s/it]
 26%|██▌       | 9708/37963 [23:19:58<77:47:45,  9.91s/it]
 26%|██▌       | 9709/37963 [23:20:12<87:29:33, 11.15s/it]
 26%|██▌       | 9710/37963 [23:20:20<79:22:37, 10.11s/it]
                                                          
{'loss': '0.1496', 'grad_norm': '2.116', 'learning_rate': '1.744e-05', 'epoch': '0.2558'}

 26%|██▌       | 9710/37963 [23:20:20<79:22:37, 10.11s/it]
 26%|██▌       | 9711/37963 [23:20:27<73:30:28,  9.37s/it]
 26%|██▌       | 9712/37963 [23:20:41<84:52:58, 10.82s/it]
 26%|██▌       | 9713/37963 [23:20:49<77:00:07,  9.81s/it]
 26%|██▌       | 9714/37963 [23:20:56<71:40:46,  9.13s/it]
 26%|██▌       | 9715/37963 [23:21:04<68:08:42,  8.68s/it]
 26%|██▌       | 9716/37963 [23:21:12<65:41:03,  8.37s/it]
 26%|██▌       | 9717/37963 [23:21:19<63:44:32,  8.12s/it]
 26%|██▌       | 9718/37963 [23:21:27<62:24:45,  7.95s/it]
 26%|██▌       | 9719/37963 [23:21:34<61:33:02,  7.85s/it]
 26%|██▌       | 9720/37963 [23:21:48<75:59:04,  9.69s/it]
                                                          
{'loss': '0.1788', 'grad_norm': '1.333', 'learning_rate': '1.744e-05', 'epoch': '0.256'}

 26%|██▌       | 9720/37963 [23:21:48<75:59:04,  9.69s/it]
 26%|██▌       | 9721/37963 [23:21:56<70:31:45,  8.99s/it]
 26%|██▌       | 9722/37963 [23:22:03<66:47:11,  8.51s/it]
 26%|██▌       | 9723/37963 [23:22:17<79:29:36, 10.13s/it]
 26%|██▌       | 9724/37963 [23:22:24<72:58:57,  9.30s/it]
 26%|██▌       | 9725/37963 [23:22:32<69:18:16,  8.84s/it]
 26%|██▌       | 9726/37963 [23:22:40<66:00:45,  8.42s/it]
 26%|██▌       | 9727/37963 [23:22:47<64:04:31,  8.17s/it]
 26%|██▌       | 9728/37963 [23:22:55<62:34:12,  7.98s/it]
 26%|██▌       | 9729/37963 [23:23:02<61:32:41,  7.85s/it]
 26%|██▌       | 9730/37963 [23:23:10<60:39:01,  7.73s/it]
                                                          
{'loss': '0.1663', 'grad_norm': '2.495', 'learning_rate': '1.743e-05', 'epoch': '0.2563'}

 26%|██▌       | 9730/37963 [23:23:10<60:39:01,  7.73s/it]
 26%|██▌       | 9731/37963 [23:23:17<59:59:29,  7.65s/it]
 26%|██▌       | 9732/37963 [23:23:31<74:48:29,  9.54s/it]
 26%|██▌       | 9733/37963 [23:23:39<70:01:14,  8.93s/it]
 26%|██▌       | 9734/37963 [23:23:46<66:28:29,  8.48s/it]
 26%|██▌       | 9735/37963 [23:23:54<64:15:30,  8.20s/it]
 26%|██▌       | 9736/37963 [23:24:01<63:01:54,  8.04s/it]
 26%|██▌       | 9737/37963 [23:24:16<77:47:09,  9.92s/it]
 26%|██▌       | 9738/37963 [23:24:23<72:07:40,  9.20s/it]
 26%|██▌       | 9739/37963 [23:24:31<68:11:26,  8.70s/it]
 26%|██▌       | 9740/37963 [23:24:38<65:25:56,  8.35s/it]
                                                          
{'loss': '0.1649', 'grad_norm': '2.768', 'learning_rate': '1.743e-05', 'epoch': '0.2566'}

 26%|██▌       | 9740/37963 [23:24:38<65:25:56,  8.35s/it]
 26%|██▌       | 9741/37963 [23:24:46<62:56:51,  8.03s/it]
 26%|██▌       | 9742/37963 [23:24:53<62:02:39,  7.91s/it]
 26%|██▌       | 9743/37963 [23:25:01<61:05:02,  7.79s/it]
 26%|██▌       | 9744/37963 [23:25:08<60:35:27,  7.73s/it]
 26%|██▌       | 9745/37963 [23:25:16<60:24:49,  7.71s/it]
 26%|██▌       | 9746/37963 [23:25:23<59:58:55,  7.65s/it]
 26%|██▌       | 9747/37963 [23:25:31<59:35:52,  7.60s/it]
 26%|██▌       | 9748/37963 [23:25:39<59:44:37,  7.62s/it]
 26%|██▌       | 9749/37963 [23:25:46<58:42:01,  7.49s/it]
 26%|██▌       | 9750/37963 [23:25:53<58:43:24,  7.49s/it]
                                                          
{'loss': '0.1474', 'grad_norm': '1.356', 'learning_rate': '1.742e-05', 'epoch': '0.2568'}

 26%|██▌       | 9750/37963 [23:25:53<58:43:24,  7.49s/it]
 26%|██▌       | 9751/37963 [23:26:01<58:46:32,  7.50s/it]
 26%|██▌       | 9752/37963 [23:26:08<58:19:54,  7.44s/it]
 26%|██▌       | 9753/37963 [23:26:16<58:22:55,  7.45s/it]
 26%|██▌       | 9754/37963 [23:26:23<58:43:26,  7.49s/it]
 26%|██▌       | 9755/37963 [23:26:31<58:41:31,  7.49s/it]
 26%|██▌       | 9756/37963 [23:26:38<59:02:06,  7.53s/it]
 26%|██▌       | 9757/37963 [23:26:52<73:29:44,  9.38s/it]
 26%|██▌       | 9758/37963 [23:27:12<98:33:13, 12.58s/it]
 26%|██▌       | 9759/37963 [23:27:20<86:45:27, 11.07s/it]
 26%|██▌       | 9760/37963 [23:27:34<93:27:54, 11.93s/it]
                                                          
{'loss': '0.153', 'grad_norm': '3.684', 'learning_rate': '1.742e-05', 'epoch': '0.2571'}

 26%|██▌       | 9760/37963 [23:27:34<93:27:54, 11.93s/it]
 26%|██▌       | 9761/37963 [23:27:41<83:11:09, 10.62s/it]
 26%|██▌       | 9762/37963 [23:27:49<75:56:19,  9.69s/it]
 26%|██▌       | 9763/37963 [23:27:56<69:35:32,  8.88s/it]
 26%|██▌       | 9764/37963 [23:28:03<66:25:43,  8.48s/it]
 26%|██▌       | 9765/37963 [23:28:11<64:22:50,  8.22s/it]
 26%|██▌       | 9766/37963 [23:28:18<62:22:22,  7.96s/it]
 26%|██▌       | 9767/37963 [23:28:26<61:27:32,  7.85s/it]
 26%|██▌       | 9768/37963 [23:28:33<60:56:44,  7.78s/it]
 26%|██▌       | 9769/37963 [23:28:47<75:49:50,  9.68s/it]
 26%|██▌       | 9770/37963 [23:28:55<70:54:05,  9.05s/it]
                                                          
{'loss': '0.1426', 'grad_norm': '1.805', 'learning_rate': '1.741e-05', 'epoch': '0.2574'}

 26%|██▌       | 9770/37963 [23:28:55<70:54:05,  9.05s/it]
 26%|██▌       | 9771/37963 [23:29:09<82:53:39, 10.59s/it]
 26%|██▌       | 9772/37963 [23:29:17<75:53:54,  9.69s/it]
 26%|██▌       | 9773/37963 [23:29:24<70:55:23,  9.06s/it]
 26%|██▌       | 9774/37963 [23:29:32<67:19:54,  8.60s/it]
 26%|██▌       | 9775/37963 [23:29:40<65:08:14,  8.32s/it]
 26%|██▌       | 9776/37963 [23:29:47<63:23:47,  8.10s/it]
 26%|██▌       | 9777/37963 [23:29:55<62:14:15,  7.95s/it]
 26%|██▌       | 9778/37963 [23:30:02<61:04:25,  7.80s/it]
 26%|██▌       | 9779/37963 [23:30:16<75:45:44,  9.68s/it]
 26%|██▌       | 9780/37963 [23:30:24<71:04:46,  9.08s/it]
                                                          
{'loss': '0.166', 'grad_norm': '1.821', 'learning_rate': '1.74e-05', 'epoch': '0.2576'}

 26%|██▌       | 9780/37963 [23:30:24<71:04:46,  9.08s/it]
 26%|██▌       | 9781/37963 [23:30:31<67:22:10,  8.61s/it]
 26%|██▌       | 9782/37963 [23:30:39<64:43:13,  8.27s/it]
 26%|██▌       | 9783/37963 [23:30:46<62:54:41,  8.04s/it]
 26%|██▌       | 9784/37963 [23:30:54<61:45:20,  7.89s/it]
 26%|██▌       | 9785/37963 [23:31:01<59:24:50,  7.59s/it]
 26%|██▌       | 9786/37963 [23:31:08<58:47:30,  7.51s/it]
 26%|██▌       | 9787/37963 [23:31:22<74:29:47,  9.52s/it]
 26%|██▌       | 9788/37963 [23:31:30<70:04:56,  8.95s/it]
 26%|██▌       | 9789/37963 [23:31:38<66:39:39,  8.52s/it]
 26%|██▌       | 9790/37963 [23:31:45<64:13:41,  8.21s/it]
                                                          
{'loss': '0.1556', 'grad_norm': '2.07', 'learning_rate': '1.74e-05', 'epoch': '0.2579'}

 26%|██▌       | 9790/37963 [23:31:45<64:13:41,  8.21s/it]
 26%|██▌       | 9791/37963 [23:31:53<62:42:02,  8.01s/it]
 26%|██▌       | 9792/37963 [23:32:00<61:20:17,  7.84s/it]
 26%|██▌       | 9793/37963 [23:32:08<60:42:15,  7.76s/it]
 26%|██▌       | 9794/37963 [23:32:15<59:41:53,  7.63s/it]
 26%|██▌       | 9795/37963 [23:32:22<59:28:32,  7.60s/it]
 26%|██▌       | 9796/37963 [23:32:30<58:50:18,  7.52s/it]
 26%|██▌       | 9797/37963 [23:32:37<59:02:33,  7.55s/it]
 26%|██▌       | 9798/37963 [23:32:45<59:00:17,  7.54s/it]
 26%|██▌       | 9799/37963 [23:32:52<58:46:17,  7.51s/it]
 26%|██▌       | 9800/37963 [23:33:00<58:53:16,  7.53s/it]
                                                          
{'loss': '0.1667', 'grad_norm': '2.865', 'learning_rate': '1.739e-05', 'epoch': '0.2581'}

 26%|██▌       | 9800/37963 [23:33:00<58:53:16,  7.53s/it]
 26%|██▌       | 9801/37963 [23:33:07<58:51:09,  7.52s/it]
 26%|██▌       | 9802/37963 [23:33:15<58:09:23,  7.43s/it]
 26%|██▌       | 9803/37963 [23:33:29<73:14:46,  9.36s/it]
 26%|██▌       | 9804/37963 [23:33:43<84:16:06, 10.77s/it]
 26%|██▌       | 9805/37963 [23:33:50<76:33:43,  9.79s/it]
 26%|██▌       | 9806/37963 [23:33:57<70:17:34,  8.99s/it]
 26%|██▌       | 9807/37963 [23:34:05<66:38:36,  8.52s/it]
 26%|██▌       | 9808/37963 [23:34:19<79:31:05, 10.17s/it]
 26%|██▌       | 9809/37963 [23:34:26<73:07:34,  9.35s/it]
 26%|██▌       | 9810/37963 [23:34:34<69:01:14,  8.83s/it]
                                                          
{'loss': '0.1579', 'grad_norm': '4.197', 'learning_rate': '1.739e-05', 'epoch': '0.2584'}

 26%|██▌       | 9810/37963 [23:34:34<69:01:14,  8.83s/it]
 26%|██▌       | 9811/37963 [23:34:47<80:18:00, 10.27s/it]
 26%|██▌       | 9812/37963 [23:34:55<73:36:19,  9.41s/it]
 26%|██▌       | 9813/37963 [23:35:02<68:58:34,  8.82s/it]
 26%|██▌       | 9814/37963 [23:35:10<65:47:25,  8.41s/it]
 26%|██▌       | 9815/37963 [23:35:17<63:46:26,  8.16s/it]
 26%|██▌       | 9816/37963 [23:35:25<62:02:56,  7.94s/it]
 26%|██▌       | 9817/37963 [23:35:32<61:17:37,  7.84s/it]
 26%|██▌       | 9818/37963 [23:35:46<75:31:46,  9.66s/it]
 26%|██▌       | 9819/37963 [23:35:54<71:03:18,  9.09s/it]
 26%|██▌       | 9820/37963 [23:36:08<83:04:39, 10.63s/it]
                                                          
{'loss': '0.1515', 'grad_norm': '2.291', 'learning_rate': '1.738e-05', 'epoch': '0.2587'}

 26%|██▌       | 9820/37963 [23:36:08<83:04:39, 10.63s/it]
 26%|██▌       | 9821/37963 [23:36:16<75:42:03,  9.68s/it]
 26%|██▌       | 9822/37963 [23:36:23<70:52:07,  9.07s/it]
 26%|██▌       | 9823/37963 [23:36:31<67:12:14,  8.60s/it]
 26%|██▌       | 9824/37963 [23:36:38<64:47:30,  8.29s/it]
 26%|██▌       | 9825/37963 [23:36:52<78:36:06, 10.06s/it]
 26%|██▌       | 9826/37963 [23:37:00<72:42:46,  9.30s/it]
 26%|██▌       | 9827/37963 [23:37:08<68:41:15,  8.79s/it]
 26%|██▌       | 9828/37963 [23:37:15<65:41:16,  8.41s/it]
 26%|██▌       | 9829/37963 [23:37:23<64:01:48,  8.19s/it]
 26%|██▌       | 9830/37963 [23:37:30<62:30:19,  8.00s/it]
                                                          
{'loss': '0.1656', 'grad_norm': '1.782', 'learning_rate': '1.738e-05', 'epoch': '0.2589'}

 26%|██▌       | 9830/37963 [23:37:30<62:30:19,  8.00s/it]
 26%|██▌       | 9831/37963 [23:37:38<61:26:47,  7.86s/it]
 26%|██▌       | 9832/37963 [23:37:45<60:20:50,  7.72s/it]
 26%|██▌       | 9833/37963 [23:37:53<60:06:42,  7.69s/it]
 26%|██▌       | 9834/37963 [23:38:00<59:35:55,  7.63s/it]
 26%|██▌       | 9835/37963 [23:38:08<58:39:33,  7.51s/it]
 26%|██▌       | 9836/37963 [23:38:15<58:38:09,  7.50s/it]
 26%|██▌       | 9837/37963 [23:38:23<58:43:58,  7.52s/it]
 26%|██▌       | 9838/37963 [23:38:30<58:31:53,  7.49s/it]
 26%|██▌       | 9839/37963 [23:38:38<58:33:35,  7.50s/it]
 26%|██▌       | 9840/37963 [23:38:52<73:35:48,  9.42s/it]
                                                          
{'loss': '0.1613', 'grad_norm': '2.249', 'learning_rate': '1.737e-05', 'epoch': '0.2592'}

 26%|██▌       | 9840/37963 [23:38:52<73:35:48,  9.42s/it]
 26%|██▌       | 9841/37963 [23:38:59<69:18:35,  8.87s/it]
 26%|██▌       | 9842/37963 [23:39:07<65:57:26,  8.44s/it]
 26%|██▌       | 9843/37963 [23:39:14<63:52:52,  8.18s/it]
 26%|██▌       | 9844/37963 [23:39:22<62:27:51,  8.00s/it]
 26%|██▌       | 9845/37963 [23:39:29<61:24:08,  7.86s/it]
 26%|██▌       | 9846/37963 [23:39:37<61:03:46,  7.82s/it]
 26%|██▌       | 9847/37963 [23:39:45<60:34:52,  7.76s/it]
 26%|██▌       | 9848/37963 [23:39:52<59:56:29,  7.68s/it]
 26%|██▌       | 9849/37963 [23:40:00<59:37:53,  7.64s/it]
 26%|██▌       | 9850/37963 [23:40:07<59:20:54,  7.60s/it]
                                                          
{'loss': '0.1619', 'grad_norm': '1.133', 'learning_rate': '1.736e-05', 'epoch': '0.2595'}

 26%|██▌       | 9850/37963 [23:40:07<59:20:54,  7.60s/it]
 26%|██▌       | 9851/37963 [23:40:15<59:07:46,  7.57s/it]
 26%|██▌       | 9852/37963 [23:40:29<74:21:02,  9.52s/it]
 26%|██▌       | 9853/37963 [23:40:36<69:19:39,  8.88s/it]
 26%|██▌       | 9854/37963 [23:40:44<66:20:33,  8.50s/it]
 26%|██▌       | 9855/37963 [23:40:51<64:17:28,  8.23s/it]
 26%|██▌       | 9856/37963 [23:41:12<93:25:47, 11.97s/it]
 26%|██▌       | 9857/37963 [23:41:20<83:06:17, 10.64s/it]
 26%|██▌       | 9858/37963 [23:41:27<75:53:57,  9.72s/it]
 26%|██▌       | 9859/37963 [23:41:35<70:46:47,  9.07s/it]
 26%|██▌       | 9860/37963 [23:41:48<81:54:35, 10.49s/it]
                                                          
{'loss': '0.1564', 'grad_norm': '2.864', 'learning_rate': '1.736e-05', 'epoch': '0.2597'}

 26%|██▌       | 9860/37963 [23:41:48<81:54:35, 10.49s/it]
 26%|██▌       | 9861/37963 [23:41:56<75:00:14,  9.61s/it]
 26%|██▌       | 9862/37963 [23:42:04<70:24:52,  9.02s/it]
 26%|██▌       | 9863/37963 [23:42:11<67:09:14,  8.60s/it]
 26%|██▌       | 9864/37963 [23:42:25<79:22:42, 10.17s/it]
 26%|██▌       | 9865/37963 [23:42:33<73:09:07,  9.37s/it]
 26%|██▌       | 9866/37963 [23:42:40<67:55:02,  8.70s/it]
 26%|██▌       | 9867/37963 [23:42:47<64:57:02,  8.32s/it]
 26%|██▌       | 9868/37963 [23:42:55<63:07:27,  8.09s/it]
 26%|██▌       | 9869/37963 [23:43:02<62:16:46,  7.98s/it]
 26%|██▌       | 9870/37963 [23:43:10<61:19:15,  7.86s/it]
                                                          
{'loss': '0.161', 'grad_norm': '1.472', 'learning_rate': '1.735e-05', 'epoch': '0.26'}

 26%|██▌       | 9870/37963 [23:43:10<61:19:15,  7.86s/it]
 26%|██▌       | 9871/37963 [23:43:17<59:56:16,  7.68s/it]
 26%|██▌       | 9872/37963 [23:43:31<74:10:02,  9.50s/it]
 26%|██▌       | 9873/37963 [23:43:45<84:42:22, 10.86s/it]
 26%|██▌       | 9874/37963 [23:43:52<76:24:23,  9.79s/it]
 26%|██▌       | 9875/37963 [23:44:00<71:14:08,  9.13s/it]
 26%|██▌       | 9876/37963 [23:44:07<67:13:31,  8.62s/it]
 26%|██▌       | 9877/37963 [23:44:15<64:38:41,  8.29s/it]
 26%|██▌       | 9878/37963 [23:44:23<63:09:47,  8.10s/it]
 26%|██▌       | 9879/37963 [23:44:30<62:03:44,  7.96s/it]
 26%|██▌       | 9880/37963 [23:44:38<60:52:43,  7.80s/it]
                                                          
{'loss': '0.1721', 'grad_norm': '0.9001', 'learning_rate': '1.735e-05', 'epoch': '0.2603'}

 26%|██▌       | 9880/37963 [23:44:38<60:52:43,  7.80s/it]
 26%|██▌       | 9881/37963 [23:44:45<60:06:16,  7.71s/it]
 26%|██▌       | 9882/37963 [23:44:53<59:46:11,  7.66s/it]
 26%|██▌       | 9883/37963 [23:45:00<59:51:41,  7.67s/it]
 26%|██▌       | 9884/37963 [23:45:08<59:19:13,  7.61s/it]
 26%|██▌       | 9885/37963 [23:45:15<59:11:31,  7.59s/it]
 26%|██▌       | 9886/37963 [23:45:23<58:37:39,  7.52s/it]
 26%|██▌       | 9887/37963 [23:45:30<58:55:06,  7.55s/it]
 26%|██▌       | 9888/37963 [23:45:38<59:12:28,  7.59s/it]
 26%|██▌       | 9889/37963 [23:45:52<74:19:06,  9.53s/it]
 26%|██▌       | 9890/37963 [23:45:59<69:17:39,  8.89s/it]
                                                          
{'loss': '0.1636', 'grad_norm': '0.8792', 'learning_rate': '1.734e-05', 'epoch': '0.2605'}

 26%|██▌       | 9890/37963 [23:45:59<69:17:39,  8.89s/it]
 26%|██▌       | 9891/37963 [23:46:07<66:23:38,  8.51s/it]
 26%|██▌       | 9892/37963 [23:46:14<63:38:19,  8.16s/it]
 26%|██▌       | 9893/37963 [23:46:22<62:08:47,  7.97s/it]
 26%|██▌       | 9894/37963 [23:46:29<60:58:56,  7.82s/it]
 26%|██▌       | 9895/37963 [23:46:37<60:23:19,  7.75s/it]
 26%|██▌       | 9896/37963 [23:46:45<60:03:50,  7.70s/it]
 26%|██▌       | 9897/37963 [23:46:52<59:42:34,  7.66s/it]
 26%|██▌       | 9898/37963 [23:47:00<59:23:49,  7.62s/it]
 26%|██▌       | 9899/37963 [23:47:07<59:12:21,  7.59s/it]
 26%|██▌       | 9900/37963 [23:47:15<58:54:35,  7.56s/it]
                                                          
{'loss': '0.1754', 'grad_norm': '2.799', 'learning_rate': '1.733e-05', 'epoch': '0.2608'}

 26%|██▌       | 9900/37963 [23:47:15<58:54:35,  7.56s/it]
 26%|██▌       | 9901/37963 [23:47:22<59:04:38,  7.58s/it]
 26%|██▌       | 9902/37963 [23:47:36<73:24:52,  9.42s/it]
 26%|██▌       | 9903/37963 [23:47:50<83:53:06, 10.76s/it]
 26%|██▌       | 9904/37963 [23:47:57<76:08:13,  9.77s/it]
 26%|██▌       | 9905/37963 [23:48:12<86:47:48, 11.14s/it]
 26%|██▌       | 9906/37963 [23:48:19<78:29:28, 10.07s/it]
 26%|██▌       | 9907/37963 [23:48:27<72:20:21,  9.28s/it]
 26%|██▌       | 9908/37963 [23:48:34<68:10:47,  8.75s/it]
 26%|██▌       | 9909/37963 [23:48:42<65:28:41,  8.40s/it]
 26%|██▌       | 9910/37963 [23:48:49<63:07:40,  8.10s/it]
                                                          
{'loss': '0.1723', 'grad_norm': '1.375', 'learning_rate': '1.733e-05', 'epoch': '0.261'}

 26%|██▌       | 9910/37963 [23:48:49<63:07:40,  8.10s/it]
 26%|██▌       | 9911/37963 [23:48:57<61:42:40,  7.92s/it]
 26%|██▌       | 9912/37963 [23:49:04<60:48:22,  7.80s/it]
 26%|██▌       | 9913/37963 [23:49:12<60:02:54,  7.71s/it]
 26%|██▌       | 9914/37963 [23:49:26<75:07:52,  9.64s/it]
 26%|██▌       | 9915/37963 [23:49:40<84:26:59, 10.84s/it]
 26%|██▌       | 9916/37963 [23:49:47<76:40:08,  9.84s/it]
 26%|██▌       | 9917/37963 [23:49:55<71:32:08,  9.18s/it]
 26%|██▌       | 9918/37963 [23:50:02<67:35:04,  8.68s/it]
 26%|██▌       | 9919/37963 [23:50:10<64:53:37,  8.33s/it]
 26%|██▌       | 9920/37963 [23:50:24<78:07:14, 10.03s/it]
                                                          
{'loss': '0.161', 'grad_norm': '0.9994', 'learning_rate': '1.732e-05', 'epoch': '0.2613'}

 26%|██▌       | 9920/37963 [23:50:24<78:07:14, 10.03s/it]
 26%|██▌       | 9921/37963 [23:50:31<71:31:25,  9.18s/it]
 26%|██▌       | 9922/37963 [23:50:38<67:31:12,  8.67s/it]
 26%|██▌       | 9923/37963 [23:50:46<64:47:15,  8.32s/it]
 26%|██▌       | 9924/37963 [23:50:54<63:12:47,  8.12s/it]
 26%|██▌       | 9925/37963 [23:51:07<75:59:13,  9.76s/it]
 26%|██▌       | 9926/37963 [23:51:15<70:45:12,  9.08s/it]
 26%|██▌       | 9927/37963 [23:51:22<66:55:59,  8.59s/it]
 26%|██▌       | 9928/37963 [23:51:29<63:42:37,  8.18s/it]
 26%|██▌       | 9929/37963 [23:51:37<62:05:46,  7.97s/it]
 26%|██▌       | 9930/37963 [23:51:44<60:51:39,  7.82s/it]
                                                          
{'loss': '0.1833', 'grad_norm': '4.044', 'learning_rate': '1.732e-05', 'epoch': '0.2616'}

 26%|██▌       | 9930/37963 [23:51:44<60:51:39,  7.82s/it]
 26%|██▌       | 9931/37963 [23:51:52<60:10:52,  7.73s/it]
 26%|██▌       | 9932/37963 [23:52:06<75:19:06,  9.67s/it]
 26%|██▌       | 9933/37963 [23:52:14<70:26:21,  9.05s/it]
 26%|██▌       | 9934/37963 [23:52:21<66:52:33,  8.59s/it]
 26%|██▌       | 9935/37963 [23:52:28<63:47:53,  8.19s/it]
 26%|██▌       | 9936/37963 [23:52:36<61:26:12,  7.89s/it]
 26%|██▌       | 9937/37963 [23:52:43<60:43:10,  7.80s/it]
 26%|██▌       | 9938/37963 [23:52:51<60:09:40,  7.73s/it]
 26%|██▌       | 9939/37963 [23:52:58<59:40:46,  7.67s/it]
 26%|██▌       | 9940/37963 [23:53:06<59:39:41,  7.66s/it]
                                                          
{'loss': '0.1618', 'grad_norm': '1.856', 'learning_rate': '1.731e-05', 'epoch': '0.2618'}

 26%|██▌       | 9940/37963 [23:53:06<59:39:41,  7.66s/it]
 26%|██▌       | 9941/37963 [23:53:13<59:15:50,  7.61s/it]
 26%|██▌       | 9942/37963 [23:53:21<59:36:36,  7.66s/it]
 26%|██▌       | 9943/37963 [23:53:28<58:55:11,  7.57s/it]
 26%|██▌       | 9944/37963 [23:53:36<58:59:18,  7.58s/it]
 26%|██▌       | 9945/37963 [23:53:44<58:55:13,  7.57s/it]
 26%|██▌       | 9946/37963 [23:53:51<58:46:46,  7.55s/it]
 26%|██▌       | 9947/37963 [23:53:59<58:38:46,  7.54s/it]
 26%|██▌       | 9948/37963 [23:54:13<73:28:39,  9.44s/it]
 26%|██▌       | 9949/37963 [23:54:20<69:09:36,  8.89s/it]
 26%|██▌       | 9950/37963 [23:54:27<65:19:24,  8.39s/it]
                                                          
{'loss': '0.1612', 'grad_norm': '2.632', 'learning_rate': '1.731e-05', 'epoch': '0.2621'}

 26%|██▌       | 9950/37963 [23:54:27<65:19:24,  8.39s/it]
 26%|██▌       | 9951/37963 [23:54:35<63:26:55,  8.15s/it]
 26%|██▌       | 9952/37963 [23:54:49<77:00:21,  9.90s/it]
 26%|██▌       | 9953/37963 [23:54:56<70:51:59,  9.11s/it]
 26%|██▌       | 9954/37963 [23:55:10<82:14:49, 10.57s/it]
 26%|██▌       | 9955/37963 [23:55:18<75:13:57,  9.67s/it]
 26%|██▌       | 9956/37963 [23:55:25<69:52:40,  8.98s/it]
 26%|██▌       | 9957/37963 [23:55:33<66:41:33,  8.57s/it]
 26%|██▌       | 9958/37963 [23:55:40<64:13:54,  8.26s/it]
 26%|██▌       | 9959/37963 [23:55:48<62:40:43,  8.06s/it]
 26%|██▌       | 9960/37963 [23:55:55<61:32:43,  7.91s/it]
                                                          
{'loss': '0.1613', 'grad_norm': '1.639', 'learning_rate': '1.73e-05', 'epoch': '0.2624'}

 26%|██▌       | 9960/37963 [23:55:55<61:32:43,  7.91s/it]
 26%|██▌       | 9961/37963 [23:56:09<75:43:06,  9.73s/it]
 26%|██▌       | 9962/37963 [23:56:17<71:04:41,  9.14s/it]
 26%|██▌       | 9963/37963 [23:56:25<67:37:14,  8.69s/it]
 26%|██▌       | 9964/37963 [23:56:32<64:56:22,  8.35s/it]
 26%|██▌       | 9965/37963 [23:56:46<77:54:26, 10.02s/it]
 26%|██▋       | 9966/37963 [23:56:54<71:50:27,  9.24s/it]
 26%|██▋       | 9967/37963 [23:57:01<67:45:10,  8.71s/it]
 26%|██▋       | 9968/37963 [23:57:09<64:47:52,  8.33s/it]
 26%|██▋       | 9969/37963 [23:57:22<77:39:31,  9.99s/it]
 26%|██▋       | 9970/37963 [23:57:30<72:01:55,  9.26s/it]
                                                          
{'loss': '0.1518', 'grad_norm': '1.696', 'learning_rate': '1.729e-05', 'epoch': '0.2626'}

 26%|██▋       | 9970/37963 [23:57:30<72:01:55,  9.26s/it]
 26%|██▋       | 9971/37963 [23:57:37<67:27:39,  8.68s/it]
 26%|██▋       | 9972/37963 [23:57:45<64:40:09,  8.32s/it]
 26%|██▋       | 9973/37963 [23:57:59<77:51:35, 10.01s/it]
 26%|██▋       | 9974/37963 [23:58:06<71:48:25,  9.24s/it]
 26%|██▋       | 9975/37963 [23:58:14<67:44:07,  8.71s/it]
 26%|██▋       | 9976/37963 [23:58:21<65:07:04,  8.38s/it]
 26%|██▋       | 9977/37963 [23:58:29<62:20:34,  8.02s/it]
 26%|██▋       | 9978/37963 [23:58:36<61:09:26,  7.87s/it]
 26%|██▋       | 9979/37963 [23:58:44<60:23:41,  7.77s/it]
 26%|██▋       | 9980/37963 [23:58:51<59:52:12,  7.70s/it]
                                                          
{'loss': '0.1576', 'grad_norm': '2.042', 'learning_rate': '1.729e-05', 'epoch': '0.2629'}

 26%|██▋       | 9980/37963 [23:58:51<59:52:12,  7.70s/it]
 26%|██▋       | 9981/37963 [23:59:05<74:32:56,  9.59s/it]
 26%|██▋       | 9982/37963 [23:59:12<69:13:20,  8.91s/it]
 26%|██▋       | 9983/37963 [23:59:20<66:00:55,  8.49s/it]
 26%|██▋       | 9984/37963 [23:59:28<63:50:11,  8.21s/it]
 26%|██▋       | 9985/37963 [23:59:35<62:10:57,  8.00s/it]
 26%|██▋       | 9986/37963 [23:59:42<60:54:26,  7.84s/it]
 26%|██▋       | 9987/37963 [23:59:50<60:12:53,  7.75s/it]
 26%|██▋       | 9988/37963 [23:59:58<59:43:36,  7.69s/it]
 26%|██▋       | 9989/37963 [24:00:05<59:20:27,  7.64s/it]
 26%|██▋       | 9990/37963 [24:00:12<58:49:48,  7.57s/it]
                                                          
{'loss': '0.1659', 'grad_norm': '3.748', 'learning_rate': '1.728e-05', 'epoch': '0.2632'}

 26%|██▋       | 9990/37963 [24:00:12<58:49:48,  7.57s/it]
 26%|██▋       | 9991/37963 [24:00:20<58:38:51,  7.55s/it]
 26%|██▋       | 9992/37963 [24:00:27<58:11:54,  7.49s/it]
 26%|██▋       | 9993/37963 [24:00:35<58:17:54,  7.50s/it]
 26%|██▋       | 9994/37963 [24:00:42<58:21:35,  7.51s/it]
 26%|██▋       | 9995/37963 [24:00:50<58:34:19,  7.54s/it]
 26%|██▋       | 9996/37963 [24:00:58<58:29:40,  7.53s/it]
 26%|██▋       | 9997/37963 [24:01:05<58:27:56,  7.53s/it]
 26%|██▋       | 9998/37963 [24:01:13<58:31:22,  7.53s/it]
 26%|██▋       | 9999/37963 [24:01:26<73:20:39,  9.44s/it]
 26%|██▋       | 10000/37963 [24:01:34<68:04:04,  8.76s/it]
                                                           
{'loss': '0.1788', 'grad_norm': '9.726', 'learning_rate': '1.728e-05', 'epoch': '0.2634'}

 26%|██▋       | 10000/37963 [24:01:34<68:04:04,  8.76s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.81s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.81s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 26%|██▋       | 10001/37963 [24:02:30<177:46:27, 22.89s/it]
 26%|██▋       | 10002/37963 [24:02:50<171:34:10, 22.09s/it]
 26%|██▋       | 10003/37963 [24:02:57<137:50:26, 17.75s/it]
 26%|██▋       | 10004/37963 [24:03:05<114:30:07, 14.74s/it]
 26%|██▋       | 10005/37963 [24:03:13<98:05:29, 12.63s/it] 
 26%|██▋       | 10006/37963 [24:03:20<86:19:34, 11.12s/it]
 26%|██▋       | 10007/37963 [24:03:28<78:04:19, 10.05s/it]
 26%|██▋       | 10008/37963 [24:03:36<72:19:00,  9.31s/it]
 26%|██▋       | 10009/37963 [24:03:43<68:07:26,  8.77s/it]
 26%|██▋       | 10010/37963 [24:03:57<79:57:18, 10.30s/it]
                                                           
{'loss': '0.1844', 'grad_norm': '1.686', 'learning_rate': '1.727e-05', 'epoch': '0.2637'}

 26%|██▋       | 10010/37963 [24:03:57<79:57:18, 10.30s/it]
 26%|██▋       | 10011/37963 [24:04:04<73:00:22,  9.40s/it]
 26%|██▋       | 10012/37963 [24:04:12<68:35:01,  8.83s/it]
 26%|██▋       | 10013/37963 [24:04:19<65:25:58,  8.43s/it]
 26%|██▋       | 10014/37963 [24:04:33<78:12:25, 10.07s/it]
 26%|██▋       | 10015/37963 [24:04:41<72:03:43,  9.28s/it]
 26%|██▋       | 10016/37963 [24:04:55<83:17:59, 10.73s/it]
 26%|██▋       | 10017/37963 [24:05:02<75:56:37,  9.78s/it]
 26%|██▋       | 10018/37963 [24:05:10<70:39:14,  9.10s/it]
 26%|██▋       | 10019/37963 [24:05:17<67:16:32,  8.67s/it]
 26%|██▋       | 10020/37963 [24:05:25<64:29:11,  8.31s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.861', 'learning_rate': '1.726e-05', 'epoch': '0.2639'}

 26%|██▋       | 10020/37963 [24:05:25<64:29:11,  8.31s/it]
 26%|██▋       | 10021/37963 [24:05:32<62:37:12,  8.07s/it]
 26%|██▋       | 10022/37963 [24:05:40<61:24:48,  7.91s/it]
 26%|██▋       | 10023/37963 [24:05:47<60:27:26,  7.79s/it]
 26%|██▋       | 10024/37963 [24:05:55<59:53:51,  7.72s/it]
 26%|██▋       | 10025/37963 [24:06:03<59:28:39,  7.66s/it]
 26%|██▋       | 10026/37963 [24:06:17<75:13:52,  9.69s/it]
 26%|██▋       | 10027/37963 [24:06:24<69:48:55,  9.00s/it]
 26%|██▋       | 10028/37963 [24:06:32<66:10:46,  8.53s/it]
 26%|██▋       | 10029/37963 [24:06:39<63:58:28,  8.24s/it]
 26%|██▋       | 10030/37963 [24:06:53<77:12:53,  9.95s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '0.8359', 'learning_rate': '1.726e-05', 'epoch': '0.2642'}

 26%|██▋       | 10030/37963 [24:06:53<77:12:53,  9.95s/it]
 26%|██▋       | 10031/37963 [24:07:01<71:39:00,  9.23s/it]
 26%|██▋       | 10032/37963 [24:07:08<67:44:49,  8.73s/it]
 26%|██▋       | 10033/37963 [24:07:16<64:44:54,  8.35s/it]
 26%|██▋       | 10034/37963 [24:07:23<63:01:16,  8.12s/it]
 26%|██▋       | 10035/37963 [24:07:31<61:37:08,  7.94s/it]
 26%|██▋       | 10036/37963 [24:07:38<60:37:37,  7.82s/it]
 26%|██▋       | 10037/37963 [24:07:46<59:45:59,  7.70s/it]
 26%|██▋       | 10038/37963 [24:07:53<59:22:22,  7.65s/it]
 26%|██▋       | 10039/37963 [24:08:01<59:04:17,  7.62s/it]
 26%|██▋       | 10040/37963 [24:08:08<58:46:40,  7.58s/it]
                                                           
{'loss': '0.179', 'grad_norm': '1.506', 'learning_rate': '1.725e-05', 'epoch': '0.2645'}

 26%|██▋       | 10040/37963 [24:08:08<58:46:40,  7.58s/it]
 26%|██▋       | 10041/37963 [24:08:16<58:41:08,  7.57s/it]
 26%|██▋       | 10042/37963 [24:08:24<58:39:48,  7.56s/it]
 26%|██▋       | 10043/37963 [24:08:31<58:15:38,  7.51s/it]
 26%|██▋       | 10044/37963 [24:08:38<58:19:05,  7.52s/it]
 26%|██▋       | 10045/37963 [24:08:46<58:12:00,  7.50s/it]
 26%|██▋       | 10046/37963 [24:08:53<57:24:49,  7.40s/it]
 26%|██▋       | 10047/37963 [24:09:07<72:53:44,  9.40s/it]
 26%|██▋       | 10048/37963 [24:09:15<68:07:59,  8.79s/it]
 26%|██▋       | 10049/37963 [24:09:22<65:15:47,  8.42s/it]
 26%|██▋       | 10050/37963 [24:09:36<78:19:13, 10.10s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '0.7544', 'learning_rate': '1.725e-05', 'epoch': '0.2647'}

 26%|██▋       | 10050/37963 [24:09:36<78:19:13, 10.10s/it]
 26%|██▋       | 10051/37963 [24:09:44<73:00:45,  9.42s/it]
 26%|██▋       | 10052/37963 [24:09:51<68:39:25,  8.86s/it]
 26%|██▋       | 10053/37963 [24:10:06<81:02:19, 10.45s/it]
 26%|██▋       | 10054/37963 [24:10:13<73:50:50,  9.53s/it]
 26%|██▋       | 10055/37963 [24:10:21<69:12:05,  8.93s/it]
 26%|██▋       | 10056/37963 [24:10:28<66:10:31,  8.54s/it]
 26%|██▋       | 10057/37963 [24:10:36<63:48:36,  8.23s/it]
 26%|██▋       | 10058/37963 [24:10:50<76:58:14,  9.93s/it]
 26%|██▋       | 10059/37963 [24:10:57<71:38:39,  9.24s/it]
 26%|██▋       | 10060/37963 [24:11:05<67:39:07,  8.73s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '1.18', 'learning_rate': '1.724e-05', 'epoch': '0.265'}

 26%|██▋       | 10060/37963 [24:11:05<67:39:07,  8.73s/it]
 27%|██▋       | 10061/37963 [24:11:18<78:53:27, 10.18s/it]
 27%|██▋       | 10062/37963 [24:11:26<72:36:53,  9.37s/it]
 27%|██▋       | 10063/37963 [24:11:40<83:15:49, 10.74s/it]
 27%|██▋       | 10064/37963 [24:11:47<75:48:44,  9.78s/it]
 27%|██▋       | 10065/37963 [24:11:55<70:34:10,  9.11s/it]
 27%|██▋       | 10066/37963 [24:12:02<67:03:01,  8.65s/it]
 27%|██▋       | 10067/37963 [24:12:10<64:36:50,  8.34s/it]
 27%|██▋       | 10068/37963 [24:12:18<62:51:26,  8.11s/it]
 27%|██▋       | 10069/37963 [24:12:25<61:35:01,  7.95s/it]
 27%|██▋       | 10070/37963 [24:12:33<60:54:40,  7.86s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '1.147', 'learning_rate': '1.724e-05', 'epoch': '0.2653'}

 27%|██▋       | 10070/37963 [24:12:33<60:54:40,  7.86s/it]
 27%|██▋       | 10071/37963 [24:12:40<59:31:28,  7.68s/it]
 27%|██▋       | 10072/37963 [24:12:48<59:26:31,  7.67s/it]
 27%|██▋       | 10073/37963 [24:12:55<59:13:37,  7.64s/it]
 27%|██▋       | 10074/37963 [24:13:09<73:15:34,  9.46s/it]
 27%|██▋       | 10075/37963 [24:13:17<69:02:51,  8.91s/it]
 27%|██▋       | 10076/37963 [24:13:24<65:53:21,  8.51s/it]
 27%|██▋       | 10077/37963 [24:13:32<63:30:34,  8.20s/it]
 27%|██▋       | 10078/37963 [24:13:39<62:03:00,  8.01s/it]
 27%|██▋       | 10079/37963 [24:13:47<60:54:31,  7.86s/it]
 27%|██▋       | 10080/37963 [24:13:54<59:46:56,  7.72s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '1.626', 'learning_rate': '1.723e-05', 'epoch': '0.2655'}

 27%|██▋       | 10080/37963 [24:13:54<59:46:56,  7.72s/it]
 27%|██▋       | 10081/37963 [24:14:02<59:22:19,  7.67s/it]
 27%|██▋       | 10082/37963 [24:14:09<59:21:56,  7.67s/it]
 27%|██▋       | 10083/37963 [24:14:17<59:14:05,  7.65s/it]
 27%|██▋       | 10084/37963 [24:14:31<73:41:09,  9.52s/it]
 27%|██▋       | 10085/37963 [24:14:38<69:14:30,  8.94s/it]
 27%|██▋       | 10086/37963 [24:14:46<66:31:01,  8.59s/it]
 27%|██▋       | 10087/37963 [24:14:54<64:01:58,  8.27s/it]
 27%|██▋       | 10088/37963 [24:15:01<62:07:31,  8.02s/it]
 27%|██▋       | 10089/37963 [24:15:09<60:45:06,  7.85s/it]
 27%|██▋       | 10090/37963 [24:15:16<59:30:38,  7.69s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '3.242', 'learning_rate': '1.722e-05', 'epoch': '0.2658'}

 27%|██▋       | 10090/37963 [24:15:16<59:30:38,  7.69s/it]
 27%|██▋       | 10091/37963 [24:15:23<59:08:03,  7.64s/it]
 27%|██▋       | 10092/37963 [24:15:31<58:50:43,  7.60s/it]
 27%|██▋       | 10093/37963 [24:15:39<59:05:10,  7.63s/it]
 27%|██▋       | 10094/37963 [24:15:46<58:29:04,  7.55s/it]
 27%|██▋       | 10095/37963 [24:15:54<58:31:41,  7.56s/it]
 27%|██▋       | 10096/37963 [24:16:01<58:30:14,  7.56s/it]
 27%|██▋       | 10097/37963 [24:16:15<73:20:40,  9.48s/it]
 27%|██▋       | 10098/37963 [24:16:23<68:48:52,  8.89s/it]
 27%|██▋       | 10099/37963 [24:16:30<65:41:38,  8.49s/it]
 27%|██▋       | 10100/37963 [24:16:38<63:40:43,  8.23s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.134', 'learning_rate': '1.722e-05', 'epoch': '0.266'}

 27%|██▋       | 10100/37963 [24:16:38<63:40:43,  8.23s/it]
 27%|██▋       | 10101/37963 [24:16:45<62:08:00,  8.03s/it]
 27%|██▋       | 10102/37963 [24:17:00<76:41:50,  9.91s/it]
 27%|██▋       | 10103/37963 [24:17:07<71:26:42,  9.23s/it]
 27%|██▋       | 10104/37963 [24:17:21<82:20:39, 10.64s/it]
 27%|██▋       | 10105/37963 [24:17:29<75:02:17,  9.70s/it]
 27%|██▋       | 10106/37963 [24:17:36<70:17:53,  9.08s/it]
 27%|██▋       | 10107/37963 [24:17:51<82:02:06, 10.60s/it]
 27%|██▋       | 10108/37963 [24:17:58<75:01:15,  9.70s/it]
 27%|██▋       | 10109/37963 [24:18:12<85:34:36, 11.06s/it]
 27%|██▋       | 10110/37963 [24:18:20<77:26:07, 10.01s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.315', 'learning_rate': '1.721e-05', 'epoch': '0.2663'}

 27%|██▋       | 10110/37963 [24:18:20<77:26:07, 10.01s/it]
 27%|██▋       | 10111/37963 [24:18:28<72:03:10,  9.31s/it]
 27%|██▋       | 10112/37963 [24:18:35<68:19:11,  8.83s/it]
 27%|██▋       | 10113/37963 [24:18:43<65:28:56,  8.46s/it]
 27%|██▋       | 10114/37963 [24:18:51<63:20:24,  8.19s/it]
 27%|██▋       | 10115/37963 [24:18:58<61:53:45,  8.00s/it]
 27%|██▋       | 10116/37963 [24:19:06<60:48:55,  7.86s/it]
 27%|██▋       | 10117/37963 [24:19:13<59:58:11,  7.75s/it]
 27%|██▋       | 10118/37963 [24:19:27<74:17:29,  9.60s/it]
 27%|██▋       | 10119/37963 [24:19:34<68:56:53,  8.91s/it]
 27%|██▋       | 10120/37963 [24:19:42<65:16:47,  8.44s/it]
                                                           
{'loss': '0.1735', 'grad_norm': '1.361', 'learning_rate': '1.721e-05', 'epoch': '0.2666'}

 27%|██▋       | 10120/37963 [24:19:42<65:16:47,  8.44s/it]
 27%|██▋       | 10121/37963 [24:19:49<62:49:37,  8.12s/it]
 27%|██▋       | 10122/37963 [24:19:56<60:51:54,  7.87s/it]
 27%|██▋       | 10123/37963 [24:20:04<60:04:54,  7.77s/it]
 27%|██▋       | 10124/37963 [24:20:12<60:04:44,  7.77s/it]
 27%|██▋       | 10125/37963 [24:20:19<59:29:43,  7.69s/it]
 27%|██▋       | 10126/37963 [24:20:27<59:16:52,  7.67s/it]
 27%|██▋       | 10127/37963 [24:20:34<58:51:17,  7.61s/it]
 27%|██▋       | 10128/37963 [24:20:42<58:48:35,  7.61s/it]
 27%|██▋       | 10129/37963 [24:20:49<58:37:38,  7.58s/it]
 27%|██▋       | 10130/37963 [24:20:57<58:33:56,  7.58s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '3.136', 'learning_rate': '1.72e-05', 'epoch': '0.2668'}

 27%|██▋       | 10130/37963 [24:20:57<58:33:56,  7.58s/it]
 27%|██▋       | 10131/37963 [24:21:04<58:31:30,  7.57s/it]
 27%|██▋       | 10132/37963 [24:21:12<58:27:30,  7.56s/it]
 27%|██▋       | 10133/37963 [24:21:26<73:28:56,  9.51s/it]
 27%|██▋       | 10134/37963 [24:21:34<69:06:10,  8.94s/it]
 27%|██▋       | 10135/37963 [24:21:41<65:48:43,  8.51s/it]
 27%|██▋       | 10136/37963 [24:21:48<62:40:54,  8.11s/it]
 27%|██▋       | 10137/37963 [24:21:56<61:34:01,  7.97s/it]
 27%|██▋       | 10138/37963 [24:22:04<60:34:16,  7.84s/it]
 27%|██▋       | 10139/37963 [24:22:11<60:06:29,  7.78s/it]
 27%|██▋       | 10140/37963 [24:22:19<59:26:11,  7.69s/it]
                                                           
{'loss': '0.163', 'grad_norm': '3.288', 'learning_rate': '1.719e-05', 'epoch': '0.2671'}

 27%|██▋       | 10140/37963 [24:22:19<59:26:11,  7.69s/it]
 27%|██▋       | 10141/37963 [24:22:26<59:04:35,  7.64s/it]
 27%|██▋       | 10142/37963 [24:22:34<58:42:58,  7.60s/it]
 27%|██▋       | 10143/37963 [24:22:41<58:49:14,  7.61s/it]
 27%|██▋       | 10144/37963 [24:22:49<58:35:09,  7.58s/it]
 27%|██▋       | 10145/37963 [24:22:56<58:40:34,  7.59s/it]
 27%|██▋       | 10146/37963 [24:23:04<58:31:10,  7.57s/it]
 27%|██▋       | 10147/37963 [24:23:18<73:04:47,  9.46s/it]
 27%|██▋       | 10148/37963 [24:23:38<98:56:43, 12.81s/it]
 27%|██▋       | 10149/37963 [24:23:46<86:41:49, 11.22s/it]
 27%|██▋       | 10150/37963 [24:23:53<77:30:35, 10.03s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '2.43', 'learning_rate': '1.719e-05', 'epoch': '0.2674'}

 27%|██▋       | 10150/37963 [24:23:53<77:30:35, 10.03s/it]
 27%|██▋       | 10151/37963 [24:24:01<71:46:51,  9.29s/it]
 27%|██▋       | 10152/37963 [24:24:08<67:20:22,  8.72s/it]
 27%|██▋       | 10153/37963 [24:24:16<64:33:13,  8.36s/it]
 27%|██▋       | 10154/37963 [24:24:30<78:05:14, 10.11s/it]
 27%|██▋       | 10155/37963 [24:24:44<87:17:00, 11.30s/it]
 27%|██▋       | 10156/37963 [24:24:52<78:44:35, 10.19s/it]
 27%|██▋       | 10157/37963 [24:24:59<72:44:58,  9.42s/it]
 27%|██▋       | 10158/37963 [24:25:07<68:19:52,  8.85s/it]
 27%|██▋       | 10159/37963 [24:25:14<65:14:57,  8.45s/it]
 27%|██▋       | 10160/37963 [24:25:22<63:08:19,  8.18s/it]
                                                           
{'loss': '0.1678', 'grad_norm': '2.095', 'learning_rate': '1.718e-05', 'epoch': '0.2676'}

 27%|██▋       | 10160/37963 [24:25:22<63:08:19,  8.18s/it]
 27%|██▋       | 10161/37963 [24:25:36<76:03:16,  9.85s/it]
 27%|██▋       | 10162/37963 [24:25:43<70:18:59,  9.11s/it]
 27%|██▋       | 10163/37963 [24:25:50<66:38:19,  8.63s/it]
 27%|██▋       | 10164/37963 [24:25:58<64:08:03,  8.31s/it]
 27%|██▋       | 10165/37963 [24:26:05<62:08:03,  8.05s/it]
 27%|██▋       | 10166/37963 [24:26:13<61:01:23,  7.90s/it]
 27%|██▋       | 10167/37963 [24:26:27<75:20:25,  9.76s/it]
 27%|██▋       | 10168/37963 [24:26:35<70:22:13,  9.11s/it]
 27%|██▋       | 10169/37963 [24:26:42<67:07:16,  8.69s/it]
 27%|██▋       | 10170/37963 [24:26:50<64:02:34,  8.30s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '3.072', 'learning_rate': '1.718e-05', 'epoch': '0.2679'}

 27%|██▋       | 10170/37963 [24:26:50<64:02:34,  8.30s/it]
 27%|██▋       | 10171/37963 [24:26:57<62:10:38,  8.05s/it]
 27%|██▋       | 10172/37963 [24:27:05<61:10:40,  7.92s/it]
 27%|██▋       | 10173/37963 [24:27:12<59:36:16,  7.72s/it]
 27%|██▋       | 10174/37963 [24:27:19<58:41:15,  7.60s/it]
 27%|██▋       | 10175/37963 [24:27:27<58:26:48,  7.57s/it]
 27%|██▋       | 10176/37963 [24:27:34<58:20:01,  7.56s/it]
 27%|██▋       | 10177/37963 [24:27:42<57:55:59,  7.51s/it]
 27%|██▋       | 10178/37963 [24:27:49<57:21:19,  7.43s/it]
 27%|██▋       | 10179/37963 [24:27:57<57:32:15,  7.46s/it]
 27%|██▋       | 10180/37963 [24:28:04<57:51:30,  7.50s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.805', 'learning_rate': '1.717e-05', 'epoch': '0.2682'}

 27%|██▋       | 10180/37963 [24:28:04<57:51:30,  7.50s/it]
 27%|██▋       | 10181/37963 [24:28:12<57:40:38,  7.47s/it]
 27%|██▋       | 10182/37963 [24:28:26<72:46:26,  9.43s/it]
 27%|██▋       | 10183/37963 [24:28:33<68:28:48,  8.87s/it]
 27%|██▋       | 10184/37963 [24:28:41<65:35:19,  8.50s/it]
 27%|██▋       | 10185/37963 [24:28:48<63:16:20,  8.20s/it]
 27%|██▋       | 10186/37963 [24:28:56<60:55:59,  7.90s/it]
 27%|██▋       | 10187/37963 [24:29:03<60:03:31,  7.78s/it]
 27%|██▋       | 10188/37963 [24:29:11<59:36:47,  7.73s/it]
 27%|██▋       | 10189/37963 [24:29:18<59:38:16,  7.73s/it]
 27%|██▋       | 10190/37963 [24:29:33<74:29:16,  9.66s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '2.207', 'learning_rate': '1.716e-05', 'epoch': '0.2684'}

 27%|██▋       | 10190/37963 [24:29:33<74:29:16,  9.66s/it]
 27%|██▋       | 10191/37963 [24:29:40<69:53:17,  9.06s/it]
 27%|██▋       | 10192/37963 [24:29:54<80:37:27, 10.45s/it]
 27%|██▋       | 10193/37963 [24:30:01<73:52:46,  9.58s/it]
 27%|██▋       | 10194/37963 [24:30:09<69:12:14,  8.97s/it]
 27%|██▋       | 10195/37963 [24:30:16<65:45:06,  8.52s/it]
 27%|██▋       | 10196/37963 [24:30:24<63:23:06,  8.22s/it]
 27%|██▋       | 10197/37963 [24:30:31<61:40:45,  8.00s/it]
 27%|██▋       | 10198/37963 [24:30:39<60:40:27,  7.87s/it]
 27%|██▋       | 10199/37963 [24:30:53<74:30:19,  9.66s/it]
 27%|██▋       | 10200/37963 [24:31:00<69:36:57,  9.03s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.693', 'learning_rate': '1.716e-05', 'epoch': '0.2687'}

 27%|██▋       | 10200/37963 [24:31:00<69:36:57,  9.03s/it]
 27%|██▋       | 10201/37963 [24:31:15<81:22:55, 10.55s/it]
 27%|██▋       | 10202/37963 [24:31:28<89:00:23, 11.54s/it]
 27%|██▋       | 10203/37963 [24:31:36<79:06:13, 10.26s/it]
 27%|██▋       | 10204/37963 [24:31:43<72:32:07,  9.41s/it]
 27%|██▋       | 10205/37963 [24:31:51<68:12:51,  8.85s/it]
 27%|██▋       | 10206/37963 [24:32:05<80:27:23, 10.43s/it]
 27%|██▋       | 10207/37963 [24:32:12<73:38:20,  9.55s/it]
 27%|██▋       | 10208/37963 [24:32:20<69:06:11,  8.96s/it]
 27%|██▋       | 10209/37963 [24:32:27<65:35:45,  8.51s/it]
 27%|██▋       | 10210/37963 [24:32:35<63:18:19,  8.21s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '0.8304', 'learning_rate': '1.715e-05', 'epoch': '0.2689'}

 27%|██▋       | 10210/37963 [24:32:35<63:18:19,  8.21s/it]
 27%|██▋       | 10211/37963 [24:32:42<61:17:15,  7.95s/it]
 27%|██▋       | 10212/37963 [24:32:50<60:39:23,  7.87s/it]
 27%|██▋       | 10213/37963 [24:32:57<59:53:07,  7.77s/it]
 27%|██▋       | 10214/37963 [24:33:11<74:31:59,  9.67s/it]
 27%|██▋       | 10215/37963 [24:33:19<69:31:05,  9.02s/it]
 27%|██▋       | 10216/37963 [24:33:26<65:55:26,  8.55s/it]
 27%|██▋       | 10217/37963 [24:33:34<63:43:35,  8.27s/it]
 27%|██▋       | 10218/37963 [24:33:42<62:10:13,  8.07s/it]
 27%|██▋       | 10219/37963 [24:33:49<60:50:58,  7.90s/it]
 27%|██▋       | 10220/37963 [24:33:57<59:57:58,  7.78s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '5.19', 'learning_rate': '1.715e-05', 'epoch': '0.2692'}

 27%|██▋       | 10220/37963 [24:33:57<59:57:58,  7.78s/it]
 27%|██▋       | 10221/37963 [24:34:04<59:37:56,  7.74s/it]
 27%|██▋       | 10222/37963 [24:34:11<58:15:07,  7.56s/it]
 27%|██▋       | 10223/37963 [24:34:19<58:21:09,  7.57s/it]
 27%|██▋       | 10224/37963 [24:34:27<58:28:50,  7.59s/it]
 27%|██▋       | 10225/37963 [24:34:34<58:26:33,  7.59s/it]
 27%|██▋       | 10226/37963 [24:34:42<58:25:56,  7.58s/it]
 27%|██▋       | 10227/37963 [24:34:49<58:28:41,  7.59s/it]
 27%|██▋       | 10228/37963 [24:34:57<58:38:02,  7.61s/it]
 27%|██▋       | 10229/37963 [24:35:11<72:55:30,  9.47s/it]
 27%|██▋       | 10230/37963 [24:35:18<68:27:19,  8.89s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.349', 'learning_rate': '1.714e-05', 'epoch': '0.2695'}

 27%|██▋       | 10230/37963 [24:35:18<68:27:19,  8.89s/it]
 27%|██▋       | 10231/37963 [24:35:26<65:10:19,  8.46s/it]
 27%|██▋       | 10232/37963 [24:35:33<62:23:10,  8.10s/it]
 27%|██▋       | 10233/37963 [24:35:41<61:03:00,  7.93s/it]
 27%|██▋       | 10234/37963 [24:35:48<59:59:47,  7.79s/it]
 27%|██▋       | 10235/37963 [24:35:55<58:55:14,  7.65s/it]
 27%|██▋       | 10236/37963 [24:36:03<58:13:06,  7.56s/it]
 27%|██▋       | 10237/37963 [24:36:10<58:34:07,  7.60s/it]
 27%|██▋       | 10238/37963 [24:36:18<58:26:37,  7.59s/it]
 27%|██▋       | 10239/37963 [24:36:26<58:15:49,  7.57s/it]
 27%|██▋       | 10240/37963 [24:36:46<88:22:26, 11.48s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '0.9808', 'learning_rate': '1.713e-05', 'epoch': '0.2697'}

 27%|██▋       | 10240/37963 [24:36:46<88:22:26, 11.48s/it]
 27%|██▋       | 10241/37963 [24:36:54<79:43:56, 10.35s/it]
 27%|██▋       | 10242/37963 [24:37:01<73:13:44,  9.51s/it]
 27%|██▋       | 10243/37963 [24:37:15<83:07:31, 10.80s/it]
 27%|██▋       | 10244/37963 [24:37:23<75:44:19,  9.84s/it]
 27%|██▋       | 10245/37963 [24:37:30<70:20:26,  9.14s/it]
 27%|██▋       | 10246/37963 [24:37:44<81:42:01, 10.61s/it]
 27%|██▋       | 10247/37963 [24:37:52<74:44:24,  9.71s/it]
 27%|██▋       | 10248/37963 [24:38:06<84:49:33, 11.02s/it]
 27%|██▋       | 10249/37963 [24:38:14<76:48:31,  9.98s/it]
 27%|██▋       | 10250/37963 [24:38:21<71:06:21,  9.24s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '2.376', 'learning_rate': '1.713e-05', 'epoch': '0.27'}

 27%|██▋       | 10250/37963 [24:38:21<71:06:21,  9.24s/it]
 27%|██▋       | 10251/37963 [24:38:29<67:16:16,  8.74s/it]
 27%|██▋       | 10252/37963 [24:38:36<64:24:44,  8.37s/it]
 27%|██▋       | 10253/37963 [24:38:43<61:28:10,  7.99s/it]
 27%|██▋       | 10254/37963 [24:38:57<75:36:04,  9.82s/it]
 27%|██▋       | 10255/37963 [24:39:05<70:29:37,  9.16s/it]
 27%|██▋       | 10256/37963 [24:39:13<67:01:36,  8.71s/it]
 27%|██▋       | 10257/37963 [24:39:20<64:18:01,  8.35s/it]
 27%|██▋       | 10258/37963 [24:39:28<62:35:44,  8.13s/it]
 27%|██▋       | 10259/37963 [24:39:35<60:45:27,  7.90s/it]
 27%|██▋       | 10260/37963 [24:39:49<75:08:37,  9.76s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '2.698', 'learning_rate': '1.712e-05', 'epoch': '0.2703'}

 27%|██▋       | 10260/37963 [24:39:49<75:08:37,  9.76s/it]
 27%|██▋       | 10261/37963 [24:39:57<69:22:09,  9.01s/it]
 27%|██▋       | 10262/37963 [24:40:04<65:37:51,  8.53s/it]
 27%|██▋       | 10263/37963 [24:40:11<63:16:19,  8.22s/it]
 27%|██▋       | 10264/37963 [24:40:19<61:59:39,  8.06s/it]
 27%|██▋       | 10265/37963 [24:40:27<60:52:51,  7.91s/it]
 27%|██▋       | 10266/37963 [24:40:34<59:42:48,  7.76s/it]
 27%|██▋       | 10267/37963 [24:40:42<59:00:56,  7.67s/it]
 27%|██▋       | 10268/37963 [24:40:49<58:43:03,  7.63s/it]
 27%|██▋       | 10269/37963 [24:40:57<58:32:50,  7.61s/it]
 27%|██▋       | 10270/37963 [24:41:04<58:31:28,  7.61s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '6.278', 'learning_rate': '1.712e-05', 'epoch': '0.2705'}

 27%|██▋       | 10270/37963 [24:41:04<58:31:28,  7.61s/it]
 27%|██▋       | 10271/37963 [24:41:12<58:29:09,  7.60s/it]
 27%|██▋       | 10272/37963 [24:41:19<58:23:19,  7.59s/it]
 27%|██▋       | 10273/37963 [24:41:27<58:21:42,  7.59s/it]
 27%|██▋       | 10274/37963 [24:41:34<57:45:59,  7.51s/it]
 27%|██▋       | 10275/37963 [24:41:42<57:55:43,  7.53s/it]
 27%|██▋       | 10276/37963 [24:41:49<57:50:23,  7.52s/it]
 27%|██▋       | 10277/37963 [24:41:57<57:51:46,  7.52s/it]
 27%|██▋       | 10278/37963 [24:42:04<57:57:46,  7.54s/it]
 27%|██▋       | 10279/37963 [24:42:12<57:07:17,  7.43s/it]
 27%|██▋       | 10280/37963 [24:42:19<57:21:59,  7.46s/it]
                                                           
{'loss': '0.1634', 'grad_norm': '1.137', 'learning_rate': '1.711e-05', 'epoch': '0.2708'}

 27%|██▋       | 10280/37963 [24:42:19<57:21:59,  7.46s/it]
 27%|██▋       | 10281/37963 [24:42:27<57:27:53,  7.47s/it]
 27%|██▋       | 10282/37963 [24:42:41<72:09:02,  9.38s/it]
 27%|██▋       | 10283/37963 [24:42:48<67:55:06,  8.83s/it]
 27%|██▋       | 10284/37963 [24:42:56<64:51:43,  8.44s/it]
 27%|██▋       | 10285/37963 [24:43:03<62:45:00,  8.16s/it]
 27%|██▋       | 10286/37963 [24:43:11<61:21:13,  7.98s/it]
 27%|██▋       | 10287/37963 [24:43:31<90:06:36, 11.72s/it]
 27%|██▋       | 10288/37963 [24:43:39<80:27:40, 10.47s/it]
 27%|██▋       | 10289/37963 [24:43:46<73:39:37,  9.58s/it]
 27%|██▋       | 10290/37963 [24:43:54<69:02:03,  8.98s/it]
                                                           
{'loss': '0.1717', 'grad_norm': '3.716', 'learning_rate': '1.71e-05', 'epoch': '0.2711'}

 27%|██▋       | 10290/37963 [24:43:54<69:02:03,  8.98s/it]
 27%|██▋       | 10291/37963 [24:44:08<80:05:10, 10.42s/it]
 27%|██▋       | 10292/37963 [24:44:15<73:42:53,  9.59s/it]
 27%|██▋       | 10293/37963 [24:44:23<68:34:59,  8.92s/it]
 27%|██▋       | 10294/37963 [24:44:30<65:20:33,  8.50s/it]
 27%|██▋       | 10295/37963 [24:44:38<63:06:21,  8.21s/it]
 27%|██▋       | 10296/37963 [24:44:45<61:49:29,  8.04s/it]
 27%|██▋       | 10297/37963 [24:45:06<90:04:32, 11.72s/it]
 27%|██▋       | 10298/37963 [24:45:13<80:24:58, 10.46s/it]
 27%|██▋       | 10299/37963 [24:45:21<73:41:35,  9.59s/it]
 27%|██▋       | 10300/37963 [24:45:35<83:46:24, 10.90s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.61', 'learning_rate': '1.71e-05', 'epoch': '0.2713'}

 27%|██▋       | 10300/37963 [24:45:35<83:46:24, 10.90s/it]
 27%|██▋       | 10301/37963 [24:45:42<76:12:13,  9.92s/it]
 27%|██▋       | 10302/37963 [24:45:50<70:38:25,  9.19s/it]
 27%|██▋       | 10303/37963 [24:45:57<66:48:19,  8.69s/it]
 27%|██▋       | 10304/37963 [24:46:05<64:20:17,  8.37s/it]
 27%|██▋       | 10305/37963 [24:46:13<62:34:41,  8.15s/it]
 27%|██▋       | 10306/37963 [24:46:20<61:43:27,  8.03s/it]
 27%|██▋       | 10307/37963 [24:46:28<60:38:29,  7.89s/it]
 27%|██▋       | 10308/37963 [24:46:35<59:41:40,  7.77s/it]
 27%|██▋       | 10309/37963 [24:46:43<59:10:47,  7.70s/it]
 27%|██▋       | 10310/37963 [24:46:50<58:42:05,  7.64s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.442', 'learning_rate': '1.709e-05', 'epoch': '0.2716'}

 27%|██▋       | 10310/37963 [24:46:50<58:42:05,  7.64s/it]
 27%|██▋       | 10311/37963 [24:46:58<58:22:05,  7.60s/it]
 27%|██▋       | 10312/37963 [24:47:05<58:09:55,  7.57s/it]
 27%|██▋       | 10313/37963 [24:47:13<57:36:36,  7.50s/it]
 27%|██▋       | 10314/37963 [24:47:27<73:03:41,  9.51s/it]
 27%|██▋       | 10315/37963 [24:47:35<68:39:11,  8.94s/it]
 27%|██▋       | 10316/37963 [24:47:42<65:29:28,  8.53s/it]
 27%|██▋       | 10317/37963 [24:47:50<62:56:39,  8.20s/it]
 27%|██▋       | 10318/37963 [24:47:57<61:22:08,  7.99s/it]
 27%|██▋       | 10319/37963 [24:48:05<60:29:36,  7.88s/it]
 27%|██▋       | 10320/37963 [24:48:12<59:11:55,  7.71s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '1.764', 'learning_rate': '1.709e-05', 'epoch': '0.2718'}

 27%|██▋       | 10320/37963 [24:48:12<59:11:55,  7.71s/it]
 27%|██▋       | 10321/37963 [24:48:20<58:57:29,  7.68s/it]
 27%|██▋       | 10322/37963 [24:48:27<58:18:50,  7.59s/it]
 27%|██▋       | 10323/37963 [24:48:34<57:43:59,  7.52s/it]
 27%|██▋       | 10324/37963 [24:48:42<57:01:58,  7.43s/it]
 27%|██▋       | 10325/37963 [24:48:49<56:44:04,  7.39s/it]
 27%|██▋       | 10326/37963 [24:48:56<57:00:11,  7.43s/it]
 27%|██▋       | 10327/37963 [24:49:04<57:14:11,  7.46s/it]
 27%|██▋       | 10328/37963 [24:49:11<56:57:34,  7.42s/it]
 27%|██▋       | 10329/37963 [24:49:19<57:13:41,  7.46s/it]
 27%|██▋       | 10330/37963 [24:49:33<72:06:20,  9.39s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '3.321', 'learning_rate': '1.708e-05', 'epoch': '0.2721'}

 27%|██▋       | 10330/37963 [24:49:33<72:06:20,  9.39s/it]
 27%|██▋       | 10331/37963 [24:49:47<83:04:57, 10.82s/it]
 27%|██▋       | 10332/37963 [24:50:01<90:20:11, 11.77s/it]
 27%|██▋       | 10333/37963 [24:50:08<80:46:54, 10.53s/it]
 27%|██▋       | 10334/37963 [24:50:16<74:00:23,  9.64s/it]
 27%|██▋       | 10335/37963 [24:50:24<69:06:58,  9.01s/it]
 27%|██▋       | 10336/37963 [24:50:37<80:16:01, 10.46s/it]
 27%|██▋       | 10337/37963 [24:50:45<73:27:53,  9.57s/it]
 27%|██▋       | 10338/37963 [24:50:53<69:04:26,  9.00s/it]
 27%|██▋       | 10339/37963 [24:51:00<65:56:47,  8.59s/it]
 27%|██▋       | 10340/37963 [24:51:08<63:27:55,  8.27s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '0.7511', 'learning_rate': '1.707e-05', 'epoch': '0.2724'}

 27%|██▋       | 10340/37963 [24:51:08<63:27:55,  8.27s/it]
 27%|██▋       | 10341/37963 [24:51:15<61:46:11,  8.05s/it]
 27%|██▋       | 10342/37963 [24:51:23<60:36:22,  7.90s/it]
 27%|██▋       | 10343/37963 [24:51:30<59:50:01,  7.80s/it]
 27%|██▋       | 10344/37963 [24:51:38<59:07:46,  7.71s/it]
 27%|██▋       | 10345/37963 [24:51:45<58:43:57,  7.66s/it]
 27%|██▋       | 10346/37963 [24:51:53<58:30:07,  7.63s/it]
 27%|██▋       | 10347/37963 [24:52:07<72:46:16,  9.49s/it]
 27%|██▋       | 10348/37963 [24:52:27<98:10:16, 12.80s/it]
 27%|██▋       | 10349/37963 [24:52:35<86:13:39, 11.24s/it]
 27%|██▋       | 10350/37963 [24:52:42<77:43:13, 10.13s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.511', 'learning_rate': '1.707e-05', 'epoch': '0.2726'}

 27%|██▋       | 10350/37963 [24:52:42<77:43:13, 10.13s/it]
 27%|██▋       | 10351/37963 [24:52:50<71:42:30,  9.35s/it]
 27%|██▋       | 10352/37963 [24:52:57<67:29:38,  8.80s/it]
 27%|██▋       | 10353/37963 [24:53:05<64:08:40,  8.36s/it]
 27%|██▋       | 10354/37963 [24:53:12<61:53:34,  8.07s/it]
 27%|██▋       | 10355/37963 [24:53:20<60:37:32,  7.91s/it]
 27%|██▋       | 10356/37963 [24:53:27<59:53:31,  7.81s/it]
 27%|██▋       | 10357/37963 [24:53:35<59:03:39,  7.70s/it]
 27%|██▋       | 10358/37963 [24:53:42<58:43:50,  7.66s/it]
 27%|██▋       | 10359/37963 [24:53:50<58:23:00,  7.61s/it]
 27%|██▋       | 10360/37963 [24:53:57<58:11:24,  7.59s/it]
                                                           
{'loss': '0.1742', 'grad_norm': '2.657', 'learning_rate': '1.706e-05', 'epoch': '0.2729'}

 27%|██▋       | 10360/37963 [24:53:57<58:11:24,  7.59s/it]
 27%|██▋       | 10361/37963 [24:54:05<57:13:46,  7.46s/it]
 27%|██▋       | 10362/37963 [24:54:12<57:38:32,  7.52s/it]
 27%|██▋       | 10363/37963 [24:54:20<57:55:57,  7.56s/it]
 27%|██▋       | 10364/37963 [24:54:27<57:51:57,  7.55s/it]
 27%|██▋       | 10365/37963 [24:54:41<72:36:39,  9.47s/it]
 27%|██▋       | 10366/37963 [24:54:49<68:05:57,  8.88s/it]
 27%|██▋       | 10367/37963 [24:54:56<65:05:44,  8.49s/it]
 27%|██▋       | 10368/37963 [24:55:04<63:05:34,  8.23s/it]
 27%|██▋       | 10369/37963 [24:55:12<61:26:59,  8.02s/it]
 27%|██▋       | 10370/37963 [24:55:19<60:10:42,  7.85s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '2.499', 'learning_rate': '1.706e-05', 'epoch': '0.2732'}

 27%|██▋       | 10370/37963 [24:55:19<60:10:42,  7.85s/it]
 27%|██▋       | 10371/37963 [24:55:27<59:26:15,  7.75s/it]
 27%|██▋       | 10372/37963 [24:55:34<59:01:21,  7.70s/it]
 27%|██▋       | 10373/37963 [24:55:42<58:47:53,  7.67s/it]
 27%|██▋       | 10374/37963 [24:55:49<58:24:52,  7.62s/it]
 27%|██▋       | 10375/37963 [24:55:57<58:12:55,  7.60s/it]
 27%|██▋       | 10376/37963 [24:56:04<58:02:07,  7.57s/it]
 27%|██▋       | 10377/37963 [24:56:12<57:52:26,  7.55s/it]
 27%|██▋       | 10378/37963 [24:56:26<72:11:52,  9.42s/it]
 27%|██▋       | 10379/37963 [24:56:33<67:23:52,  8.80s/it]
 27%|██▋       | 10380/37963 [24:56:47<79:11:27, 10.34s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.874', 'learning_rate': '1.705e-05', 'epoch': '0.2734'}

 27%|██▋       | 10380/37963 [24:56:47<79:11:27, 10.34s/it]
 27%|██▋       | 10381/37963 [24:56:54<72:39:55,  9.48s/it]
 27%|██▋       | 10382/37963 [24:57:02<68:07:19,  8.89s/it]
 27%|██▋       | 10383/37963 [24:57:09<65:00:52,  8.49s/it]
 27%|██▋       | 10384/37963 [24:57:17<62:47:17,  8.20s/it]
 27%|██▋       | 10385/37963 [24:57:37<89:55:59, 11.74s/it]
 27%|██▋       | 10386/37963 [24:57:45<80:43:53, 10.54s/it]
 27%|██▋       | 10387/37963 [24:57:52<73:50:53,  9.64s/it]
 27%|██▋       | 10388/37963 [24:58:00<68:54:43,  9.00s/it]
 27%|██▋       | 10389/37963 [24:58:07<65:30:53,  8.55s/it]
 27%|██▋       | 10390/37963 [24:58:15<63:19:05,  8.27s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.43', 'learning_rate': '1.704e-05', 'epoch': '0.2737'}

 27%|██▋       | 10390/37963 [24:58:15<63:19:05,  8.27s/it]
 27%|██▋       | 10391/37963 [24:58:22<61:48:14,  8.07s/it]
 27%|██▋       | 10392/37963 [24:58:30<60:34:32,  7.91s/it]
 27%|██▋       | 10393/37963 [24:58:37<59:27:57,  7.76s/it]
 27%|██▋       | 10394/37963 [24:58:58<88:23:56, 11.54s/it]
 27%|██▋       | 10395/37963 [24:59:12<94:23:41, 12.33s/it]
 27%|██▋       | 10396/37963 [24:59:19<83:06:17, 10.85s/it]
 27%|██▋       | 10397/37963 [24:59:27<75:31:09,  9.86s/it]
 27%|██▋       | 10398/37963 [24:59:34<70:19:16,  9.18s/it]
 27%|██▋       | 10399/37963 [24:59:42<66:28:09,  8.68s/it]
 27%|██▋       | 10400/37963 [24:59:49<63:28:10,  8.29s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '2.883', 'learning_rate': '1.704e-05', 'epoch': '0.274'}

 27%|██▋       | 10400/37963 [24:59:49<63:28:10,  8.29s/it]
 27%|██▋       | 10401/37963 [24:59:57<61:39:19,  8.05s/it]
 27%|██▋       | 10402/37963 [25:00:04<60:30:05,  7.90s/it]
 27%|██▋       | 10403/37963 [25:00:12<60:05:18,  7.85s/it]
 27%|██▋       | 10404/37963 [25:00:20<59:21:42,  7.75s/it]
 27%|██▋       | 10405/37963 [25:00:27<58:38:16,  7.66s/it]
 27%|██▋       | 10406/37963 [25:00:35<58:08:00,  7.59s/it]
 27%|██▋       | 10407/37963 [25:00:42<57:44:50,  7.54s/it]
 27%|██▋       | 10408/37963 [25:00:50<57:59:38,  7.58s/it]
 27%|██▋       | 10409/37963 [25:00:57<58:02:35,  7.58s/it]
 27%|██▋       | 10410/37963 [25:01:05<57:36:28,  7.53s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.126', 'learning_rate': '1.703e-05', 'epoch': '0.2742'}

 27%|██▋       | 10410/37963 [25:01:05<57:36:28,  7.53s/it]
 27%|██▋       | 10411/37963 [25:01:12<57:24:13,  7.50s/it]
 27%|██▋       | 10412/37963 [25:01:20<57:37:02,  7.53s/it]
 27%|██▋       | 10413/37963 [25:01:27<57:44:39,  7.55s/it]
 27%|██▋       | 10414/37963 [25:01:41<72:48:35,  9.51s/it]
 27%|██▋       | 10415/37963 [25:01:49<68:16:06,  8.92s/it]
 27%|██▋       | 10416/37963 [25:01:56<65:08:37,  8.51s/it]
 27%|██▋       | 10417/37963 [25:02:04<62:44:06,  8.20s/it]
 27%|██▋       | 10418/37963 [25:02:11<60:51:54,  7.95s/it]
 27%|██▋       | 10419/37963 [25:02:19<59:44:28,  7.81s/it]
 27%|██▋       | 10420/37963 [25:02:26<59:00:57,  7.71s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '4.977', 'learning_rate': '1.703e-05', 'epoch': '0.2745'}

 27%|██▋       | 10420/37963 [25:02:26<59:00:57,  7.71s/it]
 27%|██▋       | 10421/37963 [25:02:34<58:40:38,  7.67s/it]
 27%|██▋       | 10422/37963 [25:02:41<58:24:56,  7.64s/it]
 27%|██▋       | 10423/37963 [25:02:49<57:45:03,  7.55s/it]
 27%|██▋       | 10424/37963 [25:02:56<57:45:43,  7.55s/it]
 27%|██▋       | 10425/37963 [25:03:04<58:01:51,  7.59s/it]
 27%|██▋       | 10426/37963 [25:03:18<72:31:06,  9.48s/it]
 27%|██▋       | 10427/37963 [25:03:25<67:52:19,  8.87s/it]
 27%|██▋       | 10428/37963 [25:03:33<64:20:18,  8.41s/it]
 27%|██▋       | 10429/37963 [25:03:47<76:53:02, 10.05s/it]
 27%|██▋       | 10430/37963 [25:03:54<71:25:49,  9.34s/it]
                                                           
{'loss': '0.1698', 'grad_norm': '1.897', 'learning_rate': '1.702e-05', 'epoch': '0.2747'}

 27%|██▋       | 10430/37963 [25:03:54<71:25:49,  9.34s/it]
 27%|██▋       | 10431/37963 [25:04:01<66:22:46,  8.68s/it]
 27%|██▋       | 10432/37963 [25:04:15<78:17:17, 10.24s/it]
 27%|██▋       | 10433/37963 [25:04:23<72:06:20,  9.43s/it]
 27%|██▋       | 10434/37963 [25:04:30<67:42:21,  8.85s/it]
 27%|██▋       | 10435/37963 [25:04:38<64:11:36,  8.39s/it]
 27%|██▋       | 10436/37963 [25:04:45<62:10:03,  8.13s/it]
 27%|██▋       | 10437/37963 [25:04:53<60:31:43,  7.92s/it]
 27%|██▋       | 10438/37963 [25:05:00<58:32:41,  7.66s/it]
 27%|██▋       | 10439/37963 [25:05:14<72:58:00,  9.54s/it]
 28%|██▊       | 10440/37963 [25:05:21<68:36:41,  8.97s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '1.547', 'learning_rate': '1.701e-05', 'epoch': '0.275'}

 28%|██▊       | 10440/37963 [25:05:21<68:36:41,  8.97s/it]
 28%|██▊       | 10441/37963 [25:05:29<65:13:39,  8.53s/it]
 28%|██▊       | 10442/37963 [25:05:42<77:21:39, 10.12s/it]
 28%|██▊       | 10443/37963 [25:05:50<71:37:12,  9.37s/it]
 28%|██▊       | 10444/37963 [25:06:04<81:29:22, 10.66s/it]
 28%|██▊       | 10445/37963 [25:06:11<74:32:34,  9.75s/it]
 28%|██▊       | 10446/37963 [25:06:19<69:44:08,  9.12s/it]
 28%|██▊       | 10447/37963 [25:06:27<66:03:24,  8.64s/it]
 28%|██▊       | 10448/37963 [25:06:34<63:38:41,  8.33s/it]
 28%|██▊       | 10449/37963 [25:06:48<76:25:11, 10.00s/it]
 28%|██▊       | 10450/37963 [25:06:56<70:47:30,  9.26s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '1.282', 'learning_rate': '1.701e-05', 'epoch': '0.2753'}

 28%|██▊       | 10450/37963 [25:06:56<70:47:30,  9.26s/it]
 28%|██▊       | 10451/37963 [25:07:03<66:46:58,  8.74s/it]
 28%|██▊       | 10452/37963 [25:07:11<64:01:15,  8.38s/it]
 28%|██▊       | 10453/37963 [25:07:18<61:50:57,  8.09s/it]
 28%|██▊       | 10454/37963 [25:07:25<60:09:52,  7.87s/it]
 28%|██▊       | 10455/37963 [25:07:33<59:12:53,  7.75s/it]
 28%|██▊       | 10456/37963 [25:07:40<58:30:06,  7.66s/it]
 28%|██▊       | 10457/37963 [25:07:48<58:16:01,  7.63s/it]
 28%|██▊       | 10458/37963 [25:07:56<58:19:29,  7.63s/it]
 28%|██▊       | 10459/37963 [25:08:03<58:07:46,  7.61s/it]
 28%|██▊       | 10460/37963 [25:08:17<72:33:37,  9.50s/it]
                                                           
{'loss': '0.1693', 'grad_norm': '1.072', 'learning_rate': '1.7e-05', 'epoch': '0.2755'}

 28%|██▊       | 10460/37963 [25:08:17<72:33:37,  9.50s/it]
 28%|██▊       | 10461/37963 [25:08:25<68:15:21,  8.93s/it]
 28%|██▊       | 10462/37963 [25:08:32<64:59:25,  8.51s/it]
 28%|██▊       | 10463/37963 [25:08:40<62:55:31,  8.24s/it]
 28%|██▊       | 10464/37963 [25:08:47<61:06:24,  8.00s/it]
 28%|██▊       | 10465/37963 [25:08:55<60:01:50,  7.86s/it]
 28%|██▊       | 10466/37963 [25:09:02<59:11:04,  7.75s/it]
 28%|██▊       | 10467/37963 [25:09:10<58:41:37,  7.68s/it]
 28%|██▊       | 10468/37963 [25:09:17<58:31:04,  7.66s/it]
 28%|██▊       | 10469/37963 [25:09:25<58:13:55,  7.62s/it]
 28%|██▊       | 10470/37963 [25:09:32<57:58:19,  7.59s/it]
                                                           
{'loss': '0.175', 'grad_norm': '2.684', 'learning_rate': '1.7e-05', 'epoch': '0.2758'}

 28%|██▊       | 10470/37963 [25:09:32<57:58:19,  7.59s/it]
 28%|██▊       | 10471/37963 [25:09:40<58:03:25,  7.60s/it]
 28%|██▊       | 10472/37963 [25:09:48<57:51:14,  7.58s/it]
 28%|██▊       | 10473/37963 [25:09:55<57:29:08,  7.53s/it]
 28%|██▊       | 10474/37963 [25:10:09<72:21:07,  9.48s/it]
 28%|██▊       | 10475/37963 [25:10:17<68:08:43,  8.92s/it]
 28%|██▊       | 10476/37963 [25:10:24<64:51:14,  8.49s/it]
 28%|██▊       | 10477/37963 [25:10:38<77:51:16, 10.20s/it]
 28%|██▊       | 10478/37963 [25:10:46<71:57:08,  9.42s/it]
 28%|██▊       | 10479/37963 [25:11:00<82:44:11, 10.84s/it]
 28%|██▊       | 10480/37963 [25:11:08<75:06:20,  9.84s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '1.429', 'learning_rate': '1.699e-05', 'epoch': '0.2761'}

 28%|██▊       | 10480/37963 [25:11:08<75:06:20,  9.84s/it]
 28%|██▊       | 10481/37963 [25:11:15<69:46:20,  9.14s/it]
 28%|██▊       | 10482/37963 [25:11:23<66:08:18,  8.66s/it]
 28%|██▊       | 10483/37963 [25:11:30<62:48:44,  8.23s/it]
 28%|██▊       | 10484/37963 [25:11:38<61:39:14,  8.08s/it]
 28%|██▊       | 10485/37963 [25:11:45<60:23:30,  7.91s/it]
 28%|██▊       | 10486/37963 [25:11:53<59:26:05,  7.79s/it]
 28%|██▊       | 10487/37963 [25:12:00<58:32:41,  7.67s/it]
 28%|██▊       | 10488/37963 [25:12:14<73:01:40,  9.57s/it]
 28%|██▊       | 10489/37963 [25:12:21<68:12:12,  8.94s/it]
 28%|██▊       | 10490/37963 [25:12:29<64:55:04,  8.51s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '5.177', 'learning_rate': '1.698e-05', 'epoch': '0.2763'}

 28%|██▊       | 10490/37963 [25:12:29<64:55:04,  8.51s/it]
 28%|██▊       | 10491/37963 [25:12:37<62:51:52,  8.24s/it]
 28%|██▊       | 10492/37963 [25:12:50<75:54:44,  9.95s/it]
 28%|██▊       | 10493/37963 [25:13:04<85:10:16, 11.16s/it]
 28%|██▊       | 10494/37963 [25:13:12<76:47:47, 10.06s/it]
 28%|██▊       | 10495/37963 [25:13:20<71:11:35,  9.33s/it]
 28%|██▊       | 10496/37963 [25:13:27<66:42:51,  8.74s/it]
 28%|██▊       | 10497/37963 [25:13:35<63:58:05,  8.38s/it]
 28%|██▊       | 10498/37963 [25:13:42<61:42:55,  8.09s/it]
 28%|██▊       | 10499/37963 [25:13:49<60:11:49,  7.89s/it]
 28%|██▊       | 10500/37963 [25:13:57<58:34:41,  7.68s/it]
                                                           
{'loss': '0.1656', 'grad_norm': '1.943', 'learning_rate': '1.698e-05', 'epoch': '0.2766'}

 28%|██▊       | 10500/37963 [25:13:57<58:34:41,  7.68s/it]
 28%|██▊       | 10501/37963 [25:14:04<58:08:08,  7.62s/it]
 28%|██▊       | 10502/37963 [25:14:12<58:03:11,  7.61s/it]
 28%|██▊       | 10503/37963 [25:14:19<57:51:57,  7.59s/it]
 28%|██▊       | 10504/37963 [25:14:27<57:51:51,  7.59s/it]
 28%|██▊       | 10505/37963 [25:14:34<57:46:07,  7.57s/it]
 28%|██▊       | 10506/37963 [25:14:41<56:48:46,  7.45s/it]
 28%|██▊       | 10507/37963 [25:14:49<56:55:48,  7.46s/it]
 28%|██▊       | 10508/37963 [25:14:56<57:05:45,  7.49s/it]
 28%|██▊       | 10509/37963 [25:15:11<72:34:48,  9.52s/it]
 28%|██▊       | 10510/37963 [25:15:18<67:52:21,  8.90s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.403', 'learning_rate': '1.697e-05', 'epoch': '0.2768'}

 28%|██▊       | 10510/37963 [25:15:18<67:52:21,  8.90s/it]
 28%|██▊       | 10511/37963 [25:15:26<64:39:35,  8.48s/it]
 28%|██▊       | 10512/37963 [25:15:33<61:36:38,  8.08s/it]
 28%|██▊       | 10513/37963 [25:15:40<60:04:55,  7.88s/it]
 28%|██▊       | 10514/37963 [25:15:48<59:11:29,  7.76s/it]
 28%|██▊       | 10515/37963 [25:15:55<58:36:40,  7.69s/it]
 28%|██▊       | 10516/37963 [25:16:03<58:23:57,  7.66s/it]
 28%|██▊       | 10517/37963 [25:16:11<58:22:57,  7.66s/it]
 28%|██▊       | 10518/37963 [25:16:18<57:56:26,  7.60s/it]
 28%|██▊       | 10519/37963 [25:16:26<58:00:44,  7.61s/it]
 28%|██▊       | 10520/37963 [25:16:33<57:20:50,  7.52s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.428', 'learning_rate': '1.697e-05', 'epoch': '0.2771'}

 28%|██▊       | 10520/37963 [25:16:33<57:20:50,  7.52s/it]
 28%|██▊       | 10521/37963 [25:16:40<57:26:49,  7.54s/it]
 28%|██▊       | 10522/37963 [25:16:48<57:37:24,  7.56s/it]
 28%|██▊       | 10523/37963 [25:17:02<72:10:26,  9.47s/it]
 28%|██▊       | 10524/37963 [25:17:16<82:09:21, 10.78s/it]
 28%|██▊       | 10525/37963 [25:17:23<74:44:58,  9.81s/it]
 28%|██▊       | 10526/37963 [25:17:31<68:51:21,  9.03s/it]
 28%|██▊       | 10527/37963 [25:17:38<65:16:03,  8.56s/it]
 28%|██▊       | 10528/37963 [25:17:52<76:57:09, 10.10s/it]
 28%|██▊       | 10529/37963 [25:17:59<70:39:48,  9.27s/it]
 28%|██▊       | 10530/37963 [25:18:07<66:59:43,  8.79s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.499', 'learning_rate': '1.696e-05', 'epoch': '0.2774'}

 28%|██▊       | 10530/37963 [25:18:07<66:59:43,  8.79s/it]
 28%|██▊       | 10531/37963 [25:18:14<63:55:52,  8.39s/it]
 28%|██▊       | 10532/37963 [25:18:22<61:53:23,  8.12s/it]
 28%|██▊       | 10533/37963 [25:18:29<60:28:28,  7.94s/it]
 28%|██▊       | 10534/37963 [25:18:36<58:36:00,  7.69s/it]
 28%|██▊       | 10535/37963 [25:18:44<58:00:20,  7.61s/it]
 28%|██▊       | 10536/37963 [25:18:51<57:52:31,  7.60s/it]
 28%|██▊       | 10537/37963 [25:19:05<72:31:40,  9.52s/it]
 28%|██▊       | 10538/37963 [25:19:19<82:37:57, 10.85s/it]
 28%|██▊       | 10539/37963 [25:19:27<75:12:47,  9.87s/it]
 28%|██▊       | 10540/37963 [25:19:41<85:08:32, 11.18s/it]
                                                           
{'loss': '0.1767', 'grad_norm': '1.134', 'learning_rate': '1.695e-05', 'epoch': '0.2776'}

 28%|██▊       | 10540/37963 [25:19:41<85:08:32, 11.18s/it]
 28%|██▊       | 10541/37963 [25:19:55<91:59:49, 12.08s/it]
 28%|██▊       | 10542/37963 [25:20:03<81:40:25, 10.72s/it]
 28%|██▊       | 10543/37963 [25:20:10<74:11:34,  9.74s/it]
 28%|██▊       | 10544/37963 [25:20:18<69:29:34,  9.12s/it]
 28%|██▊       | 10545/37963 [25:20:25<65:24:23,  8.59s/it]
 28%|██▊       | 10546/37963 [25:20:33<63:05:04,  8.28s/it]
 28%|██▊       | 10547/37963 [25:20:40<61:19:29,  8.05s/it]
 28%|██▊       | 10548/37963 [25:20:48<59:21:15,  7.79s/it]
 28%|██▊       | 10549/37963 [25:20:55<58:43:25,  7.71s/it]
 28%|██▊       | 10550/37963 [25:21:03<58:22:15,  7.67s/it]
                                                           
{'loss': '0.1744', 'grad_norm': '4.315', 'learning_rate': '1.695e-05', 'epoch': '0.2779'}

 28%|██▊       | 10550/37963 [25:21:03<58:22:15,  7.67s/it]
 28%|██▊       | 10551/37963 [25:21:10<58:08:10,  7.63s/it]
 28%|██▊       | 10552/37963 [25:21:18<58:09:28,  7.64s/it]
 28%|██▊       | 10553/37963 [25:21:25<57:51:11,  7.60s/it]
 28%|██▊       | 10554/37963 [25:21:33<57:38:50,  7.57s/it]
 28%|██▊       | 10555/37963 [25:21:40<57:31:50,  7.56s/it]
 28%|██▊       | 10556/37963 [25:21:48<57:19:48,  7.53s/it]
 28%|██▊       | 10557/37963 [25:22:02<71:48:27,  9.43s/it]
 28%|██▊       | 10558/37963 [25:22:09<67:35:55,  8.88s/it]
 28%|██▊       | 10559/37963 [25:22:17<64:22:13,  8.46s/it]
 28%|██▊       | 10560/37963 [25:22:24<62:26:31,  8.20s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.555', 'learning_rate': '1.694e-05', 'epoch': '0.2782'}

 28%|██▊       | 10560/37963 [25:22:24<62:26:31,  8.20s/it]
 28%|██▊       | 10561/37963 [25:22:32<60:52:35,  8.00s/it]
 28%|██▊       | 10562/37963 [25:22:40<59:50:14,  7.86s/it]
 28%|██▊       | 10563/37963 [25:22:47<59:09:30,  7.77s/it]
 28%|██▊       | 10564/37963 [25:22:55<58:30:42,  7.69s/it]
 28%|██▊       | 10565/37963 [25:23:02<58:20:48,  7.67s/it]
 28%|██▊       | 10566/37963 [25:23:09<57:24:30,  7.54s/it]
 28%|██▊       | 10567/37963 [25:23:17<57:10:01,  7.51s/it]
 28%|██▊       | 10568/37963 [25:23:31<71:55:10,  9.45s/it]
 28%|██▊       | 10569/37963 [25:23:38<67:40:59,  8.89s/it]
 28%|██▊       | 10570/37963 [25:23:46<64:47:34,  8.52s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '2.095', 'learning_rate': '1.693e-05', 'epoch': '0.2784'}

 28%|██▊       | 10570/37963 [25:23:46<64:47:34,  8.52s/it]
 28%|██▊       | 10571/37963 [25:23:54<62:23:33,  8.20s/it]
 28%|██▊       | 10572/37963 [25:24:01<60:59:36,  8.02s/it]
 28%|██▊       | 10573/37963 [25:24:09<59:56:10,  7.88s/it]
 28%|██▊       | 10574/37963 [25:24:16<59:06:34,  7.77s/it]
 28%|██▊       | 10575/37963 [25:24:30<73:05:19,  9.61s/it]
 28%|██▊       | 10576/37963 [25:24:44<82:55:20, 10.90s/it]
 28%|██▊       | 10577/37963 [25:24:52<75:31:15,  9.93s/it]
 28%|██▊       | 10578/37963 [25:24:59<70:06:16,  9.22s/it]
 28%|██▊       | 10579/37963 [25:25:06<65:38:02,  8.63s/it]
 28%|██▊       | 10580/37963 [25:25:14<62:51:04,  8.26s/it]
                                                           
{'loss': '0.1683', 'grad_norm': '1.849', 'learning_rate': '1.693e-05', 'epoch': '0.2787'}

 28%|██▊       | 10580/37963 [25:25:14<62:51:04,  8.26s/it]
 28%|██▊       | 10581/37963 [25:25:21<61:13:28,  8.05s/it]
 28%|██▊       | 10582/37963 [25:25:29<60:10:55,  7.91s/it]
 28%|██▊       | 10583/37963 [25:25:36<58:34:26,  7.70s/it]
 28%|██▊       | 10584/37963 [25:25:57<87:20:31, 11.48s/it]
 28%|██▊       | 10585/37963 [25:26:04<77:52:05, 10.24s/it]
 28%|██▊       | 10586/37963 [25:26:11<71:30:17,  9.40s/it]
 28%|██▊       | 10587/37963 [25:26:25<82:04:01, 10.79s/it]
 28%|██▊       | 10588/37963 [25:26:33<75:06:27,  9.88s/it]
 28%|██▊       | 10589/37963 [25:26:41<69:54:52,  9.19s/it]
 28%|██▊       | 10590/37963 [25:26:48<66:16:15,  8.72s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '2.906', 'learning_rate': '1.692e-05', 'epoch': '0.279'}

 28%|██▊       | 10590/37963 [25:26:48<66:16:15,  8.72s/it]
 28%|██▊       | 10591/37963 [25:26:56<63:38:27,  8.37s/it]
 28%|██▊       | 10592/37963 [25:27:10<76:27:35, 10.06s/it]
 28%|██▊       | 10593/37963 [25:27:18<71:24:40,  9.39s/it]
 28%|██▊       | 10594/37963 [25:27:25<67:21:51,  8.86s/it]
 28%|██▊       | 10595/37963 [25:27:33<64:18:41,  8.46s/it]
 28%|██▊       | 10596/37963 [25:27:40<62:08:25,  8.17s/it]
 28%|██▊       | 10597/37963 [25:27:48<60:04:31,  7.90s/it]
 28%|██▊       | 10598/37963 [25:27:55<59:14:00,  7.79s/it]
 28%|██▊       | 10599/37963 [25:28:03<58:31:39,  7.70s/it]
 28%|██▊       | 10600/37963 [25:28:10<58:07:11,  7.65s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '3.114', 'learning_rate': '1.692e-05', 'epoch': '0.2792'}

 28%|██▊       | 10600/37963 [25:28:10<58:07:11,  7.65s/it]
 28%|██▊       | 10601/37963 [25:28:18<57:44:28,  7.60s/it]
 28%|██▊       | 10602/37963 [25:28:25<57:31:25,  7.57s/it]
 28%|██▊       | 10603/37963 [25:28:39<72:01:42,  9.48s/it]
 28%|██▊       | 10604/37963 [25:28:47<67:49:33,  8.92s/it]
 28%|██▊       | 10605/37963 [25:28:54<64:46:19,  8.52s/it]
 28%|██▊       | 10606/37963 [25:29:01<61:24:22,  8.08s/it]
 28%|██▊       | 10607/37963 [25:29:09<60:07:12,  7.91s/it]
 28%|██▊       | 10608/37963 [25:29:16<58:34:30,  7.71s/it]
 28%|██▊       | 10609/37963 [25:29:24<58:12:46,  7.66s/it]
 28%|██▊       | 10610/37963 [25:29:31<57:33:24,  7.58s/it]
                                                           
{'loss': '0.1753', 'grad_norm': '3.329', 'learning_rate': '1.691e-05', 'epoch': '0.2795'}

 28%|██▊       | 10610/37963 [25:29:31<57:33:24,  7.58s/it]
 28%|██▊       | 10611/37963 [25:29:39<57:35:26,  7.58s/it]
 28%|██▊       | 10612/37963 [25:29:46<57:31:01,  7.57s/it]
 28%|██▊       | 10613/37963 [25:29:54<57:30:25,  7.57s/it]
 28%|██▊       | 10614/37963 [25:30:07<71:19:26,  9.39s/it]
 28%|██▊       | 10615/37963 [25:30:15<67:11:56,  8.85s/it]
 28%|██▊       | 10616/37963 [25:30:23<64:26:29,  8.48s/it]
 28%|██▊       | 10617/37963 [25:30:30<62:04:43,  8.17s/it]
 28%|██▊       | 10618/37963 [25:30:37<60:23:06,  7.95s/it]
 28%|██▊       | 10619/37963 [25:30:52<74:20:38,  9.79s/it]
 28%|██▊       | 10620/37963 [25:31:05<83:33:40, 11.00s/it]
                                                           
{'loss': '0.1796', 'grad_norm': '2.49', 'learning_rate': '1.69e-05', 'epoch': '0.2797'}

 28%|██▊       | 10620/37963 [25:31:05<83:33:40, 11.00s/it]
 28%|██▊       | 10621/37963 [25:31:13<74:42:06,  9.84s/it]
 28%|██▊       | 10622/37963 [25:31:20<69:08:52,  9.10s/it]
 28%|██▊       | 10623/37963 [25:31:27<64:45:56,  8.53s/it]
 28%|██▊       | 10624/37963 [25:31:35<62:31:49,  8.23s/it]
 28%|██▊       | 10625/37963 [25:31:42<60:57:38,  8.03s/it]
 28%|██▊       | 10626/37963 [25:31:50<59:48:05,  7.88s/it]
 28%|██▊       | 10627/37963 [25:31:57<58:11:09,  7.66s/it]
 28%|██▊       | 10628/37963 [25:32:04<57:23:05,  7.56s/it]
 28%|██▊       | 10629/37963 [25:32:12<57:19:22,  7.55s/it]
 28%|██▊       | 10630/37963 [25:32:19<57:14:25,  7.54s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '1.136', 'learning_rate': '1.69e-05', 'epoch': '0.28'}

 28%|██▊       | 10630/37963 [25:32:19<57:14:25,  7.54s/it]
 28%|██▊       | 10631/37963 [25:32:33<71:41:07,  9.44s/it]
 28%|██▊       | 10632/37963 [25:32:47<82:10:59, 10.83s/it]
 28%|██▊       | 10633/37963 [25:33:01<88:54:07, 11.71s/it]
 28%|██▊       | 10634/37963 [25:33:08<78:36:38, 10.36s/it]
 28%|██▊       | 10635/37963 [25:33:16<72:15:30,  9.52s/it]
 28%|██▊       | 10636/37963 [25:33:23<66:53:59,  8.81s/it]
 28%|██▊       | 10637/37963 [25:33:31<64:14:58,  8.46s/it]
 28%|██▊       | 10638/37963 [25:33:38<61:52:12,  8.15s/it]
 28%|██▊       | 10639/37963 [25:33:45<60:27:26,  7.97s/it]
 28%|██▊       | 10640/37963 [25:33:53<59:22:38,  7.82s/it]
                                                           
{'loss': '0.1664', 'grad_norm': '2.216', 'learning_rate': '1.689e-05', 'epoch': '0.2803'}

 28%|██▊       | 10640/37963 [25:33:53<59:22:38,  7.82s/it]
 28%|██▊       | 10641/37963 [25:34:01<58:49:46,  7.75s/it]
 28%|██▊       | 10642/37963 [25:34:08<58:25:44,  7.70s/it]
 28%|██▊       | 10643/37963 [25:34:16<57:59:21,  7.64s/it]
 28%|██▊       | 10644/37963 [25:34:23<57:46:34,  7.61s/it]
 28%|██▊       | 10645/37963 [25:34:31<57:36:29,  7.59s/it]
 28%|██▊       | 10646/37963 [25:34:38<57:40:30,  7.60s/it]
 28%|██▊       | 10647/37963 [25:34:52<72:10:37,  9.51s/it]
 28%|██▊       | 10648/37963 [25:35:00<67:48:10,  8.94s/it]
 28%|██▊       | 10649/37963 [25:35:07<64:13:45,  8.47s/it]
 28%|██▊       | 10650/37963 [25:35:15<62:01:11,  8.17s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.987', 'learning_rate': '1.689e-05', 'epoch': '0.2805'}

 28%|██▊       | 10650/37963 [25:35:15<62:01:11,  8.17s/it]
 28%|██▊       | 10651/37963 [25:35:22<60:43:56,  8.01s/it]
 28%|██▊       | 10652/37963 [25:35:36<73:29:57,  9.69s/it]
 28%|██▊       | 10653/37963 [25:35:43<68:19:38,  9.01s/it]
 28%|██▊       | 10654/37963 [25:35:51<65:03:00,  8.58s/it]
 28%|██▊       | 10655/37963 [25:35:58<62:07:07,  8.19s/it]
 28%|██▊       | 10656/37963 [25:36:06<59:58:40,  7.91s/it]
 28%|██▊       | 10657/37963 [25:36:13<59:11:36,  7.80s/it]
 28%|██▊       | 10658/37963 [25:36:21<58:38:12,  7.73s/it]
 28%|██▊       | 10659/37963 [25:36:28<57:58:48,  7.64s/it]
 28%|██▊       | 10660/37963 [25:36:36<57:49:57,  7.63s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '3.473', 'learning_rate': '1.688e-05', 'epoch': '0.2808'}

 28%|██▊       | 10660/37963 [25:36:36<57:49:57,  7.63s/it]
 28%|██▊       | 10661/37963 [25:36:43<57:32:09,  7.59s/it]
 28%|██▊       | 10662/37963 [25:36:51<57:23:17,  7.57s/it]
 28%|██▊       | 10663/37963 [25:36:58<57:27:06,  7.58s/it]
 28%|██▊       | 10664/37963 [25:37:12<72:09:52,  9.52s/it]
 28%|██▊       | 10665/37963 [25:37:26<82:19:38, 10.86s/it]
 28%|██▊       | 10666/37963 [25:37:34<75:00:22,  9.89s/it]
 28%|██▊       | 10667/37963 [25:37:48<84:45:15, 11.18s/it]
 28%|██▊       | 10668/37963 [25:37:56<76:14:26, 10.06s/it]
 28%|██▊       | 10669/37963 [25:38:03<70:27:44,  9.29s/it]
 28%|██▊       | 10670/37963 [25:38:11<66:44:19,  8.80s/it]
                                                           
{'loss': '0.168', 'grad_norm': '2.72', 'learning_rate': '1.687e-05', 'epoch': '0.2811'}

 28%|██▊       | 10670/37963 [25:38:11<66:44:19,  8.80s/it]
 28%|██▊       | 10671/37963 [25:38:18<63:47:29,  8.41s/it]
 28%|██▊       | 10672/37963 [25:38:25<60:54:33,  8.03s/it]
 28%|██▊       | 10673/37963 [25:38:33<59:04:34,  7.79s/it]
 28%|██▊       | 10674/37963 [25:38:40<58:28:09,  7.71s/it]
 28%|██▊       | 10675/37963 [25:38:48<58:14:36,  7.68s/it]
 28%|██▊       | 10676/37963 [25:38:55<57:29:39,  7.59s/it]
 28%|██▊       | 10677/37963 [25:39:02<56:45:59,  7.49s/it]
 28%|██▊       | 10678/37963 [25:39:10<56:49:18,  7.50s/it]
 28%|██▊       | 10679/37963 [25:39:17<56:53:41,  7.51s/it]
 28%|██▊       | 10680/37963 [25:39:31<71:17:42,  9.41s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.478', 'learning_rate': '1.687e-05', 'epoch': '0.2813'}

 28%|██▊       | 10680/37963 [25:39:31<71:17:42,  9.41s/it]
 28%|██▊       | 10681/37963 [25:39:39<67:05:15,  8.85s/it]
 28%|██▊       | 10682/37963 [25:39:46<63:40:16,  8.40s/it]
 28%|██▊       | 10683/37963 [25:40:00<75:56:21, 10.02s/it]
 28%|██▊       | 10684/37963 [25:40:14<84:55:53, 11.21s/it]
 28%|██▊       | 10685/37963 [25:40:21<76:03:15, 10.04s/it]
 28%|██▊       | 10686/37963 [25:40:28<69:39:57,  9.19s/it]
 28%|██▊       | 10687/37963 [25:40:36<65:58:51,  8.71s/it]
 28%|██▊       | 10688/37963 [25:40:44<63:34:13,  8.39s/it]
 28%|██▊       | 10689/37963 [25:40:51<62:02:43,  8.19s/it]
 28%|██▊       | 10690/37963 [25:40:59<60:02:29,  7.93s/it]
                                                           
{'loss': '0.1705', 'grad_norm': '4.692', 'learning_rate': '1.686e-05', 'epoch': '0.2816'}

 28%|██▊       | 10690/37963 [25:40:59<60:02:29,  7.93s/it]
 28%|██▊       | 10691/37963 [25:41:06<59:10:33,  7.81s/it]
 28%|██▊       | 10692/37963 [25:41:20<72:46:32,  9.61s/it]
 28%|██▊       | 10693/37963 [25:41:28<68:14:23,  9.01s/it]
 28%|██▊       | 10694/37963 [25:41:35<65:02:05,  8.59s/it]
 28%|██▊       | 10695/37963 [25:41:43<62:41:44,  8.28s/it]
 28%|██▊       | 10696/37963 [25:41:57<75:42:28, 10.00s/it]
 28%|██▊       | 10697/37963 [25:42:04<69:31:59,  9.18s/it]
 28%|██▊       | 10698/37963 [25:42:12<66:36:28,  8.79s/it]
 28%|██▊       | 10699/37963 [25:42:19<62:56:26,  8.31s/it]
 28%|██▊       | 10700/37963 [25:42:27<61:18:49,  8.10s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.765', 'learning_rate': '1.685e-05', 'epoch': '0.2819'}

 28%|██▊       | 10700/37963 [25:42:27<61:18:49,  8.10s/it]
 28%|██▊       | 10701/37963 [25:42:34<60:04:28,  7.93s/it]
 28%|██▊       | 10702/37963 [25:42:42<59:07:57,  7.81s/it]
 28%|██▊       | 10703/37963 [25:42:49<58:29:29,  7.72s/it]
 28%|██▊       | 10704/37963 [25:42:57<57:28:52,  7.59s/it]
 28%|██▊       | 10705/37963 [25:43:04<57:17:42,  7.57s/it]
 28%|██▊       | 10706/37963 [25:43:12<56:58:05,  7.52s/it]
 28%|██▊       | 10707/37963 [25:43:19<57:11:16,  7.55s/it]
 28%|██▊       | 10708/37963 [25:43:27<56:40:49,  7.49s/it]
 28%|██▊       | 10709/37963 [25:43:40<71:10:15,  9.40s/it]
 28%|██▊       | 10710/37963 [25:43:48<66:40:11,  8.81s/it]
                                                           
{'loss': '0.165', 'grad_norm': '1.041', 'learning_rate': '1.685e-05', 'epoch': '0.2821'}

 28%|██▊       | 10710/37963 [25:43:48<66:40:11,  8.81s/it]
 28%|██▊       | 10711/37963 [25:43:55<63:39:46,  8.41s/it]
 28%|██▊       | 10712/37963 [25:44:03<61:24:19,  8.11s/it]
 28%|██▊       | 10713/37963 [25:44:10<60:04:33,  7.94s/it]
 28%|██▊       | 10714/37963 [25:44:24<73:49:01,  9.75s/it]
 28%|██▊       | 10715/37963 [25:44:32<68:22:25,  9.03s/it]
 28%|██▊       | 10716/37963 [25:44:46<79:53:34, 10.56s/it]
 28%|██▊       | 10717/37963 [25:44:53<72:38:56,  9.60s/it]
 28%|██▊       | 10718/37963 [25:45:00<67:32:06,  8.92s/it]
 28%|██▊       | 10719/37963 [25:45:08<64:17:11,  8.49s/it]
 28%|██▊       | 10720/37963 [25:45:15<61:38:10,  8.14s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.246', 'learning_rate': '1.684e-05', 'epoch': '0.2824'}

 28%|██▊       | 10720/37963 [25:45:15<61:38:10,  8.14s/it]
 28%|██▊       | 10721/37963 [25:45:23<60:27:46,  7.99s/it]
 28%|██▊       | 10722/37963 [25:45:31<59:37:19,  7.88s/it]
 28%|██▊       | 10723/37963 [25:45:38<59:04:47,  7.81s/it]
 28%|██▊       | 10724/37963 [25:45:46<58:18:41,  7.71s/it]
 28%|██▊       | 10725/37963 [25:45:53<58:05:21,  7.68s/it]
 28%|██▊       | 10726/37963 [25:46:01<57:41:14,  7.62s/it]
 28%|██▊       | 10727/37963 [25:46:08<57:36:07,  7.61s/it]
 28%|██▊       | 10728/37963 [25:46:23<72:31:11,  9.59s/it]
 28%|██▊       | 10729/37963 [25:46:30<68:01:16,  8.99s/it]
 28%|██▊       | 10730/37963 [25:46:38<64:46:59,  8.56s/it]
                                                           
{'loss': '0.1495', 'grad_norm': '1.945', 'learning_rate': '1.684e-05', 'epoch': '0.2826'}

 28%|██▊       | 10730/37963 [25:46:38<64:46:59,  8.56s/it]
 28%|██▊       | 10731/37963 [25:46:58<91:06:34, 12.04s/it]
 28%|██▊       | 10732/37963 [25:47:05<80:32:54, 10.65s/it]
 28%|██▊       | 10733/37963 [25:47:13<73:08:16,  9.67s/it]
 28%|██▊       | 10734/37963 [25:47:20<68:10:41,  9.01s/it]
 28%|██▊       | 10735/37963 [25:47:28<64:46:27,  8.56s/it]
 28%|██▊       | 10736/37963 [25:47:35<62:08:48,  8.22s/it]
 28%|██▊       | 10737/37963 [25:47:43<60:42:03,  8.03s/it]
 28%|██▊       | 10738/37963 [25:47:50<59:08:32,  7.82s/it]
 28%|██▊       | 10739/37963 [25:47:58<58:29:33,  7.73s/it]
 28%|██▊       | 10740/37963 [25:48:12<72:46:47,  9.62s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '1.718', 'learning_rate': '1.683e-05', 'epoch': '0.2829'}

 28%|██▊       | 10740/37963 [25:48:12<72:46:47,  9.62s/it]
 28%|██▊       | 10741/37963 [25:48:19<68:15:06,  9.03s/it]
 28%|██▊       | 10742/37963 [25:48:27<64:58:01,  8.59s/it]
 28%|██▊       | 10743/37963 [25:48:34<61:59:51,  8.20s/it]
 28%|██▊       | 10744/37963 [25:48:48<74:02:11,  9.79s/it]
 28%|██▊       | 10745/37963 [25:48:55<69:01:36,  9.13s/it]
 28%|██▊       | 10746/37963 [25:49:03<65:12:42,  8.63s/it]
 28%|██▊       | 10747/37963 [25:49:10<62:45:34,  8.30s/it]
 28%|██▊       | 10748/37963 [25:49:18<60:51:02,  8.05s/it]
 28%|██▊       | 10749/37963 [25:49:25<59:46:07,  7.91s/it]
 28%|██▊       | 10750/37963 [25:49:33<58:50:39,  7.78s/it]
                                                           
{'loss': '0.1731', 'grad_norm': '2.181', 'learning_rate': '1.682e-05', 'epoch': '0.2832'}

 28%|██▊       | 10750/37963 [25:49:33<58:50:39,  7.78s/it]
 28%|██▊       | 10751/37963 [25:49:40<58:16:32,  7.71s/it]
 28%|██▊       | 10752/37963 [25:49:48<57:53:51,  7.66s/it]
 28%|██▊       | 10753/37963 [25:49:55<56:57:49,  7.54s/it]
 28%|██▊       | 10754/37963 [25:50:02<56:54:31,  7.53s/it]
 28%|██▊       | 10755/37963 [25:50:10<56:27:47,  7.47s/it]
 28%|██▊       | 10756/37963 [25:50:17<56:26:24,  7.47s/it]
 28%|██▊       | 10757/37963 [25:50:25<56:33:16,  7.48s/it]
 28%|██▊       | 10758/37963 [25:50:32<56:37:57,  7.49s/it]
 28%|██▊       | 10759/37963 [25:50:40<56:24:42,  7.47s/it]
 28%|██▊       | 10760/37963 [25:50:47<56:37:00,  7.49s/it]
                                                           
{'loss': '0.1743', 'grad_norm': '1.63', 'learning_rate': '1.682e-05', 'epoch': '0.2834'}

 28%|██▊       | 10760/37963 [25:50:47<56:37:00,  7.49s/it]
 28%|██▊       | 10761/37963 [25:50:55<56:40:49,  7.50s/it]
 28%|██▊       | 10762/37963 [25:51:09<71:45:11,  9.50s/it]
 28%|██▊       | 10763/37963 [25:51:23<82:16:15, 10.89s/it]
 28%|██▊       | 10764/37963 [25:51:30<74:15:45,  9.83s/it]
 28%|██▊       | 10765/37963 [25:51:44<83:39:08, 11.07s/it]
 28%|██▊       | 10766/37963 [25:51:52<75:20:46,  9.97s/it]
 28%|██▊       | 10767/37963 [25:51:59<69:48:41,  9.24s/it]
 28%|██▊       | 10768/37963 [25:52:07<65:54:53,  8.73s/it]
 28%|██▊       | 10769/37963 [25:52:14<63:13:40,  8.37s/it]
 28%|██▊       | 10770/37963 [25:52:22<61:16:34,  8.11s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.569', 'learning_rate': '1.681e-05', 'epoch': '0.2837'}

 28%|██▊       | 10770/37963 [25:52:22<61:16:34,  8.11s/it]
 28%|██▊       | 10771/37963 [25:52:30<60:07:02,  7.96s/it]
 28%|██▊       | 10772/37963 [25:52:37<59:06:56,  7.83s/it]
 28%|██▊       | 10773/37963 [25:52:44<58:05:32,  7.69s/it]
 28%|██▊       | 10774/37963 [25:52:52<57:41:55,  7.64s/it]
 28%|██▊       | 10775/37963 [25:52:59<57:25:40,  7.60s/it]
 28%|██▊       | 10776/37963 [25:53:07<57:04:36,  7.56s/it]
 28%|██▊       | 10777/37963 [25:53:14<57:06:50,  7.56s/it]
 28%|██▊       | 10778/37963 [25:53:28<71:16:23,  9.44s/it]
 28%|██▊       | 10779/37963 [25:53:43<82:03:36, 10.87s/it]
 28%|██▊       | 10780/37963 [25:53:56<89:05:31, 11.80s/it]
                                                           
{'loss': '0.1686', 'grad_norm': '1.724', 'learning_rate': '1.68e-05', 'epoch': '0.284'}

 28%|██▊       | 10780/37963 [25:53:56<89:05:31, 11.80s/it]
 28%|██▊       | 10781/37963 [25:54:04<79:36:40, 10.54s/it]
 28%|██▊       | 10782/37963 [25:54:12<72:42:32,  9.63s/it]
 28%|██▊       | 10783/37963 [25:54:19<68:03:56,  9.02s/it]
 28%|██▊       | 10784/37963 [25:54:27<64:18:30,  8.52s/it]
 28%|██▊       | 10785/37963 [25:54:34<62:09:27,  8.23s/it]
 28%|██▊       | 10786/37963 [25:54:42<60:40:34,  8.04s/it]
 28%|██▊       | 10787/37963 [25:54:49<59:42:59,  7.91s/it]
 28%|██▊       | 10788/37963 [25:55:03<73:25:05,  9.73s/it]
 28%|██▊       | 10789/37963 [25:55:11<68:49:41,  9.12s/it]
 28%|██▊       | 10790/37963 [25:55:18<64:20:06,  8.52s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '4.269', 'learning_rate': '1.68e-05', 'epoch': '0.2842'}

 28%|██▊       | 10790/37963 [25:55:18<64:20:06,  8.52s/it]
 28%|██▊       | 10791/37963 [25:55:25<61:28:58,  8.15s/it]
 28%|██▊       | 10792/37963 [25:55:39<73:48:14,  9.78s/it]
 28%|██▊       | 10793/37963 [25:55:47<68:46:02,  9.11s/it]
 28%|██▊       | 10794/37963 [25:55:54<64:59:34,  8.61s/it]
 28%|██▊       | 10795/37963 [25:56:01<62:27:43,  8.28s/it]
 28%|██▊       | 10796/37963 [25:56:09<60:28:35,  8.01s/it]
 28%|██▊       | 10797/37963 [25:56:16<59:13:19,  7.85s/it]
 28%|██▊       | 10798/37963 [25:56:24<58:31:08,  7.76s/it]
 28%|██▊       | 10799/37963 [25:56:31<57:47:03,  7.66s/it]
 28%|██▊       | 10800/37963 [25:56:39<57:29:44,  7.62s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '3.044', 'learning_rate': '1.679e-05', 'epoch': '0.2845'}

 28%|██▊       | 10800/37963 [25:56:39<57:29:44,  7.62s/it]
 28%|██▊       | 10801/37963 [25:56:46<57:23:36,  7.61s/it]
 28%|██▊       | 10802/37963 [25:56:54<56:47:00,  7.53s/it]
 28%|██▊       | 10803/37963 [25:57:01<56:53:54,  7.54s/it]
 28%|██▊       | 10804/37963 [25:57:09<56:20:59,  7.47s/it]
 28%|██▊       | 10805/37963 [25:57:16<56:28:30,  7.49s/it]
 28%|██▊       | 10806/37963 [25:57:24<56:34:00,  7.50s/it]
 28%|██▊       | 10807/37963 [25:57:31<56:29:59,  7.49s/it]
 28%|██▊       | 10808/37963 [25:57:38<56:00:16,  7.42s/it]
 28%|██▊       | 10809/37963 [25:57:52<70:25:55,  9.34s/it]
 28%|██▊       | 10810/37963 [25:58:06<80:00:52, 10.61s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '2.712', 'learning_rate': '1.679e-05', 'epoch': '0.2848'}

 28%|██▊       | 10810/37963 [25:58:06<80:00:52, 10.61s/it]
 28%|██▊       | 10811/37963 [25:58:13<73:20:34,  9.72s/it]
 28%|██▊       | 10812/37963 [25:58:21<68:12:58,  9.04s/it]
 28%|██▊       | 10813/37963 [25:58:28<64:49:48,  8.60s/it]
 28%|██▊       | 10814/37963 [25:58:36<62:26:36,  8.28s/it]
 28%|██▊       | 10815/37963 [25:58:43<60:04:31,  7.97s/it]
 28%|██▊       | 10816/37963 [25:58:51<59:10:00,  7.85s/it]
 28%|██▊       | 10817/37963 [25:58:58<58:10:59,  7.72s/it]
 28%|██▊       | 10818/37963 [25:59:12<71:36:39,  9.50s/it]
 28%|██▊       | 10819/37963 [25:59:19<67:15:40,  8.92s/it]
 29%|██▊       | 10820/37963 [25:59:27<63:46:09,  8.46s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '5.29', 'learning_rate': '1.678e-05', 'epoch': '0.285'}

 29%|██▊       | 10820/37963 [25:59:27<63:46:09,  8.46s/it]
 29%|██▊       | 10821/37963 [25:59:34<61:38:17,  8.18s/it]
 29%|██▊       | 10822/37963 [25:59:42<60:17:57,  8.00s/it]
 29%|██▊       | 10823/37963 [25:59:49<59:10:48,  7.85s/it]
 29%|██▊       | 10824/37963 [25:59:57<58:32:34,  7.77s/it]
 29%|██▊       | 10825/37963 [26:00:11<73:12:44,  9.71s/it]
 29%|██▊       | 10826/37963 [26:00:25<82:24:46, 10.93s/it]
 29%|██▊       | 10827/37963 [26:00:33<74:42:58,  9.91s/it]
 29%|██▊       | 10828/37963 [26:00:40<69:15:07,  9.19s/it]
 29%|██▊       | 10829/37963 [26:00:48<65:39:34,  8.71s/it]
 29%|██▊       | 10830/37963 [26:00:55<62:53:41,  8.34s/it]
                                                           
{'loss': '0.1814', 'grad_norm': '6.082', 'learning_rate': '1.677e-05', 'epoch': '0.2853'}

 29%|██▊       | 10830/37963 [26:00:55<62:53:41,  8.34s/it]
 29%|██▊       | 10831/37963 [26:01:09<75:29:32, 10.02s/it]
 29%|██▊       | 10832/37963 [26:01:17<70:06:00,  9.30s/it]
 29%|██▊       | 10833/37963 [26:01:24<66:10:52,  8.78s/it]
 29%|██▊       | 10834/37963 [26:01:32<63:04:51,  8.37s/it]
 29%|██▊       | 10835/37963 [26:01:39<61:11:17,  8.12s/it]
 29%|██▊       | 10836/37963 [26:01:53<74:25:11,  9.88s/it]
 29%|██▊       | 10837/37963 [26:02:01<68:55:22,  9.15s/it]
 29%|██▊       | 10838/37963 [26:02:08<65:12:15,  8.65s/it]
 29%|██▊       | 10839/37963 [26:02:16<62:36:10,  8.31s/it]
 29%|██▊       | 10840/37963 [26:02:30<75:11:31,  9.98s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '6.59', 'learning_rate': '1.677e-05', 'epoch': '0.2855'}

 29%|██▊       | 10840/37963 [26:02:30<75:11:31,  9.98s/it]
 29%|██▊       | 10841/37963 [26:02:37<69:58:52,  9.29s/it]
 29%|██▊       | 10842/37963 [26:02:45<66:19:21,  8.80s/it]
 29%|██▊       | 10843/37963 [26:02:52<62:51:02,  8.34s/it]
 29%|██▊       | 10844/37963 [26:03:00<61:22:41,  8.15s/it]
 29%|██▊       | 10845/37963 [26:03:07<60:02:37,  7.97s/it]
 29%|██▊       | 10846/37963 [26:03:15<59:05:54,  7.85s/it]
 29%|██▊       | 10847/37963 [26:03:22<58:22:08,  7.75s/it]
 29%|██▊       | 10848/37963 [26:03:30<58:11:17,  7.73s/it]
 29%|██▊       | 10849/37963 [26:03:38<58:09:33,  7.72s/it]
 29%|██▊       | 10850/37963 [26:03:45<57:47:58,  7.67s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '2.771', 'learning_rate': '1.676e-05', 'epoch': '0.2858'}

 29%|██▊       | 10850/37963 [26:03:45<57:47:58,  7.67s/it]
 29%|██▊       | 10851/37963 [26:03:53<57:18:59,  7.61s/it]
 29%|██▊       | 10852/37963 [26:04:00<56:19:33,  7.48s/it]
 29%|██▊       | 10853/37963 [26:04:08<56:26:02,  7.49s/it]
 29%|██▊       | 10854/37963 [26:04:15<56:34:21,  7.51s/it]
 29%|██▊       | 10855/37963 [26:04:29<70:55:24,  9.42s/it]
 29%|██▊       | 10856/37963 [26:04:36<66:30:45,  8.83s/it]
 29%|██▊       | 10857/37963 [26:04:51<79:00:32, 10.49s/it]
 29%|██▊       | 10858/37963 [26:04:58<72:19:50,  9.61s/it]
 29%|██▊       | 10859/37963 [26:05:06<67:18:01,  8.94s/it]
 29%|██▊       | 10860/37963 [26:05:13<64:10:18,  8.52s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.138', 'learning_rate': '1.675e-05', 'epoch': '0.2861'}

 29%|██▊       | 10860/37963 [26:05:13<64:10:18,  8.52s/it]
 29%|██▊       | 10861/37963 [26:05:21<61:50:20,  8.21s/it]
 29%|██▊       | 10862/37963 [26:05:28<60:17:29,  8.01s/it]
 29%|██▊       | 10863/37963 [26:05:36<58:37:14,  7.79s/it]
 29%|██▊       | 10864/37963 [26:05:43<57:59:14,  7.70s/it]
 29%|██▊       | 10865/37963 [26:05:51<57:28:22,  7.64s/it]
 29%|██▊       | 10866/37963 [26:05:58<57:14:50,  7.61s/it]
 29%|██▊       | 10867/37963 [26:06:06<57:03:44,  7.58s/it]
 29%|██▊       | 10868/37963 [26:06:13<57:03:42,  7.58s/it]
 29%|██▊       | 10869/37963 [26:06:34<85:49:39, 11.40s/it]
 29%|██▊       | 10870/37963 [26:06:41<77:01:26, 10.23s/it]
                                                           
{'loss': '0.1689', 'grad_norm': '1.286', 'learning_rate': '1.675e-05', 'epoch': '0.2863'}

 29%|██▊       | 10870/37963 [26:06:41<77:01:26, 10.23s/it]
 29%|██▊       | 10871/37963 [26:06:49<70:55:32,  9.42s/it]
 29%|██▊       | 10872/37963 [26:06:56<66:46:29,  8.87s/it]
 29%|██▊       | 10873/37963 [26:07:04<63:46:23,  8.47s/it]
 29%|██▊       | 10874/37963 [26:07:11<61:33:56,  8.18s/it]
 29%|██▊       | 10875/37963 [26:07:25<73:44:25,  9.80s/it]
 29%|██▊       | 10876/37963 [26:07:32<68:34:15,  9.11s/it]
 29%|██▊       | 10877/37963 [26:07:46<79:33:59, 10.58s/it]
 29%|██▊       | 10878/37963 [26:07:54<72:57:05,  9.70s/it]
 29%|██▊       | 10879/37963 [26:08:01<67:02:48,  8.91s/it]
 29%|██▊       | 10880/37963 [26:08:08<63:50:03,  8.49s/it]
                                                           
{'loss': '0.1661', 'grad_norm': '3.225', 'learning_rate': '1.674e-05', 'epoch': '0.2866'}

 29%|██▊       | 10880/37963 [26:08:08<63:50:03,  8.49s/it]
 29%|██▊       | 10881/37963 [26:08:16<61:26:46,  8.17s/it]
 29%|██▊       | 10882/37963 [26:08:23<60:03:37,  7.98s/it]
 29%|██▊       | 10883/37963 [26:08:31<58:59:05,  7.84s/it]
 29%|██▊       | 10884/37963 [26:08:39<58:33:15,  7.78s/it]
 29%|██▊       | 10885/37963 [26:08:53<72:48:24,  9.68s/it]
 29%|██▊       | 10886/37963 [26:09:01<68:28:36,  9.10s/it]
 29%|██▊       | 10887/37963 [26:09:08<64:32:49,  8.58s/it]
 29%|██▊       | 10888/37963 [26:09:15<61:51:55,  8.23s/it]
 29%|██▊       | 10889/37963 [26:09:23<60:19:01,  8.02s/it]
 29%|██▊       | 10890/37963 [26:09:37<73:26:17,  9.77s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '1.819', 'learning_rate': '1.674e-05', 'epoch': '0.2869'}

 29%|██▊       | 10890/37963 [26:09:37<73:26:17,  9.77s/it]
 29%|██▊       | 10891/37963 [26:09:44<68:28:28,  9.11s/it]
 29%|██▊       | 10892/37963 [26:09:52<64:33:19,  8.58s/it]
 29%|██▊       | 10893/37963 [26:09:59<62:04:03,  8.25s/it]
 29%|██▊       | 10894/37963 [26:10:07<60:25:42,  8.04s/it]
 29%|██▊       | 10895/37963 [26:10:14<59:16:53,  7.88s/it]
 29%|██▊       | 10896/37963 [26:10:22<58:45:05,  7.81s/it]
 29%|██▊       | 10897/37963 [26:10:29<57:36:10,  7.66s/it]
 29%|██▊       | 10898/37963 [26:10:37<57:12:06,  7.61s/it]
 29%|██▊       | 10899/37963 [26:10:44<56:30:37,  7.52s/it]
 29%|██▊       | 10900/37963 [26:10:51<56:37:40,  7.53s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '1.681', 'learning_rate': '1.673e-05', 'epoch': '0.2871'}

 29%|██▊       | 10900/37963 [26:10:51<56:37:40,  7.53s/it]
 29%|██▊       | 10901/37963 [26:11:06<71:32:08,  9.52s/it]
 29%|██▊       | 10902/37963 [26:11:13<67:07:51,  8.93s/it]
 29%|██▊       | 10903/37963 [26:11:21<63:53:12,  8.50s/it]
 29%|██▊       | 10904/37963 [26:11:28<61:23:56,  8.17s/it]
 29%|██▊       | 10905/37963 [26:11:42<73:51:59,  9.83s/it]
 29%|██▊       | 10906/37963 [26:11:49<68:47:45,  9.15s/it]
 29%|██▊       | 10907/37963 [26:11:57<64:49:18,  8.63s/it]
 29%|██▊       | 10908/37963 [26:12:04<62:30:15,  8.32s/it]
 29%|██▊       | 10909/37963 [26:12:12<60:31:46,  8.05s/it]
 29%|██▊       | 10910/37963 [26:12:19<59:23:06,  7.90s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '1.777', 'learning_rate': '1.672e-05', 'epoch': '0.2874'}

 29%|██▊       | 10910/37963 [26:12:19<59:23:06,  7.90s/it]
 29%|██▊       | 10911/37963 [26:12:27<58:35:26,  7.80s/it]
 29%|██▊       | 10912/37963 [26:12:34<58:07:27,  7.74s/it]
 29%|██▊       | 10913/37963 [26:12:42<57:03:31,  7.59s/it]
 29%|██▊       | 10914/37963 [26:12:49<56:49:21,  7.56s/it]
 29%|██▉       | 10915/37963 [26:12:57<56:38:04,  7.54s/it]
 29%|██▉       | 10916/37963 [26:13:04<56:53:45,  7.57s/it]
 29%|██▉       | 10917/37963 [26:13:18<70:52:25,  9.43s/it]
 29%|██▉       | 10918/37963 [26:13:32<81:12:15, 10.81s/it]
 29%|██▉       | 10919/37963 [26:13:40<73:43:54,  9.81s/it]
 29%|██▉       | 10920/37963 [26:13:47<68:35:08,  9.13s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '5.053', 'learning_rate': '1.672e-05', 'epoch': '0.2876'}

 29%|██▉       | 10920/37963 [26:13:47<68:35:08,  9.13s/it]
 29%|██▉       | 10921/37963 [26:13:54<64:13:23,  8.55s/it]
 29%|██▉       | 10922/37963 [26:14:02<62:09:26,  8.28s/it]
 29%|██▉       | 10923/37963 [26:14:16<75:35:49, 10.06s/it]
 29%|██▉       | 10924/37963 [26:14:24<69:39:59,  9.28s/it]
 29%|██▉       | 10925/37963 [26:14:31<65:49:42,  8.76s/it]
 29%|██▉       | 10926/37963 [26:14:39<62:58:58,  8.39s/it]
 29%|██▉       | 10927/37963 [26:14:46<61:05:15,  8.13s/it]
 29%|██▉       | 10928/37963 [26:14:54<59:37:59,  7.94s/it]
 29%|██▉       | 10929/37963 [26:15:08<73:38:47,  9.81s/it]
 29%|██▉       | 10930/37963 [26:15:16<68:44:48,  9.16s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '1.793', 'learning_rate': '1.671e-05', 'epoch': '0.2879'}

 29%|██▉       | 10930/37963 [26:15:16<68:44:48,  9.16s/it]
 29%|██▉       | 10931/37963 [26:15:30<80:11:07, 10.68s/it]
 29%|██▉       | 10932/37963 [26:15:37<73:13:57,  9.75s/it]
 29%|██▉       | 10933/37963 [26:15:45<67:39:05,  9.01s/it]
 29%|██▉       | 10934/37963 [26:15:52<64:02:35,  8.53s/it]
 29%|██▉       | 10935/37963 [26:16:00<62:07:27,  8.27s/it]
 29%|██▉       | 10936/37963 [26:16:07<60:07:01,  8.01s/it]
 29%|██▉       | 10937/37963 [26:16:14<58:35:06,  7.80s/it]
 29%|██▉       | 10938/37963 [26:16:22<57:57:02,  7.72s/it]
 29%|██▉       | 10939/37963 [26:16:29<57:02:05,  7.60s/it]
 29%|██▉       | 10940/37963 [26:16:37<56:20:04,  7.50s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '6.503', 'learning_rate': '1.67e-05', 'epoch': '0.2882'}

 29%|██▉       | 10940/37963 [26:16:37<56:20:04,  7.50s/it]
 29%|██▉       | 10941/37963 [26:16:44<56:18:33,  7.50s/it]
 29%|██▉       | 10942/37963 [26:16:58<71:17:11,  9.50s/it]
 29%|██▉       | 10943/37963 [26:17:06<66:43:23,  8.89s/it]
 29%|██▉       | 10944/37963 [26:17:13<63:42:17,  8.49s/it]
 29%|██▉       | 10945/37963 [26:17:21<61:46:10,  8.23s/it]
 29%|██▉       | 10946/37963 [26:17:28<60:17:54,  8.03s/it]
 29%|██▉       | 10947/37963 [26:17:36<59:28:56,  7.93s/it]
 29%|██▉       | 10948/37963 [26:17:50<72:50:17,  9.71s/it]
 29%|██▉       | 10949/37963 [26:17:58<68:02:56,  9.07s/it]
 29%|██▉       | 10950/37963 [26:18:05<64:27:53,  8.59s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.207', 'learning_rate': '1.67e-05', 'epoch': '0.2884'}

 29%|██▉       | 10950/37963 [26:18:05<64:27:53,  8.59s/it]
 29%|██▉       | 10951/37963 [26:18:13<62:03:42,  8.27s/it]
 29%|██▉       | 10952/37963 [26:18:26<74:36:42,  9.94s/it]
 29%|██▉       | 10953/37963 [26:18:34<69:30:19,  9.26s/it]
 29%|██▉       | 10954/37963 [26:18:41<65:15:16,  8.70s/it]
 29%|██▉       | 10955/37963 [26:18:49<62:09:17,  8.28s/it]
 29%|██▉       | 10956/37963 [26:18:56<60:29:28,  8.06s/it]
 29%|██▉       | 10957/37963 [26:19:04<58:49:36,  7.84s/it]
 29%|██▉       | 10958/37963 [26:19:11<58:21:04,  7.78s/it]
 29%|██▉       | 10959/37963 [26:19:19<57:39:57,  7.69s/it]
 29%|██▉       | 10960/37963 [26:19:26<57:36:59,  7.68s/it]
                                                           
{'loss': '0.15', 'grad_norm': '3.56', 'learning_rate': '1.669e-05', 'epoch': '0.2887'}

 29%|██▉       | 10960/37963 [26:19:26<57:36:59,  7.68s/it]
 29%|██▉       | 10961/37963 [26:19:34<57:22:43,  7.65s/it]
 29%|██▉       | 10962/37963 [26:19:42<57:15:45,  7.63s/it]
 29%|██▉       | 10963/37963 [26:19:56<71:39:39,  9.55s/it]
 29%|██▉       | 10964/37963 [26:20:10<81:43:45, 10.90s/it]
 29%|██▉       | 10965/37963 [26:20:17<74:14:30,  9.90s/it]
 29%|██▉       | 10966/37963 [26:20:24<68:14:51,  9.10s/it]
 29%|██▉       | 10967/37963 [26:20:32<64:29:02,  8.60s/it]
 29%|██▉       | 10968/37963 [26:20:40<62:13:25,  8.30s/it]
 29%|██▉       | 10969/37963 [26:20:47<60:28:22,  8.06s/it]
 29%|██▉       | 10970/37963 [26:20:55<59:23:18,  7.92s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.997', 'learning_rate': '1.668e-05', 'epoch': '0.289'}

 29%|██▉       | 10970/37963 [26:20:55<59:23:18,  7.92s/it]
 29%|██▉       | 10971/37963 [26:21:02<57:42:42,  7.70s/it]
 29%|██▉       | 10972/37963 [26:21:16<71:54:24,  9.59s/it]
 29%|██▉       | 10973/37963 [26:21:23<67:24:58,  8.99s/it]
 29%|██▉       | 10974/37963 [26:21:31<64:09:40,  8.56s/it]
 29%|██▉       | 10975/37963 [26:21:45<76:31:17, 10.21s/it]
 29%|██▉       | 10976/37963 [26:21:52<70:15:14,  9.37s/it]
 29%|██▉       | 10977/37963 [26:22:06<80:36:46, 10.75s/it]
 29%|██▉       | 10978/37963 [26:22:14<73:40:42,  9.83s/it]
 29%|██▉       | 10979/37963 [26:22:22<68:30:35,  9.14s/it]
 29%|██▉       | 10980/37963 [26:22:29<64:22:47,  8.59s/it]
                                                           
{'loss': '0.167', 'grad_norm': '1.545', 'learning_rate': '1.668e-05', 'epoch': '0.2892'}

 29%|██▉       | 10980/37963 [26:22:29<64:22:47,  8.59s/it]
 29%|██▉       | 10981/37963 [26:22:36<61:57:50,  8.27s/it]
 29%|██▉       | 10982/37963 [26:22:44<59:29:59,  7.94s/it]
 29%|██▉       | 10983/37963 [26:22:51<58:41:43,  7.83s/it]
 29%|██▉       | 10984/37963 [26:22:58<57:27:42,  7.67s/it]
 29%|██▉       | 10985/37963 [26:23:06<57:20:28,  7.65s/it]
 29%|██▉       | 10986/37963 [26:23:14<57:04:05,  7.62s/it]
 29%|██▉       | 10987/37963 [26:23:21<57:07:12,  7.62s/it]
 29%|██▉       | 10988/37963 [26:23:29<56:49:00,  7.58s/it]
 29%|██▉       | 10989/37963 [26:23:36<56:22:35,  7.52s/it]
 29%|██▉       | 10990/37963 [26:23:50<69:56:26,  9.33s/it]
                                                           
{'loss': '0.1805', 'grad_norm': '2.409', 'learning_rate': '1.667e-05', 'epoch': '0.2895'}

 29%|██▉       | 10990/37963 [26:23:50<69:56:26,  9.33s/it]
 29%|██▉       | 10991/37963 [26:23:57<65:49:55,  8.79s/it]
 29%|██▉       | 10992/37963 [26:24:05<63:06:10,  8.42s/it]
 29%|██▉       | 10993/37963 [26:24:12<61:01:09,  8.14s/it]
 29%|██▉       | 10994/37963 [26:24:20<59:44:31,  7.97s/it]
 29%|██▉       | 10995/37963 [26:24:33<72:17:59,  9.65s/it]
 29%|██▉       | 10996/37963 [26:24:41<67:04:31,  8.95s/it]
 29%|██▉       | 10997/37963 [26:24:48<63:22:05,  8.46s/it]
 29%|██▉       | 10998/37963 [26:24:56<61:08:59,  8.16s/it]
 29%|██▉       | 10999/37963 [26:25:09<74:13:59,  9.91s/it]
 29%|██▉       | 11000/37963 [26:25:17<69:11:25,  9.24s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.742', 'learning_rate': '1.667e-05', 'epoch': '0.2898'}

 29%|██▉       | 11000/37963 [26:25:17<69:11:25,  9.24s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.74s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.74s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 29%|██▉       | 11001/37963 [26:26:14<176:51:07, 23.61s/it]
 29%|██▉       | 11002/37963 [26:26:22<140:46:32, 18.80s/it]
 29%|██▉       | 11003/37963 [26:26:29<115:33:08, 15.43s/it]
 29%|██▉       | 11004/37963 [26:26:37<98:14:49, 13.12s/it] 
 29%|██▉       | 11005/37963 [26:26:45<85:14:18, 11.38s/it]
 29%|██▉       | 11006/37963 [26:26:52<76:34:31, 10.23s/it]
 29%|██▉       | 11007/37963 [26:27:00<70:35:12,  9.43s/it]
 29%|██▉       | 11008/37963 [26:27:07<66:14:33,  8.85s/it]
 29%|██▉       | 11009/37963 [26:27:14<62:49:36,  8.39s/it]
 29%|██▉       | 11010/37963 [26:27:28<74:55:55, 10.01s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '0.8822', 'learning_rate': '1.666e-05', 'epoch': '0.29'}

 29%|██▉       | 11010/37963 [26:27:28<74:55:55, 10.01s/it]
 29%|██▉       | 11011/37963 [26:27:42<83:17:44, 11.13s/it]
 29%|██▉       | 11012/37963 [26:27:49<75:12:54, 10.05s/it]
 29%|██▉       | 11013/37963 [26:27:57<69:35:53,  9.30s/it]
 29%|██▉       | 11014/37963 [26:28:05<65:55:11,  8.81s/it]
 29%|██▉       | 11015/37963 [26:28:12<63:00:25,  8.42s/it]
 29%|██▉       | 11016/37963 [26:28:20<60:58:44,  8.15s/it]
 29%|██▉       | 11017/37963 [26:28:27<58:47:40,  7.85s/it]
 29%|██▉       | 11018/37963 [26:28:35<58:29:33,  7.81s/it]
 29%|██▉       | 11019/37963 [26:28:42<57:46:27,  7.72s/it]
 29%|██▉       | 11020/37963 [26:28:56<71:51:37,  9.60s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '2.167', 'learning_rate': '1.665e-05', 'epoch': '0.2903'}

 29%|██▉       | 11020/37963 [26:28:56<71:51:37,  9.60s/it]
 29%|██▉       | 11021/37963 [26:29:10<81:52:04, 10.94s/it]
 29%|██▉       | 11022/37963 [26:29:17<73:46:36,  9.86s/it]
 29%|██▉       | 11023/37963 [26:29:31<83:00:05, 11.09s/it]
 29%|██▉       | 11024/37963 [26:29:39<75:05:13, 10.03s/it]
 29%|██▉       | 11025/37963 [26:29:47<69:23:49,  9.27s/it]
 29%|██▉       | 11026/37963 [26:29:54<65:22:52,  8.74s/it]
 29%|██▉       | 11027/37963 [26:30:02<62:38:22,  8.37s/it]
 29%|██▉       | 11028/37963 [26:30:09<60:17:00,  8.06s/it]
 29%|██▉       | 11029/37963 [26:30:16<59:02:33,  7.89s/it]
 29%|██▉       | 11030/37963 [26:30:24<57:49:15,  7.73s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '0.8867', 'learning_rate': '1.665e-05', 'epoch': '0.2905'}

 29%|██▉       | 11030/37963 [26:30:24<57:49:15,  7.73s/it]
 29%|██▉       | 11031/37963 [26:30:31<57:24:52,  7.67s/it]
 29%|██▉       | 11032/37963 [26:30:39<56:45:56,  7.59s/it]
 29%|██▉       | 11033/37963 [26:30:46<56:34:32,  7.56s/it]
 29%|██▉       | 11034/37963 [26:30:54<56:23:24,  7.54s/it]
 29%|██▉       | 11035/37963 [26:31:01<56:20:55,  7.53s/it]
 29%|██▉       | 11036/37963 [26:31:09<56:20:17,  7.53s/it]
 29%|██▉       | 11037/37963 [26:31:16<56:39:57,  7.58s/it]
 29%|██▉       | 11038/37963 [26:31:24<56:34:36,  7.56s/it]
 29%|██▉       | 11039/37963 [26:31:38<71:24:23,  9.55s/it]
 29%|██▉       | 11040/37963 [26:31:46<66:56:22,  8.95s/it]
                                                           
{'loss': '0.1745', 'grad_norm': '3.142', 'learning_rate': '1.664e-05', 'epoch': '0.2908'}

 29%|██▉       | 11040/37963 [26:31:46<66:56:22,  8.95s/it]
 29%|██▉       | 11041/37963 [26:31:53<63:32:19,  8.50s/it]
 29%|██▉       | 11042/37963 [26:32:01<61:13:21,  8.19s/it]
 29%|██▉       | 11043/37963 [26:32:14<74:09:20,  9.92s/it]
 29%|██▉       | 11044/37963 [26:32:22<68:50:36,  9.21s/it]
 29%|██▉       | 11045/37963 [26:32:29<64:41:15,  8.65s/it]
 29%|██▉       | 11046/37963 [26:32:36<61:14:02,  8.19s/it]
 29%|██▉       | 11047/37963 [26:32:50<73:55:59,  9.89s/it]
 29%|██▉       | 11048/37963 [26:32:58<68:42:50,  9.19s/it]
 29%|██▉       | 11049/37963 [26:33:05<64:44:30,  8.66s/it]
 29%|██▉       | 11050/37963 [26:33:13<61:38:58,  8.25s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '4.293', 'learning_rate': '1.663e-05', 'epoch': '0.2911'}

 29%|██▉       | 11050/37963 [26:33:13<61:38:58,  8.25s/it]
 29%|██▉       | 11051/37963 [26:33:20<59:27:28,  7.95s/it]
 29%|██▉       | 11052/37963 [26:33:27<58:30:44,  7.83s/it]
 29%|██▉       | 11053/37963 [26:33:35<57:53:52,  7.75s/it]
 29%|██▉       | 11054/37963 [26:33:42<57:21:22,  7.67s/it]
 29%|██▉       | 11055/37963 [26:33:50<57:30:14,  7.69s/it]
 29%|██▉       | 11056/37963 [26:33:58<57:02:49,  7.63s/it]
 29%|██▉       | 11057/37963 [26:34:05<56:50:46,  7.61s/it]
 29%|██▉       | 11058/37963 [26:34:19<70:39:37,  9.45s/it]
 29%|██▉       | 11059/37963 [26:34:27<66:30:38,  8.90s/it]
 29%|██▉       | 11060/37963 [26:34:34<63:22:10,  8.48s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '2.893', 'learning_rate': '1.663e-05', 'epoch': '0.2913'}

 29%|██▉       | 11060/37963 [26:34:34<63:22:10,  8.48s/it]
 29%|██▉       | 11061/37963 [26:34:42<61:10:47,  8.19s/it]
 29%|██▉       | 11062/37963 [26:34:49<59:51:03,  8.01s/it]
 29%|██▉       | 11063/37963 [26:35:03<73:02:40,  9.78s/it]
 29%|██▉       | 11064/37963 [26:35:11<67:53:17,  9.09s/it]
 29%|██▉       | 11065/37963 [26:35:18<63:30:40,  8.50s/it]
 29%|██▉       | 11066/37963 [26:35:25<61:27:08,  8.23s/it]
 29%|██▉       | 11067/37963 [26:35:33<59:55:36,  8.02s/it]
 29%|██▉       | 11068/37963 [26:35:54<88:23:58, 11.83s/it]
 29%|██▉       | 11069/37963 [26:36:01<78:54:54, 10.56s/it]
 29%|██▉       | 11070/37963 [26:36:09<72:10:39,  9.66s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.028', 'learning_rate': '1.662e-05', 'epoch': '0.2916'}

 29%|██▉       | 11070/37963 [26:36:09<72:10:39,  9.66s/it]
 29%|██▉       | 11071/37963 [26:36:23<81:22:06, 10.89s/it]
 29%|██▉       | 11072/37963 [26:36:30<73:53:38,  9.89s/it]
 29%|██▉       | 11073/37963 [26:36:38<68:34:06,  9.18s/it]
 29%|██▉       | 11074/37963 [26:36:45<65:08:55,  8.72s/it]
 29%|██▉       | 11075/37963 [26:36:53<62:36:04,  8.38s/it]
 29%|██▉       | 11076/37963 [26:37:00<60:09:23,  8.05s/it]
 29%|██▉       | 11077/37963 [26:37:08<58:56:42,  7.89s/it]
 29%|██▉       | 11078/37963 [26:37:15<58:08:00,  7.78s/it]
 29%|██▉       | 11079/37963 [26:37:22<57:05:45,  7.65s/it]
 29%|██▉       | 11080/37963 [26:37:30<56:37:45,  7.58s/it]
                                                           
{'loss': '0.169', 'grad_norm': '2.257', 'learning_rate': '1.661e-05', 'epoch': '0.2919'}

 29%|██▉       | 11080/37963 [26:37:30<56:37:45,  7.58s/it]
 29%|██▉       | 11081/37963 [26:37:37<56:06:06,  7.51s/it]
 29%|██▉       | 11082/37963 [26:37:45<56:17:20,  7.54s/it]
 29%|██▉       | 11083/37963 [26:37:59<70:34:22,  9.45s/it]
 29%|██▉       | 11084/37963 [26:38:06<65:52:44,  8.82s/it]
 29%|██▉       | 11085/37963 [26:38:13<62:20:02,  8.35s/it]
 29%|██▉       | 11086/37963 [26:38:21<60:04:07,  8.05s/it]
 29%|██▉       | 11087/37963 [26:38:28<58:47:22,  7.87s/it]
 29%|██▉       | 11088/37963 [26:38:36<58:15:06,  7.80s/it]
 29%|██▉       | 11089/37963 [26:38:43<57:39:35,  7.72s/it]
 29%|██▉       | 11090/37963 [26:38:51<57:14:01,  7.67s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '3.209', 'learning_rate': '1.661e-05', 'epoch': '0.2921'}

 29%|██▉       | 11090/37963 [26:38:51<57:14:01,  7.67s/it]
 29%|██▉       | 11091/37963 [26:38:58<56:55:43,  7.63s/it]
 29%|██▉       | 11092/37963 [26:39:06<56:48:59,  7.61s/it]
 29%|██▉       | 11093/37963 [26:39:14<56:37:23,  7.59s/it]
 29%|██▉       | 11094/37963 [26:39:28<70:53:01,  9.50s/it]
 29%|██▉       | 11095/37963 [26:39:35<66:36:39,  8.93s/it]
 29%|██▉       | 11096/37963 [26:39:43<63:25:17,  8.50s/it]
 29%|██▉       | 11097/37963 [26:39:50<61:15:51,  8.21s/it]
 29%|██▉       | 11098/37963 [26:39:58<59:45:22,  8.01s/it]
 29%|██▉       | 11099/37963 [26:40:05<58:41:54,  7.87s/it]
 29%|██▉       | 11100/37963 [26:40:13<57:58:17,  7.77s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '2.173', 'learning_rate': '1.66e-05', 'epoch': '0.2924'}

 29%|██▉       | 11100/37963 [26:40:13<57:58:17,  7.77s/it]
 29%|██▉       | 11101/37963 [26:40:27<71:26:23,  9.57s/it]
 29%|██▉       | 11102/37963 [26:40:41<81:41:50, 10.95s/it]
 29%|██▉       | 11103/37963 [26:40:48<73:54:22,  9.91s/it]
 29%|██▉       | 11104/37963 [26:40:56<68:35:58,  9.19s/it]
 29%|██▉       | 11105/37963 [26:41:03<64:40:37,  8.67s/it]
 29%|██▉       | 11106/37963 [26:41:11<62:04:59,  8.32s/it]
 29%|██▉       | 11107/37963 [26:41:18<60:38:53,  8.13s/it]
 29%|██▉       | 11108/37963 [26:41:32<73:47:33,  9.89s/it]
 29%|██▉       | 11109/37963 [26:41:40<68:26:09,  9.17s/it]
 29%|██▉       | 11110/37963 [26:41:47<64:41:54,  8.67s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.369', 'learning_rate': '1.66e-05', 'epoch': '0.2927'}

 29%|██▉       | 11110/37963 [26:41:47<64:41:54,  8.67s/it]
 29%|██▉       | 11111/37963 [26:41:55<62:01:59,  8.32s/it]
 29%|██▉       | 11112/37963 [26:42:02<59:54:42,  8.03s/it]
 29%|██▉       | 11113/37963 [26:42:10<58:21:25,  7.82s/it]
 29%|██▉       | 11114/37963 [26:42:17<57:43:26,  7.74s/it]
 29%|██▉       | 11115/37963 [26:42:31<70:47:49,  9.49s/it]
 29%|██▉       | 11116/37963 [26:42:45<81:09:06, 10.88s/it]
 29%|██▉       | 11117/37963 [26:42:52<73:55:19,  9.91s/it]
 29%|██▉       | 11118/37963 [26:43:00<68:37:57,  9.20s/it]
 29%|██▉       | 11119/37963 [26:43:07<64:50:17,  8.70s/it]
 29%|██▉       | 11120/37963 [26:43:21<76:39:51, 10.28s/it]
                                                           
{'loss': '0.169', 'grad_norm': '1.302', 'learning_rate': '1.659e-05', 'epoch': '0.2929'}

 29%|██▉       | 11120/37963 [26:43:21<76:39:51, 10.28s/it]
 29%|██▉       | 11121/37963 [26:43:29<70:02:41,  9.39s/it]
 29%|██▉       | 11122/37963 [26:43:36<65:57:38,  8.85s/it]
 29%|██▉       | 11123/37963 [26:43:44<62:32:04,  8.39s/it]
 29%|██▉       | 11124/37963 [26:43:51<60:34:13,  8.12s/it]
 29%|██▉       | 11125/37963 [26:43:59<59:17:38,  7.95s/it]
 29%|██▉       | 11126/37963 [26:44:06<58:14:59,  7.81s/it]
 29%|██▉       | 11127/37963 [26:44:14<57:42:41,  7.74s/it]
 29%|██▉       | 11128/37963 [26:44:21<57:25:00,  7.70s/it]
 29%|██▉       | 11129/37963 [26:44:35<70:57:52,  9.52s/it]
 29%|██▉       | 11130/37963 [26:44:43<66:51:43,  8.97s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '2.979', 'learning_rate': '1.658e-05', 'epoch': '0.2932'}

 29%|██▉       | 11130/37963 [26:44:43<66:51:43,  8.97s/it]
 29%|██▉       | 11131/37963 [26:44:50<63:15:54,  8.49s/it]
 29%|██▉       | 11132/37963 [26:44:58<61:14:49,  8.22s/it]
 29%|██▉       | 11133/37963 [26:45:05<59:50:04,  8.03s/it]
 29%|██▉       | 11134/37963 [26:45:13<57:46:30,  7.75s/it]
 29%|██▉       | 11135/37963 [26:45:20<57:21:07,  7.70s/it]
 29%|██▉       | 11136/37963 [26:45:28<56:52:21,  7.63s/it]
 29%|██▉       | 11137/37963 [26:45:35<56:55:15,  7.64s/it]
 29%|██▉       | 11138/37963 [26:45:43<56:44:11,  7.61s/it]
 29%|██▉       | 11139/37963 [26:45:50<56:48:39,  7.62s/it]
 29%|██▉       | 11140/37963 [26:45:58<56:20:42,  7.56s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '1.697', 'learning_rate': '1.658e-05', 'epoch': '0.2934'}

 29%|██▉       | 11140/37963 [26:45:58<56:20:42,  7.56s/it]
 29%|██▉       | 11141/37963 [26:46:12<70:11:10,  9.42s/it]
 29%|██▉       | 11142/37963 [26:46:19<66:02:32,  8.86s/it]
 29%|██▉       | 11143/37963 [26:46:27<63:09:54,  8.48s/it]
 29%|██▉       | 11144/37963 [26:46:34<60:35:20,  8.13s/it]
 29%|██▉       | 11145/37963 [26:46:42<59:10:54,  7.94s/it]
 29%|██▉       | 11146/37963 [26:46:49<58:14:08,  7.82s/it]
 29%|██▉       | 11147/37963 [26:46:57<57:41:33,  7.75s/it]
 29%|██▉       | 11148/37963 [26:47:11<71:44:17,  9.63s/it]
 29%|██▉       | 11149/37963 [26:47:18<66:56:55,  8.99s/it]
 29%|██▉       | 11150/37963 [26:47:26<63:53:27,  8.58s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.891', 'learning_rate': '1.657e-05', 'epoch': '0.2937'}

 29%|██▉       | 11150/37963 [26:47:26<63:53:27,  8.58s/it]
 29%|██▉       | 11151/37963 [26:47:33<61:45:35,  8.29s/it]
 29%|██▉       | 11152/37963 [26:47:48<75:10:03, 10.09s/it]
 29%|██▉       | 11153/37963 [26:47:55<69:25:33,  9.32s/it]
 29%|██▉       | 11154/37963 [26:48:09<80:09:36, 10.76s/it]
 29%|██▉       | 11155/37963 [26:48:17<72:53:58,  9.79s/it]
 29%|██▉       | 11156/37963 [26:48:24<67:37:11,  9.08s/it]
 29%|██▉       | 11157/37963 [26:48:32<64:29:08,  8.66s/it]
 29%|██▉       | 11158/37963 [26:48:39<61:39:59,  8.28s/it]
 29%|██▉       | 11159/37963 [26:48:53<74:31:15, 10.01s/it]
 29%|██▉       | 11160/37963 [26:49:01<69:11:07,  9.29s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.708', 'learning_rate': '1.656e-05', 'epoch': '0.294'}

 29%|██▉       | 11160/37963 [26:49:01<69:11:07,  9.29s/it]
 29%|██▉       | 11161/37963 [26:49:09<65:14:30,  8.76s/it]
 29%|██▉       | 11162/37963 [26:49:16<61:43:31,  8.29s/it]
 29%|██▉       | 11163/37963 [26:49:23<60:02:13,  8.06s/it]
 29%|██▉       | 11164/37963 [26:49:31<58:58:42,  7.92s/it]
 29%|██▉       | 11165/37963 [26:49:38<57:32:26,  7.73s/it]
 29%|██▉       | 11166/37963 [26:49:52<70:56:07,  9.53s/it]
 29%|██▉       | 11167/37963 [26:49:59<66:23:34,  8.92s/it]
 29%|██▉       | 11168/37963 [26:50:07<63:24:14,  8.52s/it]
 29%|██▉       | 11169/37963 [26:50:15<61:11:18,  8.22s/it]
 29%|██▉       | 11170/37963 [26:50:22<59:47:25,  8.03s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.535', 'learning_rate': '1.656e-05', 'epoch': '0.2942'}

 29%|██▉       | 11170/37963 [26:50:22<59:47:25,  8.03s/it]
 29%|██▉       | 11171/37963 [26:50:36<73:01:18,  9.81s/it]
 29%|██▉       | 11172/37963 [26:50:44<68:03:01,  9.14s/it]
 29%|██▉       | 11173/37963 [26:50:51<64:27:02,  8.66s/it]
 29%|██▉       | 11174/37963 [26:50:59<61:52:01,  8.31s/it]
 29%|██▉       | 11175/37963 [26:51:12<73:20:20,  9.86s/it]
 29%|██▉       | 11176/37963 [26:51:20<68:08:07,  9.16s/it]
 29%|██▉       | 11177/37963 [26:51:27<63:54:37,  8.59s/it]
 29%|██▉       | 11178/37963 [26:51:34<61:34:12,  8.28s/it]
 29%|██▉       | 11179/37963 [26:51:42<60:07:35,  8.08s/it]
 29%|██▉       | 11180/37963 [26:51:50<58:59:18,  7.93s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '3.285', 'learning_rate': '1.655e-05', 'epoch': '0.2945'}

 29%|██▉       | 11180/37963 [26:51:50<58:59:18,  7.93s/it]
 29%|██▉       | 11181/37963 [26:51:57<58:27:16,  7.86s/it]
 29%|██▉       | 11182/37963 [26:52:05<57:08:08,  7.68s/it]
 29%|██▉       | 11183/37963 [26:52:12<56:58:10,  7.66s/it]
 29%|██▉       | 11184/37963 [26:52:20<56:35:18,  7.61s/it]
 29%|██▉       | 11185/37963 [26:52:27<56:16:33,  7.57s/it]
 29%|██▉       | 11186/37963 [26:52:34<55:33:04,  7.47s/it]
 29%|██▉       | 11187/37963 [26:52:42<55:33:51,  7.47s/it]
 29%|██▉       | 11188/37963 [26:52:49<55:21:05,  7.44s/it]
 29%|██▉       | 11189/37963 [26:52:57<55:26:35,  7.45s/it]
 29%|██▉       | 11190/37963 [26:53:11<70:51:08,  9.53s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.162', 'learning_rate': '1.654e-05', 'epoch': '0.2948'}

 29%|██▉       | 11190/37963 [26:53:11<70:51:08,  9.53s/it]
 29%|██▉       | 11191/37963 [26:53:19<66:02:48,  8.88s/it]
 29%|██▉       | 11192/37963 [26:53:26<63:17:08,  8.51s/it]
 29%|██▉       | 11193/37963 [26:53:34<60:43:53,  8.17s/it]
 29%|██▉       | 11194/37963 [26:53:41<59:25:51,  7.99s/it]
 29%|██▉       | 11195/37963 [26:53:49<58:17:10,  7.84s/it]
 29%|██▉       | 11196/37963 [26:53:56<57:16:39,  7.70s/it]
 29%|██▉       | 11197/37963 [26:54:04<57:07:12,  7.68s/it]
 29%|██▉       | 11198/37963 [26:54:11<56:01:06,  7.53s/it]
 29%|██▉       | 11199/37963 [26:54:18<55:34:27,  7.48s/it]
 30%|██▉       | 11200/37963 [26:54:26<56:01:35,  7.54s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.181', 'learning_rate': '1.654e-05', 'epoch': '0.295'}

 30%|██▉       | 11200/37963 [26:54:26<56:01:35,  7.54s/it]
 30%|██▉       | 11201/37963 [26:54:47<85:27:26, 11.50s/it]
 30%|██▉       | 11202/37963 [26:54:54<76:39:52, 10.31s/it]
 30%|██▉       | 11203/37963 [26:55:08<84:24:40, 11.36s/it]
 30%|██▉       | 11204/37963 [26:55:15<75:50:30, 10.20s/it]
 30%|██▉       | 11205/37963 [26:55:29<84:12:23, 11.33s/it]
 30%|██▉       | 11206/37963 [26:55:37<75:47:08, 10.20s/it]
 30%|██▉       | 11207/37963 [26:55:45<69:55:54,  9.41s/it]
 30%|██▉       | 11208/37963 [26:55:52<65:41:58,  8.84s/it]
 30%|██▉       | 11209/37963 [26:56:00<62:44:45,  8.44s/it]
 30%|██▉       | 11210/37963 [26:56:07<60:46:31,  8.18s/it]
                                                           
{'loss': '0.1707', 'grad_norm': '1.628', 'learning_rate': '1.653e-05', 'epoch': '0.2953'}

 30%|██▉       | 11210/37963 [26:56:07<60:46:31,  8.18s/it]
 30%|██▉       | 11211/37963 [26:56:14<58:35:42,  7.89s/it]
 30%|██▉       | 11212/37963 [26:56:22<57:53:19,  7.79s/it]
 30%|██▉       | 11213/37963 [26:56:29<56:41:46,  7.63s/it]
 30%|██▉       | 11214/37963 [26:56:37<56:32:42,  7.61s/it]
 30%|██▉       | 11215/37963 [26:56:44<56:09:01,  7.56s/it]
 30%|██▉       | 11216/37963 [26:56:52<56:06:39,  7.55s/it]
 30%|██▉       | 11217/37963 [26:56:59<56:06:30,  7.55s/it]
 30%|██▉       | 11218/37963 [26:57:13<70:23:44,  9.48s/it]
 30%|██▉       | 11219/37963 [26:57:21<65:36:17,  8.83s/it]
 30%|██▉       | 11220/37963 [26:57:28<62:56:01,  8.47s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '3.563', 'learning_rate': '1.652e-05', 'epoch': '0.2956'}

 30%|██▉       | 11220/37963 [26:57:28<62:56:01,  8.47s/it]
 30%|██▉       | 11221/37963 [26:57:35<60:16:33,  8.11s/it]
 30%|██▉       | 11222/37963 [26:57:49<72:47:43,  9.80s/it]
 30%|██▉       | 11223/37963 [26:57:57<68:21:01,  9.20s/it]
 30%|██▉       | 11224/37963 [26:58:11<78:36:57, 10.58s/it]
 30%|██▉       | 11225/37963 [26:58:18<72:04:11,  9.70s/it]
 30%|██▉       | 11226/37963 [26:58:26<67:09:18,  9.04s/it]
 30%|██▉       | 11227/37963 [26:58:33<63:46:18,  8.59s/it]
 30%|██▉       | 11228/37963 [26:58:41<61:37:49,  8.30s/it]
 30%|██▉       | 11229/37963 [26:58:49<59:50:53,  8.06s/it]
 30%|██▉       | 11230/37963 [26:58:56<58:42:11,  7.91s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '5.39', 'learning_rate': '1.652e-05', 'epoch': '0.2958'}

 30%|██▉       | 11230/37963 [26:58:56<58:42:11,  7.91s/it]
 30%|██▉       | 11231/37963 [26:59:04<57:36:14,  7.76s/it]
 30%|██▉       | 11232/37963 [26:59:11<57:14:29,  7.71s/it]
 30%|██▉       | 11233/37963 [26:59:19<56:49:57,  7.65s/it]
 30%|██▉       | 11234/37963 [26:59:26<56:36:50,  7.63s/it]
 30%|██▉       | 11235/37963 [26:59:34<56:48:25,  7.65s/it]
 30%|██▉       | 11236/37963 [26:59:41<56:15:30,  7.58s/it]
 30%|██▉       | 11237/37963 [26:59:49<56:13:53,  7.57s/it]
 30%|██▉       | 11238/37963 [26:59:56<56:06:06,  7.56s/it]
 30%|██▉       | 11239/37963 [27:00:10<70:18:39,  9.47s/it]
 30%|██▉       | 11240/37963 [27:00:18<65:53:01,  8.88s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '3.308', 'learning_rate': '1.651e-05', 'epoch': '0.2961'}

 30%|██▉       | 11240/37963 [27:00:18<65:53:01,  8.88s/it]
 30%|██▉       | 11241/37963 [27:00:25<62:51:24,  8.47s/it]
 30%|██▉       | 11242/37963 [27:00:33<60:46:55,  8.19s/it]
 30%|██▉       | 11243/37963 [27:00:40<59:17:01,  7.99s/it]
 30%|██▉       | 11244/37963 [27:00:48<58:32:16,  7.89s/it]
 30%|██▉       | 11245/37963 [27:00:56<58:07:12,  7.83s/it]
 30%|██▉       | 11246/37963 [27:01:03<57:24:30,  7.74s/it]
 30%|██▉       | 11247/37963 [27:01:17<71:08:32,  9.59s/it]
 30%|██▉       | 11248/37963 [27:01:31<80:26:51, 10.84s/it]
 30%|██▉       | 11249/37963 [27:01:45<86:37:20, 11.67s/it]
 30%|██▉       | 11250/37963 [27:01:52<77:43:09, 10.47s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '3.321', 'learning_rate': '1.651e-05', 'epoch': '0.2963'}

 30%|██▉       | 11250/37963 [27:01:52<77:43:09, 10.47s/it]
 30%|██▉       | 11251/37963 [27:02:00<71:03:28,  9.58s/it]
 30%|██▉       | 11252/37963 [27:02:07<66:27:53,  8.96s/it]
 30%|██▉       | 11253/37963 [27:02:15<63:20:33,  8.54s/it]
 30%|██▉       | 11254/37963 [27:02:22<61:04:01,  8.23s/it]
 30%|██▉       | 11255/37963 [27:02:30<59:26:48,  8.01s/it]
 30%|██▉       | 11256/37963 [27:02:37<58:19:49,  7.86s/it]
 30%|██▉       | 11257/37963 [27:02:51<72:01:00,  9.71s/it]
 30%|██▉       | 11258/37963 [27:02:59<67:10:04,  9.05s/it]
 30%|██▉       | 11259/37963 [27:03:06<63:59:26,  8.63s/it]
 30%|██▉       | 11260/37963 [27:03:14<61:56:19,  8.35s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '2.339', 'learning_rate': '1.65e-05', 'epoch': '0.2966'}

 30%|██▉       | 11260/37963 [27:03:14<61:56:19,  8.35s/it]
 30%|██▉       | 11261/37963 [27:03:22<60:11:41,  8.12s/it]
 30%|██▉       | 11262/37963 [27:03:29<59:08:13,  7.97s/it]
 30%|██▉       | 11263/37963 [27:03:43<72:09:40,  9.73s/it]
 30%|██▉       | 11264/37963 [27:03:51<67:32:08,  9.11s/it]
 30%|██▉       | 11265/37963 [27:03:58<63:55:47,  8.62s/it]
 30%|██▉       | 11266/37963 [27:04:06<61:38:07,  8.31s/it]
 30%|██▉       | 11267/37963 [27:04:13<59:30:06,  8.02s/it]
 30%|██▉       | 11268/37963 [27:04:21<58:17:01,  7.86s/it]
 30%|██▉       | 11269/37963 [27:04:28<57:33:28,  7.76s/it]
 30%|██▉       | 11270/37963 [27:04:36<56:33:46,  7.63s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '2.039', 'learning_rate': '1.649e-05', 'epoch': '0.2969'}

 30%|██▉       | 11270/37963 [27:04:36<56:33:46,  7.63s/it]
 30%|██▉       | 11271/37963 [27:04:43<56:01:40,  7.56s/it]
 30%|██▉       | 11272/37963 [27:04:57<70:15:27,  9.48s/it]
 30%|██▉       | 11273/37963 [27:05:05<66:02:56,  8.91s/it]
 30%|██▉       | 11274/37963 [27:05:19<77:29:11, 10.45s/it]
 30%|██▉       | 11275/37963 [27:05:26<70:09:38,  9.46s/it]
 30%|██▉       | 11276/37963 [27:05:33<65:56:49,  8.90s/it]
 30%|██▉       | 11277/37963 [27:05:41<62:55:51,  8.49s/it]
 30%|██▉       | 11278/37963 [27:05:49<60:58:08,  8.23s/it]
 30%|██▉       | 11279/37963 [27:05:56<59:30:38,  8.03s/it]
 30%|██▉       | 11280/37963 [27:06:04<58:25:03,  7.88s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.702', 'learning_rate': '1.649e-05', 'epoch': '0.2971'}

 30%|██▉       | 11280/37963 [27:06:04<58:25:03,  7.88s/it]
 30%|██▉       | 11281/37963 [27:06:11<57:36:39,  7.77s/it]
 30%|██▉       | 11282/37963 [27:06:19<56:45:54,  7.66s/it]
 30%|██▉       | 11283/37963 [27:06:26<56:29:09,  7.62s/it]
 30%|██▉       | 11284/37963 [27:06:34<56:10:25,  7.58s/it]
 30%|██▉       | 11285/37963 [27:06:41<55:37:42,  7.51s/it]
 30%|██▉       | 11286/37963 [27:06:48<55:38:01,  7.51s/it]
 30%|██▉       | 11287/37963 [27:07:02<70:03:11,  9.45s/it]
 30%|██▉       | 11288/37963 [27:07:10<66:05:14,  8.92s/it]
 30%|██▉       | 11289/37963 [27:07:18<62:55:07,  8.49s/it]
 30%|██▉       | 11290/37963 [27:07:25<60:41:20,  8.19s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '0.8761', 'learning_rate': '1.648e-05', 'epoch': '0.2974'}

 30%|██▉       | 11290/37963 [27:07:25<60:41:20,  8.19s/it]
 30%|██▉       | 11291/37963 [27:07:32<58:57:37,  7.96s/it]
 30%|██▉       | 11292/37963 [27:07:40<57:37:02,  7.78s/it]
 30%|██▉       | 11293/37963 [27:07:47<56:30:07,  7.63s/it]
 30%|██▉       | 11294/37963 [27:07:54<55:51:47,  7.54s/it]
 30%|██▉       | 11295/37963 [27:08:02<56:00:00,  7.56s/it]
 30%|██▉       | 11296/37963 [27:08:10<55:58:23,  7.56s/it]
 30%|██▉       | 11297/37963 [27:08:24<70:26:22,  9.51s/it]
 30%|██▉       | 11298/37963 [27:08:38<80:52:55, 10.92s/it]
 30%|██▉       | 11299/37963 [27:08:46<74:06:21, 10.01s/it]
 30%|██▉       | 11300/37963 [27:09:00<82:58:12, 11.20s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.968', 'learning_rate': '1.647e-05', 'epoch': '0.2977'}

 30%|██▉       | 11300/37963 [27:09:00<82:58:12, 11.20s/it]
 30%|██▉       | 11301/37963 [27:09:07<75:04:37, 10.14s/it]
 30%|██▉       | 11302/37963 [27:09:15<69:24:56,  9.37s/it]
 30%|██▉       | 11303/37963 [27:09:22<65:14:21,  8.81s/it]
 30%|██▉       | 11304/37963 [27:09:30<61:58:27,  8.37s/it]
 30%|██▉       | 11305/37963 [27:09:37<60:15:04,  8.14s/it]
 30%|██▉       | 11306/37963 [27:09:51<72:53:22,  9.84s/it]
 30%|██▉       | 11307/37963 [27:09:59<67:51:40,  9.16s/it]
 30%|██▉       | 11308/37963 [27:10:06<64:19:07,  8.69s/it]
 30%|██▉       | 11309/37963 [27:10:14<61:32:15,  8.31s/it]
 30%|██▉       | 11310/37963 [27:10:21<59:45:32,  8.07s/it]
                                                           
{'loss': '0.1756', 'grad_norm': '2.981', 'learning_rate': '1.647e-05', 'epoch': '0.2979'}

 30%|██▉       | 11310/37963 [27:10:21<59:45:32,  8.07s/it]
 30%|██▉       | 11311/37963 [27:10:35<72:39:53,  9.82s/it]
 30%|██▉       | 11312/37963 [27:10:43<67:37:31,  9.13s/it]
 30%|██▉       | 11313/37963 [27:10:50<64:04:43,  8.66s/it]
 30%|██▉       | 11314/37963 [27:10:58<61:41:25,  8.33s/it]
 30%|██▉       | 11315/37963 [27:11:06<60:09:05,  8.13s/it]
 30%|██▉       | 11316/37963 [27:11:13<58:56:46,  7.96s/it]
 30%|██▉       | 11317/37963 [27:11:27<72:41:14,  9.82s/it]
 30%|██▉       | 11318/37963 [27:11:35<67:38:57,  9.14s/it]
 30%|██▉       | 11319/37963 [27:11:42<63:37:12,  8.60s/it]
 30%|██▉       | 11320/37963 [27:11:49<60:48:28,  8.22s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '1.753', 'learning_rate': '1.646e-05', 'epoch': '0.2982'}

 30%|██▉       | 11320/37963 [27:11:49<60:48:28,  8.22s/it]
 30%|██▉       | 11321/37963 [27:11:57<58:57:43,  7.97s/it]
 30%|██▉       | 11322/37963 [27:12:04<57:41:48,  7.80s/it]
 30%|██▉       | 11323/37963 [27:12:18<71:14:16,  9.63s/it]
 30%|██▉       | 11324/37963 [27:12:26<66:49:10,  9.03s/it]
 30%|██▉       | 11325/37963 [27:12:33<63:22:18,  8.56s/it]
 30%|██▉       | 11326/37963 [27:12:41<61:08:31,  8.26s/it]
 30%|██▉       | 11327/37963 [27:12:48<59:23:32,  8.03s/it]
 30%|██▉       | 11328/37963 [27:12:56<58:39:54,  7.93s/it]
 30%|██▉       | 11329/37963 [27:13:03<57:39:34,  7.79s/it]
 30%|██▉       | 11330/37963 [27:13:11<57:02:00,  7.71s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '3.948', 'learning_rate': '1.645e-05', 'epoch': '0.2984'}

 30%|██▉       | 11330/37963 [27:13:11<57:02:00,  7.71s/it]
 30%|██▉       | 11331/37963 [27:13:19<56:45:30,  7.67s/it]
 30%|██▉       | 11332/37963 [27:13:26<56:13:47,  7.60s/it]
 30%|██▉       | 11333/37963 [27:13:34<56:02:15,  7.58s/it]
 30%|██▉       | 11334/37963 [27:13:48<70:28:27,  9.53s/it]
 30%|██▉       | 11335/37963 [27:13:55<66:03:59,  8.93s/it]
 30%|██▉       | 11336/37963 [27:14:03<62:52:27,  8.50s/it]
 30%|██▉       | 11337/37963 [27:14:10<60:29:21,  8.18s/it]
 30%|██▉       | 11338/37963 [27:14:18<59:05:11,  7.99s/it]
 30%|██▉       | 11339/37963 [27:14:25<57:49:21,  7.82s/it]
 30%|██▉       | 11340/37963 [27:14:33<57:05:16,  7.72s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.017', 'learning_rate': '1.645e-05', 'epoch': '0.2987'}

 30%|██▉       | 11340/37963 [27:14:33<57:05:16,  7.72s/it]
 30%|██▉       | 11341/37963 [27:14:40<56:33:35,  7.65s/it]
 30%|██▉       | 11342/37963 [27:14:47<56:09:18,  7.59s/it]
 30%|██▉       | 11343/37963 [27:14:55<55:18:31,  7.48s/it]
 30%|██▉       | 11344/37963 [27:15:15<82:44:41, 11.19s/it]
 30%|██▉       | 11345/37963 [27:15:22<74:41:20, 10.10s/it]
 30%|██▉       | 11346/37963 [27:15:36<83:13:06, 11.26s/it]
 30%|██▉       | 11347/37963 [27:15:43<74:27:02, 10.07s/it]
 30%|██▉       | 11348/37963 [27:15:51<69:01:22,  9.34s/it]
 30%|██▉       | 11349/37963 [27:15:59<65:07:49,  8.81s/it]
 30%|██▉       | 11350/37963 [27:16:06<62:25:47,  8.45s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '3.082', 'learning_rate': '1.644e-05', 'epoch': '0.299'}

 30%|██▉       | 11350/37963 [27:16:06<62:25:47,  8.45s/it]
 30%|██▉       | 11351/37963 [27:16:14<60:29:30,  8.18s/it]
 30%|██▉       | 11352/37963 [27:16:21<59:06:17,  8.00s/it]
 30%|██▉       | 11353/37963 [27:16:29<58:01:48,  7.85s/it]
 30%|██▉       | 11354/37963 [27:16:43<71:07:28,  9.62s/it]
 30%|██▉       | 11355/37963 [27:16:50<66:14:47,  8.96s/it]
 30%|██▉       | 11356/37963 [27:16:58<63:12:35,  8.55s/it]
 30%|██▉       | 11357/37963 [27:17:05<61:02:46,  8.26s/it]
 30%|██▉       | 11358/37963 [27:17:13<59:25:56,  8.04s/it]
 30%|██▉       | 11359/37963 [27:17:20<58:16:40,  7.89s/it]
 30%|██▉       | 11360/37963 [27:17:28<57:48:40,  7.82s/it]
                                                           
{'loss': '0.178', 'grad_norm': '0.9697', 'learning_rate': '1.643e-05', 'epoch': '0.2992'}

 30%|██▉       | 11360/37963 [27:17:28<57:48:40,  7.82s/it]
 30%|██▉       | 11361/37963 [27:17:35<57:09:30,  7.74s/it]
 30%|██▉       | 11362/37963 [27:17:49<70:49:53,  9.59s/it]
 30%|██▉       | 11363/37963 [27:17:57<66:17:54,  8.97s/it]
 30%|██▉       | 11364/37963 [27:18:11<76:56:35, 10.41s/it]
 30%|██▉       | 11365/37963 [27:18:19<71:49:40,  9.72s/it]
 30%|██▉       | 11366/37963 [27:18:26<67:10:53,  9.09s/it]
 30%|██▉       | 11367/37963 [27:18:34<63:42:35,  8.62s/it]
 30%|██▉       | 11368/37963 [27:18:41<61:08:29,  8.28s/it]
 30%|██▉       | 11369/37963 [27:18:49<59:24:28,  8.04s/it]
 30%|██▉       | 11370/37963 [27:18:56<57:31:08,  7.79s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.809', 'learning_rate': '1.643e-05', 'epoch': '0.2995'}

 30%|██▉       | 11370/37963 [27:18:56<57:31:08,  7.79s/it]
 30%|██▉       | 11371/37963 [27:19:04<57:03:52,  7.73s/it]
 30%|██▉       | 11372/37963 [27:19:11<56:44:13,  7.68s/it]
 30%|██▉       | 11373/37963 [27:19:25<70:43:22,  9.58s/it]
 30%|██▉       | 11374/37963 [27:19:33<66:16:22,  8.97s/it]
 30%|██▉       | 11375/37963 [27:19:40<63:10:55,  8.55s/it]
 30%|██▉       | 11376/37963 [27:19:48<60:46:05,  8.23s/it]
 30%|██▉       | 11377/37963 [27:19:55<59:16:22,  8.03s/it]
 30%|██▉       | 11378/37963 [27:20:03<57:25:26,  7.78s/it]
 30%|██▉       | 11379/37963 [27:20:10<56:52:29,  7.70s/it]
 30%|██▉       | 11380/37963 [27:20:18<56:32:34,  7.66s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.906', 'learning_rate': '1.642e-05', 'epoch': '0.2998'}

 30%|██▉       | 11380/37963 [27:20:18<56:32:34,  7.66s/it]
 30%|██▉       | 11381/37963 [27:20:25<56:03:53,  7.59s/it]
 30%|██▉       | 11382/37963 [27:20:39<69:25:41,  9.40s/it]
 30%|██▉       | 11383/37963 [27:20:46<65:19:23,  8.85s/it]
 30%|██▉       | 11384/37963 [27:20:54<62:06:09,  8.41s/it]
 30%|██▉       | 11385/37963 [27:21:01<59:59:55,  8.13s/it]
 30%|██▉       | 11386/37963 [27:21:09<58:52:24,  7.97s/it]
 30%|██▉       | 11387/37963 [27:21:16<57:51:42,  7.84s/it]
 30%|██▉       | 11388/37963 [27:21:24<56:52:02,  7.70s/it]
 30%|███       | 11389/37963 [27:21:31<56:25:45,  7.64s/it]
 30%|███       | 11390/37963 [27:21:45<70:33:15,  9.56s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.288', 'learning_rate': '1.641e-05', 'epoch': '0.3'}

 30%|███       | 11390/37963 [27:21:45<70:33:15,  9.56s/it]
 30%|███       | 11391/37963 [27:21:59<80:05:26, 10.85s/it]
 30%|███       | 11392/37963 [27:22:07<72:45:55,  9.86s/it]
 30%|███       | 11393/37963 [27:22:14<67:46:01,  9.18s/it]
 30%|███       | 11394/37963 [27:22:22<64:00:30,  8.67s/it]
 30%|███       | 11395/37963 [27:22:29<61:42:23,  8.36s/it]
 30%|███       | 11396/37963 [27:22:43<74:08:46, 10.05s/it]
 30%|███       | 11397/37963 [27:22:51<68:54:47,  9.34s/it]
 30%|███       | 11398/37963 [27:22:59<65:19:22,  8.85s/it]
 30%|███       | 11399/37963 [27:23:06<62:26:07,  8.46s/it]
 30%|███       | 11400/37963 [27:23:14<60:39:05,  8.22s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '1.562', 'learning_rate': '1.641e-05', 'epoch': '0.3003'}

 30%|███       | 11400/37963 [27:23:14<60:39:05,  8.22s/it]
 30%|███       | 11401/37963 [27:23:22<59:21:25,  8.04s/it]
 30%|███       | 11402/37963 [27:23:29<58:17:29,  7.90s/it]
 30%|███       | 11403/37963 [27:23:37<57:16:37,  7.76s/it]
 30%|███       | 11404/37963 [27:23:44<56:43:37,  7.69s/it]
 30%|███       | 11405/37963 [27:23:52<56:22:47,  7.64s/it]
 30%|███       | 11406/37963 [27:23:59<55:53:36,  7.58s/it]
 30%|███       | 11407/37963 [27:24:06<55:02:56,  7.46s/it]
 30%|███       | 11408/37963 [27:24:20<69:43:52,  9.45s/it]
 30%|███       | 11409/37963 [27:24:28<65:40:01,  8.90s/it]
 30%|███       | 11410/37963 [27:24:35<62:22:45,  8.46s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '0.8077', 'learning_rate': '1.64e-05', 'epoch': '0.3006'}

 30%|███       | 11410/37963 [27:24:35<62:22:45,  8.46s/it]
 30%|███       | 11411/37963 [27:24:43<60:21:11,  8.18s/it]
 30%|███       | 11412/37963 [27:24:57<73:21:48,  9.95s/it]
 30%|███       | 11413/37963 [27:25:04<68:03:15,  9.23s/it]
 30%|███       | 11414/37963 [27:25:12<63:46:44,  8.65s/it]
 30%|███       | 11415/37963 [27:25:26<76:12:26, 10.33s/it]
 30%|███       | 11416/37963 [27:25:34<70:10:02,  9.52s/it]
 30%|███       | 11417/37963 [27:25:41<65:53:01,  8.93s/it]
 30%|███       | 11418/37963 [27:25:49<62:43:17,  8.51s/it]
 30%|███       | 11419/37963 [27:25:56<60:59:06,  8.27s/it]
 30%|███       | 11420/37963 [27:26:04<59:31:36,  8.07s/it]
                                                           
{'loss': '0.1691', 'grad_norm': '2.659', 'learning_rate': '1.639e-05', 'epoch': '0.3008'}

 30%|███       | 11420/37963 [27:26:04<59:31:36,  8.07s/it]
 30%|███       | 11421/37963 [27:26:12<58:39:59,  7.96s/it]
 30%|███       | 11422/37963 [27:26:19<57:54:42,  7.86s/it]
 30%|███       | 11423/37963 [27:26:27<57:21:30,  7.78s/it]
 30%|███       | 11424/37963 [27:26:35<56:52:50,  7.72s/it]
 30%|███       | 11425/37963 [27:26:42<56:39:00,  7.68s/it]
 30%|███       | 11426/37963 [27:26:50<56:14:45,  7.63s/it]
 30%|███       | 11427/37963 [27:27:04<70:34:15,  9.57s/it]
 30%|███       | 11428/37963 [27:27:11<65:43:08,  8.92s/it]
 30%|███       | 11429/37963 [27:27:19<62:30:55,  8.48s/it]
 30%|███       | 11430/37963 [27:27:26<60:21:22,  8.19s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '0.9796', 'learning_rate': '1.639e-05', 'epoch': '0.3011'}

 30%|███       | 11430/37963 [27:27:26<60:21:22,  8.19s/it]
 30%|███       | 11431/37963 [27:27:34<59:05:32,  8.02s/it]
 30%|███       | 11432/37963 [27:27:48<72:13:50,  9.80s/it]
 30%|███       | 11433/37963 [27:27:55<67:02:24,  9.10s/it]
 30%|███       | 11434/37963 [27:28:03<63:38:59,  8.64s/it]
 30%|███       | 11435/37963 [27:28:10<61:26:02,  8.34s/it]
 30%|███       | 11436/37963 [27:28:18<59:41:19,  8.10s/it]
 30%|███       | 11437/37963 [27:28:26<58:34:26,  7.95s/it]
 30%|███       | 11438/37963 [27:28:33<57:46:52,  7.84s/it]
 30%|███       | 11439/37963 [27:28:41<57:22:32,  7.79s/it]
 30%|███       | 11440/37963 [27:28:55<71:32:41,  9.71s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '3.009', 'learning_rate': '1.638e-05', 'epoch': '0.3013'}

 30%|███       | 11440/37963 [27:28:55<71:32:41,  9.71s/it]
 30%|███       | 11441/37963 [27:29:02<66:42:19,  9.05s/it]
 30%|███       | 11442/37963 [27:29:16<77:18:53, 10.49s/it]
 30%|███       | 11443/37963 [27:29:24<70:43:14,  9.60s/it]
 30%|███       | 11444/37963 [27:29:38<80:33:32, 10.94s/it]
 30%|███       | 11445/37963 [27:29:46<73:48:43, 10.02s/it]
 30%|███       | 11446/37963 [27:29:53<68:32:29,  9.31s/it]
 30%|███       | 11447/37963 [27:30:01<64:37:41,  8.77s/it]
 30%|███       | 11448/37963 [27:30:09<62:10:20,  8.44s/it]
 30%|███       | 11449/37963 [27:30:16<60:34:44,  8.23s/it]
 30%|███       | 11450/37963 [27:30:24<59:10:08,  8.03s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '1.749', 'learning_rate': '1.637e-05', 'epoch': '0.3016'}

 30%|███       | 11450/37963 [27:30:24<59:10:08,  8.03s/it]
 30%|███       | 11451/37963 [27:30:31<57:45:46,  7.84s/it]
 30%|███       | 11452/37963 [27:30:39<57:01:59,  7.74s/it]
 30%|███       | 11453/37963 [27:30:46<56:03:00,  7.61s/it]
 30%|███       | 11454/37963 [27:30:54<56:09:52,  7.63s/it]
 30%|███       | 11455/37963 [27:31:02<56:27:07,  7.67s/it]
 30%|███       | 11456/37963 [27:31:16<70:16:38,  9.54s/it]
 30%|███       | 11457/37963 [27:31:23<65:14:49,  8.86s/it]
 30%|███       | 11458/37963 [27:31:30<62:34:03,  8.50s/it]
 30%|███       | 11459/37963 [27:31:44<74:14:58, 10.09s/it]
 30%|███       | 11460/37963 [27:31:52<68:47:37,  9.34s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '0.9887', 'learning_rate': '1.637e-05', 'epoch': '0.3019'}

 30%|███       | 11460/37963 [27:31:52<68:47:37,  9.34s/it]
 30%|███       | 11461/37963 [27:31:59<64:53:15,  8.81s/it]
 30%|███       | 11462/37963 [27:32:07<62:36:56,  8.51s/it]
 30%|███       | 11463/37963 [27:32:14<59:55:17,  8.14s/it]
 30%|███       | 11464/37963 [27:32:22<57:57:30,  7.87s/it]
 30%|███       | 11465/37963 [27:32:29<57:27:57,  7.81s/it]
 30%|███       | 11466/37963 [27:32:43<71:08:46,  9.67s/it]
 30%|███       | 11467/37963 [27:32:51<66:33:36,  9.04s/it]
 30%|███       | 11468/37963 [27:32:58<62:45:17,  8.53s/it]
 30%|███       | 11469/37963 [27:33:06<60:28:55,  8.22s/it]
 30%|███       | 11470/37963 [27:33:13<59:03:51,  8.03s/it]
                                                           
{'loss': '0.1806', 'grad_norm': '3.866', 'learning_rate': '1.636e-05', 'epoch': '0.3021'}

 30%|███       | 11470/37963 [27:33:13<59:03:51,  8.03s/it]
 30%|███       | 11471/37963 [27:33:21<58:02:03,  7.89s/it]
 30%|███       | 11472/37963 [27:33:29<57:29:49,  7.81s/it]
 30%|███       | 11473/37963 [27:33:36<56:52:36,  7.73s/it]
 30%|███       | 11474/37963 [27:33:44<56:23:25,  7.66s/it]
 30%|███       | 11475/37963 [27:33:51<56:12:06,  7.64s/it]
 30%|███       | 11476/37963 [27:33:59<55:55:20,  7.60s/it]
 30%|███       | 11477/37963 [27:34:20<85:16:25, 11.59s/it]
 30%|███       | 11478/37963 [27:34:27<75:34:44, 10.27s/it]
 30%|███       | 11479/37963 [27:34:34<69:31:29,  9.45s/it]
 30%|███       | 11480/37963 [27:34:42<64:49:36,  8.81s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '5.687', 'learning_rate': '1.635e-05', 'epoch': '0.3024'}

 30%|███       | 11480/37963 [27:34:42<64:49:36,  8.81s/it]
 30%|███       | 11481/37963 [27:34:49<61:58:13,  8.42s/it]
 30%|███       | 11482/37963 [27:34:57<60:01:43,  8.16s/it]
 30%|███       | 11483/37963 [27:35:04<57:57:29,  7.88s/it]
 30%|███       | 11484/37963 [27:35:12<57:32:43,  7.82s/it]
 30%|███       | 11485/37963 [27:35:19<56:52:43,  7.73s/it]
 30%|███       | 11486/37963 [27:35:33<70:17:43,  9.56s/it]
 30%|███       | 11487/37963 [27:35:41<65:59:56,  8.97s/it]
 30%|███       | 11488/37963 [27:35:48<62:39:05,  8.52s/it]
 30%|███       | 11489/37963 [27:35:56<60:57:20,  8.29s/it]
 30%|███       | 11490/37963 [27:36:10<73:18:31,  9.97s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '4.096', 'learning_rate': '1.635e-05', 'epoch': '0.3027'}

 30%|███       | 11490/37963 [27:36:10<73:18:31,  9.97s/it]
 30%|███       | 11491/37963 [27:36:17<68:14:01,  9.28s/it]
 30%|███       | 11492/37963 [27:36:25<64:35:14,  8.78s/it]
 30%|███       | 11493/37963 [27:36:33<61:47:05,  8.40s/it]
 30%|███       | 11494/37963 [27:36:46<73:54:23, 10.05s/it]
 30%|███       | 11495/37963 [27:36:54<67:38:33,  9.20s/it]
 30%|███       | 11496/37963 [27:37:01<64:13:00,  8.73s/it]
 30%|███       | 11497/37963 [27:37:09<61:54:45,  8.42s/it]
 30%|███       | 11498/37963 [27:37:17<60:09:23,  8.18s/it]
 30%|███       | 11499/37963 [27:37:24<58:49:52,  8.00s/it]
 30%|███       | 11500/37963 [27:37:32<57:44:38,  7.86s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '3.311', 'learning_rate': '1.634e-05', 'epoch': '0.3029'}

 30%|███       | 11500/37963 [27:37:32<57:44:38,  7.86s/it]
 30%|███       | 11501/37963 [27:37:39<57:08:00,  7.77s/it]
 30%|███       | 11502/37963 [27:37:47<56:32:59,  7.69s/it]
 30%|███       | 11503/37963 [27:37:54<56:08:08,  7.64s/it]
 30%|███       | 11504/37963 [27:38:02<55:45:39,  7.59s/it]
 30%|███       | 11505/37963 [27:38:09<55:40:47,  7.58s/it]
 30%|███       | 11506/37963 [27:38:17<55:51:37,  7.60s/it]
 30%|███       | 11507/37963 [27:38:31<69:46:04,  9.49s/it]
 30%|███       | 11508/37963 [27:38:38<65:07:34,  8.86s/it]
 30%|███       | 11509/37963 [27:38:46<62:13:03,  8.47s/it]
 30%|███       | 11510/37963 [27:38:54<60:33:18,  8.24s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.51', 'learning_rate': '1.634e-05', 'epoch': '0.3032'}

 30%|███       | 11510/37963 [27:38:54<60:33:18,  8.24s/it]
 30%|███       | 11511/37963 [27:39:01<58:06:25,  7.91s/it]
 30%|███       | 11512/37963 [27:39:08<57:26:12,  7.82s/it]
 30%|███       | 11513/37963 [27:39:22<71:02:36,  9.67s/it]
 30%|███       | 11514/37963 [27:39:30<66:10:44,  9.01s/it]
 30%|███       | 11515/37963 [27:39:44<77:20:50, 10.53s/it]
 30%|███       | 11516/37963 [27:39:51<70:46:30,  9.63s/it]
 30%|███       | 11517/37963 [27:39:59<66:00:56,  8.99s/it]
 30%|███       | 11518/37963 [27:40:06<62:37:53,  8.53s/it]
 30%|███       | 11519/37963 [27:40:14<60:29:53,  8.24s/it]
 30%|███       | 11520/37963 [27:40:21<58:45:24,  8.00s/it]
                                                           
{'loss': '0.155', 'grad_norm': '4.741', 'learning_rate': '1.633e-05', 'epoch': '0.3035'}

 30%|███       | 11520/37963 [27:40:21<58:45:24,  8.00s/it]
 30%|███       | 11521/37963 [27:40:29<57:58:08,  7.89s/it]
 30%|███       | 11522/37963 [27:40:36<57:10:38,  7.78s/it]
 30%|███       | 11523/37963 [27:40:50<70:39:46,  9.62s/it]
 30%|███       | 11524/37963 [27:40:58<66:26:07,  9.05s/it]
 30%|███       | 11525/37963 [27:41:12<77:21:22, 10.53s/it]
 30%|███       | 11526/37963 [27:41:20<70:43:06,  9.63s/it]
 30%|███       | 11527/37963 [27:41:27<66:03:37,  9.00s/it]
 30%|███       | 11528/37963 [27:41:35<62:55:31,  8.57s/it]
 30%|███       | 11529/37963 [27:41:42<60:38:17,  8.26s/it]
 30%|███       | 11530/37963 [27:41:50<58:51:28,  8.02s/it]
                                                           
{'loss': '0.1599', 'grad_norm': '1.966', 'learning_rate': '1.632e-05', 'epoch': '0.3037'}

 30%|███       | 11530/37963 [27:41:50<58:51:28,  8.02s/it]
 30%|███       | 11531/37963 [27:41:57<57:58:11,  7.90s/it]
 30%|███       | 11532/37963 [27:42:05<57:07:34,  7.78s/it]
 30%|███       | 11533/37963 [27:42:12<56:43:28,  7.73s/it]
 30%|███       | 11534/37963 [27:42:26<70:39:20,  9.62s/it]
 30%|███       | 11535/37963 [27:42:34<65:31:54,  8.93s/it]
 30%|███       | 11536/37963 [27:42:41<62:20:52,  8.49s/it]
 30%|███       | 11537/37963 [27:42:49<59:58:24,  8.17s/it]
 30%|███       | 11538/37963 [27:43:03<72:54:48,  9.93s/it]
 30%|███       | 11539/37963 [27:43:10<67:32:26,  9.20s/it]
 30%|███       | 11540/37963 [27:43:18<63:53:30,  8.70s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.209', 'learning_rate': '1.632e-05', 'epoch': '0.304'}

 30%|███       | 11540/37963 [27:43:18<63:53:30,  8.70s/it]
 30%|███       | 11541/37963 [27:43:25<60:48:52,  8.29s/it]
 30%|███       | 11542/37963 [27:43:39<73:22:58, 10.00s/it]
 30%|███       | 11543/37963 [27:43:46<67:23:18,  9.18s/it]
 30%|███       | 11544/37963 [27:43:54<63:03:26,  8.59s/it]
 30%|███       | 11545/37963 [27:44:01<60:45:41,  8.28s/it]
 30%|███       | 11546/37963 [27:44:09<59:00:31,  8.04s/it]
 30%|███       | 11547/37963 [27:44:16<57:39:46,  7.86s/it]
 30%|███       | 11548/37963 [27:44:23<56:29:37,  7.70s/it]
 30%|███       | 11549/37963 [27:44:31<56:27:57,  7.70s/it]
 30%|███       | 11550/37963 [27:44:39<56:13:13,  7.66s/it]
                                                           
{'loss': '0.1657', 'grad_norm': '2.093', 'learning_rate': '1.631e-05', 'epoch': '0.3042'}

 30%|███       | 11550/37963 [27:44:39<56:13:13,  7.66s/it]
 30%|███       | 11551/37963 [27:44:46<55:56:19,  7.62s/it]
 30%|███       | 11552/37963 [27:44:54<55:41:26,  7.59s/it]
 30%|███       | 11553/37963 [27:45:08<70:24:42,  9.60s/it]
 30%|███       | 11554/37963 [27:45:15<65:51:51,  8.98s/it]
 30%|███       | 11555/37963 [27:45:23<62:50:24,  8.57s/it]
 30%|███       | 11556/37963 [27:45:31<60:57:28,  8.31s/it]
 30%|███       | 11557/37963 [27:45:38<59:18:43,  8.09s/it]
 30%|███       | 11558/37963 [27:45:46<58:16:11,  7.94s/it]
 30%|███       | 11559/37963 [27:46:00<71:51:11,  9.80s/it]
 30%|███       | 11560/37963 [27:46:08<66:56:26,  9.13s/it]
                                                           
{'loss': '0.1719', 'grad_norm': '1.677', 'learning_rate': '1.63e-05', 'epoch': '0.3045'}

 30%|███       | 11560/37963 [27:46:08<66:56:26,  9.13s/it]
 30%|███       | 11561/37963 [27:46:22<77:26:26, 10.56s/it]
 30%|███       | 11562/37963 [27:46:29<70:58:10,  9.68s/it]
 30%|███       | 11563/37963 [27:46:37<66:08:57,  9.02s/it]
 30%|███       | 11564/37963 [27:46:44<63:05:13,  8.60s/it]
 30%|███       | 11565/37963 [27:46:52<60:47:57,  8.29s/it]
 30%|███       | 11566/37963 [27:46:59<58:37:21,  7.99s/it]
 30%|███       | 11567/37963 [27:47:07<58:03:27,  7.92s/it]
 30%|███       | 11568/37963 [27:47:14<57:01:41,  7.78s/it]
 30%|███       | 11569/37963 [27:47:28<70:22:13,  9.60s/it]
 30%|███       | 11570/37963 [27:47:36<66:10:06,  9.03s/it]
                                                           
{'loss': '0.173', 'grad_norm': '2.1', 'learning_rate': '1.63e-05', 'epoch': '0.3048'}

 30%|███       | 11570/37963 [27:47:36<66:10:06,  9.03s/it]
 30%|███       | 11571/37963 [27:47:43<63:01:50,  8.60s/it]
 30%|███       | 11572/37963 [27:47:51<60:41:36,  8.28s/it]
 30%|███       | 11573/37963 [27:47:58<58:35:59,  7.99s/it]
 30%|███       | 11574/37963 [27:48:12<71:30:06,  9.75s/it]
 30%|███       | 11575/37963 [27:48:20<66:35:40,  9.09s/it]
 30%|███       | 11576/37963 [27:48:27<63:15:25,  8.63s/it]
 30%|███       | 11577/37963 [27:48:35<60:26:29,  8.25s/it]
 30%|███       | 11578/37963 [27:48:42<59:07:03,  8.07s/it]
 31%|███       | 11579/37963 [27:48:50<58:05:16,  7.93s/it]
 31%|███       | 11580/37963 [27:48:57<57:24:54,  7.83s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.057', 'learning_rate': '1.629e-05', 'epoch': '0.305'}

 31%|███       | 11580/37963 [27:48:57<57:24:54,  7.83s/it]
 31%|███       | 11581/37963 [27:49:05<56:55:17,  7.77s/it]
 31%|███       | 11582/37963 [27:49:19<70:16:45,  9.59s/it]
 31%|███       | 11583/37963 [27:49:26<65:33:10,  8.95s/it]
 31%|███       | 11584/37963 [27:49:34<62:29:32,  8.53s/it]
 31%|███       | 11585/37963 [27:49:48<74:15:55, 10.14s/it]
 31%|███       | 11586/37963 [27:49:56<69:05:09,  9.43s/it]
 31%|███       | 11587/37963 [27:50:03<64:23:11,  8.79s/it]
 31%|███       | 11588/37963 [27:50:10<61:35:21,  8.41s/it]
 31%|███       | 11589/37963 [27:50:18<59:07:16,  8.07s/it]
 31%|███       | 11590/37963 [27:50:25<58:01:30,  7.92s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.469', 'learning_rate': '1.628e-05', 'epoch': '0.3053'}

 31%|███       | 11590/37963 [27:50:25<58:01:30,  7.92s/it]
 31%|███       | 11591/37963 [27:50:33<57:27:02,  7.84s/it]
 31%|███       | 11592/37963 [27:50:40<56:31:19,  7.72s/it]
 31%|███       | 11593/37963 [27:50:48<56:21:26,  7.69s/it]
 31%|███       | 11594/37963 [27:50:56<56:17:08,  7.68s/it]
 31%|███       | 11595/37963 [27:51:03<55:37:43,  7.59s/it]
 31%|███       | 11596/37963 [27:51:17<69:34:57,  9.50s/it]
 31%|███       | 11597/37963 [27:51:24<64:58:10,  8.87s/it]
 31%|███       | 11598/37963 [27:51:32<61:23:19,  8.38s/it]
 31%|███       | 11599/37963 [27:51:39<59:06:48,  8.07s/it]
 31%|███       | 11600/37963 [27:51:53<71:55:29,  9.82s/it]
                                                           
{'loss': '0.1637', 'grad_norm': '1.933', 'learning_rate': '1.628e-05', 'epoch': '0.3056'}

 31%|███       | 11600/37963 [27:51:53<71:55:29,  9.82s/it]
 31%|███       | 11601/37963 [27:52:01<67:12:09,  9.18s/it]
 31%|███       | 11602/37963 [27:52:08<63:56:31,  8.73s/it]
 31%|███       | 11603/37963 [27:52:16<61:32:01,  8.40s/it]
 31%|███       | 11604/37963 [27:52:23<59:27:55,  8.12s/it]
 31%|███       | 11605/37963 [27:52:31<58:22:11,  7.97s/it]
 31%|███       | 11606/37963 [27:52:45<72:12:57,  9.86s/it]
 31%|███       | 11607/37963 [27:52:53<67:05:26,  9.16s/it]
 31%|███       | 11608/37963 [27:53:07<77:08:23, 10.54s/it]
 31%|███       | 11609/37963 [27:53:14<70:09:23,  9.58s/it]
 31%|███       | 11610/37963 [27:53:21<65:37:42,  8.97s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '1.414', 'learning_rate': '1.627e-05', 'epoch': '0.3058'}

 31%|███       | 11610/37963 [27:53:21<65:37:42,  8.97s/it]
 31%|███       | 11611/37963 [27:53:29<62:16:58,  8.51s/it]
 31%|███       | 11612/37963 [27:53:36<60:18:40,  8.24s/it]
 31%|███       | 11613/37963 [27:53:44<58:53:03,  8.04s/it]
 31%|███       | 11614/37963 [27:53:52<58:02:25,  7.93s/it]
 31%|███       | 11615/37963 [27:53:59<57:13:48,  7.82s/it]
 31%|███       | 11616/37963 [27:54:07<56:26:29,  7.71s/it]
 31%|███       | 11617/37963 [27:54:14<56:19:01,  7.70s/it]
 31%|███       | 11618/37963 [27:54:22<55:56:45,  7.64s/it]
 31%|███       | 11619/37963 [27:54:29<54:59:00,  7.51s/it]
 31%|███       | 11620/37963 [27:54:37<55:24:01,  7.57s/it]
                                                           
{'loss': '0.1708', 'grad_norm': '1.111', 'learning_rate': '1.626e-05', 'epoch': '0.3061'}

 31%|███       | 11620/37963 [27:54:37<55:24:01,  7.57s/it]
 31%|███       | 11621/37963 [27:54:58<84:29:39, 11.55s/it]
 31%|███       | 11622/37963 [27:55:05<75:50:10, 10.36s/it]
 31%|███       | 11623/37963 [27:55:13<69:52:29,  9.55s/it]
 31%|███       | 11624/37963 [27:55:20<65:26:55,  8.95s/it]
 31%|███       | 11625/37963 [27:55:28<61:54:16,  8.46s/it]
 31%|███       | 11626/37963 [27:55:36<60:16:53,  8.24s/it]
 31%|███       | 11627/37963 [27:55:43<58:46:33,  8.03s/it]
 31%|███       | 11628/37963 [27:55:51<57:41:36,  7.89s/it]
 31%|███       | 11629/37963 [27:55:58<56:25:56,  7.71s/it]
 31%|███       | 11630/37963 [27:56:05<56:01:59,  7.66s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '1.058', 'learning_rate': '1.626e-05', 'epoch': '0.3064'}

 31%|███       | 11630/37963 [27:56:05<56:01:59,  7.66s/it]
 31%|███       | 11631/37963 [27:56:13<55:51:24,  7.64s/it]
 31%|███       | 11632/37963 [27:56:20<55:26:35,  7.58s/it]
 31%|███       | 11633/37963 [27:56:41<83:18:06, 11.39s/it]
 31%|███       | 11634/37963 [27:56:49<75:26:41, 10.32s/it]
 31%|███       | 11635/37963 [27:56:56<69:21:09,  9.48s/it]
 31%|███       | 11636/37963 [27:57:04<65:24:03,  8.94s/it]
 31%|███       | 11637/37963 [27:57:11<61:48:42,  8.45s/it]
 31%|███       | 11638/37963 [27:57:19<60:08:08,  8.22s/it]
 31%|███       | 11639/37963 [27:57:26<58:38:51,  8.02s/it]
 31%|███       | 11640/37963 [27:57:34<57:25:33,  7.85s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '2.972', 'learning_rate': '1.625e-05', 'epoch': '0.3066'}

 31%|███       | 11640/37963 [27:57:34<57:25:33,  7.85s/it]
 31%|███       | 11641/37963 [27:57:41<56:49:04,  7.77s/it]
 31%|███       | 11642/37963 [27:57:49<56:09:58,  7.68s/it]
 31%|███       | 11643/37963 [27:57:56<55:48:31,  7.63s/it]
 31%|███       | 11644/37963 [27:58:04<55:44:45,  7.63s/it]
 31%|███       | 11645/37963 [27:58:11<54:52:24,  7.51s/it]
 31%|███       | 11646/37963 [27:58:19<55:03:42,  7.53s/it]
 31%|███       | 11647/37963 [27:58:33<69:09:16,  9.46s/it]
 31%|███       | 11648/37963 [27:58:47<79:27:28, 10.87s/it]
 31%|███       | 11649/37963 [27:58:54<71:51:56,  9.83s/it]
 31%|███       | 11650/37963 [27:59:02<66:07:45,  9.05s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.729', 'learning_rate': '1.624e-05', 'epoch': '0.3069'}

 31%|███       | 11650/37963 [27:59:02<66:07:45,  9.05s/it]
 31%|███       | 11651/37963 [27:59:16<77:39:04, 10.62s/it]
 31%|███       | 11652/37963 [27:59:23<71:03:43,  9.72s/it]
 31%|███       | 11653/37963 [27:59:31<66:27:01,  9.09s/it]
 31%|███       | 11654/37963 [27:59:39<63:00:30,  8.62s/it]
 31%|███       | 11655/37963 [27:59:46<60:42:53,  8.31s/it]
 31%|███       | 11656/37963 [27:59:54<59:04:08,  8.08s/it]
 31%|███       | 11657/37963 [28:00:01<58:00:12,  7.94s/it]
 31%|███       | 11658/37963 [28:00:09<56:22:40,  7.72s/it]
 31%|███       | 11659/37963 [28:00:23<70:23:05,  9.63s/it]
 31%|███       | 11660/37963 [28:00:30<65:51:36,  9.01s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.406', 'learning_rate': '1.624e-05', 'epoch': '0.3071'}

 31%|███       | 11660/37963 [28:00:30<65:51:36,  9.01s/it]
 31%|███       | 11661/37963 [28:00:38<62:29:00,  8.55s/it]
 31%|███       | 11662/37963 [28:00:45<60:37:09,  8.30s/it]
 31%|███       | 11663/37963 [28:00:53<58:43:34,  8.04s/it]
 31%|███       | 11664/37963 [28:01:00<57:37:28,  7.89s/it]
 31%|███       | 11665/37963 [28:01:08<56:31:04,  7.74s/it]
 31%|███       | 11666/37963 [28:01:15<55:57:29,  7.66s/it]
 31%|███       | 11667/37963 [28:01:23<55:46:27,  7.64s/it]
 31%|███       | 11668/37963 [28:01:37<69:20:00,  9.49s/it]
 31%|███       | 11669/37963 [28:01:44<65:12:04,  8.93s/it]
 31%|███       | 11670/37963 [28:01:58<76:16:09, 10.44s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '2.33', 'learning_rate': '1.623e-05', 'epoch': '0.3074'}

 31%|███       | 11670/37963 [28:01:58<76:16:09, 10.44s/it]
 31%|███       | 11671/37963 [28:02:06<69:48:30,  9.56s/it]
 31%|███       | 11672/37963 [28:02:13<65:26:42,  8.96s/it]
 31%|███       | 11673/37963 [28:02:21<62:21:10,  8.54s/it]
 31%|███       | 11674/37963 [28:02:28<60:13:25,  8.25s/it]
 31%|███       | 11675/37963 [28:02:36<58:31:11,  8.01s/it]
 31%|███       | 11676/37963 [28:02:43<57:25:28,  7.86s/it]
 31%|███       | 11677/37963 [28:02:51<56:39:32,  7.76s/it]
 31%|███       | 11678/37963 [28:02:58<56:07:25,  7.69s/it]
 31%|███       | 11679/37963 [28:03:06<55:41:23,  7.63s/it]
 31%|███       | 11680/37963 [28:03:13<55:26:32,  7.59s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '3.298', 'learning_rate': '1.622e-05', 'epoch': '0.3077'}

 31%|███       | 11680/37963 [28:03:13<55:26:32,  7.59s/it]
 31%|███       | 11681/37963 [28:03:27<69:13:28,  9.48s/it]
 31%|███       | 11682/37963 [28:03:35<64:17:07,  8.81s/it]
 31%|███       | 11683/37963 [28:03:42<61:39:39,  8.45s/it]
 31%|███       | 11684/37963 [28:03:50<60:12:28,  8.25s/it]
 31%|███       | 11685/37963 [28:03:57<58:37:47,  8.03s/it]
 31%|███       | 11686/37963 [28:04:05<57:43:10,  7.91s/it]
 31%|███       | 11687/37963 [28:04:19<71:07:59,  9.75s/it]
 31%|███       | 11688/37963 [28:04:26<65:56:41,  9.04s/it]
 31%|███       | 11689/37963 [28:04:34<62:38:55,  8.58s/it]
 31%|███       | 11690/37963 [28:04:42<60:21:18,  8.27s/it]
                                                           
{'loss': '0.1722', 'grad_norm': '3.274', 'learning_rate': '1.622e-05', 'epoch': '0.3079'}

 31%|███       | 11690/37963 [28:04:42<60:21:18,  8.27s/it]
 31%|███       | 11691/37963 [28:04:55<72:34:16,  9.94s/it]
 31%|███       | 11692/37963 [28:05:03<67:19:29,  9.23s/it]
 31%|███       | 11693/37963 [28:05:10<63:37:25,  8.72s/it]
 31%|███       | 11694/37963 [28:05:18<60:50:29,  8.34s/it]
 31%|███       | 11695/37963 [28:05:26<59:08:45,  8.11s/it]
 31%|███       | 11696/37963 [28:05:40<72:31:43,  9.94s/it]
 31%|███       | 11697/37963 [28:05:47<67:35:30,  9.26s/it]
 31%|███       | 11698/37963 [28:05:55<64:00:46,  8.77s/it]
 31%|███       | 11699/37963 [28:06:03<61:10:08,  8.38s/it]
 31%|███       | 11700/37963 [28:06:10<59:18:59,  8.13s/it]
                                                           
{'loss': '0.1685', 'grad_norm': '2.137', 'learning_rate': '1.621e-05', 'epoch': '0.3082'}

 31%|███       | 11700/37963 [28:06:10<59:18:59,  8.13s/it]
 31%|███       | 11701/37963 [28:06:18<58:07:30,  7.97s/it]
 31%|███       | 11702/37963 [28:06:25<56:44:22,  7.78s/it]
 31%|███       | 11703/37963 [28:06:39<70:37:46,  9.68s/it]
 31%|███       | 11704/37963 [28:06:47<65:51:22,  9.03s/it]
 31%|███       | 11705/37963 [28:06:54<62:49:02,  8.61s/it]
 31%|███       | 11706/37963 [28:07:02<60:20:44,  8.27s/it]
 31%|███       | 11707/37963 [28:07:09<58:17:34,  7.99s/it]
 31%|███       | 11708/37963 [28:07:23<71:23:03,  9.79s/it]
 31%|███       | 11709/37963 [28:07:31<66:40:19,  9.14s/it]
 31%|███       | 11710/37963 [28:07:38<62:51:42,  8.62s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.993', 'learning_rate': '1.62e-05', 'epoch': '0.3085'}

 31%|███       | 11710/37963 [28:07:38<62:51:42,  8.62s/it]
 31%|███       | 11711/37963 [28:07:45<60:12:11,  8.26s/it]
 31%|███       | 11712/37963 [28:07:53<58:32:19,  8.03s/it]
 31%|███       | 11713/37963 [28:08:01<57:32:28,  7.89s/it]
 31%|███       | 11714/37963 [28:08:08<57:37:29,  7.90s/it]
 31%|███       | 11715/37963 [28:08:22<70:57:21,  9.73s/it]
 31%|███       | 11716/37963 [28:08:30<66:12:25,  9.08s/it]
 31%|███       | 11717/37963 [28:08:38<63:07:30,  8.66s/it]
 31%|███       | 11718/37963 [28:08:45<60:40:12,  8.32s/it]
 31%|███       | 11719/37963 [28:08:53<59:02:47,  8.10s/it]
 31%|███       | 11720/37963 [28:09:00<57:48:08,  7.93s/it]
                                                           
{'loss': '0.1662', 'grad_norm': '1.939', 'learning_rate': '1.62e-05', 'epoch': '0.3087'}

 31%|███       | 11720/37963 [28:09:00<57:48:08,  7.93s/it]
 31%|███       | 11721/37963 [28:09:08<56:33:36,  7.76s/it]
 31%|███       | 11722/37963 [28:09:15<56:14:43,  7.72s/it]
 31%|███       | 11723/37963 [28:09:29<69:41:53,  9.56s/it]
 31%|███       | 11724/37963 [28:09:37<64:56:19,  8.91s/it]
 31%|███       | 11725/37963 [28:09:44<62:00:44,  8.51s/it]
 31%|███       | 11726/37963 [28:09:52<59:50:56,  8.21s/it]
 31%|███       | 11727/37963 [28:09:59<57:49:51,  7.94s/it]
 31%|███       | 11728/37963 [28:10:07<56:54:41,  7.81s/it]
 31%|███       | 11729/37963 [28:10:14<56:37:07,  7.77s/it]
 31%|███       | 11730/37963 [28:10:22<56:25:39,  7.74s/it]
                                                           
{'loss': '0.1786', 'grad_norm': '2.386', 'learning_rate': '1.619e-05', 'epoch': '0.309'}

 31%|███       | 11730/37963 [28:10:22<56:25:39,  7.74s/it]
 31%|███       | 11731/37963 [28:10:29<55:14:40,  7.58s/it]
 31%|███       | 11732/37963 [28:10:37<55:06:58,  7.56s/it]
 31%|███       | 11733/37963 [28:10:44<55:17:06,  7.59s/it]
 31%|███       | 11734/37963 [28:10:58<69:13:25,  9.50s/it]
 31%|███       | 11735/37963 [28:11:12<79:09:54, 10.87s/it]
 31%|███       | 11736/37963 [28:11:20<72:07:51,  9.90s/it]
 31%|███       | 11737/37963 [28:11:27<66:45:37,  9.16s/it]
 31%|███       | 11738/37963 [28:11:35<62:36:56,  8.60s/it]
 31%|███       | 11739/37963 [28:11:42<60:16:53,  8.28s/it]
 31%|███       | 11740/37963 [28:11:50<58:34:41,  8.04s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '3.021', 'learning_rate': '1.618e-05', 'epoch': '0.3092'}

 31%|███       | 11740/37963 [28:11:50<58:34:41,  8.04s/it]
 31%|███       | 11741/37963 [28:12:04<71:50:44,  9.86s/it]
 31%|███       | 11742/37963 [28:12:17<79:57:04, 10.98s/it]
 31%|███       | 11743/37963 [28:12:25<72:36:39,  9.97s/it]
 31%|███       | 11744/37963 [28:12:32<67:15:05,  9.23s/it]
 31%|███       | 11745/37963 [28:12:40<63:05:09,  8.66s/it]
 31%|███       | 11746/37963 [28:12:47<60:37:34,  8.32s/it]
 31%|███       | 11747/37963 [28:12:55<58:34:03,  8.04s/it]
 31%|███       | 11748/37963 [28:13:02<57:27:07,  7.89s/it]
 31%|███       | 11749/37963 [28:13:16<71:12:21,  9.78s/it]
 31%|███       | 11750/37963 [28:13:24<66:03:39,  9.07s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.342', 'learning_rate': '1.618e-05', 'epoch': '0.3095'}

 31%|███       | 11750/37963 [28:13:24<66:03:39,  9.07s/it]
 31%|███       | 11751/37963 [28:13:31<62:39:13,  8.60s/it]
 31%|███       | 11752/37963 [28:13:39<60:22:34,  8.29s/it]
 31%|███       | 11753/37963 [28:13:47<59:04:11,  8.11s/it]
 31%|███       | 11754/37963 [28:13:54<57:43:32,  7.93s/it]
 31%|███       | 11755/37963 [28:14:02<56:50:48,  7.81s/it]
 31%|███       | 11756/37963 [28:14:09<56:15:38,  7.73s/it]
 31%|███       | 11757/37963 [28:14:23<69:52:21,  9.60s/it]
 31%|███       | 11758/37963 [28:14:31<65:28:43,  9.00s/it]
 31%|███       | 11759/37963 [28:14:38<62:14:16,  8.55s/it]
 31%|███       | 11760/37963 [28:14:46<59:50:37,  8.22s/it]
                                                           
{'loss': '0.1775', 'grad_norm': '2.259', 'learning_rate': '1.617e-05', 'epoch': '0.3098'}

 31%|███       | 11760/37963 [28:14:46<59:50:37,  8.22s/it]
 31%|███       | 11761/37963 [28:14:53<58:27:42,  8.03s/it]
 31%|███       | 11762/37963 [28:15:01<56:57:32,  7.83s/it]
 31%|███       | 11763/37963 [28:15:08<56:26:50,  7.76s/it]
 31%|███       | 11764/37963 [28:15:22<69:33:10,  9.56s/it]
 31%|███       | 11765/37963 [28:15:30<65:11:59,  8.96s/it]
 31%|███       | 11766/37963 [28:15:37<62:02:26,  8.53s/it]
 31%|███       | 11767/37963 [28:15:44<59:27:56,  8.17s/it]
 31%|███       | 11768/37963 [28:15:52<58:04:48,  7.98s/it]
 31%|███       | 11769/37963 [28:15:59<56:36:04,  7.78s/it]
 31%|███       | 11770/37963 [28:16:07<55:38:43,  7.65s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '3.33', 'learning_rate': '1.616e-05', 'epoch': '0.31'}

 31%|███       | 11770/37963 [28:16:07<55:38:43,  7.65s/it]
 31%|███       | 11771/37963 [28:16:14<55:37:04,  7.64s/it]
 31%|███       | 11772/37963 [28:16:22<55:44:42,  7.66s/it]
 31%|███       | 11773/37963 [28:16:29<55:01:48,  7.56s/it]
 31%|███       | 11774/37963 [28:16:43<69:22:57,  9.54s/it]
 31%|███       | 11775/37963 [28:16:51<64:49:22,  8.91s/it]
 31%|███       | 11776/37963 [28:16:58<61:36:34,  8.47s/it]
 31%|███       | 11777/37963 [28:17:06<59:32:54,  8.19s/it]
 31%|███       | 11778/37963 [28:17:13<57:41:26,  7.93s/it]
 31%|███       | 11779/37963 [28:17:21<57:17:16,  7.88s/it]
 31%|███       | 11780/37963 [28:17:29<56:42:10,  7.80s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '3.324', 'learning_rate': '1.616e-05', 'epoch': '0.3103'}

 31%|███       | 11780/37963 [28:17:29<56:42:10,  7.80s/it]
 31%|███       | 11781/37963 [28:17:43<70:19:09,  9.67s/it]
 31%|███       | 11782/37963 [28:17:50<66:10:25,  9.10s/it]
 31%|███       | 11783/37963 [28:17:58<62:41:30,  8.62s/it]
 31%|███       | 11784/37963 [28:18:11<73:28:21, 10.10s/it]
 31%|███       | 11785/37963 [28:18:19<67:39:10,  9.30s/it]
 31%|███       | 11786/37963 [28:18:26<62:54:07,  8.65s/it]
 31%|███       | 11787/37963 [28:18:33<60:23:19,  8.31s/it]
 31%|███       | 11788/37963 [28:18:47<72:34:42,  9.98s/it]
 31%|███       | 11789/37963 [28:19:01<81:25:09, 11.20s/it]
 31%|███       | 11790/37963 [28:19:09<73:19:22, 10.09s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '0.9193', 'learning_rate': '1.615e-05', 'epoch': '0.3106'}

 31%|███       | 11790/37963 [28:19:09<73:19:22, 10.09s/it]
 31%|███       | 11791/37963 [28:19:16<67:35:46,  9.30s/it]
 31%|███       | 11792/37963 [28:19:24<64:07:50,  8.82s/it]
 31%|███       | 11793/37963 [28:19:32<61:18:07,  8.43s/it]
 31%|███       | 11794/37963 [28:19:39<59:10:32,  8.14s/it]
 31%|███       | 11795/37963 [28:19:47<57:45:47,  7.95s/it]
 31%|███       | 11796/37963 [28:19:54<56:11:54,  7.73s/it]
 31%|███       | 11797/37963 [28:20:01<56:01:42,  7.71s/it]
 31%|███       | 11798/37963 [28:20:09<55:35:21,  7.65s/it]
 31%|███       | 11799/37963 [28:20:16<55:21:20,  7.62s/it]
 31%|███       | 11800/37963 [28:20:24<55:18:15,  7.61s/it]
                                                           
{'loss': '0.155', 'grad_norm': '2.411', 'learning_rate': '1.614e-05', 'epoch': '0.3108'}

 31%|███       | 11800/37963 [28:20:24<55:18:15,  7.61s/it]
 31%|███       | 11801/37963 [28:20:32<55:08:50,  7.59s/it]
 31%|███       | 11802/37963 [28:20:39<54:57:22,  7.56s/it]
 31%|███       | 11803/37963 [28:20:53<69:12:50,  9.52s/it]
 31%|███       | 11804/37963 [28:21:01<65:04:41,  8.96s/it]
 31%|███       | 11805/37963 [28:21:08<61:58:24,  8.53s/it]
 31%|███       | 11806/37963 [28:21:16<59:42:32,  8.22s/it]
 31%|███       | 11807/37963 [28:21:23<57:14:35,  7.88s/it]
 31%|███       | 11808/37963 [28:21:30<56:14:03,  7.74s/it]
 31%|███       | 11809/37963 [28:21:38<55:37:20,  7.66s/it]
 31%|███       | 11810/37963 [28:21:52<69:06:20,  9.51s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '2.771', 'learning_rate': '1.614e-05', 'epoch': '0.3111'}

 31%|███       | 11810/37963 [28:21:52<69:06:20,  9.51s/it]
 31%|███       | 11811/37963 [28:21:59<64:21:01,  8.86s/it]
 31%|███       | 11812/37963 [28:22:07<61:25:16,  8.46s/it]
 31%|███       | 11813/37963 [28:22:14<59:29:18,  8.19s/it]
 31%|███       | 11814/37963 [28:22:22<58:05:10,  8.00s/it]
 31%|███       | 11815/37963 [28:22:36<71:09:56,  9.80s/it]
 31%|███       | 11816/37963 [28:22:43<65:58:41,  9.08s/it]
 31%|███       | 11817/37963 [28:22:51<62:38:55,  8.63s/it]
 31%|███       | 11818/37963 [28:22:58<60:16:03,  8.30s/it]
 31%|███       | 11819/37963 [28:23:06<58:39:28,  8.08s/it]
 31%|███       | 11820/37963 [28:23:14<58:04:51,  8.00s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '0.8421', 'learning_rate': '1.613e-05', 'epoch': '0.3114'}

 31%|███       | 11820/37963 [28:23:14<58:04:51,  8.00s/it]
 31%|███       | 11821/37963 [28:23:21<56:57:08,  7.84s/it]
 31%|███       | 11822/37963 [28:23:35<70:04:05,  9.65s/it]
 31%|███       | 11823/37963 [28:23:43<65:42:38,  9.05s/it]
 31%|███       | 11824/37963 [28:23:50<62:25:28,  8.60s/it]
 31%|███       | 11825/37963 [28:23:58<60:30:59,  8.33s/it]
 31%|███       | 11826/37963 [28:24:05<58:21:58,  8.04s/it]
 31%|███       | 11827/37963 [28:24:19<71:39:14,  9.87s/it]
 31%|███       | 11828/37963 [28:24:27<66:51:32,  9.21s/it]
 31%|███       | 11829/37963 [28:24:35<63:45:41,  8.78s/it]
 31%|███       | 11830/37963 [28:24:42<61:20:07,  8.45s/it]
                                                           
{'loss': '0.1726', 'grad_norm': '2.658', 'learning_rate': '1.612e-05', 'epoch': '0.3116'}

 31%|███       | 11830/37963 [28:24:42<61:20:07,  8.45s/it]
 31%|███       | 11831/37963 [28:24:50<59:25:32,  8.19s/it]
 31%|███       | 11832/37963 [28:24:58<58:13:15,  8.02s/it]
 31%|███       | 11833/37963 [28:25:12<71:07:12,  9.80s/it]
 31%|███       | 11834/37963 [28:25:26<80:57:01, 11.15s/it]
 31%|███       | 11835/37963 [28:25:40<87:25:26, 12.05s/it]
 31%|███       | 11836/37963 [28:25:48<77:41:30, 10.71s/it]
 31%|███       | 11837/37963 [28:25:55<70:54:34,  9.77s/it]
 31%|███       | 11838/37963 [28:26:03<66:15:33,  9.13s/it]
 31%|███       | 11839/37963 [28:26:11<63:09:34,  8.70s/it]
 31%|███       | 11840/37963 [28:26:18<60:36:28,  8.35s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '2.213', 'learning_rate': '1.611e-05', 'epoch': '0.3119'}

 31%|███       | 11840/37963 [28:26:18<60:36:28,  8.35s/it]
 31%|███       | 11841/37963 [28:26:26<58:55:49,  8.12s/it]
 31%|███       | 11842/37963 [28:26:33<57:13:35,  7.89s/it]
 31%|███       | 11843/37963 [28:26:41<56:32:27,  7.79s/it]
 31%|███       | 11844/37963 [28:26:48<55:55:40,  7.71s/it]
 31%|███       | 11845/37963 [28:26:56<55:30:38,  7.65s/it]
 31%|███       | 11846/37963 [28:27:03<55:28:12,  7.65s/it]
 31%|███       | 11847/37963 [28:27:11<54:56:13,  7.57s/it]
 31%|███       | 11848/37963 [28:27:18<54:39:21,  7.53s/it]
 31%|███       | 11849/37963 [28:27:32<69:16:21,  9.55s/it]
 31%|███       | 11850/37963 [28:27:40<64:41:23,  8.92s/it]
                                                           
{'loss': '0.1765', 'grad_norm': '2.364', 'learning_rate': '1.611e-05', 'epoch': '0.3121'}

 31%|███       | 11850/37963 [28:27:40<64:41:23,  8.92s/it]
 31%|███       | 11851/37963 [28:27:47<61:54:02,  8.53s/it]
 31%|███       | 11852/37963 [28:27:55<59:43:10,  8.23s/it]
 31%|███       | 11853/37963 [28:28:02<58:15:53,  8.03s/it]
 31%|███       | 11854/37963 [28:28:10<56:52:28,  7.84s/it]
 31%|███       | 11855/37963 [28:28:24<70:04:44,  9.66s/it]
 31%|███       | 11856/37963 [28:28:31<65:23:37,  9.02s/it]
 31%|███       | 11857/37963 [28:28:39<61:41:46,  8.51s/it]
 31%|███       | 11858/37963 [28:28:46<59:30:20,  8.21s/it]
 31%|███       | 11859/37963 [28:29:00<72:34:42, 10.01s/it]
 31%|███       | 11860/37963 [28:29:08<68:02:09,  9.38s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '3.57', 'learning_rate': '1.61e-05', 'epoch': '0.3124'}

 31%|███       | 11860/37963 [28:29:08<68:02:09,  9.38s/it]
 31%|███       | 11861/37963 [28:29:16<64:04:33,  8.84s/it]
 31%|███       | 11862/37963 [28:29:23<61:00:24,  8.41s/it]
 31%|███       | 11863/37963 [28:29:31<59:12:40,  8.17s/it]
 31%|███▏      | 11864/37963 [28:29:38<57:57:47,  8.00s/it]
 31%|███▏      | 11865/37963 [28:29:46<57:14:52,  7.90s/it]
 31%|███▏      | 11866/37963 [28:29:54<56:44:07,  7.83s/it]
 31%|███▏      | 11867/37963 [28:30:01<55:43:26,  7.69s/it]
 31%|███▏      | 11868/37963 [28:30:09<55:45:45,  7.69s/it]
 31%|███▏      | 11869/37963 [28:30:16<55:34:02,  7.67s/it]
 31%|███▏      | 11870/37963 [28:30:24<55:49:28,  7.70s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.656', 'learning_rate': '1.609e-05', 'epoch': '0.3127'}

 31%|███▏      | 11870/37963 [28:30:24<55:49:28,  7.70s/it]
 31%|███▏      | 11871/37963 [28:30:38<69:10:16,  9.54s/it]
 31%|███▏      | 11872/37963 [28:30:46<64:53:12,  8.95s/it]
 31%|███▏      | 11873/37963 [28:31:00<75:51:36, 10.47s/it]
 31%|███▏      | 11874/37963 [28:31:07<69:38:03,  9.61s/it]
 31%|███▏      | 11875/37963 [28:31:15<65:00:37,  8.97s/it]
 31%|███▏      | 11876/37963 [28:31:22<61:39:11,  8.51s/it]
 31%|███▏      | 11877/37963 [28:31:30<59:33:30,  8.22s/it]
 31%|███▏      | 11878/37963 [28:31:37<58:14:24,  8.04s/it]
 31%|███▏      | 11879/37963 [28:31:45<57:09:54,  7.89s/it]
 31%|███▏      | 11880/37963 [28:31:59<70:51:45,  9.78s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '1.494', 'learning_rate': '1.609e-05', 'epoch': '0.3129'}

 31%|███▏      | 11880/37963 [28:31:59<70:51:45,  9.78s/it]
 31%|███▏      | 11881/37963 [28:32:07<66:53:06,  9.23s/it]
 31%|███▏      | 11882/37963 [28:32:21<77:26:04, 10.69s/it]
 31%|███▏      | 11883/37963 [28:32:29<70:39:43,  9.75s/it]
 31%|███▏      | 11884/37963 [28:32:36<65:52:28,  9.09s/it]
 31%|███▏      | 11885/37963 [28:32:50<76:50:15, 10.61s/it]
 31%|███▏      | 11886/37963 [28:32:58<70:36:35,  9.75s/it]
 31%|███▏      | 11887/37963 [28:33:06<65:48:02,  9.08s/it]
 31%|███▏      | 11888/37963 [28:33:13<62:47:29,  8.67s/it]
 31%|███▏      | 11889/37963 [28:33:21<60:02:29,  8.29s/it]
 31%|███▏      | 11890/37963 [28:33:28<58:30:48,  8.08s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '3.956', 'learning_rate': '1.608e-05', 'epoch': '0.3132'}

 31%|███▏      | 11890/37963 [28:33:28<58:30:48,  8.08s/it]
 31%|███▏      | 11891/37963 [28:33:36<58:07:31,  8.03s/it]
 31%|███▏      | 11892/37963 [28:33:44<57:00:38,  7.87s/it]
 31%|███▏      | 11893/37963 [28:33:51<56:30:48,  7.80s/it]
 31%|███▏      | 11894/37963 [28:33:59<55:27:38,  7.66s/it]
 31%|███▏      | 11895/37963 [28:34:06<55:05:57,  7.61s/it]
 31%|███▏      | 11896/37963 [28:34:14<55:03:35,  7.60s/it]
 31%|███▏      | 11897/37963 [28:34:21<54:55:25,  7.59s/it]
 31%|███▏      | 11898/37963 [28:34:29<54:54:39,  7.58s/it]
 31%|███▏      | 11899/37963 [28:34:43<68:20:51,  9.44s/it]
 31%|███▏      | 11900/37963 [28:34:50<64:24:27,  8.90s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '2.305', 'learning_rate': '1.607e-05', 'epoch': '0.3135'}

 31%|███▏      | 11900/37963 [28:34:50<64:24:27,  8.90s/it]
 31%|███▏      | 11901/37963 [28:34:58<61:36:03,  8.51s/it]
 31%|███▏      | 11902/37963 [28:35:05<59:21:07,  8.20s/it]
 31%|███▏      | 11903/37963 [28:35:13<57:30:28,  7.94s/it]
 31%|███▏      | 11904/37963 [28:35:20<55:53:50,  7.72s/it]
 31%|███▏      | 11905/37963 [28:35:28<55:38:46,  7.69s/it]
 31%|███▏      | 11906/37963 [28:35:42<70:08:04,  9.69s/it]
 31%|███▏      | 11907/37963 [28:35:56<80:30:31, 11.12s/it]
 31%|███▏      | 11908/37963 [28:36:04<73:41:11, 10.18s/it]
 31%|███▏      | 11909/37963 [28:36:12<68:16:35,  9.43s/it]
 31%|███▏      | 11910/37963 [28:36:19<63:17:59,  8.75s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '0.8325', 'learning_rate': '1.607e-05', 'epoch': '0.3137'}

 31%|███▏      | 11910/37963 [28:36:19<63:17:59,  8.75s/it]
 31%|███▏      | 11911/37963 [28:36:27<61:06:43,  8.44s/it]
 31%|███▏      | 11912/37963 [28:36:35<59:19:22,  8.20s/it]
 31%|███▏      | 11913/37963 [28:36:42<58:14:43,  8.05s/it]
 31%|███▏      | 11914/37963 [28:36:50<57:15:30,  7.91s/it]
 31%|███▏      | 11915/37963 [28:36:57<56:08:33,  7.76s/it]
 31%|███▏      | 11916/37963 [28:37:05<55:22:46,  7.65s/it]
 31%|███▏      | 11917/37963 [28:37:12<55:17:52,  7.64s/it]
 31%|███▏      | 11918/37963 [28:37:26<68:55:39,  9.53s/it]
 31%|███▏      | 11919/37963 [28:37:34<64:44:02,  8.95s/it]
 31%|███▏      | 11920/37963 [28:37:41<61:21:29,  8.48s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.245', 'learning_rate': '1.606e-05', 'epoch': '0.314'}

 31%|███▏      | 11920/37963 [28:37:41<61:21:29,  8.48s/it]
 31%|███▏      | 11921/37963 [28:37:49<59:24:45,  8.21s/it]
 31%|███▏      | 11922/37963 [28:37:56<57:35:46,  7.96s/it]
 31%|███▏      | 11923/37963 [28:38:04<57:04:36,  7.89s/it]
 31%|███▏      | 11924/37963 [28:38:18<70:40:48,  9.77s/it]
 31%|███▏      | 11925/37963 [28:38:26<65:55:18,  9.11s/it]
 31%|███▏      | 11926/37963 [28:38:40<76:23:15, 10.56s/it]
 31%|███▏      | 11927/37963 [28:38:47<70:37:00,  9.76s/it]
 31%|███▏      | 11928/37963 [28:38:55<65:46:35,  9.10s/it]
 31%|███▏      | 11929/37963 [28:39:03<62:23:23,  8.63s/it]
 31%|███▏      | 11930/37963 [28:39:10<59:54:20,  8.28s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.463', 'learning_rate': '1.605e-05', 'epoch': '0.3143'}

 31%|███▏      | 11930/37963 [28:39:10<59:54:20,  8.28s/it]
 31%|███▏      | 11931/37963 [28:39:24<72:05:34,  9.97s/it]
 31%|███▏      | 11932/37963 [28:39:31<66:38:15,  9.22s/it]
 31%|███▏      | 11933/37963 [28:39:39<62:13:52,  8.61s/it]
 31%|███▏      | 11934/37963 [28:39:52<73:34:18, 10.18s/it]
 31%|███▏      | 11935/37963 [28:40:00<68:10:43,  9.43s/it]
 31%|███▏      | 11936/37963 [28:40:08<64:05:11,  8.86s/it]
 31%|███▏      | 11937/37963 [28:40:15<61:05:37,  8.45s/it]
 31%|███▏      | 11938/37963 [28:40:22<58:31:37,  8.10s/it]
 31%|███▏      | 11939/37963 [28:40:30<57:03:59,  7.89s/it]
 31%|███▏      | 11940/37963 [28:40:37<56:11:46,  7.77s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.928', 'learning_rate': '1.605e-05', 'epoch': '0.3145'}

 31%|███▏      | 11940/37963 [28:40:37<56:11:46,  7.77s/it]
 31%|███▏      | 11941/37963 [28:40:45<56:05:47,  7.76s/it]
 31%|███▏      | 11942/37963 [28:40:53<55:41:55,  7.71s/it]
 31%|███▏      | 11943/37963 [28:41:00<55:28:19,  7.67s/it]
 31%|███▏      | 11944/37963 [28:41:08<55:21:06,  7.66s/it]
 31%|███▏      | 11945/37963 [28:41:16<55:18:37,  7.65s/it]
 31%|███▏      | 11946/37963 [28:41:23<54:39:41,  7.56s/it]
 31%|███▏      | 11947/37963 [28:41:30<54:39:31,  7.56s/it]
 31%|███▏      | 11948/37963 [28:41:44<68:44:42,  9.51s/it]
 31%|███▏      | 11949/37963 [28:41:52<65:06:53,  9.01s/it]
 31%|███▏      | 11950/37963 [28:42:00<62:16:27,  8.62s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.01', 'learning_rate': '1.604e-05', 'epoch': '0.3148'}

 31%|███▏      | 11950/37963 [28:42:00<62:16:27,  8.62s/it]
 31%|███▏      | 11951/37963 [28:42:08<60:13:25,  8.33s/it]
 31%|███▏      | 11952/37963 [28:42:15<58:10:06,  8.05s/it]
 31%|███▏      | 11953/37963 [28:42:23<57:13:12,  7.92s/it]
 31%|███▏      | 11954/37963 [28:42:37<70:50:04,  9.80s/it]
 31%|███▏      | 11955/37963 [28:42:45<66:18:38,  9.18s/it]
 31%|███▏      | 11956/37963 [28:42:52<62:46:54,  8.69s/it]
 31%|███▏      | 11957/37963 [28:43:06<74:16:55, 10.28s/it]
 31%|███▏      | 11958/37963 [28:43:14<68:52:45,  9.54s/it]
 32%|███▏      | 11959/37963 [28:43:22<64:39:16,  8.95s/it]
 32%|███▏      | 11960/37963 [28:43:29<61:17:06,  8.48s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.738', 'learning_rate': '1.603e-05', 'epoch': '0.315'}

 32%|███▏      | 11960/37963 [28:43:29<61:17:06,  8.48s/it]
 32%|███▏      | 11961/37963 [28:43:37<59:18:02,  8.21s/it]
 32%|███▏      | 11962/37963 [28:43:44<57:49:03,  8.01s/it]
 32%|███▏      | 11963/37963 [28:43:52<56:47:46,  7.86s/it]
 32%|███▏      | 11964/37963 [28:43:59<55:17:41,  7.66s/it]
 32%|███▏      | 11965/37963 [28:44:06<54:34:14,  7.56s/it]
 32%|███▏      | 11966/37963 [28:44:14<55:03:45,  7.62s/it]
 32%|███▏      | 11967/37963 [28:44:28<68:44:33,  9.52s/it]
 32%|███▏      | 11968/37963 [28:44:35<64:28:35,  8.93s/it]
 32%|███▏      | 11969/37963 [28:44:43<61:20:27,  8.50s/it]
 32%|███▏      | 11970/37963 [28:44:50<59:21:51,  8.22s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '1.647', 'learning_rate': '1.603e-05', 'epoch': '0.3153'}

 32%|███▏      | 11970/37963 [28:44:50<59:21:51,  8.22s/it]
 32%|███▏      | 11971/37963 [28:44:58<57:51:16,  8.01s/it]
 32%|███▏      | 11972/37963 [28:45:05<56:31:23,  7.83s/it]
 32%|███▏      | 11973/37963 [28:45:19<69:38:43,  9.65s/it]
 32%|███▏      | 11974/37963 [28:45:33<79:28:28, 11.01s/it]
 32%|███▏      | 11975/37963 [28:45:41<72:01:58,  9.98s/it]
 32%|███▏      | 11976/37963 [28:45:48<66:18:23,  9.19s/it]
 32%|███▏      | 11977/37963 [28:45:56<62:58:22,  8.72s/it]
 32%|███▏      | 11978/37963 [28:46:04<60:23:58,  8.37s/it]
 32%|███▏      | 11979/37963 [28:46:11<59:11:05,  8.20s/it]
 32%|███▏      | 11980/37963 [28:46:25<71:16:57,  9.88s/it]
                                                           
{'loss': '0.162', 'grad_norm': '2.03', 'learning_rate': '1.602e-05', 'epoch': '0.3156'}

 32%|███▏      | 11980/37963 [28:46:25<71:16:57,  9.88s/it]
 32%|███▏      | 11981/37963 [28:46:33<66:39:31,  9.24s/it]
 32%|███▏      | 11982/37963 [28:46:47<77:42:17, 10.77s/it]
 32%|███▏      | 11983/37963 [28:46:55<70:59:47,  9.84s/it]
 32%|███▏      | 11984/37963 [28:47:02<65:56:06,  9.14s/it]
 32%|███▏      | 11985/37963 [28:47:10<62:37:29,  8.68s/it]
 32%|███▏      | 11986/37963 [28:47:18<60:22:49,  8.37s/it]
 32%|███▏      | 11987/37963 [28:47:25<58:23:03,  8.09s/it]
 32%|███▏      | 11988/37963 [28:47:33<57:31:25,  7.97s/it]
 32%|███▏      | 11989/37963 [28:47:40<56:36:01,  7.84s/it]
 32%|███▏      | 11990/37963 [28:47:48<56:01:48,  7.77s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '1.604', 'learning_rate': '1.601e-05', 'epoch': '0.3158'}

 32%|███▏      | 11990/37963 [28:47:48<56:01:48,  7.77s/it]
 32%|███▏      | 11991/37963 [28:47:55<55:18:36,  7.67s/it]
 32%|███▏      | 11992/37963 [28:48:03<54:58:17,  7.62s/it]
 32%|███▏      | 11993/37963 [28:48:10<54:54:54,  7.61s/it]
 32%|███▏      | 11994/37963 [28:48:18<54:59:40,  7.62s/it]
 32%|███▏      | 11995/37963 [28:48:32<68:40:26,  9.52s/it]
 32%|███▏      | 11996/37963 [28:48:40<65:07:30,  9.03s/it]
 32%|███▏      | 11997/37963 [28:48:47<61:34:47,  8.54s/it]
 32%|███▏      | 11998/37963 [28:49:01<73:22:42, 10.17s/it]
 32%|███▏      | 11999/37963 [28:49:09<67:42:34,  9.39s/it]
 32%|███▏      | 12000/37963 [28:49:16<63:53:11,  8.86s/it]
                                                           
{'loss': '0.1712', 'grad_norm': '1.501', 'learning_rate': '1.601e-05', 'epoch': '0.3161'}

 32%|███▏      | 12000/37963 [28:49:16<63:53:11,  8.86s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.57s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.57s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 32%|███▏      | 12001/37963 [28:50:17<176:09:52, 24.43s/it]
 32%|███▏      | 12002/37963 [28:50:25<139:42:55, 19.37s/it]
 32%|███▏      | 12003/37963 [28:50:32<113:58:43, 15.81s/it]
 32%|███▏      | 12004/37963 [28:50:40<95:30:27, 13.25s/it] 
 32%|███▏      | 12005/37963 [28:50:54<97:19:17, 13.50s/it]
 32%|███▏      | 12006/37963 [28:51:01<84:40:13, 11.74s/it]
 32%|███▏      | 12007/37963 [28:51:09<75:45:51, 10.51s/it]
 32%|███▏      | 12008/37963 [28:51:17<69:27:33,  9.63s/it]
 32%|███▏      | 12009/37963 [28:51:24<65:01:58,  9.02s/it]
 32%|███▏      | 12010/37963 [28:51:32<61:45:52,  8.57s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '1.455', 'learning_rate': '1.6e-05', 'epoch': '0.3164'}

 32%|███▏      | 12010/37963 [28:51:32<61:45:52,  8.57s/it]
 32%|███▏      | 12011/37963 [28:51:39<59:43:04,  8.28s/it]
 32%|███▏      | 12012/37963 [28:51:47<57:53:05,  8.03s/it]
 32%|███▏      | 12013/37963 [28:51:54<56:50:59,  7.89s/it]
 32%|███▏      | 12014/37963 [28:52:02<56:05:59,  7.78s/it]
 32%|███▏      | 12015/37963 [28:52:09<55:31:18,  7.70s/it]
 32%|███▏      | 12016/37963 [28:52:17<55:19:39,  7.68s/it]
 32%|███▏      | 12017/37963 [28:52:24<55:07:45,  7.65s/it]
 32%|███▏      | 12018/37963 [28:52:32<54:56:09,  7.62s/it]
 32%|███▏      | 12019/37963 [28:52:53<83:46:35, 11.62s/it]
 32%|███▏      | 12020/37963 [28:53:01<75:05:20, 10.42s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '2.47', 'learning_rate': '1.599e-05', 'epoch': '0.3166'}

 32%|███▏      | 12020/37963 [28:53:01<75:05:20, 10.42s/it]
 32%|███▏      | 12021/37963 [28:53:08<68:55:41,  9.57s/it]
 32%|███▏      | 12022/37963 [28:53:15<64:02:27,  8.89s/it]
 32%|███▏      | 12023/37963 [28:53:23<61:05:55,  8.48s/it]
 32%|███▏      | 12024/37963 [28:53:31<58:59:26,  8.19s/it]
 32%|███▏      | 12025/37963 [28:53:38<56:49:03,  7.89s/it]
 32%|███▏      | 12026/37963 [28:53:45<55:41:16,  7.73s/it]
 32%|███▏      | 12027/37963 [28:53:52<54:56:34,  7.63s/it]
 32%|███▏      | 12028/37963 [28:54:00<55:20:36,  7.68s/it]
 32%|███▏      | 12029/37963 [28:54:14<68:29:01,  9.51s/it]
 32%|███▏      | 12030/37963 [28:54:21<63:52:46,  8.87s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '0.8512', 'learning_rate': '1.599e-05', 'epoch': '0.3169'}

 32%|███▏      | 12030/37963 [28:54:21<63:52:46,  8.87s/it]
 32%|███▏      | 12031/37963 [28:54:29<60:59:05,  8.47s/it]
 32%|███▏      | 12032/37963 [28:54:37<59:17:30,  8.23s/it]
 32%|███▏      | 12033/37963 [28:54:44<57:47:46,  8.02s/it]
 32%|███▏      | 12034/37963 [28:54:52<56:47:43,  7.89s/it]
 32%|███▏      | 12035/37963 [28:55:06<69:37:51,  9.67s/it]
 32%|███▏      | 12036/37963 [28:55:13<65:12:25,  9.05s/it]
 32%|███▏      | 12037/37963 [28:55:21<61:32:28,  8.55s/it]
 32%|███▏      | 12038/37963 [28:55:28<59:37:47,  8.28s/it]
 32%|███▏      | 12039/37963 [28:55:36<57:58:17,  8.05s/it]
 32%|███▏      | 12040/37963 [28:55:43<56:53:35,  7.90s/it]
                                                           
{'loss': '0.1676', 'grad_norm': '2.464', 'learning_rate': '1.598e-05', 'epoch': '0.3172'}

 32%|███▏      | 12040/37963 [28:55:43<56:53:35,  7.90s/it]
 32%|███▏      | 12041/37963 [28:55:51<55:59:30,  7.78s/it]
 32%|███▏      | 12042/37963 [28:55:58<55:45:16,  7.74s/it]
 32%|███▏      | 12043/37963 [28:56:12<69:01:25,  9.59s/it]
 32%|███▏      | 12044/37963 [28:56:20<64:49:17,  9.00s/it]
 32%|███▏      | 12045/37963 [28:56:28<62:12:03,  8.64s/it]
 32%|███▏      | 12046/37963 [28:56:35<59:58:29,  8.33s/it]
 32%|███▏      | 12047/37963 [28:56:49<71:59:04, 10.00s/it]
 32%|███▏      | 12048/37963 [28:56:57<66:47:13,  9.28s/it]
 32%|███▏      | 12049/37963 [28:57:04<63:00:43,  8.75s/it]
 32%|███▏      | 12050/37963 [28:57:12<60:29:32,  8.40s/it]
                                                           
{'loss': '0.1648', 'grad_norm': '2.088', 'learning_rate': '1.597e-05', 'epoch': '0.3174'}

 32%|███▏      | 12050/37963 [28:57:12<60:29:32,  8.40s/it]
 32%|███▏      | 12051/37963 [28:57:19<58:38:49,  8.15s/it]
 32%|███▏      | 12052/37963 [28:57:27<57:16:07,  7.96s/it]
 32%|███▏      | 12053/37963 [28:57:35<56:18:28,  7.82s/it]
 32%|███▏      | 12054/37963 [28:57:42<55:45:37,  7.75s/it]
 32%|███▏      | 12055/37963 [28:57:50<55:38:05,  7.73s/it]
 32%|███▏      | 12056/37963 [28:58:04<69:02:15,  9.59s/it]
 32%|███▏      | 12057/37963 [28:58:11<64:24:14,  8.95s/it]
 32%|███▏      | 12058/37963 [28:58:19<61:19:18,  8.52s/it]
 32%|███▏      | 12059/37963 [28:58:26<58:34:40,  8.14s/it]
 32%|███▏      | 12060/37963 [28:58:34<57:21:28,  7.97s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.941', 'learning_rate': '1.597e-05', 'epoch': '0.3177'}

 32%|███▏      | 12060/37963 [28:58:34<57:21:28,  7.97s/it]
 32%|███▏      | 12061/37963 [28:58:41<56:12:40,  7.81s/it]
 32%|███▏      | 12062/37963 [28:58:49<55:44:09,  7.75s/it]
 32%|███▏      | 12063/37963 [28:58:56<54:29:35,  7.57s/it]
 32%|███▏      | 12064/37963 [28:59:03<54:23:24,  7.56s/it]
 32%|███▏      | 12065/37963 [28:59:17<67:38:35,  9.40s/it]
 32%|███▏      | 12066/37963 [28:59:31<77:49:32, 10.82s/it]
 32%|███▏      | 12067/37963 [28:59:39<71:09:45,  9.89s/it]
 32%|███▏      | 12068/37963 [28:59:46<65:57:46,  9.17s/it]
 32%|███▏      | 12069/37963 [28:59:54<62:23:10,  8.67s/it]
 32%|███▏      | 12070/37963 [29:00:08<73:52:07, 10.27s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '1.716', 'learning_rate': '1.596e-05', 'epoch': '0.3179'}

 32%|███▏      | 12070/37963 [29:00:08<73:52:07, 10.27s/it]
 32%|███▏      | 12071/37963 [29:00:16<68:33:19,  9.53s/it]
 32%|███▏      | 12072/37963 [29:00:23<64:41:08,  8.99s/it]
 32%|███▏      | 12073/37963 [29:00:31<61:11:43,  8.51s/it]
 32%|███▏      | 12074/37963 [29:00:38<59:32:19,  8.28s/it]
 32%|███▏      | 12075/37963 [29:00:46<58:39:32,  8.16s/it]
 32%|███▏      | 12076/37963 [29:00:54<56:57:06,  7.92s/it]
 32%|███▏      | 12077/37963 [29:01:01<56:05:11,  7.80s/it]
 32%|███▏      | 12078/37963 [29:01:15<69:03:14,  9.60s/it]
 32%|███▏      | 12079/37963 [29:01:23<64:43:14,  9.00s/it]
 32%|███▏      | 12080/37963 [29:01:30<61:28:27,  8.55s/it]
                                                           
{'loss': '0.1644', 'grad_norm': '1.525', 'learning_rate': '1.595e-05', 'epoch': '0.3182'}

 32%|███▏      | 12080/37963 [29:01:30<61:28:27,  8.55s/it]
 32%|███▏      | 12081/37963 [29:01:38<59:48:33,  8.32s/it]
 32%|███▏      | 12082/37963 [29:01:45<57:34:15,  8.01s/it]
 32%|███▏      | 12083/37963 [29:01:53<56:24:16,  7.85s/it]
 32%|███▏      | 12084/37963 [29:02:00<55:50:24,  7.77s/it]
 32%|███▏      | 12085/37963 [29:02:14<68:16:48,  9.50s/it]
 32%|███▏      | 12086/37963 [29:02:21<63:39:39,  8.86s/it]
 32%|███▏      | 12087/37963 [29:02:29<61:05:34,  8.50s/it]
 32%|███▏      | 12088/37963 [29:02:36<59:11:22,  8.24s/it]
 32%|███▏      | 12089/37963 [29:02:44<57:52:25,  8.05s/it]
 32%|███▏      | 12090/37963 [29:02:58<71:11:32,  9.91s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '3.704', 'learning_rate': '1.594e-05', 'epoch': '0.3185'}

 32%|███▏      | 12090/37963 [29:02:58<71:11:32,  9.91s/it]
 32%|███▏      | 12091/37963 [29:03:06<65:54:36,  9.17s/it]
 32%|███▏      | 12092/37963 [29:03:13<62:38:51,  8.72s/it]
 32%|███▏      | 12093/37963 [29:03:28<74:16:12, 10.34s/it]
 32%|███▏      | 12094/37963 [29:03:35<68:12:02,  9.49s/it]
 32%|███▏      | 12095/37963 [29:03:43<64:00:13,  8.91s/it]
 32%|███▏      | 12096/37963 [29:03:50<60:59:31,  8.49s/it]
 32%|███▏      | 12097/37963 [29:03:58<58:44:55,  8.18s/it]
 32%|███▏      | 12098/37963 [29:04:05<57:28:13,  8.00s/it]
 32%|███▏      | 12099/37963 [29:04:13<56:26:18,  7.86s/it]
 32%|███▏      | 12100/37963 [29:04:20<55:49:12,  7.77s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '0.6363', 'learning_rate': '1.594e-05', 'epoch': '0.3187'}

 32%|███▏      | 12100/37963 [29:04:20<55:49:12,  7.77s/it]
 32%|███▏      | 12101/37963 [29:04:28<55:27:35,  7.72s/it]
 32%|███▏      | 12102/37963 [29:04:35<55:05:15,  7.67s/it]
 32%|███▏      | 12103/37963 [29:04:43<54:59:59,  7.66s/it]
 32%|███▏      | 12104/37963 [29:04:51<54:59:30,  7.66s/it]
 32%|███▏      | 12105/37963 [29:04:58<55:09:08,  7.68s/it]
 32%|███▏      | 12106/37963 [29:05:13<69:11:11,  9.63s/it]
 32%|███▏      | 12107/37963 [29:05:20<64:31:56,  8.99s/it]
 32%|███▏      | 12108/37963 [29:05:28<61:36:19,  8.58s/it]
 32%|███▏      | 12109/37963 [29:05:35<59:19:24,  8.26s/it]
 32%|███▏      | 12110/37963 [29:05:43<57:53:04,  8.06s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.13', 'learning_rate': '1.593e-05', 'epoch': '0.319'}

 32%|███▏      | 12110/37963 [29:05:43<57:53:04,  8.06s/it]
 32%|███▏      | 12111/37963 [29:05:50<56:50:02,  7.91s/it]
 32%|███▏      | 12112/37963 [29:05:58<55:55:03,  7.79s/it]
 32%|███▏      | 12113/37963 [29:06:05<55:34:07,  7.74s/it]
 32%|███▏      | 12114/37963 [29:06:19<68:53:29,  9.59s/it]
 32%|███▏      | 12115/37963 [29:06:27<64:46:04,  9.02s/it]
 32%|███▏      | 12116/37963 [29:06:35<61:43:23,  8.60s/it]
 32%|███▏      | 12117/37963 [29:06:42<59:24:48,  8.28s/it]
 32%|███▏      | 12118/37963 [29:06:56<71:43:18,  9.99s/it]
 32%|███▏      | 12119/37963 [29:07:04<66:17:22,  9.23s/it]
 32%|███▏      | 12120/37963 [29:07:11<62:34:24,  8.72s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.321', 'learning_rate': '1.592e-05', 'epoch': '0.3193'}

 32%|███▏      | 12120/37963 [29:07:11<62:34:24,  8.72s/it]
 32%|███▏      | 12121/37963 [29:07:25<74:35:43, 10.39s/it]
 32%|███▏      | 12122/37963 [29:07:33<68:56:32,  9.60s/it]
 32%|███▏      | 12123/37963 [29:07:41<64:56:14,  9.05s/it]
 32%|███▏      | 12124/37963 [29:07:49<61:42:47,  8.60s/it]
 32%|███▏      | 12125/37963 [29:07:56<59:30:20,  8.29s/it]
 32%|███▏      | 12126/37963 [29:08:04<57:56:07,  8.07s/it]
 32%|███▏      | 12127/37963 [29:08:11<56:57:12,  7.94s/it]
 32%|███▏      | 12128/37963 [29:08:19<56:05:25,  7.82s/it]
 32%|███▏      | 12129/37963 [29:08:32<68:19:33,  9.52s/it]
 32%|███▏      | 12130/37963 [29:08:40<63:52:26,  8.90s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '1.895', 'learning_rate': '1.592e-05', 'epoch': '0.3195'}

 32%|███▏      | 12130/37963 [29:08:40<63:52:26,  8.90s/it]
 32%|███▏      | 12131/37963 [29:08:54<75:12:19, 10.48s/it]
 32%|███▏      | 12132/37963 [29:09:01<68:35:50,  9.56s/it]
 32%|███▏      | 12133/37963 [29:09:09<64:17:20,  8.96s/it]
 32%|███▏      | 12134/37963 [29:09:16<61:05:53,  8.52s/it]
 32%|███▏      | 12135/37963 [29:09:24<58:53:43,  8.21s/it]
 32%|███▏      | 12136/37963 [29:09:32<57:43:57,  8.05s/it]
 32%|███▏      | 12137/37963 [29:09:39<55:53:50,  7.79s/it]
 32%|███▏      | 12138/37963 [29:09:46<55:17:26,  7.71s/it]
 32%|███▏      | 12139/37963 [29:09:54<54:50:40,  7.65s/it]
 32%|███▏      | 12140/37963 [29:10:01<54:43:12,  7.63s/it]
                                                           
{'loss': '0.162', 'grad_norm': '0.8672', 'learning_rate': '1.591e-05', 'epoch': '0.3198'}

 32%|███▏      | 12140/37963 [29:10:01<54:43:12,  7.63s/it]
 32%|███▏      | 12141/37963 [29:10:15<68:20:35,  9.53s/it]
 32%|███▏      | 12142/37963 [29:10:23<64:09:08,  8.94s/it]
 32%|███▏      | 12143/37963 [29:10:37<75:31:00, 10.53s/it]
 32%|███▏      | 12144/37963 [29:10:45<69:08:30,  9.64s/it]
 32%|███▏      | 12145/37963 [29:10:52<64:03:48,  8.93s/it]
 32%|███▏      | 12146/37963 [29:11:00<61:10:10,  8.53s/it]
 32%|███▏      | 12147/37963 [29:11:07<59:07:51,  8.25s/it]
 32%|███▏      | 12148/37963 [29:11:15<57:25:11,  8.01s/it]
 32%|███▏      | 12149/37963 [29:11:22<56:30:59,  7.88s/it]
 32%|███▏      | 12150/37963 [29:11:30<55:58:12,  7.81s/it]
                                                           
{'loss': '0.1695', 'grad_norm': '3.268', 'learning_rate': '1.59e-05', 'epoch': '0.32'}

 32%|███▏      | 12150/37963 [29:11:30<55:58:12,  7.81s/it]
 32%|███▏      | 12151/37963 [29:11:37<55:02:51,  7.68s/it]
 32%|███▏      | 12152/37963 [29:11:45<54:51:54,  7.65s/it]
 32%|███▏      | 12153/37963 [29:11:53<54:59:06,  7.67s/it]
 32%|███▏      | 12154/37963 [29:12:00<54:05:38,  7.55s/it]
 32%|███▏      | 12155/37963 [29:12:14<68:08:29,  9.51s/it]
 32%|███▏      | 12156/37963 [29:12:21<63:12:09,  8.82s/it]
 32%|███▏      | 12157/37963 [29:12:29<60:35:07,  8.45s/it]
 32%|███▏      | 12158/37963 [29:12:36<58:56:52,  8.22s/it]
 32%|███▏      | 12159/37963 [29:12:44<57:25:18,  8.01s/it]
 32%|███▏      | 12160/37963 [29:12:51<56:17:55,  7.85s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.246', 'learning_rate': '1.59e-05', 'epoch': '0.3203'}

 32%|███▏      | 12160/37963 [29:12:51<56:17:55,  7.85s/it]
 32%|███▏      | 12161/37963 [29:12:59<55:23:57,  7.73s/it]
 32%|███▏      | 12162/37963 [29:13:13<68:52:00,  9.61s/it]
 32%|███▏      | 12163/37963 [29:13:27<78:48:44, 11.00s/it]
 32%|███▏      | 12164/37963 [29:13:34<71:11:50,  9.93s/it]
 32%|███▏      | 12165/37963 [29:13:42<65:52:24,  9.19s/it]
 32%|███▏      | 12166/37963 [29:13:50<62:29:06,  8.72s/it]
 32%|███▏      | 12167/37963 [29:13:57<60:11:40,  8.40s/it]
 32%|███▏      | 12168/37963 [29:14:05<58:15:18,  8.13s/it]
 32%|███▏      | 12169/37963 [29:14:19<71:15:22,  9.95s/it]
 32%|███▏      | 12170/37963 [29:14:26<65:53:50,  9.20s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '1.221', 'learning_rate': '1.589e-05', 'epoch': '0.3206'}

 32%|███▏      | 12170/37963 [29:14:26<65:53:50,  9.20s/it]
 32%|███▏      | 12171/37963 [29:14:34<61:59:46,  8.65s/it]
 32%|███▏      | 12172/37963 [29:14:41<59:42:54,  8.34s/it]
 32%|███▏      | 12173/37963 [29:14:49<57:58:18,  8.09s/it]
 32%|███▏      | 12174/37963 [29:14:56<56:58:55,  7.95s/it]
 32%|███▏      | 12175/37963 [29:15:04<56:02:49,  7.82s/it]
 32%|███▏      | 12176/37963 [29:15:12<55:25:19,  7.74s/it]
 32%|███▏      | 12177/37963 [29:15:19<55:07:11,  7.70s/it]
 32%|███▏      | 12178/37963 [29:15:33<68:27:51,  9.56s/it]
 32%|███▏      | 12179/37963 [29:15:41<64:08:33,  8.96s/it]
 32%|███▏      | 12180/37963 [29:15:48<60:49:41,  8.49s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '4.605', 'learning_rate': '1.588e-05', 'epoch': '0.3208'}

 32%|███▏      | 12180/37963 [29:15:48<60:49:41,  8.49s/it]
 32%|███▏      | 12181/37963 [29:15:56<58:52:30,  8.22s/it]
 32%|███▏      | 12182/37963 [29:16:03<57:35:50,  8.04s/it]
 32%|███▏      | 12183/37963 [29:16:11<56:05:01,  7.83s/it]
 32%|███▏      | 12184/37963 [29:16:25<69:25:11,  9.69s/it]
 32%|███▏      | 12185/37963 [29:16:32<64:58:49,  9.07s/it]
 32%|███▏      | 12186/37963 [29:16:40<61:45:29,  8.63s/it]
 32%|███▏      | 12187/37963 [29:16:47<59:24:05,  8.30s/it]
 32%|███▏      | 12188/37963 [29:16:55<57:48:19,  8.07s/it]
 32%|███▏      | 12189/37963 [29:17:02<56:06:18,  7.84s/it]
 32%|███▏      | 12190/37963 [29:17:23<82:58:22, 11.59s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '0.9479', 'learning_rate': '1.588e-05', 'epoch': '0.3211'}

 32%|███▏      | 12190/37963 [29:17:23<82:58:22, 11.59s/it]
 32%|███▏      | 12191/37963 [29:17:30<74:22:23, 10.39s/it]
 32%|███▏      | 12192/37963 [29:17:38<68:14:13,  9.53s/it]
 32%|███▏      | 12193/37963 [29:17:45<63:57:20,  8.93s/it]
 32%|███▏      | 12194/37963 [29:17:53<60:42:41,  8.48s/it]
 32%|███▏      | 12195/37963 [29:18:00<58:56:13,  8.23s/it]
 32%|███▏      | 12196/37963 [29:18:08<57:20:59,  8.01s/it]
 32%|███▏      | 12197/37963 [29:18:15<56:20:08,  7.87s/it]
 32%|███▏      | 12198/37963 [29:18:23<55:22:55,  7.74s/it]
 32%|███▏      | 12199/37963 [29:18:30<54:59:02,  7.68s/it]
 32%|███▏      | 12200/37963 [29:18:38<54:36:44,  7.63s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '0.7814', 'learning_rate': '1.587e-05', 'epoch': '0.3214'}

 32%|███▏      | 12200/37963 [29:18:38<54:36:44,  7.63s/it]
 32%|███▏      | 12201/37963 [29:18:52<68:35:29,  9.59s/it]
 32%|███▏      | 12202/37963 [29:18:59<64:15:56,  8.98s/it]
 32%|███▏      | 12203/37963 [29:19:07<61:00:53,  8.53s/it]
 32%|███▏      | 12204/37963 [29:19:14<58:50:07,  8.22s/it]
 32%|███▏      | 12205/37963 [29:19:22<57:22:53,  8.02s/it]
 32%|███▏      | 12206/37963 [29:19:29<56:08:11,  7.85s/it]
 32%|███▏      | 12207/37963 [29:19:37<55:25:07,  7.75s/it]
 32%|███▏      | 12208/37963 [29:19:51<68:11:04,  9.53s/it]
 32%|███▏      | 12209/37963 [29:19:58<63:47:19,  8.92s/it]
 32%|███▏      | 12210/37963 [29:20:06<60:48:00,  8.50s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2.485', 'learning_rate': '1.586e-05', 'epoch': '0.3216'}

 32%|███▏      | 12210/37963 [29:20:06<60:48:00,  8.50s/it]
 32%|███▏      | 12211/37963 [29:20:20<72:54:03, 10.19s/it]
 32%|███▏      | 12212/37963 [29:20:27<67:02:38,  9.37s/it]
 32%|███▏      | 12213/37963 [29:20:35<63:12:00,  8.84s/it]
 32%|███▏      | 12214/37963 [29:20:43<60:41:05,  8.48s/it]
 32%|███▏      | 12215/37963 [29:20:50<58:28:17,  8.18s/it]
 32%|███▏      | 12216/37963 [29:20:58<57:14:48,  8.00s/it]
 32%|███▏      | 12217/37963 [29:21:12<70:31:26,  9.86s/it]
 32%|███▏      | 12218/37963 [29:21:19<65:26:37,  9.15s/it]
 32%|███▏      | 12219/37963 [29:21:27<61:55:15,  8.66s/it]
 32%|███▏      | 12220/37963 [29:21:34<58:57:08,  8.24s/it]
                                                           
{'loss': '0.1848', 'grad_norm': '1.473', 'learning_rate': '1.586e-05', 'epoch': '0.3219'}

 32%|███▏      | 12220/37963 [29:21:34<58:57:08,  8.24s/it]
 32%|███▏      | 12221/37963 [29:21:42<57:31:22,  8.04s/it]
 32%|███▏      | 12222/37963 [29:21:49<56:53:33,  7.96s/it]
 32%|███▏      | 12223/37963 [29:21:57<56:00:05,  7.83s/it]
 32%|███▏      | 12224/37963 [29:22:05<55:41:22,  7.79s/it]
 32%|███▏      | 12225/37963 [29:22:12<55:21:46,  7.74s/it]
 32%|███▏      | 12226/37963 [29:22:20<55:09:39,  7.72s/it]
 32%|███▏      | 12227/37963 [29:22:27<54:13:32,  7.59s/it]
 32%|███▏      | 12228/37963 [29:22:35<54:08:40,  7.57s/it]
 32%|███▏      | 12229/37963 [29:22:48<67:16:41,  9.41s/it]
 32%|███▏      | 12230/37963 [29:22:56<63:17:02,  8.85s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '0.9627', 'learning_rate': '1.585e-05', 'epoch': '0.3222'}

 32%|███▏      | 12230/37963 [29:22:56<63:17:02,  8.85s/it]
 32%|███▏      | 12231/37963 [29:23:03<59:48:54,  8.37s/it]
 32%|███▏      | 12232/37963 [29:23:11<58:03:40,  8.12s/it]
 32%|███▏      | 12233/37963 [29:23:18<56:41:52,  7.93s/it]
 32%|███▏      | 12234/37963 [29:23:32<69:42:44,  9.75s/it]
 32%|███▏      | 12235/37963 [29:23:40<65:14:51,  9.13s/it]
 32%|███▏      | 12236/37963 [29:23:47<61:51:17,  8.66s/it]
 32%|███▏      | 12237/37963 [29:23:55<59:23:37,  8.31s/it]
 32%|███▏      | 12238/37963 [29:24:09<71:23:41,  9.99s/it]
 32%|███▏      | 12239/37963 [29:24:16<65:51:15,  9.22s/it]
 32%|███▏      | 12240/37963 [29:24:24<62:14:28,  8.71s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '3.809', 'learning_rate': '1.584e-05', 'epoch': '0.3224'}

 32%|███▏      | 12240/37963 [29:24:24<62:14:28,  8.71s/it]
 32%|███▏      | 12241/37963 [29:24:31<59:10:09,  8.28s/it]
 32%|███▏      | 12242/37963 [29:24:39<57:39:37,  8.07s/it]
 32%|███▏      | 12243/37963 [29:24:46<56:12:06,  7.87s/it]
 32%|███▏      | 12244/37963 [29:25:00<68:52:34,  9.64s/it]
 32%|███▏      | 12245/37963 [29:25:07<64:24:58,  9.02s/it]
 32%|███▏      | 12246/37963 [29:25:15<61:12:16,  8.57s/it]
 32%|███▏      | 12247/37963 [29:25:22<58:18:41,  8.16s/it]
 32%|███▏      | 12248/37963 [29:25:37<71:35:01, 10.02s/it]
 32%|███▏      | 12249/37963 [29:25:44<66:17:02,  9.28s/it]
 32%|███▏      | 12250/37963 [29:25:52<62:25:05,  8.74s/it]
                                                           
{'loss': '0.1724', 'grad_norm': '1.434', 'learning_rate': '1.583e-05', 'epoch': '0.3227'}

 32%|███▏      | 12250/37963 [29:25:52<62:25:05,  8.74s/it]
 32%|███▏      | 12251/37963 [29:25:59<59:53:52,  8.39s/it]
 32%|███▏      | 12252/37963 [29:26:07<58:01:59,  8.13s/it]
 32%|███▏      | 12253/37963 [29:26:14<56:46:11,  7.95s/it]
 32%|███▏      | 12254/37963 [29:26:22<55:45:49,  7.81s/it]
 32%|███▏      | 12255/37963 [29:26:29<55:08:20,  7.72s/it]
 32%|███▏      | 12256/37963 [29:26:37<54:53:35,  7.69s/it]
 32%|███▏      | 12257/37963 [29:26:51<68:19:11,  9.57s/it]
 32%|███▏      | 12258/37963 [29:26:58<63:52:46,  8.95s/it]
 32%|███▏      | 12259/37963 [29:27:12<74:22:21, 10.42s/it]
 32%|███▏      | 12260/37963 [29:27:19<67:51:52,  9.51s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '2.475', 'learning_rate': '1.583e-05', 'epoch': '0.3229'}

 32%|███▏      | 12260/37963 [29:27:19<67:51:52,  9.51s/it]
 32%|███▏      | 12261/37963 [29:27:33<76:41:04, 10.74s/it]
 32%|███▏      | 12262/37963 [29:27:41<69:46:56,  9.77s/it]
 32%|███▏      | 12263/37963 [29:27:48<64:54:06,  9.09s/it]
 32%|███▏      | 12264/37963 [29:27:56<61:17:58,  8.59s/it]
 32%|███▏      | 12265/37963 [29:28:03<59:06:15,  8.28s/it]
 32%|███▏      | 12266/37963 [29:28:11<57:31:34,  8.06s/it]
 32%|███▏      | 12267/37963 [29:28:18<56:31:23,  7.92s/it]
 32%|███▏      | 12268/37963 [29:28:26<55:34:20,  7.79s/it]
 32%|███▏      | 12269/37963 [29:28:33<54:19:10,  7.61s/it]
 32%|███▏      | 12270/37963 [29:28:41<54:19:28,  7.61s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '2.1', 'learning_rate': '1.582e-05', 'epoch': '0.3232'}

 32%|███▏      | 12270/37963 [29:28:41<54:19:28,  7.61s/it]
 32%|███▏      | 12271/37963 [29:28:48<54:29:08,  7.63s/it]
 32%|███▏      | 12272/37963 [29:28:56<54:43:44,  7.67s/it]
 32%|███▏      | 12273/37963 [29:29:04<54:30:48,  7.64s/it]
 32%|███▏      | 12274/37963 [29:29:11<54:24:20,  7.62s/it]
 32%|███▏      | 12275/37963 [29:29:19<54:09:36,  7.59s/it]
 32%|███▏      | 12276/37963 [29:29:26<54:03:39,  7.58s/it]
 32%|███▏      | 12277/37963 [29:29:34<54:01:06,  7.57s/it]
 32%|███▏      | 12278/37963 [29:29:41<54:09:47,  7.59s/it]
 32%|███▏      | 12279/37963 [29:29:55<67:03:42,  9.40s/it]
 32%|███▏      | 12280/37963 [29:30:02<62:41:08,  8.79s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.347', 'learning_rate': '1.581e-05', 'epoch': '0.3235'}

 32%|███▏      | 12280/37963 [29:30:02<62:41:08,  8.79s/it]
 32%|███▏      | 12281/37963 [29:30:10<59:42:56,  8.37s/it]
 32%|███▏      | 12282/37963 [29:30:24<71:48:59, 10.07s/it]
 32%|███▏      | 12283/37963 [29:30:31<66:27:00,  9.32s/it]
 32%|███▏      | 12284/37963 [29:30:39<62:43:34,  8.79s/it]
 32%|███▏      | 12285/37963 [29:30:46<59:57:28,  8.41s/it]
 32%|███▏      | 12286/37963 [29:30:54<58:10:07,  8.16s/it]
 32%|███▏      | 12287/37963 [29:31:01<56:25:02,  7.91s/it]
 32%|███▏      | 12288/37963 [29:31:15<69:21:49,  9.73s/it]
 32%|███▏      | 12289/37963 [29:31:23<64:26:03,  9.03s/it]
 32%|███▏      | 12290/37963 [29:31:30<60:28:19,  8.48s/it]
                                                           
{'loss': '0.174', 'grad_norm': '2.016', 'learning_rate': '1.581e-05', 'epoch': '0.3237'}

 32%|███▏      | 12290/37963 [29:31:30<60:28:19,  8.48s/it]
 32%|███▏      | 12291/37963 [29:31:37<58:21:20,  8.18s/it]
 32%|███▏      | 12292/37963 [29:31:45<57:01:28,  8.00s/it]
 32%|███▏      | 12293/37963 [29:31:52<56:03:36,  7.86s/it]
 32%|███▏      | 12294/37963 [29:32:06<69:07:07,  9.69s/it]
 32%|███▏      | 12295/37963 [29:32:14<64:21:57,  9.03s/it]
 32%|███▏      | 12296/37963 [29:32:21<61:07:46,  8.57s/it]
 32%|███▏      | 12297/37963 [29:32:29<58:40:48,  8.23s/it]
 32%|███▏      | 12298/37963 [29:32:36<57:12:33,  8.02s/it]
 32%|███▏      | 12299/37963 [29:32:44<56:35:48,  7.94s/it]
 32%|███▏      | 12300/37963 [29:32:52<55:43:58,  7.82s/it]
                                                           
{'loss': '0.1702', 'grad_norm': '0.9303', 'learning_rate': '1.58e-05', 'epoch': '0.324'}

 32%|███▏      | 12300/37963 [29:32:52<55:43:58,  7.82s/it]
 32%|███▏      | 12301/37963 [29:32:59<54:49:37,  7.69s/it]
 32%|███▏      | 12302/37963 [29:33:13<67:50:25,  9.52s/it]
 32%|███▏      | 12303/37963 [29:33:20<63:36:21,  8.92s/it]
 32%|███▏      | 12304/37963 [29:33:28<60:53:46,  8.54s/it]
 32%|███▏      | 12305/37963 [29:33:36<58:42:03,  8.24s/it]
 32%|███▏      | 12306/37963 [29:33:43<57:06:29,  8.01s/it]
 32%|███▏      | 12307/37963 [29:33:51<55:52:26,  7.84s/it]
 32%|███▏      | 12308/37963 [29:34:11<83:32:24, 11.72s/it]
 32%|███▏      | 12309/37963 [29:34:19<74:58:09, 10.52s/it]
 32%|███▏      | 12310/37963 [29:34:26<67:57:40,  9.54s/it]
                                                           
{'loss': '0.1713', 'grad_norm': '1.522', 'learning_rate': '1.579e-05', 'epoch': '0.3243'}

 32%|███▏      | 12310/37963 [29:34:26<67:57:40,  9.54s/it]
 32%|███▏      | 12311/37963 [29:34:34<63:37:04,  8.93s/it]
 32%|███▏      | 12312/37963 [29:34:41<60:53:04,  8.54s/it]
 32%|███▏      | 12313/37963 [29:34:49<58:36:29,  8.23s/it]
 32%|███▏      | 12314/37963 [29:34:56<57:04:17,  8.01s/it]
 32%|███▏      | 12315/37963 [29:35:04<56:06:04,  7.87s/it]
 32%|███▏      | 12316/37963 [29:35:18<68:20:41,  9.59s/it]
 32%|███▏      | 12317/37963 [29:35:25<64:01:03,  8.99s/it]
 32%|███▏      | 12318/37963 [29:35:33<60:56:00,  8.55s/it]
 32%|███▏      | 12319/37963 [29:35:40<58:51:47,  8.26s/it]
 32%|███▏      | 12320/37963 [29:35:48<57:26:45,  8.06s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '2.844', 'learning_rate': '1.579e-05', 'epoch': '0.3245'}

 32%|███▏      | 12320/37963 [29:35:48<57:26:45,  8.06s/it]
 32%|███▏      | 12321/37963 [29:35:55<56:17:41,  7.90s/it]
 32%|███▏      | 12322/37963 [29:36:03<55:36:28,  7.81s/it]
 32%|███▏      | 12323/37963 [29:36:11<55:03:52,  7.73s/it]
 32%|███▏      | 12324/37963 [29:36:18<54:40:42,  7.68s/it]
 32%|███▏      | 12325/37963 [29:36:26<54:32:35,  7.66s/it]
 32%|███▏      | 12326/37963 [29:36:46<81:17:33, 11.42s/it]
 32%|███▏      | 12327/37963 [29:36:53<73:00:15, 10.25s/it]
 32%|███▏      | 12328/37963 [29:37:01<67:07:05,  9.43s/it]
 32%|███▏      | 12329/37963 [29:37:08<63:04:36,  8.86s/it]
 32%|███▏      | 12330/37963 [29:37:16<60:09:44,  8.45s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '1.515', 'learning_rate': '1.578e-05', 'epoch': '0.3248'}

 32%|███▏      | 12330/37963 [29:37:16<60:09:44,  8.45s/it]
 32%|███▏      | 12331/37963 [29:37:23<57:21:39,  8.06s/it]
 32%|███▏      | 12332/37963 [29:37:31<56:12:04,  7.89s/it]
 32%|███▏      | 12333/37963 [29:37:38<55:41:26,  7.82s/it]
 32%|███▏      | 12334/37963 [29:37:46<55:16:02,  7.76s/it]
 32%|███▏      | 12335/37963 [29:37:53<54:43:21,  7.69s/it]
 32%|███▏      | 12336/37963 [29:38:01<54:12:13,  7.61s/it]
 32%|███▏      | 12337/37963 [29:38:08<54:05:45,  7.60s/it]
 33%|███▎      | 12338/37963 [29:38:16<53:59:37,  7.59s/it]
 33%|███▎      | 12339/37963 [29:38:23<53:56:41,  7.58s/it]
 33%|███▎      | 12340/37963 [29:38:31<53:49:04,  7.56s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.412', 'learning_rate': '1.577e-05', 'epoch': '0.3251'}

 33%|███▎      | 12340/37963 [29:38:31<53:49:04,  7.56s/it]
 33%|███▎      | 12341/37963 [29:38:39<53:42:34,  7.55s/it]
 33%|███▎      | 12342/37963 [29:38:46<53:15:17,  7.48s/it]
 33%|███▎      | 12343/37963 [29:39:00<68:21:11,  9.60s/it]
 33%|███▎      | 12344/37963 [29:39:08<64:04:24,  9.00s/it]
 33%|███▎      | 12345/37963 [29:39:15<60:30:04,  8.50s/it]
 33%|███▎      | 12346/37963 [29:39:29<71:18:02, 10.02s/it]
 33%|███▎      | 12347/37963 [29:39:43<79:54:23, 11.23s/it]
 33%|███▎      | 12348/37963 [29:39:50<71:34:25, 10.06s/it]
 33%|███▎      | 12349/37963 [29:39:58<65:52:22,  9.26s/it]
 33%|███▎      | 12350/37963 [29:40:05<61:44:23,  8.68s/it]
                                                           
{'loss': '0.1697', 'grad_norm': '0.8356', 'learning_rate': '1.576e-05', 'epoch': '0.3253'}

 33%|███▎      | 12350/37963 [29:40:05<61:44:23,  8.68s/it]
 33%|███▎      | 12351/37963 [29:40:19<73:20:52, 10.31s/it]
 33%|███▎      | 12352/37963 [29:40:27<67:11:50,  9.45s/it]
 33%|███▎      | 12353/37963 [29:40:34<63:18:54,  8.90s/it]
 33%|███▎      | 12354/37963 [29:40:42<60:40:38,  8.53s/it]
 33%|███▎      | 12355/37963 [29:40:49<58:06:43,  8.17s/it]
 33%|███▎      | 12356/37963 [29:40:57<56:59:45,  8.01s/it]
 33%|███▎      | 12357/37963 [29:41:11<69:31:07,  9.77s/it]
 33%|███▎      | 12358/37963 [29:41:18<65:03:52,  9.15s/it]
 33%|███▎      | 12359/37963 [29:41:26<61:44:08,  8.68s/it]
 33%|███▎      | 12360/37963 [29:41:34<59:21:16,  8.35s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.077', 'learning_rate': '1.576e-05', 'epoch': '0.3256'}

 33%|███▎      | 12360/37963 [29:41:34<59:21:16,  8.35s/it]
 33%|███▎      | 12361/37963 [29:41:41<57:35:44,  8.10s/it]
 33%|███▎      | 12362/37963 [29:41:49<56:21:51,  7.93s/it]
 33%|███▎      | 12363/37963 [29:41:56<55:22:26,  7.79s/it]
 33%|███▎      | 12364/37963 [29:42:10<68:23:42,  9.62s/it]
 33%|███▎      | 12365/37963 [29:42:18<64:02:57,  9.01s/it]
 33%|███▎      | 12366/37963 [29:42:25<60:49:39,  8.55s/it]
 33%|███▎      | 12367/37963 [29:42:32<57:56:04,  8.15s/it]
 33%|███▎      | 12368/37963 [29:42:40<56:43:52,  7.98s/it]
 33%|███▎      | 12369/37963 [29:42:47<55:38:45,  7.83s/it]
 33%|███▎      | 12370/37963 [29:42:55<54:55:39,  7.73s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '0.6523', 'learning_rate': '1.575e-05', 'epoch': '0.3258'}

 33%|███▎      | 12370/37963 [29:42:55<54:55:39,  7.73s/it]
 33%|███▎      | 12371/37963 [29:43:02<54:20:53,  7.65s/it]
 33%|███▎      | 12372/37963 [29:43:16<67:38:39,  9.52s/it]
 33%|███▎      | 12373/37963 [29:43:24<63:10:43,  8.89s/it]
 33%|███▎      | 12374/37963 [29:43:37<73:43:13, 10.37s/it]
 33%|███▎      | 12375/37963 [29:43:45<67:26:52,  9.49s/it]
 33%|███▎      | 12376/37963 [29:43:52<63:15:42,  8.90s/it]
 33%|███▎      | 12377/37963 [29:44:00<60:23:26,  8.50s/it]
 33%|███▎      | 12378/37963 [29:44:07<58:17:15,  8.20s/it]
 33%|███▎      | 12379/37963 [29:44:15<56:48:45,  7.99s/it]
 33%|███▎      | 12380/37963 [29:44:22<55:50:37,  7.86s/it]
                                                           
{'loss': '0.1663', 'grad_norm': '3.068', 'learning_rate': '1.574e-05', 'epoch': '0.3261'}

 33%|███▎      | 12380/37963 [29:44:22<55:50:37,  7.86s/it]
 33%|███▎      | 12381/37963 [29:44:30<55:14:46,  7.77s/it]
 33%|███▎      | 12382/37963 [29:44:38<54:47:46,  7.71s/it]
 33%|███▎      | 12383/37963 [29:44:45<54:20:11,  7.65s/it]
 33%|███▎      | 12384/37963 [29:44:53<54:01:48,  7.60s/it]
 33%|███▎      | 12385/37963 [29:45:00<53:47:19,  7.57s/it]
 33%|███▎      | 12386/37963 [29:45:08<53:43:40,  7.56s/it]
 33%|███▎      | 12387/37963 [29:45:15<53:50:09,  7.58s/it]
 33%|███▎      | 12388/37963 [29:45:29<67:41:53,  9.53s/it]
 33%|███▎      | 12389/37963 [29:45:37<63:44:22,  8.97s/it]
 33%|███▎      | 12390/37963 [29:45:45<60:45:21,  8.55s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.737', 'learning_rate': '1.574e-05', 'epoch': '0.3264'}

 33%|███▎      | 12390/37963 [29:45:45<60:45:21,  8.55s/it]
 33%|███▎      | 12391/37963 [29:45:58<71:45:16, 10.10s/it]
 33%|███▎      | 12392/37963 [29:46:06<66:15:08,  9.33s/it]
 33%|███▎      | 12393/37963 [29:46:14<62:48:40,  8.84s/it]
 33%|███▎      | 12394/37963 [29:46:21<60:19:51,  8.49s/it]
 33%|███▎      | 12395/37963 [29:46:29<57:53:43,  8.15s/it]
 33%|███▎      | 12396/37963 [29:46:43<70:24:58,  9.92s/it]
 33%|███▎      | 12397/37963 [29:46:50<65:11:46,  9.18s/it]
 33%|███▎      | 12398/37963 [29:46:58<62:06:06,  8.75s/it]
 33%|███▎      | 12399/37963 [29:47:06<60:17:02,  8.49s/it]
 33%|███▎      | 12400/37963 [29:47:20<72:13:42, 10.17s/it]
                                                           
{'loss': '0.148', 'grad_norm': '0.9269', 'learning_rate': '1.573e-05', 'epoch': '0.3266'}

 33%|███▎      | 12400/37963 [29:47:20<72:13:42, 10.17s/it]
 33%|███▎      | 12401/37963 [29:47:27<66:53:04,  9.42s/it]
 33%|███▎      | 12402/37963 [29:47:35<62:49:02,  8.85s/it]
 33%|███▎      | 12403/37963 [29:47:49<74:18:40, 10.47s/it]
 33%|███▎      | 12404/37963 [29:47:57<68:00:04,  9.58s/it]
 33%|███▎      | 12405/37963 [29:48:04<63:37:04,  8.96s/it]
 33%|███▎      | 12406/37963 [29:48:12<60:26:08,  8.51s/it]
 33%|███▎      | 12407/37963 [29:48:19<58:22:57,  8.22s/it]
 33%|███▎      | 12408/37963 [29:48:34<71:46:51, 10.11s/it]
 33%|███▎      | 12409/37963 [29:48:41<65:34:47,  9.24s/it]
 33%|███▎      | 12410/37963 [29:48:49<62:09:59,  8.76s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '2.988', 'learning_rate': '1.572e-05', 'epoch': '0.3269'}

 33%|███▎      | 12410/37963 [29:48:49<62:09:59,  8.76s/it]
 33%|███▎      | 12411/37963 [29:48:56<59:27:35,  8.38s/it]
 33%|███▎      | 12412/37963 [29:49:03<57:08:13,  8.05s/it]
 33%|███▎      | 12413/37963 [29:49:11<55:39:40,  7.84s/it]
 33%|███▎      | 12414/37963 [29:49:18<54:55:59,  7.74s/it]
 33%|███▎      | 12415/37963 [29:49:26<54:47:03,  7.72s/it]
 33%|███▎      | 12416/37963 [29:49:33<54:16:51,  7.65s/it]
 33%|███▎      | 12417/37963 [29:49:41<54:01:34,  7.61s/it]
 33%|███▎      | 12418/37963 [29:49:49<54:01:05,  7.61s/it]
 33%|███▎      | 12419/37963 [29:49:56<53:48:34,  7.58s/it]
 33%|███▎      | 12420/37963 [29:50:17<81:21:23, 11.47s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.398', 'learning_rate': '1.572e-05', 'epoch': '0.3272'}

 33%|███▎      | 12420/37963 [29:50:17<81:21:23, 11.47s/it]
 33%|███▎      | 12421/37963 [29:50:24<73:05:04, 10.30s/it]
 33%|███▎      | 12422/37963 [29:50:32<67:12:15,  9.47s/it]
 33%|███▎      | 12423/37963 [29:50:39<63:13:51,  8.91s/it]
 33%|███▎      | 12424/37963 [29:50:47<60:14:57,  8.49s/it]
 33%|███▎      | 12425/37963 [29:50:54<58:16:03,  8.21s/it]
 33%|███▎      | 12426/37963 [29:51:02<56:43:43,  8.00s/it]
 33%|███▎      | 12427/37963 [29:51:09<55:19:49,  7.80s/it]
 33%|███▎      | 12428/37963 [29:51:17<54:55:35,  7.74s/it]
 33%|███▎      | 12429/37963 [29:51:24<54:33:47,  7.69s/it]
 33%|███▎      | 12430/37963 [29:51:32<53:51:19,  7.59s/it]
                                                           
{'loss': '0.1621', 'grad_norm': '3.009', 'learning_rate': '1.571e-05', 'epoch': '0.3274'}

 33%|███▎      | 12430/37963 [29:51:32<53:51:19,  7.59s/it]
 33%|███▎      | 12431/37963 [29:51:39<53:49:58,  7.59s/it]
 33%|███▎      | 12432/37963 [29:51:47<53:39:35,  7.57s/it]
 33%|███▎      | 12433/37963 [29:51:54<53:30:12,  7.54s/it]
 33%|███▎      | 12434/37963 [29:52:02<53:10:13,  7.50s/it]
 33%|███▎      | 12435/37963 [29:52:09<53:09:19,  7.50s/it]
 33%|███▎      | 12436/37963 [29:52:17<53:03:16,  7.48s/it]
 33%|███▎      | 12437/37963 [29:52:24<53:15:37,  7.51s/it]
 33%|███▎      | 12438/37963 [29:52:31<52:38:00,  7.42s/it]
 33%|███▎      | 12439/37963 [29:52:39<53:04:34,  7.49s/it]
 33%|███▎      | 12440/37963 [29:52:53<67:40:49,  9.55s/it]
                                                           
{'loss': '0.1612', 'grad_norm': '1.2', 'learning_rate': '1.57e-05', 'epoch': '0.3277'}

 33%|███▎      | 12440/37963 [29:52:53<67:40:49,  9.55s/it]
 33%|███▎      | 12441/37963 [29:53:01<64:07:58,  9.05s/it]
 33%|███▎      | 12442/37963 [29:53:09<61:03:07,  8.61s/it]
 33%|███▎      | 12443/37963 [29:53:16<58:47:42,  8.29s/it]
 33%|███▎      | 12444/37963 [29:53:31<71:16:42, 10.06s/it]
 33%|███▎      | 12445/37963 [29:53:45<80:08:15, 11.31s/it]
 33%|███▎      | 12446/37963 [29:53:53<72:26:25, 10.22s/it]
 33%|███▎      | 12447/37963 [29:54:00<66:49:06,  9.43s/it]
 33%|███▎      | 12448/37963 [29:54:08<62:51:55,  8.87s/it]
 33%|███▎      | 12449/37963 [29:54:15<59:55:35,  8.46s/it]
 33%|███▎      | 12450/37963 [29:54:23<57:40:57,  8.14s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '4.522', 'learning_rate': '1.57e-05', 'epoch': '0.328'}

 33%|███▎      | 12450/37963 [29:54:23<57:40:57,  8.14s/it]
 33%|███▎      | 12451/37963 [29:54:30<56:25:46,  7.96s/it]
 33%|███▎      | 12452/37963 [29:54:44<69:01:26,  9.74s/it]
 33%|███▎      | 12453/37963 [29:54:52<64:12:50,  9.06s/it]
 33%|███▎      | 12454/37963 [29:54:59<60:53:25,  8.59s/it]
 33%|███▎      | 12455/37963 [29:55:07<59:03:00,  8.33s/it]
 33%|███▎      | 12456/37963 [29:55:21<71:38:23, 10.11s/it]
 33%|███▎      | 12457/37963 [29:55:28<66:01:52,  9.32s/it]
 33%|███▎      | 12458/37963 [29:55:36<62:09:29,  8.77s/it]
 33%|███▎      | 12459/37963 [29:55:43<59:04:11,  8.34s/it]
 33%|███▎      | 12460/37963 [29:55:51<57:43:21,  8.15s/it]
                                                           
{'loss': '0.1595', 'grad_norm': '4.904', 'learning_rate': '1.569e-05', 'epoch': '0.3282'}

 33%|███▎      | 12460/37963 [29:55:51<57:43:21,  8.15s/it]
 33%|███▎      | 12461/37963 [29:55:58<56:04:46,  7.92s/it]
 33%|███▎      | 12462/37963 [29:56:06<54:46:14,  7.73s/it]
 33%|███▎      | 12463/37963 [29:56:13<54:32:26,  7.70s/it]
 33%|███▎      | 12464/37963 [29:56:21<54:23:57,  7.68s/it]
 33%|███▎      | 12465/37963 [29:56:28<53:26:45,  7.55s/it]
 33%|███▎      | 12466/37963 [29:56:36<53:50:07,  7.60s/it]
 33%|███▎      | 12467/37963 [29:56:43<53:43:04,  7.58s/it]
 33%|███▎      | 12468/37963 [29:56:51<53:40:17,  7.58s/it]
 33%|███▎      | 12469/37963 [29:56:58<53:02:57,  7.49s/it]
 33%|███▎      | 12470/37963 [29:57:06<52:36:52,  7.43s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '1.155', 'learning_rate': '1.568e-05', 'epoch': '0.3285'}

 33%|███▎      | 12470/37963 [29:57:06<52:36:52,  7.43s/it]
 33%|███▎      | 12471/37963 [29:57:19<65:58:43,  9.32s/it]
 33%|███▎      | 12472/37963 [29:57:33<75:25:02, 10.65s/it]
 33%|███▎      | 12473/37963 [29:57:40<68:18:04,  9.65s/it]
 33%|███▎      | 12474/37963 [29:57:48<63:39:25,  8.99s/it]
 33%|███▎      | 12475/37963 [29:57:55<60:47:54,  8.59s/it]
 33%|███▎      | 12476/37963 [29:58:03<57:57:41,  8.19s/it]
 33%|███▎      | 12477/37963 [29:58:10<57:00:10,  8.05s/it]
 33%|███▎      | 12478/37963 [29:58:18<56:03:58,  7.92s/it]
 33%|███▎      | 12479/37963 [29:58:26<55:13:37,  7.80s/it]
 33%|███▎      | 12480/37963 [29:58:33<54:14:01,  7.66s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '3.545', 'learning_rate': '1.567e-05', 'epoch': '0.3287'}

 33%|███▎      | 12480/37963 [29:58:33<54:14:01,  7.66s/it]
 33%|███▎      | 12481/37963 [29:58:41<54:06:57,  7.65s/it]
 33%|███▎      | 12482/37963 [29:58:48<53:50:14,  7.61s/it]
 33%|███▎      | 12483/37963 [29:58:56<53:29:54,  7.56s/it]
 33%|███▎      | 12484/37963 [29:59:03<53:08:46,  7.51s/it]
 33%|███▎      | 12485/37963 [29:59:11<53:32:48,  7.57s/it]
 33%|███▎      | 12486/37963 [29:59:25<67:29:29,  9.54s/it]
 33%|███▎      | 12487/37963 [29:59:32<63:15:36,  8.94s/it]
 33%|███▎      | 12488/37963 [29:59:46<74:15:13, 10.49s/it]
 33%|███▎      | 12489/37963 [29:59:54<68:02:36,  9.62s/it]
 33%|███▎      | 12490/37963 [30:00:01<63:36:56,  8.99s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '2.395', 'learning_rate': '1.567e-05', 'epoch': '0.329'}

 33%|███▎      | 12490/37963 [30:00:02<63:36:56,  8.99s/it]
 33%|███▎      | 12491/37963 [30:00:09<60:00:36,  8.48s/it]
 33%|███▎      | 12492/37963 [30:00:16<57:57:14,  8.19s/it]
 33%|███▎      | 12493/37963 [30:00:24<56:34:54,  8.00s/it]
 33%|███▎      | 12494/37963 [30:00:38<69:37:25,  9.84s/it]
 33%|███▎      | 12495/37963 [30:00:46<64:44:23,  9.15s/it]
 33%|███▎      | 12496/37963 [30:01:00<75:21:24, 10.65s/it]
 33%|███▎      | 12497/37963 [30:01:07<69:06:21,  9.77s/it]
 33%|███▎      | 12498/37963 [30:01:15<64:22:40,  9.10s/it]
 33%|███▎      | 12499/37963 [30:01:23<61:24:19,  8.68s/it]
 33%|███▎      | 12500/37963 [30:01:37<73:28:46, 10.39s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '2.137', 'learning_rate': '1.566e-05', 'epoch': '0.3293'}

 33%|███▎      | 12500/37963 [30:01:37<73:28:46, 10.39s/it]
 33%|███▎      | 12501/37963 [30:01:45<67:46:27,  9.58s/it]
 33%|███▎      | 12502/37963 [30:01:52<63:40:41,  9.00s/it]
 33%|███▎      | 12503/37963 [30:02:00<60:36:25,  8.57s/it]
 33%|███▎      | 12504/37963 [30:02:08<58:37:04,  8.29s/it]
 33%|███▎      | 12505/37963 [30:02:15<57:09:51,  8.08s/it]
 33%|███▎      | 12506/37963 [30:02:23<55:45:15,  7.88s/it]
 33%|███▎      | 12507/37963 [30:02:36<68:28:20,  9.68s/it]
 33%|███▎      | 12508/37963 [30:02:44<64:07:40,  9.07s/it]
 33%|███▎      | 12509/37963 [30:02:52<60:40:14,  8.58s/it]
 33%|███▎      | 12510/37963 [30:02:59<58:28:15,  8.27s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.616', 'learning_rate': '1.565e-05', 'epoch': '0.3295'}

 33%|███▎      | 12510/37963 [30:02:59<58:28:15,  8.27s/it]
 33%|███▎      | 12511/37963 [30:03:07<56:52:27,  8.04s/it]
 33%|███▎      | 12512/37963 [30:03:14<55:47:52,  7.89s/it]
 33%|███▎      | 12513/37963 [30:03:21<54:31:31,  7.71s/it]
 33%|███▎      | 12514/37963 [30:03:29<54:10:02,  7.66s/it]
 33%|███▎      | 12515/37963 [30:03:37<53:57:51,  7.63s/it]
 33%|███▎      | 12516/37963 [30:03:50<66:44:12,  9.44s/it]
 33%|███▎      | 12517/37963 [30:03:57<61:51:03,  8.75s/it]
 33%|███▎      | 12518/37963 [30:04:05<58:52:26,  8.33s/it]
 33%|███▎      | 12519/37963 [30:04:12<57:23:01,  8.12s/it]
 33%|███▎      | 12520/37963 [30:04:20<56:14:33,  7.96s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.284', 'learning_rate': '1.565e-05', 'epoch': '0.3298'}

 33%|███▎      | 12520/37963 [30:04:20<56:14:33,  7.96s/it]
 33%|███▎      | 12521/37963 [30:04:34<68:34:45,  9.70s/it]
 33%|███▎      | 12522/37963 [30:04:41<64:02:34,  9.06s/it]
 33%|███▎      | 12523/37963 [30:04:49<60:46:57,  8.60s/it]
 33%|███▎      | 12524/37963 [30:04:56<58:37:01,  8.30s/it]
 33%|███▎      | 12525/37963 [30:05:04<56:40:21,  8.02s/it]
 33%|███▎      | 12526/37963 [30:05:11<55:45:15,  7.89s/it]
 33%|███▎      | 12527/37963 [30:05:19<55:16:54,  7.82s/it]
 33%|███▎      | 12528/37963 [30:05:26<54:16:45,  7.68s/it]
 33%|███▎      | 12529/37963 [30:05:34<54:00:43,  7.65s/it]
 33%|███▎      | 12530/37963 [30:05:42<54:16:03,  7.68s/it]
                                                           
{'loss': '0.1646', 'grad_norm': '0.9209', 'learning_rate': '1.564e-05', 'epoch': '0.3301'}

 33%|███▎      | 12530/37963 [30:05:42<54:16:03,  7.68s/it]
 33%|███▎      | 12531/37963 [30:05:49<54:27:17,  7.71s/it]
 33%|███▎      | 12532/37963 [30:05:57<53:38:48,  7.59s/it]
 33%|███▎      | 12533/37963 [30:06:04<53:30:40,  7.58s/it]
 33%|███▎      | 12534/37963 [30:06:19<67:43:27,  9.59s/it]
 33%|███▎      | 12535/37963 [30:06:33<77:41:31, 11.00s/it]
 33%|███▎      | 12536/37963 [30:06:40<70:18:45,  9.95s/it]
 33%|███▎      | 12537/37963 [30:06:48<65:15:26,  9.24s/it]
 33%|███▎      | 12538/37963 [30:06:56<61:51:30,  8.76s/it]
 33%|███▎      | 12539/37963 [30:07:03<58:46:26,  8.32s/it]
 33%|███▎      | 12540/37963 [30:07:11<57:23:53,  8.13s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '3.329', 'learning_rate': '1.563e-05', 'epoch': '0.3303'}

 33%|███▎      | 12540/37963 [30:07:11<57:23:53,  8.13s/it]
 33%|███▎      | 12541/37963 [30:07:18<56:17:29,  7.97s/it]
 33%|███▎      | 12542/37963 [30:07:32<68:30:11,  9.70s/it]
 33%|███▎      | 12543/37963 [30:07:39<63:55:52,  9.05s/it]
 33%|███▎      | 12544/37963 [30:07:47<60:03:13,  8.51s/it]
 33%|███▎      | 12545/37963 [30:08:01<71:20:55, 10.11s/it]
 33%|███▎      | 12546/37963 [30:08:08<65:56:06,  9.34s/it]
 33%|███▎      | 12547/37963 [30:08:16<62:19:30,  8.83s/it]
 33%|███▎      | 12548/37963 [30:08:30<73:13:23, 10.37s/it]
 33%|███▎      | 12549/37963 [30:08:37<67:23:44,  9.55s/it]
 33%|███▎      | 12550/37963 [30:08:45<62:32:53,  8.86s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '0.7914', 'learning_rate': '1.562e-05', 'epoch': '0.3306'}

 33%|███▎      | 12550/37963 [30:08:45<62:32:53,  8.86s/it]
 33%|███▎      | 12551/37963 [30:08:58<73:17:12, 10.38s/it]
 33%|███▎      | 12552/37963 [30:09:06<67:40:07,  9.59s/it]
 33%|███▎      | 12553/37963 [30:09:14<63:13:56,  8.96s/it]
 33%|███▎      | 12554/37963 [30:09:21<60:28:34,  8.57s/it]
 33%|███▎      | 12555/37963 [30:09:29<58:21:09,  8.27s/it]
 33%|███▎      | 12556/37963 [30:09:36<56:28:04,  8.00s/it]
 33%|███▎      | 12557/37963 [30:09:44<55:38:48,  7.89s/it]
 33%|███▎      | 12558/37963 [30:09:51<54:56:27,  7.79s/it]
 33%|███▎      | 12559/37963 [30:09:59<54:27:37,  7.72s/it]
 33%|███▎      | 12560/37963 [30:10:07<54:27:27,  7.72s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '2.201', 'learning_rate': '1.562e-05', 'epoch': '0.3308'}

 33%|███▎      | 12560/37963 [30:10:07<54:27:27,  7.72s/it]
 33%|███▎      | 12561/37963 [30:10:14<54:03:27,  7.66s/it]
 33%|███▎      | 12562/37963 [30:10:22<53:48:14,  7.63s/it]
 33%|███▎      | 12563/37963 [30:10:29<53:33:15,  7.59s/it]
 33%|███▎      | 12564/37963 [30:10:37<53:28:22,  7.58s/it]
 33%|███▎      | 12565/37963 [30:10:44<53:22:04,  7.56s/it]
 33%|███▎      | 12566/37963 [30:10:52<53:20:30,  7.56s/it]
 33%|███▎      | 12567/37963 [30:10:59<52:42:45,  7.47s/it]
 33%|███▎      | 12568/37963 [30:11:07<53:00:00,  7.51s/it]
 33%|███▎      | 12569/37963 [30:11:21<66:31:35,  9.43s/it]
 33%|███▎      | 12570/37963 [30:11:28<62:43:52,  8.89s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '1.914', 'learning_rate': '1.561e-05', 'epoch': '0.3311'}

 33%|███▎      | 12570/37963 [30:11:28<62:43:52,  8.89s/it]
 33%|███▎      | 12571/37963 [30:11:36<60:01:08,  8.51s/it]
 33%|███▎      | 12572/37963 [30:11:50<71:51:10, 10.19s/it]
 33%|███▎      | 12573/37963 [30:11:58<65:56:58,  9.35s/it]
 33%|███▎      | 12574/37963 [30:12:05<62:11:16,  8.82s/it]
 33%|███▎      | 12575/37963 [30:12:13<59:12:40,  8.40s/it]
 33%|███▎      | 12576/37963 [30:12:20<57:33:37,  8.16s/it]
 33%|███▎      | 12577/37963 [30:12:28<56:34:38,  8.02s/it]
 33%|███▎      | 12578/37963 [30:12:35<55:40:44,  7.90s/it]
 33%|███▎      | 12579/37963 [30:12:49<68:41:49,  9.74s/it]
 33%|███▎      | 12580/37963 [30:12:57<64:17:54,  9.12s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '2.148', 'learning_rate': '1.56e-05', 'epoch': '0.3314'}

 33%|███▎      | 12580/37963 [30:12:57<64:17:54,  9.12s/it]
 33%|███▎      | 12581/37963 [30:13:11<74:08:30, 10.52s/it]
 33%|███▎      | 12582/37963 [30:13:19<68:01:54,  9.65s/it]
 33%|███▎      | 12583/37963 [30:13:26<63:55:49,  9.07s/it]
 33%|███▎      | 12584/37963 [30:13:34<60:58:34,  8.65s/it]
 33%|███▎      | 12585/37963 [30:13:41<58:32:35,  8.30s/it]
 33%|███▎      | 12586/37963 [30:13:49<56:13:24,  7.98s/it]
 33%|███▎      | 12587/37963 [30:13:56<55:01:35,  7.81s/it]
 33%|███▎      | 12588/37963 [30:14:03<53:56:25,  7.65s/it]
 33%|███▎      | 12589/37963 [30:14:17<67:20:06,  9.55s/it]
 33%|███▎      | 12590/37963 [30:14:25<63:28:23,  9.01s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '2.345', 'learning_rate': '1.56e-05', 'epoch': '0.3316'}

 33%|███▎      | 12590/37963 [30:14:25<63:28:23,  9.01s/it]
 33%|███▎      | 12591/37963 [30:14:33<60:36:57,  8.60s/it]
 33%|███▎      | 12592/37963 [30:14:40<58:02:33,  8.24s/it]
 33%|███▎      | 12593/37963 [30:14:48<56:57:27,  8.08s/it]
 33%|███▎      | 12594/37963 [30:14:55<55:13:13,  7.84s/it]
 33%|███▎      | 12595/37963 [30:15:09<67:40:58,  9.60s/it]
 33%|███▎      | 12596/37963 [30:15:22<76:14:28, 10.82s/it]
 33%|███▎      | 12597/37963 [30:15:30<69:29:47,  9.86s/it]
 33%|███▎      | 12598/37963 [30:15:37<63:51:14,  9.06s/it]
 33%|███▎      | 12599/37963 [30:15:51<73:58:16, 10.50s/it]
 33%|███▎      | 12600/37963 [30:15:59<67:58:26,  9.65s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.234', 'learning_rate': '1.559e-05', 'epoch': '0.3319'}

 33%|███▎      | 12600/37963 [30:15:59<67:58:26,  9.65s/it]
 33%|███▎      | 12601/37963 [30:16:06<63:31:10,  9.02s/it]
 33%|███▎      | 12602/37963 [30:16:14<60:47:50,  8.63s/it]
 33%|███▎      | 12603/37963 [30:16:22<58:37:35,  8.32s/it]
 33%|███▎      | 12604/37963 [30:16:29<56:50:18,  8.07s/it]
 33%|███▎      | 12605/37963 [30:16:37<55:53:34,  7.93s/it]
 33%|███▎      | 12606/37963 [30:16:44<54:58:19,  7.80s/it]
 33%|███▎      | 12607/37963 [30:16:52<53:54:45,  7.65s/it]
 33%|███▎      | 12608/37963 [30:16:59<53:42:25,  7.63s/it]
 33%|███▎      | 12609/37963 [30:17:07<53:26:21,  7.59s/it]
 33%|███▎      | 12610/37963 [30:17:14<53:24:09,  7.58s/it]
                                                           
{'loss': '0.1767', 'grad_norm': '2.265', 'learning_rate': '1.558e-05', 'epoch': '0.3322'}

 33%|███▎      | 12610/37963 [30:17:14<53:24:09,  7.58s/it]
 33%|███▎      | 12611/37963 [30:17:22<53:10:00,  7.55s/it]
 33%|███▎      | 12612/37963 [30:17:29<53:07:07,  7.54s/it]
 33%|███▎      | 12613/37963 [30:17:37<53:00:09,  7.53s/it]
 33%|███▎      | 12614/37963 [30:17:44<53:26:29,  7.59s/it]
 33%|███▎      | 12615/37963 [30:17:52<53:27:30,  7.59s/it]
 33%|███▎      | 12616/37963 [30:18:06<66:32:41,  9.45s/it]
 33%|███▎      | 12617/37963 [30:18:14<63:04:18,  8.96s/it]
 33%|███▎      | 12618/37963 [30:18:21<60:08:37,  8.54s/it]
 33%|███▎      | 12619/37963 [30:18:29<58:06:16,  8.25s/it]
 33%|███▎      | 12620/37963 [30:18:36<56:35:46,  8.04s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '2.212', 'learning_rate': '1.558e-05', 'epoch': '0.3324'}

 33%|███▎      | 12620/37963 [30:18:36<56:35:46,  8.04s/it]
 33%|███▎      | 12621/37963 [30:18:44<55:37:27,  7.90s/it]
 33%|███▎      | 12622/37963 [30:18:52<55:11:01,  7.84s/it]
 33%|███▎      | 12623/37963 [30:19:12<81:57:46, 11.64s/it]
 33%|███▎      | 12624/37963 [30:19:20<73:25:04, 10.43s/it]
 33%|███▎      | 12625/37963 [30:19:27<67:32:42,  9.60s/it]
 33%|███▎      | 12626/37963 [30:19:35<63:06:49,  8.97s/it]
 33%|███▎      | 12627/37963 [30:19:49<74:15:42, 10.55s/it]
 33%|███▎      | 12628/37963 [30:19:57<67:54:11,  9.65s/it]
 33%|███▎      | 12629/37963 [30:20:04<63:11:00,  8.98s/it]
 33%|███▎      | 12630/37963 [30:20:12<60:04:56,  8.54s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '1.15', 'learning_rate': '1.557e-05', 'epoch': '0.3327'}

 33%|███▎      | 12630/37963 [30:20:12<60:04:56,  8.54s/it]
 33%|███▎      | 12631/37963 [30:20:19<57:12:12,  8.13s/it]
 33%|███▎      | 12632/37963 [30:20:26<55:40:35,  7.91s/it]
 33%|███▎      | 12633/37963 [30:20:34<54:59:37,  7.82s/it]
 33%|███▎      | 12634/37963 [30:20:41<54:31:03,  7.75s/it]
 33%|███▎      | 12635/37963 [30:20:49<54:20:59,  7.73s/it]
 33%|███▎      | 12636/37963 [30:20:57<53:56:24,  7.67s/it]
 33%|███▎      | 12637/37963 [30:21:04<53:26:56,  7.60s/it]
 33%|███▎      | 12638/37963 [30:21:18<66:48:42,  9.50s/it]
 33%|███▎      | 12639/37963 [30:21:25<62:28:05,  8.88s/it]
 33%|███▎      | 12640/37963 [30:21:33<59:42:46,  8.49s/it]
                                                           
{'loss': '0.1682', 'grad_norm': '3.573', 'learning_rate': '1.556e-05', 'epoch': '0.333'}

 33%|███▎      | 12640/37963 [30:21:33<59:42:46,  8.49s/it]
 33%|███▎      | 12641/37963 [30:21:47<71:02:44, 10.10s/it]
 33%|███▎      | 12642/37963 [30:21:54<65:56:37,  9.38s/it]
 33%|███▎      | 12643/37963 [30:22:02<62:23:43,  8.87s/it]
 33%|███▎      | 12644/37963 [30:22:10<59:18:04,  8.43s/it]
 33%|███▎      | 12645/37963 [30:22:17<57:41:21,  8.20s/it]
 33%|███▎      | 12646/37963 [30:22:31<69:48:58,  9.93s/it]
 33%|███▎      | 12647/37963 [30:22:46<79:24:35, 11.29s/it]
 33%|███▎      | 12648/37963 [30:22:53<71:38:52, 10.19s/it]
 33%|███▎      | 12649/37963 [30:23:01<66:00:35,  9.39s/it]
 33%|███▎      | 12650/37963 [30:23:08<62:17:28,  8.86s/it]
                                                           
{'loss': '0.1659', 'grad_norm': '1.449', 'learning_rate': '1.555e-05', 'epoch': '0.3332'}

 33%|███▎      | 12650/37963 [30:23:08<62:17:28,  8.86s/it]
 33%|███▎      | 12651/37963 [30:23:16<58:54:39,  8.38s/it]
 33%|███▎      | 12652/37963 [30:23:23<56:55:20,  8.10s/it]
 33%|███▎      | 12653/37963 [30:23:31<55:36:52,  7.91s/it]
 33%|███▎      | 12654/37963 [30:23:38<55:04:10,  7.83s/it]
 33%|███▎      | 12655/37963 [30:23:46<54:24:08,  7.74s/it]
 33%|███▎      | 12656/37963 [30:23:53<54:18:26,  7.73s/it]
 33%|███▎      | 12657/37963 [30:24:01<53:58:39,  7.68s/it]
 33%|███▎      | 12658/37963 [30:24:09<53:59:31,  7.68s/it]
 33%|███▎      | 12659/37963 [30:24:16<53:45:06,  7.65s/it]
 33%|███▎      | 12660/37963 [30:24:24<53:34:37,  7.62s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.448', 'learning_rate': '1.555e-05', 'epoch': '0.3335'}

 33%|███▎      | 12660/37963 [30:24:24<53:34:37,  7.62s/it]
 33%|███▎      | 12661/37963 [30:24:31<53:33:08,  7.62s/it]
 33%|███▎      | 12662/37963 [30:24:39<53:21:37,  7.59s/it]
 33%|███▎      | 12663/37963 [30:24:53<66:44:39,  9.50s/it]
 33%|███▎      | 12664/37963 [30:25:01<62:45:41,  8.93s/it]
 33%|███▎      | 12665/37963 [30:25:08<59:46:52,  8.51s/it]
 33%|███▎      | 12666/37963 [30:25:16<57:43:33,  8.21s/it]
 33%|███▎      | 12667/37963 [30:25:23<56:05:37,  7.98s/it]
 33%|███▎      | 12668/37963 [30:25:31<55:23:11,  7.88s/it]
 33%|███▎      | 12669/37963 [30:25:38<54:38:11,  7.78s/it]
 33%|███▎      | 12670/37963 [30:25:46<53:39:59,  7.64s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '2.241', 'learning_rate': '1.554e-05', 'epoch': '0.3337'}

 33%|███▎      | 12670/37963 [30:25:46<53:39:59,  7.64s/it]
 33%|███▎      | 12671/37963 [30:25:53<53:33:29,  7.62s/it]
 33%|███▎      | 12672/37963 [30:26:01<53:28:11,  7.61s/it]
 33%|███▎      | 12673/37963 [30:26:08<53:32:08,  7.62s/it]
 33%|███▎      | 12674/37963 [30:26:16<53:21:46,  7.60s/it]
 33%|███▎      | 12675/37963 [30:26:36<79:56:18, 11.38s/it]
 33%|███▎      | 12676/37963 [30:26:44<72:03:29, 10.26s/it]
 33%|███▎      | 12677/37963 [30:26:58<79:44:03, 11.35s/it]
 33%|███▎      | 12678/37963 [30:27:05<71:59:02, 10.25s/it]
 33%|███▎      | 12679/37963 [30:27:13<65:41:20,  9.35s/it]
 33%|███▎      | 12680/37963 [30:27:20<61:12:07,  8.71s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '1.546', 'learning_rate': '1.553e-05', 'epoch': '0.334'}

 33%|███▎      | 12680/37963 [30:27:20<61:12:07,  8.71s/it]
 33%|███▎      | 12681/37963 [30:27:27<58:43:45,  8.36s/it]
 33%|███▎      | 12682/37963 [30:27:35<56:55:55,  8.11s/it]
 33%|███▎      | 12683/37963 [30:27:42<55:47:12,  7.94s/it]
 33%|███▎      | 12684/37963 [30:27:50<55:08:06,  7.85s/it]
 33%|███▎      | 12685/37963 [30:28:04<67:59:31,  9.68s/it]
 33%|███▎      | 12686/37963 [30:28:12<63:52:50,  9.10s/it]
 33%|███▎      | 12687/37963 [30:28:19<60:32:26,  8.62s/it]
 33%|███▎      | 12688/37963 [30:28:33<71:11:53, 10.14s/it]
 33%|███▎      | 12689/37963 [30:28:41<65:46:37,  9.37s/it]
 33%|███▎      | 12690/37963 [30:28:48<61:54:28,  8.82s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '3.315', 'learning_rate': '1.553e-05', 'epoch': '0.3343'}

 33%|███▎      | 12690/37963 [30:28:48<61:54:28,  8.82s/it]
 33%|███▎      | 12691/37963 [30:29:02<73:15:28, 10.44s/it]
 33%|███▎      | 12692/37963 [30:29:16<81:06:46, 11.56s/it]
 33%|███▎      | 12693/37963 [30:29:24<72:38:37, 10.35s/it]
 33%|███▎      | 12694/37963 [30:29:32<66:50:46,  9.52s/it]
 33%|███▎      | 12695/37963 [30:29:39<62:45:14,  8.94s/it]
 33%|███▎      | 12696/37963 [30:29:47<59:43:21,  8.51s/it]
 33%|███▎      | 12697/37963 [30:29:54<57:27:27,  8.19s/it]
 33%|███▎      | 12698/37963 [30:30:01<55:34:50,  7.92s/it]
 33%|███▎      | 12699/37963 [30:30:09<54:47:05,  7.81s/it]
 33%|███▎      | 12700/37963 [30:30:16<54:06:55,  7.71s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.133', 'learning_rate': '1.552e-05', 'epoch': '0.3345'}

 33%|███▎      | 12700/37963 [30:30:16<54:06:55,  7.71s/it]
 33%|███▎      | 12701/37963 [30:30:24<53:43:50,  7.66s/it]
 33%|███▎      | 12702/37963 [30:30:31<52:54:00,  7.54s/it]
 33%|███▎      | 12703/37963 [30:30:39<52:57:44,  7.55s/it]
 33%|███▎      | 12704/37963 [30:30:46<53:00:31,  7.55s/it]
 33%|███▎      | 12705/37963 [30:30:54<52:58:39,  7.55s/it]
 33%|███▎      | 12706/37963 [30:31:01<52:42:29,  7.51s/it]
 33%|███▎      | 12707/37963 [30:31:09<52:36:01,  7.50s/it]
 33%|███▎      | 12708/37963 [30:31:16<52:39:13,  7.51s/it]
 33%|███▎      | 12709/37963 [30:31:24<52:49:46,  7.53s/it]
 33%|███▎      | 12710/37963 [30:31:31<52:45:22,  7.52s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '1.26', 'learning_rate': '1.551e-05', 'epoch': '0.3348'}

 33%|███▎      | 12710/37963 [30:31:31<52:45:22,  7.52s/it]
 33%|███▎      | 12711/37963 [30:31:45<66:10:15,  9.43s/it]
 33%|███▎      | 12712/37963 [30:31:53<62:08:09,  8.86s/it]
 33%|███▎      | 12713/37963 [30:32:00<59:28:30,  8.48s/it]
 33%|███▎      | 12714/37963 [30:32:08<57:24:05,  8.18s/it]
 33%|███▎      | 12715/37963 [30:32:15<56:09:03,  8.01s/it]
 33%|███▎      | 12716/37963 [30:32:23<55:00:08,  7.84s/it]
 33%|███▎      | 12717/37963 [30:32:30<54:18:35,  7.74s/it]
 34%|███▎      | 12718/37963 [30:32:38<53:39:42,  7.65s/it]
 34%|███▎      | 12719/37963 [30:32:45<53:31:53,  7.63s/it]
 34%|███▎      | 12720/37963 [30:33:00<67:22:11,  9.61s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.431', 'learning_rate': '1.55e-05', 'epoch': '0.3351'}

 34%|███▎      | 12720/37963 [30:33:00<67:22:11,  9.61s/it]
 34%|███▎      | 12721/37963 [30:33:07<62:41:36,  8.94s/it]
 34%|███▎      | 12722/37963 [30:33:15<59:36:54,  8.50s/it]
 34%|███▎      | 12723/37963 [30:33:22<57:40:44,  8.23s/it]
 34%|███▎      | 12724/37963 [30:33:36<69:41:45,  9.94s/it]
 34%|███▎      | 12725/37963 [30:33:44<64:24:10,  9.19s/it]
 34%|███▎      | 12726/37963 [30:33:51<60:37:13,  8.65s/it]
 34%|███▎      | 12727/37963 [30:34:05<71:50:23, 10.25s/it]
 34%|███▎      | 12728/37963 [30:34:12<66:15:30,  9.45s/it]
 34%|███▎      | 12729/37963 [30:34:20<62:04:52,  8.86s/it]
 34%|███▎      | 12730/37963 [30:34:27<59:14:19,  8.45s/it]
                                                           
{'loss': '0.1665', 'grad_norm': '2.647', 'learning_rate': '1.55e-05', 'epoch': '0.3353'}

 34%|███▎      | 12730/37963 [30:34:27<59:14:19,  8.45s/it]
 34%|███▎      | 12731/37963 [30:34:35<57:13:33,  8.16s/it]
 34%|███▎      | 12732/37963 [30:34:43<55:57:34,  7.98s/it]
 34%|███▎      | 12733/37963 [30:34:50<54:53:48,  7.83s/it]
 34%|███▎      | 12734/37963 [30:34:57<54:10:22,  7.73s/it]
 34%|███▎      | 12735/37963 [30:35:05<53:48:04,  7.68s/it]
 34%|███▎      | 12736/37963 [30:35:25<80:10:54, 11.44s/it]
 34%|███▎      | 12737/37963 [30:35:39<85:39:08, 12.22s/it]
 34%|███▎      | 12738/37963 [30:35:47<75:44:13, 10.81s/it]
 34%|███▎      | 12739/37963 [30:36:01<82:52:42, 11.83s/it]
 34%|███▎      | 12740/37963 [30:36:09<73:57:35, 10.56s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '1.464', 'learning_rate': '1.549e-05', 'epoch': '0.3356'}

 34%|███▎      | 12740/37963 [30:36:09<73:57:35, 10.56s/it]
 34%|███▎      | 12741/37963 [30:36:16<67:42:58,  9.67s/it]
 34%|███▎      | 12742/37963 [30:36:24<63:13:04,  9.02s/it]
 34%|███▎      | 12743/37963 [30:36:31<60:05:02,  8.58s/it]
 34%|███▎      | 12744/37963 [30:36:39<58:00:02,  8.28s/it]
 34%|███▎      | 12745/37963 [30:36:46<56:37:32,  8.08s/it]
 34%|███▎      | 12746/37963 [30:36:54<55:30:22,  7.92s/it]
 34%|███▎      | 12747/37963 [30:37:02<54:35:54,  7.79s/it]
 34%|███▎      | 12748/37963 [30:37:09<54:18:23,  7.75s/it]
 34%|███▎      | 12749/37963 [30:37:17<53:48:46,  7.68s/it]
 34%|███▎      | 12750/37963 [30:37:24<53:44:54,  7.67s/it]
                                                           
{'loss': '0.1636', 'grad_norm': '2.323', 'learning_rate': '1.548e-05', 'epoch': '0.3359'}

 34%|███▎      | 12750/37963 [30:37:24<53:44:54,  7.67s/it]
 34%|███▎      | 12751/37963 [30:37:32<53:12:04,  7.60s/it]
 34%|███▎      | 12752/37963 [30:37:39<53:00:04,  7.57s/it]
 34%|███▎      | 12753/37963 [30:37:47<52:33:18,  7.50s/it]
 34%|███▎      | 12754/37963 [30:37:54<52:39:13,  7.52s/it]
 34%|███▎      | 12755/37963 [30:38:02<52:36:48,  7.51s/it]
 34%|███▎      | 12756/37963 [30:38:09<52:39:53,  7.52s/it]
 34%|███▎      | 12757/37963 [30:38:17<52:36:47,  7.51s/it]
 34%|███▎      | 12758/37963 [30:38:24<52:54:29,  7.56s/it]
 34%|███▎      | 12759/37963 [30:38:32<52:49:54,  7.55s/it]
 34%|███▎      | 12760/37963 [30:38:46<66:08:14,  9.45s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.012', 'learning_rate': '1.548e-05', 'epoch': '0.3361'}

 34%|███▎      | 12760/37963 [30:38:46<66:08:14,  9.45s/it]
 34%|███▎      | 12761/37963 [30:38:53<62:15:13,  8.89s/it]
 34%|███▎      | 12762/37963 [30:39:01<59:22:00,  8.48s/it]
 34%|███▎      | 12763/37963 [30:39:08<57:30:02,  8.21s/it]
 34%|███▎      | 12764/37963 [30:39:16<56:10:05,  8.02s/it]
 34%|███▎      | 12765/37963 [30:39:24<55:16:15,  7.90s/it]
 34%|███▎      | 12766/37963 [30:39:31<54:36:41,  7.80s/it]
 34%|███▎      | 12767/37963 [30:39:39<53:49:47,  7.69s/it]
 34%|███▎      | 12768/37963 [30:39:46<53:27:51,  7.64s/it]
 34%|███▎      | 12769/37963 [30:39:54<53:13:37,  7.61s/it]
 34%|███▎      | 12770/37963 [30:40:08<67:00:26,  9.58s/it]
                                                           
{'loss': '0.1769', 'grad_norm': '3.677', 'learning_rate': '1.547e-05', 'epoch': '0.3364'}

 34%|███▎      | 12770/37963 [30:40:08<67:00:26,  9.58s/it]
 34%|███▎      | 12771/37963 [30:40:16<62:53:54,  8.99s/it]
 34%|███▎      | 12772/37963 [30:40:23<59:36:34,  8.52s/it]
 34%|███▎      | 12773/37963 [30:40:31<57:43:37,  8.25s/it]
 34%|███▎      | 12774/37963 [30:40:38<56:09:42,  8.03s/it]
 34%|███▎      | 12775/37963 [30:40:52<68:36:49,  9.81s/it]
 34%|███▎      | 12776/37963 [30:41:00<64:00:34,  9.15s/it]
 34%|███▎      | 12777/37963 [30:41:14<74:26:16, 10.64s/it]
 34%|███▎      | 12778/37963 [30:41:21<68:20:13,  9.77s/it]
 34%|███▎      | 12779/37963 [30:41:29<63:14:44,  9.04s/it]
 34%|███▎      | 12780/37963 [30:41:36<60:12:22,  8.61s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '3.234', 'learning_rate': '1.546e-05', 'epoch': '0.3366'}

 34%|███▎      | 12780/37963 [30:41:36<60:12:22,  8.61s/it]
 34%|███▎      | 12781/37963 [30:41:44<58:00:21,  8.29s/it]
 34%|███▎      | 12782/37963 [30:41:52<56:22:26,  8.06s/it]
 34%|███▎      | 12783/37963 [30:41:59<55:17:26,  7.90s/it]
 34%|███▎      | 12784/37963 [30:42:13<67:52:24,  9.70s/it]
 34%|███▎      | 12785/37963 [30:42:21<63:33:17,  9.09s/it]
 34%|███▎      | 12786/37963 [30:42:41<87:19:22, 12.49s/it]
 34%|███▎      | 12787/37963 [30:42:49<76:51:46, 10.99s/it]
 34%|███▎      | 12788/37963 [30:42:56<69:49:31,  9.98s/it]
 34%|███▎      | 12789/37963 [30:43:04<64:41:20,  9.25s/it]
 34%|███▎      | 12790/37963 [30:43:18<75:06:47, 10.74s/it]
                                                           
{'loss': '0.1598', 'grad_norm': '2.506', 'learning_rate': '1.545e-05', 'epoch': '0.3369'}

 34%|███▎      | 12790/37963 [30:43:18<75:06:47, 10.74s/it]
 34%|███▎      | 12791/37963 [30:43:26<68:50:35,  9.85s/it]
 34%|███▎      | 12792/37963 [30:43:33<64:03:45,  9.16s/it]
 34%|███▎      | 12793/37963 [30:43:41<61:07:01,  8.74s/it]
 34%|███▎      | 12794/37963 [30:43:48<58:08:26,  8.32s/it]
 34%|███▎      | 12795/37963 [30:43:56<56:40:18,  8.11s/it]
 34%|███▎      | 12796/37963 [30:44:03<55:31:06,  7.94s/it]
 34%|███▎      | 12797/37963 [30:44:11<54:43:33,  7.83s/it]
 34%|███▎      | 12798/37963 [30:44:18<53:50:48,  7.70s/it]
 34%|███▎      | 12799/37963 [30:44:26<53:28:01,  7.65s/it]
 34%|███▎      | 12800/37963 [30:44:34<53:21:04,  7.63s/it]
                                                           
{'loss': '0.1751', 'grad_norm': '1.969', 'learning_rate': '1.545e-05', 'epoch': '0.3372'}

 34%|███▎      | 12800/37963 [30:44:34<53:21:04,  7.63s/it]
 34%|███▎      | 12801/37963 [30:44:41<53:00:10,  7.58s/it]
 34%|███▎      | 12802/37963 [30:44:49<52:57:39,  7.58s/it]
 34%|███▎      | 12803/37963 [30:44:56<52:01:42,  7.44s/it]
 34%|███▎      | 12804/37963 [30:45:03<52:14:18,  7.47s/it]
 34%|███▎      | 12805/37963 [30:45:11<52:05:47,  7.45s/it]
 34%|███▎      | 12806/37963 [30:45:24<65:07:03,  9.32s/it]
 34%|███▎      | 12807/37963 [30:45:32<61:36:46,  8.82s/it]
 34%|███▎      | 12808/37963 [30:45:40<58:52:54,  8.43s/it]
 34%|███▎      | 12809/37963 [30:45:47<56:52:09,  8.14s/it]
 34%|███▎      | 12810/37963 [30:45:55<55:58:00,  8.01s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '2.894', 'learning_rate': '1.544e-05', 'epoch': '0.3374'}

 34%|███▎      | 12810/37963 [30:45:55<55:58:00,  8.01s/it]
 34%|███▎      | 12811/37963 [30:46:02<54:58:36,  7.87s/it]
 34%|███▎      | 12812/37963 [30:46:10<54:26:25,  7.79s/it]
 34%|███▍      | 12813/37963 [30:46:17<53:51:20,  7.71s/it]
 34%|███▍      | 12814/37963 [30:46:25<53:35:39,  7.67s/it]
 34%|███▍      | 12815/37963 [30:46:33<53:33:05,  7.67s/it]
 34%|███▍      | 12816/37963 [30:46:40<53:49:30,  7.71s/it]
 34%|███▍      | 12817/37963 [30:46:54<66:57:11,  9.59s/it]
 34%|███▍      | 12818/37963 [30:47:02<62:45:01,  8.98s/it]
 34%|███▍      | 12819/37963 [30:47:10<60:12:37,  8.62s/it]
 34%|███▍      | 12820/37963 [30:47:17<58:06:04,  8.32s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.612', 'learning_rate': '1.543e-05', 'epoch': '0.3377'}

 34%|███▍      | 12820/37963 [30:47:17<58:06:04,  8.32s/it]
 34%|███▍      | 12821/37963 [30:47:25<55:55:19,  8.01s/it]
 34%|███▍      | 12822/37963 [30:47:32<54:32:25,  7.81s/it]
 34%|███▍      | 12823/37963 [30:47:40<53:56:05,  7.72s/it]
 34%|███▍      | 12824/37963 [30:47:47<53:18:22,  7.63s/it]
 34%|███▍      | 12825/37963 [30:47:54<53:07:43,  7.61s/it]
 34%|███▍      | 12826/37963 [30:48:08<66:11:06,  9.48s/it]
 34%|███▍      | 12827/37963 [30:48:22<75:57:44, 10.88s/it]
 34%|███▍      | 12828/37963 [30:48:30<68:50:24,  9.86s/it]
 34%|███▍      | 12829/37963 [30:48:38<64:09:18,  9.19s/it]
 34%|███▍      | 12830/37963 [30:48:51<73:44:49, 10.56s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.377', 'learning_rate': '1.543e-05', 'epoch': '0.338'}

 34%|███▍      | 12830/37963 [30:48:51<73:44:49, 10.56s/it]
 34%|███▍      | 12831/37963 [30:49:06<81:23:50, 11.66s/it]
 34%|███▍      | 12832/37963 [30:49:13<72:49:44, 10.43s/it]
 34%|███▍      | 12833/37963 [30:49:21<66:49:55,  9.57s/it]
 34%|███▍      | 12834/37963 [30:49:28<62:04:16,  8.89s/it]
 34%|███▍      | 12835/37963 [30:49:36<59:27:10,  8.52s/it]
 34%|███▍      | 12836/37963 [30:49:50<71:50:20, 10.29s/it]
 34%|███▍      | 12837/37963 [30:49:57<65:43:56,  9.42s/it]
 34%|███▍      | 12838/37963 [30:50:11<75:04:22, 10.76s/it]
 34%|███▍      | 12839/37963 [30:50:19<67:51:18,  9.72s/it]
 34%|███▍      | 12840/37963 [30:50:26<62:55:28,  9.02s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.247', 'learning_rate': '1.542e-05', 'epoch': '0.3382'}

 34%|███▍      | 12840/37963 [30:50:26<62:55:28,  9.02s/it]
 34%|███▍      | 12841/37963 [30:50:34<59:58:53,  8.60s/it]
 34%|███▍      | 12842/37963 [30:50:41<57:50:23,  8.29s/it]
 34%|███▍      | 12843/37963 [30:50:49<56:16:50,  8.07s/it]
 34%|███▍      | 12844/37963 [30:50:56<55:13:11,  7.91s/it]
 34%|███▍      | 12845/37963 [30:51:04<54:34:23,  7.82s/it]
 34%|███▍      | 12846/37963 [30:51:12<54:06:23,  7.76s/it]
 34%|███▍      | 12847/37963 [30:51:19<53:42:05,  7.70s/it]
 34%|███▍      | 12848/37963 [30:51:27<53:32:58,  7.68s/it]
 34%|███▍      | 12849/37963 [30:51:34<53:16:25,  7.64s/it]
 34%|███▍      | 12850/37963 [30:51:42<53:01:37,  7.60s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '2.344', 'learning_rate': '1.541e-05', 'epoch': '0.3385'}

 34%|███▍      | 12850/37963 [30:51:42<53:01:37,  7.60s/it]
 34%|███▍      | 12851/37963 [30:51:49<53:10:16,  7.62s/it]
 34%|███▍      | 12852/37963 [30:51:57<53:02:31,  7.60s/it]
 34%|███▍      | 12853/37963 [30:52:05<52:57:38,  7.59s/it]
 34%|███▍      | 12854/37963 [30:52:19<66:20:26,  9.51s/it]
 34%|███▍      | 12855/37963 [30:52:26<62:27:03,  8.95s/it]
 34%|███▍      | 12856/37963 [30:52:34<59:34:41,  8.54s/it]
 34%|███▍      | 12857/37963 [30:52:41<57:37:27,  8.26s/it]
 34%|███▍      | 12858/37963 [30:52:49<56:02:14,  8.04s/it]
 34%|███▍      | 12859/37963 [30:52:57<55:17:10,  7.93s/it]
 34%|███▍      | 12860/37963 [30:53:04<54:40:36,  7.84s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.952', 'learning_rate': '1.54e-05', 'epoch': '0.3388'}

 34%|███▍      | 12860/37963 [30:53:04<54:40:36,  7.84s/it]
 34%|███▍      | 12861/37963 [30:53:12<54:03:25,  7.75s/it]
 34%|███▍      | 12862/37963 [30:53:19<53:39:38,  7.70s/it]
 34%|███▍      | 12863/37963 [30:53:27<53:21:19,  7.65s/it]
 34%|███▍      | 12864/37963 [30:53:41<66:23:57,  9.52s/it]
 34%|███▍      | 12865/37963 [30:53:48<62:22:53,  8.95s/it]
 34%|███▍      | 12866/37963 [30:53:56<59:25:51,  8.52s/it]
 34%|███▍      | 12867/37963 [30:54:03<57:21:00,  8.23s/it]
 34%|███▍      | 12868/37963 [30:54:11<54:55:48,  7.88s/it]
 34%|███▍      | 12869/37963 [30:54:18<54:13:23,  7.78s/it]
 34%|███▍      | 12870/37963 [30:54:26<53:44:07,  7.71s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '2.628', 'learning_rate': '1.54e-05', 'epoch': '0.339'}

 34%|███▍      | 12870/37963 [30:54:26<53:44:07,  7.71s/it]
 34%|███▍      | 12871/37963 [30:54:33<53:45:34,  7.71s/it]
 34%|███▍      | 12872/37963 [30:54:41<53:29:18,  7.67s/it]
 34%|███▍      | 12873/37963 [30:54:49<53:20:23,  7.65s/it]
 34%|███▍      | 12874/37963 [30:55:03<67:14:24,  9.65s/it]
 34%|███▍      | 12875/37963 [30:55:23<90:06:53, 12.93s/it]
 34%|███▍      | 12876/37963 [30:55:31<79:08:40, 11.36s/it]
 34%|███▍      | 12877/37963 [30:55:45<84:49:56, 12.17s/it]
 34%|███▍      | 12878/37963 [30:55:53<75:15:05, 10.80s/it]
 34%|███▍      | 12879/37963 [30:56:00<68:21:34,  9.81s/it]
 34%|███▍      | 12880/37963 [30:56:08<63:07:44,  9.06s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.319', 'learning_rate': '1.539e-05', 'epoch': '0.3393'}

 34%|███▍      | 12880/37963 [30:56:08<63:07:44,  9.06s/it]
 34%|███▍      | 12881/37963 [30:56:15<60:03:15,  8.62s/it]
 34%|███▍      | 12882/37963 [30:56:23<57:31:45,  8.26s/it]
 34%|███▍      | 12883/37963 [30:56:30<56:00:46,  8.04s/it]
 34%|███▍      | 12884/37963 [30:56:44<68:23:48,  9.82s/it]
 34%|███▍      | 12885/37963 [30:56:52<63:55:40,  9.18s/it]
 34%|███▍      | 12886/37963 [30:57:06<73:51:25, 10.60s/it]
 34%|███▍      | 12887/37963 [30:57:13<67:50:32,  9.74s/it]
 34%|███▍      | 12888/37963 [30:57:21<62:57:29,  9.04s/it]
 34%|███▍      | 12889/37963 [30:57:29<60:07:39,  8.63s/it]
 34%|███▍      | 12890/37963 [30:57:36<57:50:41,  8.31s/it]
                                                           
{'loss': '0.161', 'grad_norm': '1.231', 'learning_rate': '1.538e-05', 'epoch': '0.3395'}

 34%|███▍      | 12890/37963 [30:57:36<57:50:41,  8.31s/it]
 34%|███▍      | 12891/37963 [30:57:44<56:16:29,  8.08s/it]
 34%|███▍      | 12892/37963 [30:57:51<55:11:05,  7.92s/it]
 34%|███▍      | 12893/37963 [30:57:59<54:19:02,  7.80s/it]
 34%|███▍      | 12894/37963 [30:58:06<53:41:05,  7.71s/it]
 34%|███▍      | 12895/37963 [30:58:14<53:29:22,  7.68s/it]
 34%|███▍      | 12896/37963 [30:58:21<53:18:44,  7.66s/it]
 34%|███▍      | 12897/37963 [30:58:29<53:16:05,  7.65s/it]
 34%|███▍      | 12898/37963 [30:58:37<52:53:28,  7.60s/it]
 34%|███▍      | 12899/37963 [30:58:44<52:50:46,  7.59s/it]
 34%|███▍      | 12900/37963 [30:58:52<52:49:27,  7.59s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '2.295', 'learning_rate': '1.538e-05', 'epoch': '0.3398'}

 34%|███▍      | 12900/37963 [30:58:52<52:49:27,  7.59s/it]
 34%|███▍      | 12901/37963 [30:58:59<52:41:27,  7.57s/it]
 34%|███▍      | 12902/37963 [30:59:07<52:48:32,  7.59s/it]
 34%|███▍      | 12903/37963 [30:59:14<52:58:42,  7.61s/it]
 34%|███▍      | 12904/37963 [30:59:22<52:57:45,  7.61s/it]
 34%|███▍      | 12905/37963 [30:59:30<52:49:22,  7.59s/it]
 34%|███▍      | 12906/37963 [30:59:37<52:35:19,  7.56s/it]
 34%|███▍      | 12907/37963 [30:59:45<52:38:26,  7.56s/it]
 34%|███▍      | 12908/37963 [30:59:59<65:52:46,  9.47s/it]
 34%|███▍      | 12909/37963 [31:00:06<61:48:01,  8.88s/it]
 34%|███▍      | 12910/37963 [31:00:14<59:09:49,  8.50s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '3.773', 'learning_rate': '1.537e-05', 'epoch': '0.3401'}

 34%|███▍      | 12910/37963 [31:00:14<59:09:49,  8.50s/it]
 34%|███▍      | 12911/37963 [31:00:21<57:14:55,  8.23s/it]
 34%|███▍      | 12912/37963 [31:00:35<69:35:11, 10.00s/it]
 34%|███▍      | 12913/37963 [31:00:43<64:52:51,  9.32s/it]
 34%|███▍      | 12914/37963 [31:00:51<61:17:52,  8.81s/it]
 34%|███▍      | 12915/37963 [31:00:58<58:43:15,  8.44s/it]
 34%|███▍      | 12916/37963 [31:01:06<56:52:24,  8.17s/it]
 34%|███▍      | 12917/37963 [31:01:13<55:25:25,  7.97s/it]
 34%|███▍      | 12918/37963 [31:01:21<54:31:32,  7.84s/it]
 34%|███▍      | 12919/37963 [31:01:28<53:52:20,  7.74s/it]
 34%|███▍      | 12920/37963 [31:01:36<53:14:54,  7.65s/it]
                                                           
{'loss': '0.163', 'grad_norm': '2.903', 'learning_rate': '1.536e-05', 'epoch': '0.3403'}

 34%|███▍      | 12920/37963 [31:01:36<53:14:54,  7.65s/it]
 34%|███▍      | 12921/37963 [31:01:57<80:20:29, 11.55s/it]
 34%|███▍      | 12922/37963 [31:02:04<71:47:27, 10.32s/it]
 34%|███▍      | 12923/37963 [31:02:18<79:37:01, 11.45s/it]
 34%|███▍      | 12924/37963 [31:02:25<71:01:38, 10.21s/it]
 34%|███▍      | 12925/37963 [31:02:33<65:26:52,  9.41s/it]
 34%|███▍      | 12926/37963 [31:02:41<61:33:09,  8.85s/it]
 34%|███▍      | 12927/37963 [31:02:55<73:11:45, 10.53s/it]
 34%|███▍      | 12928/37963 [31:03:03<67:07:54,  9.65s/it]
 34%|███▍      | 12929/37963 [31:03:10<63:05:39,  9.07s/it]
 34%|███▍      | 12930/37963 [31:03:18<59:45:12,  8.59s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '0.9238', 'learning_rate': '1.535e-05', 'epoch': '0.3406'}

 34%|███▍      | 12930/37963 [31:03:18<59:45:12,  8.59s/it]
 34%|███▍      | 12931/37963 [31:03:25<57:22:51,  8.25s/it]
 34%|███▍      | 12932/37963 [31:03:33<55:49:12,  8.03s/it]
 34%|███▍      | 12933/37963 [31:03:40<54:20:29,  7.82s/it]
 34%|███▍      | 12934/37963 [31:03:54<67:40:12,  9.73s/it]
 34%|███▍      | 12935/37963 [31:04:08<76:15:36, 10.97s/it]
 34%|███▍      | 12936/37963 [31:04:16<68:59:03,  9.92s/it]
 34%|███▍      | 12937/37963 [31:04:23<64:04:39,  9.22s/it]
 34%|███▍      | 12938/37963 [31:04:31<60:22:17,  8.68s/it]
 34%|███▍      | 12939/37963 [31:04:38<57:57:54,  8.34s/it]
 34%|███▍      | 12940/37963 [31:04:46<56:27:01,  8.12s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '4.087', 'learning_rate': '1.535e-05', 'epoch': '0.3409'}

 34%|███▍      | 12940/37963 [31:04:46<56:27:01,  8.12s/it]
 34%|███▍      | 12941/37963 [31:04:53<55:13:35,  7.95s/it]
 34%|███▍      | 12942/37963 [31:05:01<54:36:52,  7.86s/it]
 34%|███▍      | 12943/37963 [31:05:08<54:02:17,  7.78s/it]
 34%|███▍      | 12944/37963 [31:05:16<53:28:27,  7.69s/it]
 34%|███▍      | 12945/37963 [31:05:23<53:02:38,  7.63s/it]
 34%|███▍      | 12946/37963 [31:05:31<52:47:20,  7.60s/it]
 34%|███▍      | 12947/37963 [31:05:39<52:38:48,  7.58s/it]
 34%|███▍      | 12948/37963 [31:05:46<51:59:27,  7.48s/it]
 34%|███▍      | 12949/37963 [31:05:53<52:08:59,  7.51s/it]
 34%|███▍      | 12950/37963 [31:06:01<52:08:33,  7.50s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '3.449', 'learning_rate': '1.534e-05', 'epoch': '0.3411'}

 34%|███▍      | 12950/37963 [31:06:01<52:08:33,  7.50s/it]
 34%|███▍      | 12951/37963 [31:06:08<51:46:38,  7.45s/it]
 34%|███▍      | 12952/37963 [31:06:15<51:19:20,  7.39s/it]
 34%|███▍      | 12953/37963 [31:06:23<51:38:02,  7.43s/it]
 34%|███▍      | 12954/37963 [31:06:30<51:49:34,  7.46s/it]
 34%|███▍      | 12955/37963 [31:06:38<51:48:41,  7.46s/it]
 34%|███▍      | 12956/37963 [31:06:46<52:10:13,  7.51s/it]
 34%|███▍      | 12957/37963 [31:06:53<52:12:56,  7.52s/it]
 34%|███▍      | 12958/37963 [31:07:07<65:31:49,  9.43s/it]
 34%|███▍      | 12959/37963 [31:07:14<60:58:13,  8.78s/it]
 34%|███▍      | 12960/37963 [31:07:28<71:36:21, 10.31s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '2.305', 'learning_rate': '1.533e-05', 'epoch': '0.3414'}

 34%|███▍      | 12960/37963 [31:07:28<71:36:21, 10.31s/it]
 34%|███▍      | 12961/37963 [31:07:36<65:54:49,  9.49s/it]
 34%|███▍      | 12962/37963 [31:07:43<61:59:08,  8.93s/it]
 34%|███▍      | 12963/37963 [31:07:51<59:23:20,  8.55s/it]
 34%|███▍      | 12964/37963 [31:07:59<57:23:04,  8.26s/it]
 34%|███▍      | 12965/37963 [31:08:06<55:30:28,  7.99s/it]
 34%|███▍      | 12966/37963 [31:08:13<54:26:56,  7.84s/it]
 34%|███▍      | 12967/37963 [31:08:27<67:07:04,  9.67s/it]
 34%|███▍      | 12968/37963 [31:08:35<62:34:04,  9.01s/it]
 34%|███▍      | 12969/37963 [31:08:49<73:05:24, 10.53s/it]
 34%|███▍      | 12970/37963 [31:08:57<67:03:27,  9.66s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.8', 'learning_rate': '1.532e-05', 'epoch': '0.3416'}

 34%|███▍      | 12970/37963 [31:08:57<67:03:27,  9.66s/it]
 34%|███▍      | 12971/37963 [31:09:10<75:41:02, 10.90s/it]
 34%|███▍      | 12972/37963 [31:09:18<69:02:29,  9.95s/it]
 34%|███▍      | 12973/37963 [31:09:26<63:59:02,  9.22s/it]
 34%|███▍      | 12974/37963 [31:09:33<60:45:55,  8.75s/it]
 34%|███▍      | 12975/37963 [31:09:41<58:23:13,  8.41s/it]
 34%|███▍      | 12976/37963 [31:09:48<56:33:10,  8.15s/it]
 34%|███▍      | 12977/37963 [31:10:02<68:19:26,  9.84s/it]
 34%|███▍      | 12978/37963 [31:10:10<63:28:51,  9.15s/it]
 34%|███▍      | 12979/37963 [31:10:17<60:01:51,  8.65s/it]
 34%|███▍      | 12980/37963 [31:10:25<57:53:34,  8.34s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '2.976', 'learning_rate': '1.532e-05', 'epoch': '0.3419'}

 34%|███▍      | 12980/37963 [31:10:25<57:53:34,  8.34s/it]
 34%|███▍      | 12981/37963 [31:10:39<69:39:53, 10.04s/it]
 34%|███▍      | 12982/37963 [31:10:47<64:43:18,  9.33s/it]
 34%|███▍      | 12983/37963 [31:10:54<60:43:49,  8.75s/it]
 34%|███▍      | 12984/37963 [31:11:01<58:10:43,  8.38s/it]
 34%|███▍      | 12985/37963 [31:11:09<56:32:46,  8.15s/it]
 34%|███▍      | 12986/37963 [31:11:23<68:31:25,  9.88s/it]
 34%|███▍      | 12987/37963 [31:11:31<63:39:56,  9.18s/it]
 34%|███▍      | 12988/37963 [31:11:38<60:40:26,  8.75s/it]
 34%|███▍      | 12989/37963 [31:11:46<57:56:01,  8.35s/it]
 34%|███▍      | 12990/37963 [31:11:53<55:58:53,  8.07s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.541', 'learning_rate': '1.531e-05', 'epoch': '0.3422'}

 34%|███▍      | 12990/37963 [31:11:53<55:58:53,  8.07s/it]
 34%|███▍      | 12991/37963 [31:12:01<54:55:46,  7.92s/it]
 34%|███▍      | 12992/37963 [31:12:08<54:18:57,  7.83s/it]
 34%|███▍      | 12993/37963 [31:12:16<53:31:24,  7.72s/it]
 34%|███▍      | 12994/37963 [31:12:23<52:46:00,  7.61s/it]
 34%|███▍      | 12995/37963 [31:12:31<52:35:35,  7.58s/it]
 34%|███▍      | 12996/37963 [31:12:38<52:42:46,  7.60s/it]
 34%|███▍      | 12997/37963 [31:12:46<52:48:38,  7.62s/it]
 34%|███▍      | 12998/37963 [31:12:53<52:37:34,  7.59s/it]
 34%|███▍      | 12999/37963 [31:13:01<52:33:48,  7.58s/it]
 34%|███▍      | 13000/37963 [31:13:09<52:33:33,  7.58s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '1.631', 'learning_rate': '1.53e-05', 'epoch': '0.3424'}

 34%|███▍      | 13000/37963 [31:13:09<52:33:33,  7.58s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  9.00s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  9.00s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 34%|███▍      | 13001/37963 [31:14:05<154:19:21, 22.26s/it]
 34%|███▍      | 13002/37963 [31:14:20<139:44:52, 20.16s/it]
 34%|███▍      | 13003/37963 [31:14:30<117:20:58, 16.93s/it]
 34%|███▍      | 13004/37963 [31:14:38<99:44:21, 14.39s/it] 
 34%|███▍      | 13005/37963 [31:14:46<85:31:07, 12.34s/it]
 34%|███▍      | 13006/37963 [31:14:53<75:38:06, 10.91s/it]
 34%|███▍      | 13007/37963 [31:15:07<81:53:35, 11.81s/it]
 34%|███▍      | 13008/37963 [31:15:15<72:40:16, 10.48s/it]
 34%|███▍      | 13009/37963 [31:15:22<66:36:10,  9.61s/it]
 34%|███▍      | 13010/37963 [31:15:30<62:33:00,  9.02s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '3.29', 'learning_rate': '1.53e-05', 'epoch': '0.3427'}

 34%|███▍      | 13010/37963 [31:15:30<62:33:00,  9.02s/it]
 34%|███▍      | 13011/37963 [31:15:37<59:15:01,  8.55s/it]
 34%|███▍      | 13012/37963 [31:15:44<56:17:54,  8.12s/it]
 34%|███▍      | 13013/37963 [31:15:52<54:53:25,  7.92s/it]
 34%|███▍      | 13014/37963 [31:16:12<80:47:43, 11.66s/it]
 34%|███▍      | 13015/37963 [31:16:20<72:26:31, 10.45s/it]
 34%|███▍      | 13016/37963 [31:16:28<66:41:21,  9.62s/it]
 34%|███▍      | 13017/37963 [31:16:35<62:38:03,  9.04s/it]
 34%|███▍      | 13018/37963 [31:16:43<59:37:48,  8.61s/it]
 34%|███▍      | 13019/37963 [31:16:57<71:19:49, 10.29s/it]
 34%|███▍      | 13020/37963 [31:17:05<65:38:36,  9.47s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '2.553', 'learning_rate': '1.529e-05', 'epoch': '0.343'}

 34%|███▍      | 13020/37963 [31:17:05<65:38:36,  9.47s/it]
 34%|███▍      | 13021/37963 [31:17:19<75:01:42, 10.83s/it]
 34%|███▍      | 13022/37963 [31:17:26<68:12:16,  9.84s/it]
 34%|███▍      | 13023/37963 [31:17:34<63:26:54,  9.16s/it]
 34%|███▍      | 13024/37963 [31:17:41<60:06:13,  8.68s/it]
 34%|███▍      | 13025/37963 [31:17:49<57:40:51,  8.33s/it]
 34%|███▍      | 13026/37963 [31:18:02<68:46:21,  9.93s/it]
 34%|███▍      | 13027/37963 [31:18:10<63:23:39,  9.15s/it]
 34%|███▍      | 13028/37963 [31:18:17<60:02:25,  8.67s/it]
 34%|███▍      | 13029/37963 [31:18:25<57:42:02,  8.33s/it]
 34%|███▍      | 13030/37963 [31:18:32<55:58:00,  8.08s/it]
                                                           
{'loss': '0.1786', 'grad_norm': '2.324', 'learning_rate': '1.528e-05', 'epoch': '0.3432'}

 34%|███▍      | 13030/37963 [31:18:32<55:58:00,  8.08s/it]
 34%|███▍      | 13031/37963 [31:18:40<55:17:05,  7.98s/it]
 34%|███▍      | 13032/37963 [31:18:48<54:20:24,  7.85s/it]
 34%|███▍      | 13033/37963 [31:18:55<53:49:35,  7.77s/it]
 34%|███▍      | 13034/37963 [31:19:03<53:16:27,  7.69s/it]
 34%|███▍      | 13035/37963 [31:19:10<53:09:45,  7.68s/it]
 34%|███▍      | 13036/37963 [31:19:24<65:30:31,  9.46s/it]
 34%|███▍      | 13037/37963 [31:19:32<61:35:25,  8.90s/it]
 34%|███▍      | 13038/37963 [31:19:39<58:41:50,  8.48s/it]
 34%|███▍      | 13039/37963 [31:19:46<56:24:10,  8.15s/it]
 34%|███▍      | 13040/37963 [31:19:54<55:15:12,  7.98s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.988', 'learning_rate': '1.527e-05', 'epoch': '0.3435'}

 34%|███▍      | 13040/37963 [31:19:54<55:15:12,  7.98s/it]
 34%|███▍      | 13041/37963 [31:20:02<54:37:23,  7.89s/it]
 34%|███▍      | 13042/37963 [31:20:09<54:17:00,  7.84s/it]
 34%|███▍      | 13043/37963 [31:20:17<53:32:33,  7.73s/it]
 34%|███▍      | 13044/37963 [31:20:25<53:13:52,  7.69s/it]
 34%|███▍      | 13045/37963 [31:20:32<52:55:18,  7.65s/it]
 34%|███▍      | 13046/37963 [31:20:40<52:39:55,  7.61s/it]
 34%|███▍      | 13047/37963 [31:20:47<52:34:28,  7.60s/it]
 34%|███▍      | 13048/37963 [31:20:55<52:35:31,  7.60s/it]
 34%|███▍      | 13049/37963 [31:21:09<65:57:12,  9.53s/it]
 34%|███▍      | 13050/37963 [31:21:16<61:51:45,  8.94s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '5.049', 'learning_rate': '1.527e-05', 'epoch': '0.3438'}

 34%|███▍      | 13050/37963 [31:21:16<61:51:45,  8.94s/it]
 34%|███▍      | 13051/37963 [31:21:24<58:40:36,  8.48s/it]
 34%|███▍      | 13052/37963 [31:21:31<56:51:00,  8.22s/it]
 34%|███▍      | 13053/37963 [31:21:39<55:38:06,  8.04s/it]
 34%|███▍      | 13054/37963 [31:21:47<54:43:28,  7.91s/it]
 34%|███▍      | 13055/37963 [31:21:54<53:52:08,  7.79s/it]
 34%|███▍      | 13056/37963 [31:22:02<53:27:00,  7.73s/it]
 34%|███▍      | 13057/37963 [31:22:09<53:20:54,  7.71s/it]
 34%|███▍      | 13058/37963 [31:22:23<66:00:51,  9.54s/it]
 34%|███▍      | 13059/37963 [31:22:31<62:16:51,  9.00s/it]
 34%|███▍      | 13060/37963 [31:22:39<59:17:20,  8.57s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '3.652', 'learning_rate': '1.526e-05', 'epoch': '0.344'}

 34%|███▍      | 13060/37963 [31:22:39<59:17:20,  8.57s/it]
 34%|███▍      | 13061/37963 [31:22:46<57:12:06,  8.27s/it]
 34%|███▍      | 13062/37963 [31:23:00<69:02:20,  9.98s/it]
 34%|███▍      | 13063/37963 [31:23:14<78:18:04, 11.32s/it]
 34%|███▍      | 13064/37963 [31:23:22<70:39:45, 10.22s/it]
 34%|███▍      | 13065/37963 [31:23:30<65:02:59,  9.41s/it]
 34%|███▍      | 13066/37963 [31:23:37<61:19:20,  8.87s/it]
 34%|███▍      | 13067/37963 [31:23:45<58:38:51,  8.48s/it]
 34%|███▍      | 13068/37963 [31:23:52<56:37:20,  8.19s/it]
 34%|███▍      | 13069/37963 [31:24:06<68:59:16,  9.98s/it]
 34%|███▍      | 13070/37963 [31:24:14<64:11:10,  9.28s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '3.101', 'learning_rate': '1.525e-05', 'epoch': '0.3443'}

 34%|███▍      | 13070/37963 [31:24:14<64:11:10,  9.28s/it]
 34%|███▍      | 13071/37963 [31:24:22<60:33:37,  8.76s/it]
 34%|███▍      | 13072/37963 [31:24:29<58:10:31,  8.41s/it]
 34%|███▍      | 13073/37963 [31:24:37<56:18:49,  8.15s/it]
 34%|███▍      | 13074/37963 [31:24:44<55:12:46,  7.99s/it]
 34%|███▍      | 13075/37963 [31:24:52<54:21:38,  7.86s/it]
 34%|███▍      | 13076/37963 [31:25:00<53:39:35,  7.76s/it]
 34%|███▍      | 13077/37963 [31:25:13<66:02:30,  9.55s/it]
 34%|███▍      | 13078/37963 [31:25:21<62:13:48,  9.00s/it]
 34%|███▍      | 13079/37963 [31:25:29<59:18:01,  8.58s/it]
 34%|███▍      | 13080/37963 [31:25:36<56:47:43,  8.22s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '2.622', 'learning_rate': '1.525e-05', 'epoch': '0.3445'}

 34%|███▍      | 13080/37963 [31:25:36<56:47:43,  8.22s/it]
 34%|███▍      | 13081/37963 [31:25:50<68:56:33,  9.97s/it]
 34%|███▍      | 13082/37963 [31:25:58<64:27:55,  9.33s/it]
 34%|███▍      | 13083/37963 [31:26:06<61:02:36,  8.83s/it]
 34%|███▍      | 13084/37963 [31:26:13<59:08:10,  8.56s/it]
 34%|███▍      | 13085/37963 [31:26:21<57:10:10,  8.27s/it]
 34%|███▍      | 13086/37963 [31:26:29<56:04:21,  8.11s/it]
 34%|███▍      | 13087/37963 [31:26:36<54:17:28,  7.86s/it]
 34%|███▍      | 13088/37963 [31:26:44<53:40:21,  7.77s/it]
 34%|███▍      | 13089/37963 [31:26:51<53:20:42,  7.72s/it]
 34%|███▍      | 13090/37963 [31:26:59<53:20:43,  7.72s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '0.6624', 'learning_rate': '1.524e-05', 'epoch': '0.3448'}

 34%|███▍      | 13090/37963 [31:26:59<53:20:43,  7.72s/it]
 34%|███▍      | 13091/37963 [31:27:06<52:48:11,  7.64s/it]
 34%|███▍      | 13092/37963 [31:27:14<52:44:46,  7.63s/it]
 34%|███▍      | 13093/37963 [31:27:21<52:07:35,  7.55s/it]
 34%|███▍      | 13094/37963 [31:27:35<65:13:12,  9.44s/it]
 34%|███▍      | 13095/37963 [31:27:43<61:23:03,  8.89s/it]
 34%|███▍      | 13096/37963 [31:27:50<58:41:18,  8.50s/it]
 34%|███▍      | 13097/37963 [31:27:58<56:38:34,  8.20s/it]
 35%|███▍      | 13098/37963 [31:28:06<55:24:52,  8.02s/it]
 35%|███▍      | 13099/37963 [31:28:13<54:20:18,  7.87s/it]
 35%|███▍      | 13100/37963 [31:28:21<53:37:38,  7.76s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.199', 'learning_rate': '1.523e-05', 'epoch': '0.3451'}

 35%|███▍      | 13100/37963 [31:28:21<53:37:38,  7.76s/it]
 35%|███▍      | 13101/37963 [31:28:28<53:11:03,  7.70s/it]
 35%|███▍      | 13102/37963 [31:28:36<53:09:04,  7.70s/it]
 35%|███▍      | 13103/37963 [31:28:43<53:03:01,  7.68s/it]
 35%|███▍      | 13104/37963 [31:28:51<52:34:51,  7.61s/it]
 35%|███▍      | 13105/37963 [31:28:58<51:54:12,  7.52s/it]
 35%|███▍      | 13106/37963 [31:29:06<51:56:59,  7.52s/it]
 35%|███▍      | 13107/37963 [31:29:13<51:46:30,  7.50s/it]
 35%|███▍      | 13108/37963 [31:29:21<51:34:44,  7.47s/it]
 35%|███▍      | 13109/37963 [31:29:28<51:44:51,  7.50s/it]
 35%|███▍      | 13110/37963 [31:29:42<65:27:22,  9.48s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.61', 'learning_rate': '1.522e-05', 'epoch': '0.3453'}

 35%|███▍      | 13110/37963 [31:29:42<65:27:22,  9.48s/it]
 35%|███▍      | 13111/37963 [31:30:03<88:31:28, 12.82s/it]
 35%|███▍      | 13112/37963 [31:30:10<77:14:53, 11.19s/it]
 35%|███▍      | 13113/37963 [31:30:18<69:40:41, 10.09s/it]
 35%|███▍      | 13114/37963 [31:30:32<77:36:00, 11.24s/it]
 35%|███▍      | 13115/37963 [31:30:39<70:09:33, 10.16s/it]
 35%|███▍      | 13116/37963 [31:30:47<64:44:20,  9.38s/it]
 35%|███▍      | 13117/37963 [31:30:54<61:00:07,  8.84s/it]
 35%|███▍      | 13118/37963 [31:31:02<58:18:45,  8.45s/it]
 35%|███▍      | 13119/37963 [31:31:10<56:39:25,  8.21s/it]
 35%|███▍      | 13120/37963 [31:31:17<55:12:03,  8.00s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '4.204', 'learning_rate': '1.522e-05', 'epoch': '0.3456'}

 35%|███▍      | 13120/37963 [31:31:17<55:12:03,  8.00s/it]
 35%|███▍      | 13121/37963 [31:31:31<67:38:31,  9.80s/it]
 35%|███▍      | 13122/37963 [31:31:39<63:10:16,  9.15s/it]
 35%|███▍      | 13123/37963 [31:31:46<60:04:35,  8.71s/it]
 35%|███▍      | 13124/37963 [31:31:54<57:39:24,  8.36s/it]
 35%|███▍      | 13125/37963 [31:32:08<69:11:42, 10.03s/it]
 35%|███▍      | 13126/37963 [31:32:22<77:39:21, 11.26s/it]
 35%|███▍      | 13127/37963 [31:32:30<69:50:22, 10.12s/it]
 35%|███▍      | 13128/37963 [31:32:37<64:28:24,  9.35s/it]
 35%|███▍      | 13129/37963 [31:32:45<60:56:52,  8.84s/it]
 35%|███▍      | 13130/37963 [31:32:52<58:22:18,  8.46s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '2.756', 'learning_rate': '1.521e-05', 'epoch': '0.3459'}

 35%|███▍      | 13130/37963 [31:32:52<58:22:18,  8.46s/it]
 35%|███▍      | 13131/37963 [31:33:00<56:24:49,  8.18s/it]
 35%|███▍      | 13132/37963 [31:33:07<55:03:43,  7.98s/it]
 35%|███▍      | 13133/37963 [31:33:15<53:57:36,  7.82s/it]
 35%|███▍      | 13134/37963 [31:33:22<53:33:41,  7.77s/it]
 35%|███▍      | 13135/37963 [31:33:30<53:10:21,  7.71s/it]
 35%|███▍      | 13136/37963 [31:33:38<52:49:12,  7.66s/it]
 35%|███▍      | 13137/37963 [31:33:52<65:54:58,  9.56s/it]
 35%|███▍      | 13138/37963 [31:33:59<62:10:17,  9.02s/it]
 35%|███▍      | 13139/37963 [31:34:07<58:43:20,  8.52s/it]
 35%|███▍      | 13140/37963 [31:34:14<56:36:35,  8.21s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '1.366', 'learning_rate': '1.52e-05', 'epoch': '0.3461'}

 35%|███▍      | 13140/37963 [31:34:14<56:36:35,  8.21s/it]
 35%|███▍      | 13141/37963 [31:34:22<55:20:30,  8.03s/it]
 35%|███▍      | 13142/37963 [31:34:29<54:30:10,  7.91s/it]
 35%|███▍      | 13143/37963 [31:34:37<53:53:11,  7.82s/it]
 35%|███▍      | 13144/37963 [31:34:44<52:33:51,  7.62s/it]
 35%|███▍      | 13145/37963 [31:34:52<52:33:45,  7.62s/it]
 35%|███▍      | 13146/37963 [31:34:59<52:26:26,  7.61s/it]
 35%|███▍      | 13147/37963 [31:35:07<51:59:05,  7.54s/it]
 35%|███▍      | 13148/37963 [31:35:14<52:02:52,  7.55s/it]
 35%|███▍      | 13149/37963 [31:35:22<52:05:02,  7.56s/it]
 35%|███▍      | 13150/37963 [31:35:29<51:47:32,  7.51s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '1.589', 'learning_rate': '1.519e-05', 'epoch': '0.3464'}

 35%|███▍      | 13150/37963 [31:35:29<51:47:32,  7.51s/it]
 35%|███▍      | 13151/37963 [31:35:37<51:47:30,  7.51s/it]
 35%|███▍      | 13152/37963 [31:35:44<51:48:58,  7.52s/it]
 35%|███▍      | 13153/37963 [31:35:52<51:53:58,  7.53s/it]
 35%|███▍      | 13154/37963 [31:35:59<51:58:19,  7.54s/it]
 35%|███▍      | 13155/37963 [31:36:07<52:14:23,  7.58s/it]
 35%|███▍      | 13156/37963 [31:36:21<65:27:02,  9.50s/it]
 35%|███▍      | 13157/37963 [31:36:29<61:25:39,  8.91s/it]
 35%|███▍      | 13158/37963 [31:36:36<58:35:01,  8.50s/it]
 35%|███▍      | 13159/37963 [31:36:50<70:00:47, 10.16s/it]
 35%|███▍      | 13160/37963 [31:36:58<64:31:06,  9.36s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.603', 'learning_rate': '1.519e-05', 'epoch': '0.3467'}

 35%|███▍      | 13160/37963 [31:36:58<64:31:06,  9.36s/it]
 35%|███▍      | 13161/37963 [31:37:12<73:41:11, 10.70s/it]
 35%|███▍      | 13162/37963 [31:37:19<67:05:54,  9.74s/it]
 35%|███▍      | 13163/37963 [31:37:26<62:16:27,  9.04s/it]
 35%|███▍      | 13164/37963 [31:37:40<72:35:39, 10.54s/it]
 35%|███▍      | 13165/37963 [31:37:48<66:07:43,  9.60s/it]
 35%|███▍      | 13166/37963 [31:37:55<61:52:57,  8.98s/it]
 35%|███▍      | 13167/37963 [31:38:03<59:16:08,  8.60s/it]
 35%|███▍      | 13168/37963 [31:38:11<56:54:24,  8.26s/it]
 35%|███▍      | 13169/37963 [31:38:18<55:28:59,  8.06s/it]
 35%|███▍      | 13170/37963 [31:38:26<54:33:31,  7.92s/it]
                                                           
{'loss': '0.144', 'grad_norm': '1.074', 'learning_rate': '1.518e-05', 'epoch': '0.3469'}

 35%|███▍      | 13170/37963 [31:38:26<54:33:31,  7.92s/it]
 35%|███▍      | 13171/37963 [31:38:33<53:44:05,  7.80s/it]
 35%|███▍      | 13172/37963 [31:38:41<53:15:37,  7.73s/it]
 35%|███▍      | 13173/37963 [31:39:02<79:49:07, 11.59s/it]
 35%|███▍      | 13174/37963 [31:39:09<71:06:18, 10.33s/it]
 35%|███▍      | 13175/37963 [31:39:16<65:24:34,  9.50s/it]
 35%|███▍      | 13176/37963 [31:39:30<74:04:23, 10.76s/it]
 35%|███▍      | 13177/37963 [31:39:38<67:28:12,  9.80s/it]
 35%|███▍      | 13178/37963 [31:39:45<62:44:00,  9.11s/it]
 35%|███▍      | 13179/37963 [31:39:53<59:02:10,  8.58s/it]
 35%|███▍      | 13180/37963 [31:40:00<57:13:18,  8.31s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '3.816', 'learning_rate': '1.517e-05', 'epoch': '0.3472'}

 35%|███▍      | 13180/37963 [31:40:00<57:13:18,  8.31s/it]
 35%|███▍      | 13181/37963 [31:40:08<55:44:31,  8.10s/it]
 35%|███▍      | 13182/37963 [31:40:15<54:39:30,  7.94s/it]
 35%|███▍      | 13183/37963 [31:40:23<53:56:30,  7.84s/it]
 35%|███▍      | 13184/37963 [31:40:31<53:15:16,  7.74s/it]
 35%|███▍      | 13185/37963 [31:40:38<52:45:16,  7.66s/it]
 35%|███▍      | 13186/37963 [31:40:45<51:40:01,  7.51s/it]
 35%|███▍      | 13187/37963 [31:40:53<51:45:09,  7.52s/it]
 35%|███▍      | 13188/37963 [31:41:00<51:43:02,  7.51s/it]
 35%|███▍      | 13189/37963 [31:41:08<51:45:19,  7.52s/it]
 35%|███▍      | 13190/37963 [31:41:16<52:20:57,  7.61s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '3.535', 'learning_rate': '1.517e-05', 'epoch': '0.3474'}

 35%|███▍      | 13190/37963 [31:41:16<52:20:57,  7.61s/it]
 35%|███▍      | 13191/37963 [31:41:29<65:25:12,  9.51s/it]
 35%|███▍      | 13192/37963 [31:41:37<61:29:36,  8.94s/it]
 35%|███▍      | 13193/37963 [31:41:44<58:19:54,  8.48s/it]
 35%|███▍      | 13194/37963 [31:41:52<56:08:18,  8.16s/it]
 35%|███▍      | 13195/37963 [31:41:59<54:24:18,  7.91s/it]
 35%|███▍      | 13196/37963 [31:42:07<53:39:46,  7.80s/it]
 35%|███▍      | 13197/37963 [31:42:14<53:14:52,  7.74s/it]
 35%|███▍      | 13198/37963 [31:42:22<52:24:46,  7.62s/it]
 35%|███▍      | 13199/37963 [31:42:29<52:14:34,  7.59s/it]
 35%|███▍      | 13200/37963 [31:42:43<65:44:36,  9.56s/it]
                                                           
{'loss': '0.1729', 'grad_norm': '3.084', 'learning_rate': '1.516e-05', 'epoch': '0.3477'}

 35%|███▍      | 13200/37963 [31:42:43<65:44:36,  9.56s/it]
 35%|███▍      | 13201/37963 [31:42:51<62:13:32,  9.05s/it]
 35%|███▍      | 13202/37963 [31:42:59<58:53:32,  8.56s/it]
 35%|███▍      | 13203/37963 [31:43:06<56:43:16,  8.25s/it]
 35%|███▍      | 13204/37963 [31:43:13<54:42:28,  7.95s/it]
 35%|███▍      | 13205/37963 [31:43:28<67:18:33,  9.79s/it]
 35%|███▍      | 13206/37963 [31:43:35<62:17:09,  9.06s/it]
 35%|███▍      | 13207/37963 [31:43:42<59:11:18,  8.61s/it]
 35%|███▍      | 13208/37963 [31:43:50<57:13:18,  8.32s/it]
 35%|███▍      | 13209/37963 [31:43:58<55:43:02,  8.10s/it]
 35%|███▍      | 13210/37963 [31:44:05<54:31:58,  7.93s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '2.456', 'learning_rate': '1.515e-05', 'epoch': '0.348'}

 35%|███▍      | 13210/37963 [31:44:05<54:31:58,  7.93s/it]
 35%|███▍      | 13211/37963 [31:44:21<70:04:10, 10.19s/it]
 35%|███▍      | 13212/37963 [31:44:28<65:10:12,  9.48s/it]
 35%|███▍      | 13213/37963 [31:44:36<61:08:14,  8.89s/it]
 35%|███▍      | 13214/37963 [31:44:51<73:46:23, 10.73s/it]
 35%|███▍      | 13215/37963 [31:44:59<67:14:28,  9.78s/it]
 35%|███▍      | 13216/37963 [31:45:06<62:58:49,  9.16s/it]
 35%|███▍      | 13217/37963 [31:45:15<62:37:11,  9.11s/it]
 35%|███▍      | 13218/37963 [31:45:23<60:37:32,  8.82s/it]
 35%|███▍      | 13219/37963 [31:45:31<58:08:26,  8.46s/it]
 35%|███▍      | 13220/37963 [31:45:39<56:05:27,  8.16s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.239', 'learning_rate': '1.514e-05', 'epoch': '0.3482'}

 35%|███▍      | 13220/37963 [31:45:39<56:05:27,  8.16s/it]
 35%|███▍      | 13221/37963 [31:45:54<70:20:52, 10.24s/it]
 35%|███▍      | 13222/37963 [31:46:01<65:16:38,  9.50s/it]
 35%|███▍      | 13223/37963 [31:46:09<61:25:55,  8.94s/it]
 35%|███▍      | 13224/37963 [31:46:17<58:43:20,  8.55s/it]
 35%|███▍      | 13225/37963 [31:46:24<56:58:04,  8.29s/it]
 35%|███▍      | 13226/37963 [31:46:39<71:02:06, 10.34s/it]
 35%|███▍      | 13227/37963 [31:46:47<65:34:45,  9.54s/it]
 35%|███▍      | 13228/37963 [31:46:55<61:25:42,  8.94s/it]
 35%|███▍      | 13229/37963 [31:47:02<58:48:35,  8.56s/it]
 35%|███▍      | 13230/37963 [31:47:10<57:04:58,  8.31s/it]
                                                           
{'loss': '0.1728', 'grad_norm': '1.946', 'learning_rate': '1.514e-05', 'epoch': '0.3485'}

 35%|███▍      | 13230/37963 [31:47:10<57:04:58,  8.31s/it]
 35%|███▍      | 13231/37963 [31:47:17<55:10:59,  8.03s/it]
 35%|███▍      | 13232/37963 [31:47:25<54:58:34,  8.00s/it]
 35%|███▍      | 13233/37963 [31:47:33<53:41:09,  7.82s/it]
 35%|███▍      | 13234/37963 [31:47:40<53:13:57,  7.75s/it]
 35%|███▍      | 13235/37963 [31:47:48<53:01:10,  7.72s/it]
 35%|███▍      | 13236/37963 [31:47:56<53:00:27,  7.72s/it]
 35%|███▍      | 13237/37963 [31:48:04<53:52:39,  7.84s/it]
 35%|███▍      | 13238/37963 [31:48:11<53:15:27,  7.75s/it]
 35%|███▍      | 13239/37963 [31:48:19<53:02:08,  7.72s/it]
 35%|███▍      | 13240/37963 [31:48:27<52:48:31,  7.69s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '1.227', 'learning_rate': '1.513e-05', 'epoch': '0.3488'}

 35%|███▍      | 13240/37963 [31:48:27<52:48:31,  7.69s/it]
 35%|███▍      | 13241/37963 [31:48:34<52:41:57,  7.67s/it]
 35%|███▍      | 13242/37963 [31:48:50<68:31:29,  9.98s/it]
 35%|███▍      | 13243/37963 [31:48:57<63:43:05,  9.28s/it]
 35%|███▍      | 13244/37963 [31:49:05<60:17:39,  8.78s/it]
 35%|███▍      | 13245/37963 [31:49:13<58:17:54,  8.49s/it]
 35%|███▍      | 13246/37963 [31:49:21<58:03:51,  8.46s/it]
 35%|███▍      | 13247/37963 [31:49:36<71:34:45, 10.43s/it]
 35%|███▍      | 13248/37963 [31:49:44<65:38:01,  9.56s/it]
 35%|███▍      | 13249/37963 [31:49:51<61:39:51,  8.98s/it]
 35%|███▍      | 13250/37963 [31:49:59<59:18:01,  8.64s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '2.312', 'learning_rate': '1.512e-05', 'epoch': '0.349'}

 35%|███▍      | 13250/37963 [31:49:59<59:18:01,  8.64s/it]
 35%|███▍      | 13251/37963 [31:50:07<56:56:59,  8.30s/it]
 35%|███▍      | 13252/37963 [31:50:15<56:26:05,  8.22s/it]
 35%|███▍      | 13253/37963 [31:50:29<69:23:28, 10.11s/it]
 35%|███▍      | 13254/37963 [31:50:37<65:23:36,  9.53s/it]
 35%|███▍      | 13255/37963 [31:50:45<61:34:57,  8.97s/it]
 35%|███▍      | 13256/37963 [31:50:53<58:48:01,  8.57s/it]
 35%|███▍      | 13257/37963 [31:51:01<57:25:00,  8.37s/it]
 35%|███▍      | 13258/37963 [31:51:08<56:23:05,  8.22s/it]
 35%|███▍      | 13259/37963 [31:51:25<73:05:33, 10.65s/it]
 35%|███▍      | 13260/37963 [31:51:33<68:14:58,  9.95s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.597', 'learning_rate': '1.511e-05', 'epoch': '0.3493'}

 35%|███▍      | 13260/37963 [31:51:33<68:14:58,  9.95s/it]
 35%|███▍      | 13261/37963 [31:51:41<63:25:58,  9.24s/it]
 35%|███▍      | 13262/37963 [31:51:48<60:07:46,  8.76s/it]
 35%|███▍      | 13263/37963 [31:51:56<57:49:36,  8.43s/it]
 35%|███▍      | 13264/37963 [31:52:04<56:05:05,  8.17s/it]
 35%|███▍      | 13265/37963 [31:52:18<68:59:07, 10.06s/it]
 35%|███▍      | 13266/37963 [31:52:26<64:02:10,  9.33s/it]
 35%|███▍      | 13267/37963 [31:52:40<75:20:52, 10.98s/it]
 35%|███▍      | 13268/37963 [31:52:48<68:43:45, 10.02s/it]
 35%|███▍      | 13269/37963 [31:53:03<77:44:51, 11.33s/it]
 35%|███▍      | 13270/37963 [31:53:10<70:15:45, 10.24s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.122', 'learning_rate': '1.511e-05', 'epoch': '0.3496'}

 35%|███▍      | 13270/37963 [31:53:10<70:15:45, 10.24s/it]
 35%|███▍      | 13271/37963 [31:53:18<64:53:58,  9.46s/it]
 35%|███▍      | 13272/37963 [31:53:25<60:50:40,  8.87s/it]
 35%|███▍      | 13273/37963 [31:53:33<58:19:58,  8.51s/it]
 35%|███▍      | 13274/37963 [31:53:41<56:10:20,  8.19s/it]
 35%|███▍      | 13275/37963 [31:53:48<55:02:51,  8.03s/it]
 35%|███▍      | 13276/37963 [31:54:02<67:47:52,  9.89s/it]
 35%|███▍      | 13277/37963 [31:54:10<63:05:18,  9.20s/it]
 35%|███▍      | 13278/37963 [31:54:18<59:55:32,  8.74s/it]
 35%|███▍      | 13279/37963 [31:54:25<57:52:04,  8.44s/it]
 35%|███▍      | 13280/37963 [31:54:33<56:10:38,  8.19s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.799', 'learning_rate': '1.51e-05', 'epoch': '0.3498'}

 35%|███▍      | 13280/37963 [31:54:33<56:10:38,  8.19s/it]
 35%|███▍      | 13281/37963 [31:54:41<55:11:30,  8.05s/it]
 35%|███▍      | 13282/37963 [31:54:48<54:17:15,  7.92s/it]
 35%|███▍      | 13283/37963 [31:54:56<53:51:34,  7.86s/it]
 35%|███▍      | 13284/37963 [31:55:04<53:19:20,  7.78s/it]
 35%|███▍      | 13285/37963 [31:55:11<52:57:00,  7.72s/it]
 35%|███▍      | 13286/37963 [31:55:27<68:30:09,  9.99s/it]
 35%|███▍      | 13287/37963 [31:55:34<63:24:32,  9.25s/it]
 35%|███▌      | 13288/37963 [31:55:42<60:07:24,  8.77s/it]
 35%|███▌      | 13289/37963 [31:55:49<57:46:37,  8.43s/it]
 35%|███▌      | 13290/37963 [31:55:57<56:17:31,  8.21s/it]
                                                           
{'loss': '0.1844', 'grad_norm': '3.797', 'learning_rate': '1.509e-05', 'epoch': '0.3501'}

 35%|███▌      | 13290/37963 [31:55:57<56:17:31,  8.21s/it]
 35%|███▌      | 13291/37963 [31:56:05<54:52:48,  8.01s/it]
 35%|███▌      | 13292/37963 [31:56:12<54:11:16,  7.91s/it]
 35%|███▌      | 13293/37963 [31:56:28<69:22:47, 10.12s/it]
 35%|███▌      | 13294/37963 [31:56:36<64:49:50,  9.46s/it]
 35%|███▌      | 13295/37963 [31:56:43<61:10:38,  8.93s/it]
 35%|███▌      | 13296/37963 [31:56:51<58:16:26,  8.50s/it]
 35%|███▌      | 13297/37963 [31:56:58<56:24:57,  8.23s/it]
 35%|███▌      | 13298/37963 [31:57:06<55:09:55,  8.05s/it]
 35%|███▌      | 13299/37963 [31:57:21<68:45:57, 10.04s/it]
 35%|███▌      | 13300/37963 [31:57:29<64:26:00,  9.41s/it]
                                                           
{'loss': '0.157', 'grad_norm': '4.122', 'learning_rate': '1.508e-05', 'epoch': '0.3503'}

 35%|███▌      | 13300/37963 [31:57:29<64:26:00,  9.41s/it]
 35%|███▌      | 13301/37963 [31:57:36<60:12:24,  8.79s/it]
 35%|███▌      | 13302/37963 [31:57:44<57:59:48,  8.47s/it]
 35%|███▌      | 13303/37963 [31:57:58<69:24:46, 10.13s/it]
 35%|███▌      | 13304/37963 [31:58:05<64:21:04,  9.39s/it]
 35%|███▌      | 13305/37963 [31:58:13<60:45:19,  8.87s/it]
 35%|███▌      | 13306/37963 [31:58:21<58:17:13,  8.51s/it]
 35%|███▌      | 13307/37963 [31:58:28<55:58:06,  8.17s/it]
 35%|███▌      | 13308/37963 [31:58:36<54:47:26,  8.00s/it]
 35%|███▌      | 13309/37963 [31:58:43<53:49:09,  7.86s/it]
 35%|███▌      | 13310/37963 [31:58:51<53:25:52,  7.80s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '2.033', 'learning_rate': '1.508e-05', 'epoch': '0.3506'}

 35%|███▌      | 13310/37963 [31:58:51<53:25:52,  7.80s/it]
 35%|███▌      | 13311/37963 [31:58:58<53:01:44,  7.74s/it]
 35%|███▌      | 13312/37963 [31:59:06<52:59:14,  7.74s/it]
 35%|███▌      | 13313/37963 [31:59:14<52:48:37,  7.71s/it]
 35%|███▌      | 13314/37963 [31:59:21<52:07:09,  7.61s/it]
 35%|███▌      | 13315/37963 [31:59:29<52:08:40,  7.62s/it]
 35%|███▌      | 13316/37963 [31:59:37<52:25:05,  7.66s/it]
 35%|███▌      | 13317/37963 [31:59:51<66:38:09,  9.73s/it]
 35%|███▌      | 13318/37963 [31:59:59<61:59:53,  9.06s/it]
 35%|███▌      | 13319/37963 [32:00:06<58:28:25,  8.54s/it]
 35%|███▌      | 13320/37963 [32:00:14<56:38:23,  8.27s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.093', 'learning_rate': '1.507e-05', 'epoch': '0.3509'}

 35%|███▌      | 13320/37963 [32:00:14<56:38:23,  8.27s/it]
 35%|███▌      | 13321/37963 [32:00:34<82:13:23, 12.01s/it]
 35%|███▌      | 13322/37963 [32:00:49<87:58:09, 12.85s/it]
 35%|███▌      | 13323/37963 [32:00:57<76:53:47, 11.23s/it]
 35%|███▌      | 13324/37963 [32:01:04<69:42:09, 10.18s/it]
 35%|███▌      | 13325/37963 [32:01:12<64:11:38,  9.38s/it]
 35%|███▌      | 13326/37963 [32:01:19<60:34:39,  8.85s/it]
 35%|███▌      | 13327/37963 [32:01:27<58:14:03,  8.51s/it]
 35%|███▌      | 13328/37963 [32:01:35<56:34:59,  8.27s/it]
 35%|███▌      | 13329/37963 [32:01:43<55:16:07,  8.08s/it]
 35%|███▌      | 13330/37963 [32:01:50<54:07:41,  7.91s/it]
                                                           
{'loss': '0.174', 'grad_norm': '2.998', 'learning_rate': '1.506e-05', 'epoch': '0.3511'}

 35%|███▌      | 13330/37963 [32:01:50<54:07:41,  7.91s/it]
 35%|███▌      | 13331/37963 [32:01:58<53:34:40,  7.83s/it]
 35%|███▌      | 13332/37963 [32:02:05<53:11:04,  7.77s/it]
 35%|███▌      | 13333/37963 [32:02:13<52:35:36,  7.69s/it]
 35%|███▌      | 13334/37963 [32:02:21<52:35:22,  7.69s/it]
 35%|███▌      | 13335/37963 [32:02:28<52:17:22,  7.64s/it]
 35%|███▌      | 13336/37963 [32:02:36<52:24:14,  7.66s/it]
 35%|███▌      | 13337/37963 [32:02:43<52:25:34,  7.66s/it]
 35%|███▌      | 13338/37963 [32:02:51<51:38:56,  7.55s/it]
 35%|███▌      | 13339/37963 [32:02:58<51:22:26,  7.51s/it]
 35%|███▌      | 13340/37963 [32:03:12<64:57:46,  9.50s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '2.275', 'learning_rate': '1.506e-05', 'epoch': '0.3514'}

 35%|███▌      | 13340/37963 [32:03:12<64:57:46,  9.50s/it]
 35%|███▌      | 13341/37963 [32:03:20<61:27:26,  8.99s/it]
 35%|███▌      | 13342/37963 [32:03:35<73:42:03, 10.78s/it]
 35%|███▌      | 13343/37963 [32:03:50<81:53:58, 11.98s/it]
 35%|███▌      | 13344/37963 [32:03:58<73:43:36, 10.78s/it]
 35%|███▌      | 13345/37963 [32:04:05<67:13:33,  9.83s/it]
 35%|███▌      | 13346/37963 [32:04:13<62:01:12,  9.07s/it]
 35%|███▌      | 13347/37963 [32:04:20<58:59:18,  8.63s/it]
 35%|███▌      | 13348/37963 [32:04:28<56:19:43,  8.24s/it]
 35%|███▌      | 13349/37963 [32:04:35<55:03:37,  8.05s/it]
 35%|███▌      | 13350/37963 [32:04:43<54:26:47,  7.96s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '1.802', 'learning_rate': '1.505e-05', 'epoch': '0.3517'}

 35%|███▌      | 13350/37963 [32:04:43<54:26:47,  7.96s/it]
 35%|███▌      | 13351/37963 [32:04:51<53:41:28,  7.85s/it]
 35%|███▌      | 13352/37963 [32:04:58<53:13:29,  7.79s/it]
 35%|███▌      | 13353/37963 [32:05:12<66:05:13,  9.67s/it]
 35%|███▌      | 13354/37963 [32:05:20<62:04:48,  9.08s/it]
 35%|███▌      | 13355/37963 [32:05:27<58:45:52,  8.60s/it]
 35%|███▌      | 13356/37963 [32:05:35<56:43:21,  8.30s/it]
 35%|███▌      | 13357/37963 [32:05:43<55:06:37,  8.06s/it]
 35%|███▌      | 13358/37963 [32:05:50<54:08:04,  7.92s/it]
 35%|███▌      | 13359/37963 [32:05:58<53:42:36,  7.86s/it]
 35%|███▌      | 13360/37963 [32:06:06<53:16:50,  7.80s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.025', 'learning_rate': '1.504e-05', 'epoch': '0.3519'}

 35%|███▌      | 13360/37963 [32:06:06<53:16:50,  7.80s/it]
 35%|███▌      | 13361/37963 [32:06:13<52:37:42,  7.70s/it]
 35%|███▌      | 13362/37963 [32:06:21<52:42:35,  7.71s/it]
 35%|███▌      | 13363/37963 [32:06:28<52:37:20,  7.70s/it]
 35%|███▌      | 13364/37963 [32:06:36<52:22:48,  7.67s/it]
 35%|███▌      | 13365/37963 [32:06:57<80:28:05, 11.78s/it]
 35%|███▌      | 13366/37963 [32:07:05<72:21:58, 10.59s/it]
 35%|███▌      | 13367/37963 [32:07:20<80:54:31, 11.84s/it]
 35%|███▌      | 13368/37963 [32:07:28<72:09:58, 10.56s/it]
 35%|███▌      | 13369/37963 [32:07:35<66:05:26,  9.67s/it]
 35%|███▌      | 13370/37963 [32:07:43<61:51:39,  9.06s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '2.264', 'learning_rate': '1.503e-05', 'epoch': '0.3522'}

 35%|███▌      | 13370/37963 [32:07:43<61:51:39,  9.06s/it]
 35%|███▌      | 13371/37963 [32:07:50<58:56:53,  8.63s/it]
 35%|███▌      | 13372/37963 [32:07:58<57:02:47,  8.35s/it]
 35%|███▌      | 13373/37963 [32:08:06<55:39:16,  8.15s/it]
 35%|███▌      | 13374/37963 [32:08:14<54:51:54,  8.03s/it]
 35%|███▌      | 13375/37963 [32:08:28<68:25:19, 10.02s/it]
 35%|███▌      | 13376/37963 [32:08:36<63:46:50,  9.34s/it]
 35%|███▌      | 13377/37963 [32:08:43<60:05:33,  8.80s/it]
 35%|███▌      | 13378/37963 [32:08:51<57:44:27,  8.46s/it]
 35%|███▌      | 13379/37963 [32:08:59<56:03:05,  8.21s/it]
 35%|███▌      | 13380/37963 [32:09:06<54:54:46,  8.04s/it]
                                                           
{'loss': '0.1755', 'grad_norm': '0.8118', 'learning_rate': '1.503e-05', 'epoch': '0.3524'}

 35%|███▌      | 13380/37963 [32:09:06<54:54:46,  8.04s/it]
 35%|███▌      | 13381/37963 [32:09:14<54:22:30,  7.96s/it]
 35%|███▌      | 13382/37963 [32:09:22<54:06:43,  7.92s/it]
 35%|███▌      | 13383/37963 [32:09:30<53:40:05,  7.86s/it]
 35%|███▌      | 13384/37963 [32:09:37<53:07:52,  7.78s/it]
 35%|███▌      | 13385/37963 [32:09:45<52:55:48,  7.75s/it]
 35%|███▌      | 13386/37963 [32:09:52<52:02:24,  7.62s/it]
 35%|███▌      | 13387/37963 [32:10:07<66:30:56,  9.74s/it]
 35%|███▌      | 13388/37963 [32:10:15<62:04:57,  9.09s/it]
 35%|███▌      | 13389/37963 [32:10:29<72:51:01, 10.67s/it]
 35%|███▌      | 13390/37963 [32:10:43<80:21:09, 11.77s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '3.423', 'learning_rate': '1.502e-05', 'epoch': '0.3527'}

 35%|███▌      | 13390/37963 [32:10:43<80:21:09, 11.77s/it]
 35%|███▌      | 13391/37963 [32:10:51<71:13:46, 10.44s/it]
 35%|███▌      | 13392/37963 [32:10:58<65:35:07,  9.61s/it]
 35%|███▌      | 13393/37963 [32:11:06<61:32:46,  9.02s/it]
 35%|███▌      | 13394/37963 [32:11:14<58:42:02,  8.60s/it]
 35%|███▌      | 13395/37963 [32:11:21<56:59:46,  8.35s/it]
 35%|███▌      | 13396/37963 [32:11:29<54:56:13,  8.05s/it]
 35%|███▌      | 13397/37963 [32:11:36<54:00:47,  7.92s/it]
 35%|███▌      | 13398/37963 [32:11:44<53:37:58,  7.86s/it]
 35%|███▌      | 13399/37963 [32:11:52<53:04:31,  7.78s/it]
 35%|███▌      | 13400/37963 [32:11:59<52:39:21,  7.72s/it]
                                                           
{'loss': '0.1575', 'grad_norm': '1.668', 'learning_rate': '1.501e-05', 'epoch': '0.353'}

 35%|███▌      | 13400/37963 [32:11:59<52:39:21,  7.72s/it]
 35%|███▌      | 13401/37963 [32:12:07<52:40:58,  7.72s/it]
 35%|███▌      | 13402/37963 [32:12:21<66:25:56,  9.74s/it]
 35%|███▌      | 13403/37963 [32:12:29<62:17:26,  9.13s/it]
 35%|███▌      | 13404/37963 [32:12:37<59:17:36,  8.69s/it]
 35%|███▌      | 13405/37963 [32:12:44<57:07:13,  8.37s/it]
 35%|███▌      | 13406/37963 [32:12:52<55:45:16,  8.17s/it]
 35%|███▌      | 13407/37963 [32:13:00<54:40:14,  8.01s/it]
 35%|███▌      | 13408/37963 [32:13:07<53:10:18,  7.80s/it]
 35%|███▌      | 13409/37963 [32:13:15<52:52:57,  7.75s/it]
 35%|███▌      | 13410/37963 [32:13:22<52:39:32,  7.72s/it]
                                                           
{'loss': '0.1655', 'grad_norm': '4.665', 'learning_rate': '1.5e-05', 'epoch': '0.3532'}

 35%|███▌      | 13410/37963 [32:13:22<52:39:32,  7.72s/it]
 35%|███▌      | 13411/37963 [32:13:30<52:07:29,  7.64s/it]
 35%|███▌      | 13412/37963 [32:13:44<66:39:48,  9.78s/it]
 35%|███▌      | 13413/37963 [32:13:52<62:38:52,  9.19s/it]
 35%|███▌      | 13414/37963 [32:14:07<73:29:13, 10.78s/it]
 35%|███▌      | 13415/37963 [32:14:14<66:49:46,  9.80s/it]
 35%|███▌      | 13416/37963 [32:14:22<62:27:50,  9.16s/it]
 35%|███▌      | 13417/37963 [32:14:37<73:38:17, 10.80s/it]
 35%|███▌      | 13418/37963 [32:14:44<67:11:27,  9.85s/it]
 35%|███▌      | 13419/37963 [32:14:52<62:35:16,  9.18s/it]
 35%|███▌      | 13420/37963 [32:14:59<59:15:46,  8.69s/it]
                                                           
{'loss': '0.1642', 'grad_norm': '5.163', 'learning_rate': '1.5e-05', 'epoch': '0.3535'}

 35%|███▌      | 13420/37963 [32:14:59<59:15:46,  8.69s/it]
 35%|███▌      | 13421/37963 [32:15:07<56:35:12,  8.30s/it]
 35%|███▌      | 13422/37963 [32:15:14<54:56:08,  8.06s/it]
 35%|███▌      | 13423/37963 [32:15:22<54:01:50,  7.93s/it]
 35%|███▌      | 13424/37963 [32:15:37<67:42:25,  9.93s/it]
 35%|███▌      | 13425/37963 [32:15:44<63:02:31,  9.25s/it]
 35%|███▌      | 13426/37963 [32:15:52<59:43:51,  8.76s/it]
 35%|███▌      | 13427/37963 [32:15:59<57:22:18,  8.42s/it]
 35%|███▌      | 13428/37963 [32:16:07<55:12:55,  8.10s/it]
 35%|███▌      | 13429/37963 [32:16:14<53:32:20,  7.86s/it]
 35%|███▌      | 13430/37963 [32:16:22<53:03:26,  7.79s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.581', 'learning_rate': '1.499e-05', 'epoch': '0.3538'}

 35%|███▌      | 13430/37963 [32:16:22<53:03:26,  7.79s/it]
 35%|███▌      | 13431/37963 [32:16:29<52:38:35,  7.73s/it]
 35%|███▌      | 13432/37963 [32:16:37<52:45:08,  7.74s/it]
 35%|███▌      | 13433/37963 [32:16:45<52:35:35,  7.72s/it]
 35%|███▌      | 13434/37963 [32:16:52<52:29:55,  7.70s/it]
 35%|███▌      | 13435/37963 [32:17:07<66:36:57,  9.78s/it]
 35%|███▌      | 13436/37963 [32:17:15<62:19:45,  9.15s/it]
 35%|███▌      | 13437/37963 [32:17:29<73:32:03, 10.79s/it]
 35%|███▌      | 13438/37963 [32:17:37<67:16:10,  9.87s/it]
 35%|███▌      | 13439/37963 [32:17:45<62:46:48,  9.22s/it]
 35%|███▌      | 13440/37963 [32:17:52<59:38:18,  8.75s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '4.699', 'learning_rate': '1.498e-05', 'epoch': '0.354'}

 35%|███▌      | 13440/37963 [32:17:52<59:38:18,  8.75s/it]
 35%|███▌      | 13441/37963 [32:18:00<57:29:06,  8.44s/it]
 35%|███▌      | 13442/37963 [32:18:07<55:06:45,  8.09s/it]
 35%|███▌      | 13443/37963 [32:18:22<67:38:10,  9.93s/it]
 35%|███▌      | 13444/37963 [32:18:29<62:43:47,  9.21s/it]
 35%|███▌      | 13445/37963 [32:18:37<59:25:17,  8.72s/it]
 35%|███▌      | 13446/37963 [32:18:44<57:25:51,  8.43s/it]
 35%|███▌      | 13447/37963 [32:18:52<55:52:10,  8.20s/it]
 35%|███▌      | 13448/37963 [32:19:00<54:42:20,  8.03s/it]
 35%|███▌      | 13449/37963 [32:19:07<54:01:38,  7.93s/it]
 35%|███▌      | 13450/37963 [32:19:15<53:02:52,  7.79s/it]
                                                           
{'loss': '0.167', 'grad_norm': '3.359', 'learning_rate': '1.497e-05', 'epoch': '0.3543'}

 35%|███▌      | 13450/37963 [32:19:15<53:02:52,  7.79s/it]
 35%|███▌      | 13451/37963 [32:19:23<52:39:30,  7.73s/it]
 35%|███▌      | 13452/37963 [32:19:30<52:27:09,  7.70s/it]
 35%|███▌      | 13453/37963 [32:19:38<52:32:08,  7.72s/it]
 35%|███▌      | 13454/37963 [32:19:46<52:44:04,  7.75s/it]
 35%|███▌      | 13455/37963 [32:19:53<52:15:39,  7.68s/it]
 35%|███▌      | 13456/37963 [32:20:09<68:42:22, 10.09s/it]
 35%|███▌      | 13457/37963 [32:20:18<66:26:20,  9.76s/it]
 35%|███▌      | 13458/37963 [32:20:27<65:04:06,  9.56s/it]
 35%|███▌      | 13459/37963 [32:20:35<62:23:51,  9.17s/it]
 35%|███▌      | 13460/37963 [32:20:43<58:36:16,  8.61s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '2.944', 'learning_rate': '1.497e-05', 'epoch': '0.3546'}

 35%|███▌      | 13460/37963 [32:20:43<58:36:16,  8.61s/it]
 35%|███▌      | 13461/37963 [32:20:50<56:52:04,  8.36s/it]
 35%|███▌      | 13462/37963 [32:20:58<55:18:43,  8.13s/it]
 35%|███▌      | 13463/37963 [32:21:12<68:03:16, 10.00s/it]
 35%|███▌      | 13464/37963 [32:21:20<63:14:01,  9.29s/it]
 35%|███▌      | 13465/37963 [32:21:28<59:52:22,  8.80s/it]
 35%|███▌      | 13466/37963 [32:21:35<57:22:40,  8.43s/it]
 35%|███▌      | 13467/37963 [32:21:50<70:04:57, 10.30s/it]
 35%|███▌      | 13468/37963 [32:21:57<64:27:51,  9.47s/it]
 35%|███▌      | 13469/37963 [32:22:05<60:50:43,  8.94s/it]
 35%|███▌      | 13470/37963 [32:22:13<58:32:04,  8.60s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '4.379', 'learning_rate': '1.496e-05', 'epoch': '0.3548'}

 35%|███▌      | 13470/37963 [32:22:13<58:32:04,  8.60s/it]
 35%|███▌      | 13471/37963 [32:22:20<56:15:46,  8.27s/it]
 35%|███▌      | 13472/37963 [32:22:28<55:03:48,  8.09s/it]
 35%|███▌      | 13473/37963 [32:22:35<53:15:51,  7.83s/it]
 35%|███▌      | 13474/37963 [32:22:50<67:27:51,  9.92s/it]
 35%|███▌      | 13475/37963 [32:22:58<62:47:49,  9.23s/it]
 35%|███▌      | 13476/37963 [32:23:05<59:42:23,  8.78s/it]
 36%|███▌      | 13477/37963 [32:23:13<57:19:34,  8.43s/it]
 36%|███▌      | 13478/37963 [32:23:21<55:37:39,  8.18s/it]
 36%|███▌      | 13479/37963 [32:23:28<54:05:57,  7.95s/it]
 36%|███▌      | 13480/37963 [32:23:35<52:46:05,  7.76s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '1.701', 'learning_rate': '1.495e-05', 'epoch': '0.3551'}

 36%|███▌      | 13480/37963 [32:23:35<52:46:05,  7.76s/it]
 36%|███▌      | 13481/37963 [32:23:43<52:08:35,  7.67s/it]
 36%|███▌      | 13482/37963 [32:23:51<52:05:34,  7.66s/it]
 36%|███▌      | 13483/37963 [32:24:05<65:53:06,  9.69s/it]
 36%|███▌      | 13484/37963 [32:24:12<61:25:37,  9.03s/it]
 36%|███▌      | 13485/37963 [32:24:20<58:32:59,  8.61s/it]
 36%|███▌      | 13486/37963 [32:24:28<56:23:06,  8.29s/it]
 36%|███▌      | 13487/37963 [32:24:35<55:03:24,  8.10s/it]
 36%|███▌      | 13488/37963 [32:24:50<68:52:06, 10.13s/it]
 36%|███▌      | 13489/37963 [32:24:58<63:49:55,  9.39s/it]
 36%|███▌      | 13490/37963 [32:25:05<59:55:38,  8.82s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.099', 'learning_rate': '1.494e-05', 'epoch': '0.3553'}

 36%|███▌      | 13490/37963 [32:25:05<59:55:38,  8.82s/it]
 36%|███▌      | 13491/37963 [32:25:13<57:39:40,  8.48s/it]
 36%|███▌      | 13492/37963 [32:25:21<55:57:15,  8.23s/it]
 36%|███▌      | 13493/37963 [32:25:28<54:10:05,  7.97s/it]
 36%|███▌      | 13494/37963 [32:25:36<53:52:44,  7.93s/it]
 36%|███▌      | 13495/37963 [32:25:44<53:38:34,  7.89s/it]
 36%|███▌      | 13496/37963 [32:25:58<66:45:07,  9.82s/it]
 36%|███▌      | 13497/37963 [32:26:05<61:47:45,  9.09s/it]
 36%|███▌      | 13498/37963 [32:26:13<58:50:20,  8.66s/it]
 36%|███▌      | 13499/37963 [32:26:21<56:48:37,  8.36s/it]
 36%|███▌      | 13500/37963 [32:26:28<55:14:13,  8.13s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.059', 'learning_rate': '1.494e-05', 'epoch': '0.3556'}

 36%|███▌      | 13500/37963 [32:26:28<55:14:13,  8.13s/it]
 36%|███▌      | 13501/37963 [32:26:36<54:16:16,  7.99s/it]
 36%|███▌      | 13502/37963 [32:26:43<53:01:01,  7.80s/it]
 36%|███▌      | 13503/37963 [32:27:05<81:10:11, 11.95s/it]
 36%|███▌      | 13504/37963 [32:27:13<72:39:16, 10.69s/it]
 36%|███▌      | 13505/37963 [32:27:20<66:24:29,  9.77s/it]
 36%|███▌      | 13506/37963 [32:27:28<62:02:05,  9.13s/it]
 36%|███▌      | 13507/37963 [32:27:36<58:56:43,  8.68s/it]
 36%|███▌      | 13508/37963 [32:27:43<56:40:00,  8.34s/it]
 36%|███▌      | 13509/37963 [32:27:51<55:11:21,  8.12s/it]
 36%|███▌      | 13510/37963 [32:27:58<53:56:34,  7.94s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '2.789', 'learning_rate': '1.493e-05', 'epoch': '0.3559'}

 36%|███▌      | 13510/37963 [32:27:58<53:56:34,  7.94s/it]
 36%|███▌      | 13511/37963 [32:28:06<52:53:54,  7.79s/it]
 36%|███▌      | 13512/37963 [32:28:13<52:35:04,  7.74s/it]
 36%|███▌      | 13513/37963 [32:28:21<52:26:35,  7.72s/it]
 36%|███▌      | 13514/37963 [32:28:42<80:32:06, 11.86s/it]
 36%|███▌      | 13515/37963 [32:28:50<71:53:51, 10.59s/it]
 36%|███▌      | 13516/37963 [32:28:58<65:46:34,  9.69s/it]
 36%|███▌      | 13517/37963 [32:29:05<61:44:46,  9.09s/it]
 36%|███▌      | 13518/37963 [32:29:20<72:34:18, 10.69s/it]
 36%|███▌      | 13519/37963 [32:29:27<65:41:41,  9.68s/it]
 36%|███▌      | 13520/37963 [32:29:35<61:32:26,  9.06s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '1.202', 'learning_rate': '1.492e-05', 'epoch': '0.3561'}

 36%|███▌      | 13520/37963 [32:29:35<61:32:26,  9.06s/it]
 36%|███▌      | 13521/37963 [32:29:42<58:34:41,  8.63s/it]
 36%|███▌      | 13522/37963 [32:29:50<56:40:59,  8.35s/it]
 36%|███▌      | 13523/37963 [32:29:58<55:30:50,  8.18s/it]
 36%|███▌      | 13524/37963 [32:30:05<53:58:32,  7.95s/it]
 36%|███▌      | 13525/37963 [32:30:13<53:49:12,  7.93s/it]
 36%|███▌      | 13526/37963 [32:30:21<53:08:40,  7.83s/it]
 36%|███▌      | 13527/37963 [32:30:28<52:46:03,  7.77s/it]
 36%|███▌      | 13528/37963 [32:30:36<52:33:56,  7.74s/it]
 36%|███▌      | 13529/37963 [32:30:44<52:26:52,  7.73s/it]
 36%|███▌      | 13530/37963 [32:30:51<52:10:26,  7.69s/it]
                                                           
{'loss': '0.1638', 'grad_norm': '2.77', 'learning_rate': '1.491e-05', 'epoch': '0.3564'}

 36%|███▌      | 13530/37963 [32:30:51<52:10:26,  7.69s/it]
 36%|███▌      | 13531/37963 [32:30:59<51:58:26,  7.66s/it]
 36%|███▌      | 13532/37963 [32:31:06<51:45:57,  7.63s/it]
 36%|███▌      | 13533/37963 [32:31:14<51:32:18,  7.59s/it]
 36%|███▌      | 13534/37963 [32:31:28<65:35:39,  9.67s/it]
 36%|███▌      | 13535/37963 [32:31:36<61:33:08,  9.07s/it]
 36%|███▌      | 13536/37963 [32:31:44<58:30:48,  8.62s/it]
 36%|███▌      | 13537/37963 [32:31:58<70:12:50, 10.35s/it]
 36%|███▌      | 13538/37963 [32:32:06<64:47:59,  9.55s/it]
 36%|███▌      | 13539/37963 [32:32:13<60:49:04,  8.96s/it]
 36%|███▌      | 13540/37963 [32:32:21<58:00:45,  8.55s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '2.077', 'learning_rate': '1.491e-05', 'epoch': '0.3567'}

 36%|███▌      | 13540/37963 [32:32:21<58:00:45,  8.55s/it]
 36%|███▌      | 13541/37963 [32:32:28<55:46:18,  8.22s/it]
 36%|███▌      | 13542/37963 [32:32:36<54:33:38,  8.04s/it]
 36%|███▌      | 13543/37963 [32:32:44<53:46:51,  7.93s/it]
 36%|███▌      | 13544/37963 [32:32:51<53:06:09,  7.83s/it]
 36%|███▌      | 13545/37963 [32:32:59<52:42:15,  7.77s/it]
 36%|███▌      | 13546/37963 [32:33:07<52:36:56,  7.76s/it]
 36%|███▌      | 13547/37963 [32:33:21<65:15:38,  9.62s/it]
 36%|███▌      | 13548/37963 [32:33:28<61:25:41,  9.06s/it]
 36%|███▌      | 13549/37963 [32:33:36<58:36:52,  8.64s/it]
 36%|███▌      | 13550/37963 [32:33:51<71:08:17, 10.49s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.182', 'learning_rate': '1.49e-05', 'epoch': '0.3569'}

 36%|███▌      | 13550/37963 [32:33:51<71:08:17, 10.49s/it]
 36%|███▌      | 13551/37963 [32:33:59<65:36:36,  9.68s/it]
 36%|███▌      | 13552/37963 [32:34:13<74:51:25, 11.04s/it]
 36%|███▌      | 13553/37963 [32:34:21<68:00:06, 10.03s/it]
 36%|███▌      | 13554/37963 [32:34:28<63:01:02,  9.29s/it]
 36%|███▌      | 13555/37963 [32:34:36<59:54:29,  8.84s/it]
 36%|███▌      | 13556/37963 [32:34:43<57:25:24,  8.47s/it]
 36%|███▌      | 13557/37963 [32:34:51<55:51:05,  8.24s/it]
 36%|███▌      | 13558/37963 [32:34:59<54:53:00,  8.10s/it]
 36%|███▌      | 13559/37963 [32:35:07<53:55:40,  7.96s/it]
 36%|███▌      | 13560/37963 [32:35:14<53:11:03,  7.85s/it]
                                                           
{'loss': '0.151', 'grad_norm': '3.307', 'learning_rate': '1.489e-05', 'epoch': '0.3572'}

 36%|███▌      | 13560/37963 [32:35:14<53:11:03,  7.85s/it]
 36%|███▌      | 13561/37963 [32:35:29<67:07:09,  9.90s/it]
 36%|███▌      | 13562/37963 [32:35:37<62:42:26,  9.25s/it]
 36%|███▌      | 13563/37963 [32:35:44<59:50:02,  8.83s/it]
 36%|███▌      | 13564/37963 [32:35:52<56:36:27,  8.35s/it]
 36%|███▌      | 13565/37963 [32:35:59<55:09:06,  8.14s/it]
 36%|███▌      | 13566/37963 [32:36:07<53:24:15,  7.88s/it]
 36%|███▌      | 13567/37963 [32:36:14<52:08:10,  7.69s/it]
 36%|███▌      | 13568/37963 [32:36:35<79:52:17, 11.79s/it]
 36%|███▌      | 13569/37963 [32:36:43<71:54:34, 10.61s/it]
 36%|███▌      | 13570/37963 [32:36:51<65:46:00,  9.71s/it]
                                                           
{'loss': '0.1535', 'grad_norm': '0.6126', 'learning_rate': '1.488e-05', 'epoch': '0.3575'}

 36%|███▌      | 13570/37963 [32:36:51<65:46:00,  9.71s/it]
 36%|███▌      | 13571/37963 [32:36:58<61:30:24,  9.08s/it]
 36%|███▌      | 13572/37963 [32:37:06<58:26:09,  8.62s/it]
 36%|███▌      | 13573/37963 [32:37:13<56:25:31,  8.33s/it]
 36%|███▌      | 13574/37963 [32:37:21<54:55:12,  8.11s/it]
 36%|███▌      | 13575/37963 [32:37:29<53:54:37,  7.96s/it]
 36%|███▌      | 13576/37963 [32:37:36<52:48:37,  7.80s/it]
 36%|███▌      | 13577/37963 [32:37:44<52:32:55,  7.76s/it]
 36%|███▌      | 13578/37963 [32:37:51<52:14:44,  7.71s/it]
 36%|███▌      | 13579/37963 [32:37:59<52:01:06,  7.68s/it]
 36%|███▌      | 13580/37963 [32:38:07<52:10:50,  7.70s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '0.9153', 'learning_rate': '1.488e-05', 'epoch': '0.3577'}

 36%|███▌      | 13580/37963 [32:38:07<52:10:50,  7.70s/it]
 36%|███▌      | 13581/37963 [32:38:14<52:13:41,  7.71s/it]
 36%|███▌      | 13582/37963 [32:38:22<52:01:57,  7.68s/it]
 36%|███▌      | 13583/37963 [32:38:30<52:08:35,  7.70s/it]
 36%|███▌      | 13584/37963 [32:38:44<66:17:00,  9.79s/it]
 36%|███▌      | 13585/37963 [32:38:52<62:10:27,  9.18s/it]
 36%|███▌      | 13586/37963 [32:39:07<72:45:34, 10.75s/it]
 36%|███▌      | 13587/37963 [32:39:14<66:31:50,  9.83s/it]
 36%|███▌      | 13588/37963 [32:39:22<62:13:06,  9.19s/it]
 36%|███▌      | 13589/37963 [32:39:30<58:50:25,  8.69s/it]
 36%|███▌      | 13590/37963 [32:39:37<56:41:21,  8.37s/it]
                                                           
{'loss': '0.1651', 'grad_norm': '1.913', 'learning_rate': '1.487e-05', 'epoch': '0.358'}

 36%|███▌      | 13590/37963 [32:39:37<56:41:21,  8.37s/it]
 36%|███▌      | 13591/37963 [32:39:45<54:59:09,  8.12s/it]
 36%|███▌      | 13592/37963 [32:39:52<53:54:29,  7.96s/it]
 36%|███▌      | 13593/37963 [32:40:00<53:11:58,  7.86s/it]
 36%|███▌      | 13594/37963 [32:40:07<52:30:43,  7.76s/it]
 36%|███▌      | 13595/37963 [32:40:15<52:15:17,  7.72s/it]
 36%|███▌      | 13596/37963 [32:40:29<65:09:30,  9.63s/it]
 36%|███▌      | 13597/37963 [32:40:44<76:34:52, 11.31s/it]
 36%|███▌      | 13598/37963 [32:40:52<69:35:49, 10.28s/it]
 36%|███▌      | 13599/37963 [32:41:00<64:27:05,  9.52s/it]
 36%|███▌      | 13600/37963 [32:41:08<60:41:30,  8.97s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.046', 'learning_rate': '1.486e-05', 'epoch': '0.3582'}

 36%|███▌      | 13600/37963 [32:41:08<60:41:30,  8.97s/it]
 36%|███▌      | 13601/37963 [32:41:22<71:46:50, 10.61s/it]
 36%|███▌      | 13602/37963 [32:41:30<66:01:19,  9.76s/it]
 36%|███▌      | 13603/37963 [32:41:38<62:00:04,  9.16s/it]
 36%|███▌      | 13604/37963 [32:41:45<59:00:28,  8.72s/it]
 36%|███▌      | 13605/37963 [32:41:53<56:39:40,  8.37s/it]
 36%|███▌      | 13606/37963 [32:42:01<55:26:07,  8.19s/it]
 36%|███▌      | 13607/37963 [32:42:08<54:06:19,  8.00s/it]
 36%|███▌      | 13608/37963 [32:42:16<53:34:33,  7.92s/it]
 36%|███▌      | 13609/37963 [32:42:23<52:18:34,  7.73s/it]
 36%|███▌      | 13610/37963 [32:42:31<52:02:26,  7.69s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '1.343', 'learning_rate': '1.485e-05', 'epoch': '0.3585'}

 36%|███▌      | 13610/37963 [32:42:31<52:02:26,  7.69s/it]
 36%|███▌      | 13611/37963 [32:42:38<51:36:54,  7.63s/it]
 36%|███▌      | 13612/37963 [32:42:53<65:34:10,  9.69s/it]
 36%|███▌      | 13613/37963 [32:43:00<60:45:55,  8.98s/it]
 36%|███▌      | 13614/37963 [32:43:08<57:43:48,  8.54s/it]
 36%|███▌      | 13615/37963 [32:43:15<55:23:09,  8.19s/it]
 36%|███▌      | 13616/37963 [32:43:30<68:16:21, 10.09s/it]
 36%|███▌      | 13617/37963 [32:43:37<63:21:14,  9.37s/it]
 36%|███▌      | 13618/37963 [32:43:45<59:17:10,  8.77s/it]
 36%|███▌      | 13619/37963 [32:43:58<69:28:17, 10.27s/it]
 36%|███▌      | 13620/37963 [32:44:06<64:09:57,  9.49s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '2.84', 'learning_rate': '1.485e-05', 'epoch': '0.3588'}

 36%|███▌      | 13620/37963 [32:44:06<64:09:57,  9.49s/it]
 36%|███▌      | 13621/37963 [32:44:14<60:31:17,  8.95s/it]
 36%|███▌      | 13622/37963 [32:44:21<57:49:13,  8.55s/it]
 36%|███▌      | 13623/37963 [32:44:29<55:54:05,  8.27s/it]
 36%|███▌      | 13624/37963 [32:44:36<54:02:19,  7.99s/it]
 36%|███▌      | 13625/37963 [32:44:44<53:13:13,  7.87s/it]
 36%|███▌      | 13626/37963 [32:44:52<52:49:42,  7.81s/it]
 36%|███▌      | 13627/37963 [32:44:59<52:13:35,  7.73s/it]
 36%|███▌      | 13628/37963 [32:45:07<52:00:28,  7.69s/it]
 36%|███▌      | 13629/37963 [32:45:15<52:07:48,  7.71s/it]
 36%|███▌      | 13630/37963 [32:45:29<66:29:02,  9.84s/it]
                                                           
{'loss': '0.1654', 'grad_norm': '0.7263', 'learning_rate': '1.484e-05', 'epoch': '0.359'}

 36%|███▌      | 13630/37963 [32:45:29<66:29:02,  9.84s/it]
 36%|███▌      | 13631/37963 [32:45:37<61:52:45,  9.16s/it]
 36%|███▌      | 13632/37963 [32:45:44<58:41:24,  8.68s/it]
 36%|███▌      | 13633/37963 [32:45:52<56:15:18,  8.32s/it]
 36%|███▌      | 13634/37963 [32:46:06<67:49:18, 10.04s/it]
 36%|███▌      | 13635/37963 [32:46:14<63:15:31,  9.36s/it]
 36%|███▌      | 13636/37963 [32:46:22<59:54:44,  8.87s/it]
 36%|███▌      | 13637/37963 [32:46:29<57:25:02,  8.50s/it]
 36%|███▌      | 13638/37963 [32:46:37<55:28:35,  8.21s/it]
 36%|███▌      | 13639/37963 [32:46:51<67:30:48,  9.99s/it]
 36%|███▌      | 13640/37963 [32:47:05<76:42:42, 11.35s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '2.6', 'learning_rate': '1.483e-05', 'epoch': '0.3593'}

 36%|███▌      | 13640/37963 [32:47:05<76:42:42, 11.35s/it]
 36%|███▌      | 13641/37963 [32:47:13<69:19:43, 10.26s/it]
 36%|███▌      | 13642/37963 [32:47:21<63:44:09,  9.43s/it]
 36%|███▌      | 13643/37963 [32:47:28<60:19:00,  8.93s/it]
 36%|███▌      | 13644/37963 [32:47:36<57:58:02,  8.58s/it]
 36%|███▌      | 13645/37963 [32:47:44<56:07:32,  8.31s/it]
 36%|███▌      | 13646/37963 [32:47:52<55:01:40,  8.15s/it]
 36%|███▌      | 13647/37963 [32:47:59<54:01:10,  8.00s/it]
 36%|███▌      | 13648/37963 [32:48:07<53:12:47,  7.88s/it]
 36%|███▌      | 13649/37963 [32:48:14<52:40:23,  7.80s/it]
 36%|███▌      | 13650/37963 [32:48:22<52:33:12,  7.78s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.604', 'learning_rate': '1.483e-05', 'epoch': '0.3596'}

 36%|███▌      | 13650/37963 [32:48:22<52:33:12,  7.78s/it]
 36%|███▌      | 13651/37963 [32:48:29<51:23:43,  7.61s/it]
 36%|███▌      | 13652/37963 [32:48:37<51:09:57,  7.58s/it]
 36%|███▌      | 13653/37963 [32:48:44<51:14:53,  7.59s/it]
 36%|███▌      | 13654/37963 [32:48:59<65:06:16,  9.64s/it]
 36%|███▌      | 13655/37963 [32:49:06<60:48:17,  9.01s/it]
 36%|███▌      | 13656/37963 [32:49:14<58:06:53,  8.61s/it]
 36%|███▌      | 13657/37963 [32:49:22<56:05:46,  8.31s/it]
 36%|███▌      | 13658/37963 [32:49:29<54:55:47,  8.14s/it]
 36%|███▌      | 13659/37963 [32:49:37<53:54:56,  7.99s/it]
 36%|███▌      | 13660/37963 [32:49:45<53:09:51,  7.88s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '2.995', 'learning_rate': '1.482e-05', 'epoch': '0.3598'}

 36%|███▌      | 13660/37963 [32:49:45<53:09:51,  7.88s/it]
 36%|███▌      | 13661/37963 [32:49:59<65:46:39,  9.74s/it]
 36%|███▌      | 13662/37963 [32:50:06<61:24:16,  9.10s/it]
 36%|███▌      | 13663/37963 [32:50:14<58:06:46,  8.61s/it]
 36%|███▌      | 13664/37963 [32:50:21<55:43:03,  8.25s/it]
 36%|███▌      | 13665/37963 [32:50:36<68:17:48, 10.12s/it]
 36%|███▌      | 13666/37963 [32:50:44<63:28:57,  9.41s/it]
 36%|███▌      | 13667/37963 [32:50:52<60:50:49,  9.02s/it]
 36%|███▌      | 13668/37963 [32:50:59<58:04:24,  8.61s/it]
 36%|███▌      | 13669/37963 [32:51:07<56:03:36,  8.31s/it]
 36%|███▌      | 13670/37963 [32:51:21<68:09:45, 10.10s/it]
                                                           
{'loss': '0.1645', 'grad_norm': '1.373', 'learning_rate': '1.481e-05', 'epoch': '0.3601'}

 36%|███▌      | 13670/37963 [32:51:21<68:09:45, 10.10s/it]
 36%|███▌      | 13671/37963 [32:51:29<63:22:34,  9.39s/it]
 36%|███▌      | 13672/37963 [32:51:37<60:10:32,  8.92s/it]
 36%|███▌      | 13673/37963 [32:51:44<57:38:17,  8.54s/it]
 36%|███▌      | 13674/37963 [32:51:59<70:46:35, 10.49s/it]
 36%|███▌      | 13675/37963 [32:52:07<65:11:35,  9.66s/it]
 36%|███▌      | 13676/37963 [32:52:15<61:03:03,  9.05s/it]
 36%|███▌      | 13677/37963 [32:52:29<71:21:43, 10.58s/it]
 36%|███▌      | 13678/37963 [32:52:37<65:23:54,  9.69s/it]
 36%|███▌      | 13679/37963 [32:52:44<61:16:46,  9.08s/it]
 36%|███▌      | 13680/37963 [32:52:52<58:22:32,  8.65s/it]
                                                           
{'loss': '0.1667', 'grad_norm': '1.359', 'learning_rate': '1.48e-05', 'epoch': '0.3604'}

 36%|███▌      | 13680/37963 [32:52:52<58:22:32,  8.65s/it]
 36%|███▌      | 13681/37963 [32:53:00<56:31:33,  8.38s/it]
 36%|███▌      | 13682/37963 [32:53:07<54:40:36,  8.11s/it]
 36%|███▌      | 13683/37963 [32:53:21<67:28:45, 10.01s/it]
 36%|███▌      | 13684/37963 [32:53:36<76:15:50, 11.31s/it]
 36%|███▌      | 13685/37963 [32:53:44<68:56:14, 10.22s/it]
 36%|███▌      | 13686/37963 [32:53:51<63:48:53,  9.46s/it]
 36%|███▌      | 13687/37963 [32:53:59<60:14:08,  8.93s/it]
 36%|███▌      | 13688/37963 [32:54:07<57:36:12,  8.54s/it]
 36%|███▌      | 13689/37963 [32:54:14<55:09:53,  8.18s/it]
 36%|███▌      | 13690/37963 [32:54:22<54:29:24,  8.08s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '2.748', 'learning_rate': '1.48e-05', 'epoch': '0.3606'}

 36%|███▌      | 13690/37963 [32:54:22<54:29:24,  8.08s/it]
 36%|███▌      | 13691/37963 [32:54:29<53:31:28,  7.94s/it]
 36%|███▌      | 13692/37963 [32:54:37<53:01:42,  7.87s/it]
 36%|███▌      | 13693/37963 [32:54:45<52:39:34,  7.81s/it]
 36%|███▌      | 13694/37963 [32:54:52<52:19:49,  7.76s/it]
 36%|███▌      | 13695/37963 [32:55:00<52:06:17,  7.73s/it]
 36%|███▌      | 13696/37963 [32:55:08<51:57:40,  7.71s/it]
 36%|███▌      | 13697/37963 [32:55:15<51:50:24,  7.69s/it]
 36%|███▌      | 13698/37963 [32:55:30<65:06:07,  9.66s/it]
 36%|███▌      | 13699/37963 [32:55:37<61:07:05,  9.07s/it]
 36%|███▌      | 13700/37963 [32:55:45<58:24:40,  8.67s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.737', 'learning_rate': '1.479e-05', 'epoch': '0.3609'}

 36%|███▌      | 13700/37963 [32:55:45<58:24:40,  8.67s/it]
 36%|███▌      | 13701/37963 [32:55:53<56:17:58,  8.35s/it]
 36%|███▌      | 13702/37963 [32:56:00<55:06:56,  8.18s/it]
 36%|███▌      | 13703/37963 [32:56:08<54:13:10,  8.05s/it]
 36%|███▌      | 13704/37963 [32:56:16<53:23:59,  7.92s/it]
 36%|███▌      | 13705/37963 [32:56:23<52:58:35,  7.86s/it]
 36%|███▌      | 13706/37963 [32:56:31<53:00:45,  7.87s/it]
 36%|███▌      | 13707/37963 [32:56:39<52:57:10,  7.86s/it]
 36%|███▌      | 13708/37963 [32:56:47<52:12:11,  7.75s/it]
 36%|███▌      | 13709/37963 [32:57:02<66:50:45,  9.92s/it]
 36%|███▌      | 13710/37963 [32:57:09<62:14:38,  9.24s/it]
                                                           
{'loss': '0.156', 'grad_norm': '3.36', 'learning_rate': '1.478e-05', 'epoch': '0.3611'}

 36%|███▌      | 13710/37963 [32:57:09<62:14:38,  9.24s/it]
 36%|███▌      | 13711/37963 [32:57:17<59:05:25,  8.77s/it]
 36%|███▌      | 13712/37963 [32:57:25<56:54:41,  8.45s/it]
 36%|███▌      | 13713/37963 [32:57:32<55:32:50,  8.25s/it]
 36%|███▌      | 13714/37963 [32:57:40<54:23:42,  8.08s/it]
 36%|███▌      | 13715/37963 [32:57:54<66:49:08,  9.92s/it]
 36%|███▌      | 13716/37963 [32:58:02<62:50:47,  9.33s/it]
 36%|███▌      | 13717/37963 [32:58:17<73:45:06, 10.95s/it]
 36%|███▌      | 13718/37963 [32:58:25<67:07:42,  9.97s/it]
 36%|███▌      | 13719/37963 [32:58:32<62:25:56,  9.27s/it]
 36%|███▌      | 13720/37963 [32:58:40<59:18:56,  8.81s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.337', 'learning_rate': '1.477e-05', 'epoch': '0.3614'}

 36%|███▌      | 13720/37963 [32:58:40<59:18:56,  8.81s/it]
 36%|███▌      | 13721/37963 [32:58:48<57:17:04,  8.51s/it]
 36%|███▌      | 13722/37963 [32:59:02<69:30:56, 10.32s/it]
 36%|███▌      | 13723/37963 [32:59:10<64:08:37,  9.53s/it]
 36%|███▌      | 13724/37963 [32:59:18<60:16:47,  8.95s/it]
 36%|███▌      | 13725/37963 [32:59:32<70:52:19, 10.53s/it]
 36%|███▌      | 13726/37963 [32:59:40<65:20:23,  9.71s/it]
 36%|███▌      | 13727/37963 [32:59:47<60:29:52,  8.99s/it]
 36%|███▌      | 13728/37963 [32:59:55<57:45:13,  8.58s/it]
 36%|███▌      | 13729/37963 [33:00:02<55:42:26,  8.28s/it]
 36%|███▌      | 13730/37963 [33:00:10<54:20:59,  8.07s/it]
                                                           
{'loss': '0.1616', 'grad_norm': '1.604', 'learning_rate': '1.477e-05', 'epoch': '0.3617'}

 36%|███▌      | 13730/37963 [33:00:10<54:20:59,  8.07s/it]
 36%|███▌      | 13731/37963 [33:00:17<53:06:26,  7.89s/it]
 36%|███▌      | 13732/37963 [33:00:25<52:16:29,  7.77s/it]
 36%|███▌      | 13733/37963 [33:00:32<51:54:44,  7.71s/it]
 36%|███▌      | 13734/37963 [33:00:40<51:43:03,  7.68s/it]
 36%|███▌      | 13735/37963 [33:00:55<65:52:30,  9.79s/it]
 36%|███▌      | 13736/37963 [33:01:03<62:08:44,  9.23s/it]
 36%|███▌      | 13737/37963 [33:01:17<72:14:20, 10.73s/it]
 36%|███▌      | 13738/37963 [33:01:25<66:05:59,  9.82s/it]
 36%|███▌      | 13739/37963 [33:01:32<61:19:41,  9.11s/it]
 36%|███▌      | 13740/37963 [33:01:40<58:19:33,  8.67s/it]
                                                           
{'loss': '0.1688', 'grad_norm': '2.574', 'learning_rate': '1.476e-05', 'epoch': '0.3619'}

 36%|███▌      | 13740/37963 [33:01:40<58:19:33,  8.67s/it]
 36%|███▌      | 13741/37963 [33:01:47<56:12:34,  8.35s/it]
 36%|███▌      | 13742/37963 [33:02:02<68:29:21, 10.18s/it]
 36%|███▌      | 13743/37963 [33:02:09<63:18:54,  9.41s/it]
 36%|███▌      | 13744/37963 [33:02:17<59:38:30,  8.87s/it]
 36%|███▌      | 13745/37963 [33:02:25<57:10:02,  8.50s/it]
 36%|███▌      | 13746/37963 [33:02:32<54:57:48,  8.17s/it]
 36%|███▌      | 13747/37963 [33:02:40<53:57:58,  8.02s/it]
 36%|███▌      | 13748/37963 [33:02:47<53:00:54,  7.88s/it]
 36%|███▌      | 13749/37963 [33:02:55<52:15:45,  7.77s/it]
 36%|███▌      | 13750/37963 [33:03:02<51:37:54,  7.68s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.685', 'learning_rate': '1.475e-05', 'epoch': '0.3622'}

 36%|███▌      | 13750/37963 [33:03:02<51:37:54,  7.68s/it]
 36%|███▌      | 13751/37963 [33:03:10<51:33:35,  7.67s/it]
 36%|███▌      | 13752/37963 [33:03:18<51:49:13,  7.71s/it]
 36%|███▌      | 13753/37963 [33:03:32<65:38:04,  9.76s/it]
 36%|███▌      | 13754/37963 [33:03:40<61:09:35,  9.09s/it]
 36%|███▌      | 13755/37963 [33:03:47<58:10:52,  8.65s/it]
 36%|███▌      | 13756/37963 [33:03:55<56:01:13,  8.33s/it]
 36%|███▌      | 13757/37963 [33:04:03<54:34:55,  8.12s/it]
 36%|███▌      | 13758/37963 [33:04:10<52:50:07,  7.86s/it]
 36%|███▌      | 13759/37963 [33:04:17<52:20:19,  7.78s/it]
 36%|███▌      | 13760/37963 [33:04:25<51:58:14,  7.73s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '4.382', 'learning_rate': '1.474e-05', 'epoch': '0.3625'}

 36%|███▌      | 13760/37963 [33:04:25<51:58:14,  7.73s/it]
 36%|███▌      | 13761/37963 [33:04:33<52:04:36,  7.75s/it]
 36%|███▋      | 13762/37963 [33:04:54<79:40:09, 11.85s/it]
 36%|███▋      | 13763/37963 [33:05:02<70:53:02, 10.54s/it]
 36%|███▋      | 13764/37963 [33:05:09<64:44:35,  9.63s/it]
 36%|███▋      | 13765/37963 [33:05:17<60:39:52,  9.03s/it]
 36%|███▋      | 13766/37963 [33:05:24<57:22:03,  8.54s/it]
 36%|███▋      | 13767/37963 [33:05:32<55:36:21,  8.27s/it]
 36%|███▋      | 13768/37963 [33:05:40<54:28:26,  8.11s/it]
 36%|███▋      | 13769/37963 [33:05:47<53:25:21,  7.95s/it]
 36%|███▋      | 13770/37963 [33:05:55<52:45:08,  7.85s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '2.071', 'learning_rate': '1.474e-05', 'epoch': '0.3627'}

 36%|███▋      | 13770/37963 [33:05:55<52:45:08,  7.85s/it]
 36%|███▋      | 13771/37963 [33:06:10<66:46:22,  9.94s/it]
 36%|███▋      | 13772/37963 [33:06:17<61:56:07,  9.22s/it]
 36%|███▋      | 13773/37963 [33:06:25<58:39:18,  8.73s/it]
 36%|███▋      | 13774/37963 [33:06:32<56:24:39,  8.40s/it]
 36%|███▋      | 13775/37963 [33:06:40<55:01:38,  8.19s/it]
 36%|███▋      | 13776/37963 [33:06:54<66:56:50,  9.96s/it]
 36%|███▋      | 13777/37963 [33:07:02<62:33:11,  9.31s/it]
 36%|███▋      | 13778/37963 [33:07:10<59:13:22,  8.82s/it]
 36%|███▋      | 13779/37963 [33:07:17<56:59:36,  8.48s/it]
 36%|███▋      | 13780/37963 [33:07:25<55:26:02,  8.25s/it]
                                                           
{'loss': '0.1727', 'grad_norm': '2.139', 'learning_rate': '1.473e-05', 'epoch': '0.363'}

 36%|███▋      | 13780/37963 [33:07:25<55:26:02,  8.25s/it]
 36%|███▋      | 13781/37963 [33:07:33<54:14:12,  8.07s/it]
 36%|███▋      | 13782/37963 [33:07:40<53:31:21,  7.97s/it]
 36%|███▋      | 13783/37963 [33:07:48<52:01:49,  7.75s/it]
 36%|███▋      | 13784/37963 [33:08:02<64:52:53,  9.66s/it]
 36%|███▋      | 13785/37963 [33:08:16<74:14:56, 11.06s/it]
 36%|███▋      | 13786/37963 [33:08:24<67:25:50, 10.04s/it]
 36%|███▋      | 13787/37963 [33:08:31<62:34:30,  9.32s/it]
 36%|███▋      | 13788/37963 [33:08:39<59:12:25,  8.82s/it]
 36%|███▋      | 13789/37963 [33:08:54<71:06:46, 10.59s/it]
 36%|███▋      | 13790/37963 [33:09:01<65:09:23,  9.70s/it]
                                                           
{'loss': '0.1625', 'grad_norm': '4.453', 'learning_rate': '1.472e-05', 'epoch': '0.3632'}

 36%|███▋      | 13790/37963 [33:09:01<65:09:23,  9.70s/it]
 36%|███▋      | 13791/37963 [33:09:09<60:58:23,  9.08s/it]
 36%|███▋      | 13792/37963 [33:09:16<57:39:47,  8.59s/it]
 36%|███▋      | 13793/37963 [33:09:24<54:57:44,  8.19s/it]
 36%|███▋      | 13794/37963 [33:09:31<53:50:54,  8.02s/it]
 36%|███▋      | 13795/37963 [33:09:39<53:11:55,  7.92s/it]
 36%|███▋      | 13796/37963 [33:09:47<52:38:18,  7.84s/it]
 36%|███▋      | 13797/37963 [33:09:54<52:28:05,  7.82s/it]
 36%|███▋      | 13798/37963 [33:10:02<51:37:09,  7.69s/it]
 36%|███▋      | 13799/37963 [33:10:10<51:39:35,  7.70s/it]
 36%|███▋      | 13800/37963 [33:10:17<50:49:36,  7.57s/it]
                                                           
{'loss': '0.16', 'grad_norm': '2.89', 'learning_rate': '1.471e-05', 'epoch': '0.3635'}

 36%|███▋      | 13800/37963 [33:10:17<50:49:36,  7.57s/it]
 36%|███▋      | 13801/37963 [33:10:25<51:04:39,  7.61s/it]
 36%|███▋      | 13802/37963 [33:10:39<64:53:32,  9.67s/it]
 36%|███▋      | 13803/37963 [33:10:47<60:57:05,  9.08s/it]
 36%|███▋      | 13804/37963 [33:10:54<57:41:24,  8.60s/it]
 36%|███▋      | 13805/37963 [33:11:02<55:57:25,  8.34s/it]
 36%|███▋      | 13806/37963 [33:11:09<54:23:42,  8.11s/it]
 36%|███▋      | 13807/37963 [33:11:17<53:36:29,  7.99s/it]
 36%|███▋      | 13808/37963 [33:11:25<52:17:29,  7.79s/it]
 36%|███▋      | 13809/37963 [33:11:32<52:07:48,  7.77s/it]
 36%|███▋      | 13810/37963 [33:11:47<65:35:31,  9.78s/it]
                                                           
{'loss': '0.1763', 'grad_norm': '2.749', 'learning_rate': '1.471e-05', 'epoch': '0.3638'}

 36%|███▋      | 13810/37963 [33:11:47<65:35:31,  9.78s/it]
 36%|███▋      | 13811/37963 [33:11:54<61:16:00,  9.13s/it]
 36%|███▋      | 13812/37963 [33:12:02<57:53:40,  8.63s/it]
 36%|███▋      | 13813/37963 [33:12:10<56:16:50,  8.39s/it]
 36%|███▋      | 13814/37963 [33:12:24<68:28:53, 10.21s/it]
 36%|███▋      | 13815/37963 [33:12:32<63:27:22,  9.46s/it]
 36%|███▋      | 13816/37963 [33:12:40<60:01:58,  8.95s/it]
 36%|███▋      | 13817/37963 [33:12:47<57:35:47,  8.59s/it]
 36%|███▋      | 13818/37963 [33:12:55<55:43:54,  8.31s/it]
 36%|███▋      | 13819/37963 [33:13:03<54:46:07,  8.17s/it]
 36%|███▋      | 13820/37963 [33:13:10<53:41:24,  8.01s/it]
                                                           
{'loss': '0.1658', 'grad_norm': '3.287', 'learning_rate': '1.47e-05', 'epoch': '0.364'}

 36%|███▋      | 13820/37963 [33:13:10<53:41:24,  8.01s/it]
 36%|███▋      | 13821/37963 [33:13:25<66:53:33,  9.97s/it]
 36%|███▋      | 13822/37963 [33:13:39<75:17:25, 11.23s/it]
 36%|███▋      | 13823/37963 [33:13:47<68:13:24, 10.17s/it]
 36%|███▋      | 13824/37963 [33:13:55<63:17:32,  9.44s/it]
 36%|███▋      | 13825/37963 [33:14:02<59:04:19,  8.81s/it]
 36%|███▋      | 13826/37963 [33:14:10<56:42:12,  8.46s/it]
 36%|███▋      | 13827/37963 [33:14:17<54:59:48,  8.20s/it]
 36%|███▋      | 13828/37963 [33:14:25<53:50:38,  8.03s/it]
 36%|███▋      | 13829/37963 [33:14:32<52:56:33,  7.90s/it]
 36%|███▋      | 13830/37963 [33:14:40<52:17:56,  7.80s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '1.452', 'learning_rate': '1.469e-05', 'epoch': '0.3643'}

 36%|███▋      | 13830/37963 [33:14:40<52:17:56,  7.80s/it]
 36%|███▋      | 13831/37963 [33:14:48<51:55:34,  7.75s/it]
 36%|███▋      | 13832/37963 [33:14:55<51:40:21,  7.71s/it]
 36%|███▋      | 13833/37963 [33:15:16<78:37:20, 11.73s/it]
 36%|███▋      | 13834/37963 [33:15:24<70:17:19, 10.49s/it]
 36%|███▋      | 13835/37963 [33:15:31<64:25:13,  9.61s/it]
 36%|███▋      | 13836/37963 [33:15:39<60:29:27,  9.03s/it]
 36%|███▋      | 13837/37963 [33:15:47<57:23:05,  8.56s/it]
 36%|███▋      | 13838/37963 [33:15:54<55:29:48,  8.28s/it]
 36%|███▋      | 13839/37963 [33:16:02<54:06:54,  8.08s/it]
 36%|███▋      | 13840/37963 [33:16:09<52:30:32,  7.84s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '1.108', 'learning_rate': '1.468e-05', 'epoch': '0.3646'}

 36%|███▋      | 13840/37963 [33:16:09<52:30:32,  7.84s/it]
 36%|███▋      | 13841/37963 [33:16:17<52:10:18,  7.79s/it]
 36%|███▋      | 13842/37963 [33:16:31<65:54:39,  9.84s/it]
 36%|███▋      | 13843/37963 [33:16:39<62:16:51,  9.30s/it]
 36%|███▋      | 13844/37963 [33:16:47<59:17:13,  8.85s/it]
 36%|███▋      | 13845/37963 [33:16:55<57:04:15,  8.52s/it]
 36%|███▋      | 13846/37963 [33:17:03<55:28:43,  8.28s/it]
 36%|███▋      | 13847/37963 [33:17:10<54:13:01,  8.09s/it]
 36%|███▋      | 13848/37963 [33:17:18<53:25:55,  7.98s/it]
 36%|███▋      | 13849/37963 [33:17:26<53:01:39,  7.92s/it]
 36%|███▋      | 13850/37963 [33:17:41<67:03:27, 10.01s/it]
                                                           
{'loss': '0.1732', 'grad_norm': '1.344', 'learning_rate': '1.467e-05', 'epoch': '0.3648'}

 36%|███▋      | 13850/37963 [33:17:41<67:03:27, 10.01s/it]
 36%|███▋      | 13851/37963 [33:17:49<62:33:17,  9.34s/it]
 36%|███▋      | 13852/37963 [33:17:56<58:39:31,  8.76s/it]
 36%|███▋      | 13853/37963 [33:18:04<56:23:27,  8.42s/it]
 36%|███▋      | 13854/37963 [33:18:11<55:03:25,  8.22s/it]
 36%|███▋      | 13855/37963 [33:18:19<54:02:22,  8.07s/it]
 36%|███▋      | 13856/37963 [33:18:27<53:13:35,  7.95s/it]
 37%|███▋      | 13857/37963 [33:18:34<52:38:09,  7.86s/it]
 37%|███▋      | 13858/37963 [33:18:49<65:28:42,  9.78s/it]
 37%|███▋      | 13859/37963 [33:18:56<61:19:04,  9.16s/it]
 37%|███▋      | 13860/37963 [33:19:04<57:27:38,  8.58s/it]
                                                           
{'loss': '0.164', 'grad_norm': '3.232', 'learning_rate': '1.467e-05', 'epoch': '0.3651'}

 37%|███▋      | 13860/37963 [33:19:04<57:27:38,  8.58s/it]
 37%|███▋      | 13861/37963 [33:19:11<55:33:03,  8.30s/it]
 37%|███▋      | 13862/37963 [33:19:19<54:10:43,  8.09s/it]
 37%|███▋      | 13863/37963 [33:19:26<53:05:14,  7.93s/it]
 37%|███▋      | 13864/37963 [33:19:34<52:47:37,  7.89s/it]
 37%|███▋      | 13865/37963 [33:19:42<52:15:11,  7.81s/it]
 37%|███▋      | 13866/37963 [33:19:56<65:44:30,  9.82s/it]
 37%|███▋      | 13867/37963 [33:20:04<61:40:24,  9.21s/it]
 37%|███▋      | 13868/37963 [33:20:11<57:46:09,  8.63s/it]
 37%|███▋      | 13869/37963 [33:20:19<55:42:20,  8.32s/it]
 37%|███▋      | 13870/37963 [33:20:27<54:20:58,  8.12s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.066', 'learning_rate': '1.466e-05', 'epoch': '0.3654'}

 37%|███▋      | 13870/37963 [33:20:27<54:20:58,  8.12s/it]
 37%|███▋      | 13871/37963 [33:20:42<68:32:29, 10.24s/it]
 37%|███▋      | 13872/37963 [33:20:56<76:43:08, 11.46s/it]
 37%|███▋      | 13873/37963 [33:21:04<69:12:21, 10.34s/it]
 37%|███▋      | 13874/37963 [33:21:11<63:48:01,  9.53s/it]
 37%|███▋      | 13875/37963 [33:21:19<59:43:23,  8.93s/it]
 37%|███▋      | 13876/37963 [33:21:27<57:18:11,  8.56s/it]
 37%|███▋      | 13877/37963 [33:21:34<55:26:36,  8.29s/it]
 37%|███▋      | 13878/37963 [33:21:42<54:10:46,  8.10s/it]
 37%|███▋      | 13879/37963 [33:21:49<52:56:55,  7.91s/it]
 37%|███▋      | 13880/37963 [33:21:57<52:23:41,  7.83s/it]
                                                           
{'loss': '0.1617', 'grad_norm': '3.74', 'learning_rate': '1.465e-05', 'epoch': '0.3656'}

 37%|███▋      | 13880/37963 [33:21:57<52:23:41,  7.83s/it]
 37%|███▋      | 13881/37963 [33:22:05<52:29:44,  7.85s/it]
 37%|███▋      | 13882/37963 [33:22:19<65:35:32,  9.81s/it]
 37%|███▋      | 13883/37963 [33:22:27<61:20:05,  9.17s/it]
 37%|███▋      | 13884/37963 [33:22:35<58:33:02,  8.75s/it]
 37%|███▋      | 13885/37963 [33:22:42<56:15:44,  8.41s/it]
 37%|███▋      | 13886/37963 [33:22:50<54:42:20,  8.18s/it]
 37%|███▋      | 13887/37963 [33:22:58<53:34:50,  8.01s/it]
 37%|███▋      | 13888/37963 [33:23:12<66:30:19,  9.94s/it]
 37%|███▋      | 13889/37963 [33:23:20<62:01:45,  9.28s/it]
 37%|███▋      | 13890/37963 [33:23:35<73:29:19, 10.99s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.523', 'learning_rate': '1.464e-05', 'epoch': '0.3659'}

 37%|███▋      | 13890/37963 [33:23:35<73:29:19, 10.99s/it]
 37%|███▋      | 13891/37963 [33:23:42<66:42:20,  9.98s/it]
 37%|███▋      | 13892/37963 [33:23:50<62:14:33,  9.31s/it]
 37%|███▋      | 13893/37963 [33:23:58<59:05:18,  8.84s/it]
 37%|███▋      | 13894/37963 [33:24:06<56:37:37,  8.47s/it]
 37%|███▋      | 13895/37963 [33:24:13<54:42:17,  8.18s/it]
 37%|███▋      | 13896/37963 [33:24:21<53:37:22,  8.02s/it]
 37%|███▋      | 13897/37963 [33:24:28<52:01:21,  7.78s/it]
 37%|███▋      | 13898/37963 [33:24:36<51:43:14,  7.74s/it]
 37%|███▋      | 13899/37963 [33:24:50<64:36:19,  9.67s/it]
 37%|███▋      | 13900/37963 [33:24:57<60:39:35,  9.08s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.208', 'learning_rate': '1.464e-05', 'epoch': '0.3661'}

 37%|███▋      | 13900/37963 [33:24:57<60:39:35,  9.08s/it]
 37%|███▋      | 13901/37963 [33:25:05<57:39:03,  8.63s/it]
 37%|███▋      | 13902/37963 [33:25:13<55:23:08,  8.29s/it]
 37%|███▋      | 13903/37963 [33:25:20<54:10:01,  8.10s/it]
 37%|███▋      | 13904/37963 [33:25:28<52:49:26,  7.90s/it]
 37%|███▋      | 13905/37963 [33:25:35<52:27:33,  7.85s/it]
 37%|███▋      | 13906/37963 [33:25:50<65:32:28,  9.81s/it]
 37%|███▋      | 13907/37963 [33:25:57<61:00:27,  9.13s/it]
 37%|███▋      | 13908/37963 [33:26:05<57:55:12,  8.67s/it]
 37%|███▋      | 13909/37963 [33:26:13<55:55:54,  8.37s/it]
 37%|███▋      | 13910/37963 [33:26:27<67:39:12, 10.13s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '0.9655', 'learning_rate': '1.463e-05', 'epoch': '0.3664'}

 37%|███▋      | 13910/37963 [33:26:27<67:39:12, 10.13s/it]
 37%|███▋      | 13911/37963 [33:26:35<62:53:39,  9.41s/it]
 37%|███▋      | 13912/37963 [33:26:42<59:22:20,  8.89s/it]
 37%|███▋      | 13913/37963 [33:26:50<56:47:45,  8.50s/it]
 37%|███▋      | 13914/37963 [33:26:58<55:16:19,  8.27s/it]
 37%|███▋      | 13915/37963 [33:27:05<54:04:12,  8.09s/it]
 37%|███▋      | 13916/37963 [33:27:13<53:01:56,  7.94s/it]
 37%|███▋      | 13917/37963 [33:27:20<52:00:57,  7.79s/it]
 37%|███▋      | 13918/37963 [33:27:28<51:43:31,  7.74s/it]
 37%|███▋      | 13919/37963 [33:27:43<66:37:32,  9.98s/it]
 37%|███▋      | 13920/37963 [33:27:51<61:58:40,  9.28s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '2.822', 'learning_rate': '1.462e-05', 'epoch': '0.3667'}

 37%|███▋      | 13920/37963 [33:27:51<61:58:40,  9.28s/it]
 37%|███▋      | 13921/37963 [33:27:58<58:42:15,  8.79s/it]
 37%|███▋      | 13922/37963 [33:28:13<69:24:19, 10.39s/it]
 37%|███▋      | 13923/37963 [33:28:20<63:11:01,  9.46s/it]
 37%|███▋      | 13924/37963 [33:28:27<59:28:30,  8.91s/it]
 37%|███▋      | 13925/37963 [33:28:35<56:56:06,  8.53s/it]
 37%|███▋      | 13926/37963 [33:28:43<55:07:57,  8.26s/it]
 37%|███▋      | 13927/37963 [33:28:50<53:51:47,  8.07s/it]
 37%|███▋      | 13928/37963 [33:28:58<53:03:09,  7.95s/it]
 37%|███▋      | 13929/37963 [33:29:06<52:14:59,  7.83s/it]
 37%|███▋      | 13930/37963 [33:29:13<51:52:56,  7.77s/it]
                                                           
{'loss': '0.1692', 'grad_norm': '0.8471', 'learning_rate': '1.461e-05', 'epoch': '0.3669'}

 37%|███▋      | 13930/37963 [33:29:13<51:52:56,  7.77s/it]
 37%|███▋      | 13931/37963 [33:29:27<64:52:46,  9.72s/it]
 37%|███▋      | 13932/37963 [33:29:35<60:50:07,  9.11s/it]
 37%|███▋      | 13933/37963 [33:29:43<57:51:27,  8.67s/it]
 37%|███▋      | 13934/37963 [33:29:50<55:54:48,  8.38s/it]
 37%|███▋      | 13935/37963 [33:29:58<54:37:35,  8.18s/it]
 37%|███▋      | 13936/37963 [33:30:06<53:28:46,  8.01s/it]
 37%|███▋      | 13937/37963 [33:30:13<52:42:34,  7.90s/it]
 37%|███▋      | 13938/37963 [33:30:28<66:29:56,  9.96s/it]
 37%|███▋      | 13939/37963 [33:30:43<75:30:33, 11.32s/it]
 37%|███▋      | 13940/37963 [33:30:50<68:15:20, 10.23s/it]
                                                           
{'loss': '0.1696', 'grad_norm': '0.8293', 'learning_rate': '1.461e-05', 'epoch': '0.3672'}

 37%|███▋      | 13940/37963 [33:30:50<68:15:20, 10.23s/it]
 37%|███▋      | 13941/37963 [33:30:58<63:08:29,  9.46s/it]
 37%|███▋      | 13942/37963 [33:31:06<59:43:29,  8.95s/it]
 37%|███▋      | 13943/37963 [33:31:13<56:55:15,  8.53s/it]
 37%|███▋      | 13944/37963 [33:31:21<55:09:20,  8.27s/it]
 37%|███▋      | 13945/37963 [33:31:29<53:39:11,  8.04s/it]
 37%|███▋      | 13946/37963 [33:31:36<52:15:06,  7.83s/it]
 37%|███▋      | 13947/37963 [33:31:44<52:01:43,  7.80s/it]
 37%|███▋      | 13948/37963 [33:31:51<51:48:22,  7.77s/it]
 37%|███▋      | 13949/37963 [33:31:59<51:29:10,  7.72s/it]
 37%|███▋      | 13950/37963 [33:32:06<51:11:27,  7.67s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '2.757', 'learning_rate': '1.46e-05', 'epoch': '0.3675'}

 37%|███▋      | 13950/37963 [33:32:06<51:11:27,  7.67s/it]
 37%|███▋      | 13951/37963 [33:32:14<50:41:24,  7.60s/it]
 37%|███▋      | 13952/37963 [33:32:21<50:40:44,  7.60s/it]
 37%|███▋      | 13953/37963 [33:32:36<64:05:34,  9.61s/it]
 37%|███▋      | 13954/37963 [33:32:43<60:06:33,  9.01s/it]
 37%|███▋      | 13955/37963 [33:32:51<57:19:37,  8.60s/it]
 37%|███▋      | 13956/37963 [33:32:59<55:23:35,  8.31s/it]
 37%|███▋      | 13957/37963 [33:33:13<66:41:06, 10.00s/it]
 37%|███▋      | 13958/37963 [33:33:27<74:49:33, 11.22s/it]
 37%|███▋      | 13959/37963 [33:33:34<67:30:32, 10.12s/it]
 37%|███▋      | 13960/37963 [33:33:42<62:41:57,  9.40s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.486', 'learning_rate': '1.459e-05', 'epoch': '0.3677'}

 37%|███▋      | 13960/37963 [33:33:42<62:41:57,  9.40s/it]
 37%|███▋      | 13961/37963 [33:33:50<59:09:34,  8.87s/it]
 37%|███▋      | 13962/37963 [33:33:57<56:59:19,  8.55s/it]
 37%|███▋      | 13963/37963 [33:34:05<54:50:02,  8.23s/it]
 37%|███▋      | 13964/37963 [33:34:12<53:29:58,  8.03s/it]
 37%|███▋      | 13965/37963 [33:34:20<52:36:45,  7.89s/it]
 37%|███▋      | 13966/37963 [33:34:28<51:59:57,  7.80s/it]
 37%|███▋      | 13967/37963 [33:34:42<65:05:20,  9.76s/it]
 37%|███▋      | 13968/37963 [33:34:50<61:03:50,  9.16s/it]
 37%|███▋      | 13969/37963 [33:34:57<58:05:06,  8.71s/it]
 37%|███▋      | 13970/37963 [33:35:05<55:44:53,  8.36s/it]
                                                           
{'loss': '0.1706', 'grad_norm': '1.468', 'learning_rate': '1.458e-05', 'epoch': '0.368'}

 37%|███▋      | 13970/37963 [33:35:05<55:44:53,  8.36s/it]
 37%|███▋      | 13971/37963 [33:35:12<54:09:06,  8.13s/it]
 37%|███▋      | 13972/37963 [33:35:20<53:03:57,  7.96s/it]
 37%|███▋      | 13973/37963 [33:35:28<52:18:59,  7.85s/it]
 37%|███▋      | 13974/37963 [33:35:35<51:51:08,  7.78s/it]
 37%|███▋      | 13975/37963 [33:35:43<51:38:44,  7.75s/it]
 37%|███▋      | 13976/37963 [33:35:57<63:54:06,  9.59s/it]
 37%|███▋      | 13977/37963 [33:36:11<72:29:32, 10.88s/it]
 37%|███▋      | 13978/37963 [33:36:19<66:32:54,  9.99s/it]
 37%|███▋      | 13979/37963 [33:36:26<61:24:59,  9.22s/it]
 37%|███▋      | 13980/37963 [33:36:34<58:07:55,  8.73s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '0.8037', 'learning_rate': '1.458e-05', 'epoch': '0.3683'}

 37%|███▋      | 13980/37963 [33:36:34<58:07:55,  8.73s/it]
 37%|███▋      | 13981/37963 [33:36:41<55:56:38,  8.40s/it]
 37%|███▋      | 13982/37963 [33:36:49<54:06:56,  8.12s/it]
 37%|███▋      | 13983/37963 [33:36:56<52:53:56,  7.94s/it]
 37%|███▋      | 13984/37963 [33:37:10<64:56:02,  9.75s/it]
 37%|███▋      | 13985/37963 [33:37:18<60:34:32,  9.09s/it]
 37%|███▋      | 13986/37963 [33:37:25<57:23:25,  8.62s/it]
 37%|███▋      | 13987/37963 [33:37:33<55:28:48,  8.33s/it]
 37%|███▋      | 13988/37963 [33:37:40<53:44:25,  8.07s/it]
 37%|███▋      | 13989/37963 [33:37:48<52:52:23,  7.94s/it]
 37%|███▋      | 13990/37963 [33:38:02<65:02:53,  9.77s/it]
                                                           
{'loss': '0.1643', 'grad_norm': '2.037', 'learning_rate': '1.457e-05', 'epoch': '0.3685'}

 37%|███▋      | 13990/37963 [33:38:02<65:02:53,  9.77s/it]
 37%|███▋      | 13991/37963 [33:38:10<60:57:49,  9.16s/it]
 37%|███▋      | 13992/37963 [33:38:17<57:27:02,  8.63s/it]
 37%|███▋      | 13993/37963 [33:38:25<55:18:08,  8.31s/it]
 37%|███▋      | 13994/37963 [33:38:32<53:45:48,  8.07s/it]
 37%|███▋      | 13995/37963 [33:38:40<52:17:04,  7.85s/it]
 37%|███▋      | 13996/37963 [33:38:47<50:58:35,  7.66s/it]
 37%|███▋      | 13997/37963 [33:38:54<50:54:39,  7.65s/it]
 37%|███▋      | 13998/37963 [33:39:02<50:52:07,  7.64s/it]
 37%|███▋      | 13999/37963 [33:39:10<50:56:58,  7.65s/it]
 37%|███▋      | 14000/37963 [33:39:17<50:07:02,  7.53s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.236', 'learning_rate': '1.456e-05', 'epoch': '0.3688'}

 37%|███▋      | 14000/37963 [33:39:17<50:07:02,  7.53s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.57s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.57s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 37%|███▋      | 14001/37963 [33:40:21<161:55:30, 24.33s/it]
 37%|███▋      | 14002/37963 [33:40:34<140:43:07, 21.14s/it]
 37%|███▋      | 14003/37963 [33:40:42<113:32:43, 17.06s/it]
 37%|███▋      | 14004/37963 [33:40:49<94:50:20, 14.25s/it] 
 37%|███▋      | 14005/37963 [33:40:57<81:35:42, 12.26s/it]
 37%|███▋      | 14006/37963 [33:41:05<71:55:22, 10.81s/it]
 37%|███▋      | 14007/37963 [33:41:18<77:54:01, 11.71s/it]
 37%|███▋      | 14008/37963 [33:41:26<69:31:01, 10.45s/it]
 37%|███▋      | 14009/37963 [33:41:33<63:18:15,  9.51s/it]
 37%|███▋      | 14010/37963 [33:41:41<59:14:27,  8.90s/it]
                                                           
{'loss': '0.1704', 'grad_norm': '2.079', 'learning_rate': '1.455e-05', 'epoch': '0.369'}

 37%|███▋      | 14010/37963 [33:41:41<59:14:27,  8.90s/it]
 37%|███▋      | 14011/37963 [33:41:48<56:25:15,  8.48s/it]
 37%|███▋      | 14012/37963 [33:41:56<54:13:11,  8.15s/it]
 37%|███▋      | 14013/37963 [33:42:03<53:06:58,  7.98s/it]
 37%|███▋      | 14014/37963 [33:42:11<52:07:20,  7.83s/it]
 37%|███▋      | 14015/37963 [33:42:18<51:39:26,  7.77s/it]
 37%|███▋      | 14016/37963 [33:42:25<50:39:39,  7.62s/it]
 37%|███▋      | 14017/37963 [33:42:33<50:26:40,  7.58s/it]
 37%|███▋      | 14018/37963 [33:42:41<50:30:07,  7.59s/it]
 37%|███▋      | 14019/37963 [33:42:55<63:46:05,  9.59s/it]
 37%|███▋      | 14020/37963 [33:43:09<72:42:31, 10.93s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '0.8348', 'learning_rate': '1.455e-05', 'epoch': '0.3693'}

 37%|███▋      | 14020/37963 [33:43:09<72:42:31, 10.93s/it]
 37%|███▋      | 14021/37963 [33:43:16<65:54:07,  9.91s/it]
 37%|███▋      | 14022/37963 [33:43:24<60:49:01,  9.15s/it]
 37%|███▋      | 14023/37963 [33:43:31<57:33:31,  8.66s/it]
 37%|███▋      | 14024/37963 [33:43:39<55:20:01,  8.32s/it]
 37%|███▋      | 14025/37963 [33:43:46<53:48:57,  8.09s/it]
 37%|███▋      | 14026/37963 [33:43:54<52:30:04,  7.90s/it]
 37%|███▋      | 14027/37963 [33:44:01<51:32:32,  7.75s/it]
 37%|███▋      | 14028/37963 [33:44:15<63:31:12,  9.55s/it]
 37%|███▋      | 14029/37963 [33:44:23<59:25:35,  8.94s/it]
 37%|███▋      | 14030/37963 [33:44:30<56:15:20,  8.46s/it]
                                                           
{'loss': '0.1521', 'grad_norm': '1.508', 'learning_rate': '1.454e-05', 'epoch': '0.3696'}

 37%|███▋      | 14030/37963 [33:44:30<56:15:20,  8.46s/it]
 37%|███▋      | 14031/37963 [33:44:37<54:01:22,  8.13s/it]
 37%|███▋      | 14032/37963 [33:44:45<52:25:11,  7.89s/it]
 37%|███▋      | 14033/37963 [33:44:52<51:37:38,  7.77s/it]
 37%|███▋      | 14034/37963 [33:45:00<51:21:36,  7.73s/it]
 37%|███▋      | 14035/37963 [33:45:07<50:58:34,  7.67s/it]
 37%|███▋      | 14036/37963 [33:45:21<63:23:25,  9.54s/it]
 37%|███▋      | 14037/37963 [33:45:29<59:23:24,  8.94s/it]
 37%|███▋      | 14038/37963 [33:45:36<56:34:18,  8.51s/it]
 37%|███▋      | 14039/37963 [33:45:44<54:48:41,  8.25s/it]
 37%|███▋      | 14040/37963 [33:45:58<66:12:54,  9.96s/it]
                                                           
{'loss': '0.8677', 'grad_norm': '110.6', 'learning_rate': '1.453e-05', 'epoch': '0.3698'}

 37%|███▋      | 14040/37963 [33:45:58<66:12:54,  9.96s/it]
 37%|███▋      | 14041/37963 [33:46:05<61:25:20,  9.24s/it]
 37%|███▋      | 14042/37963 [33:46:13<58:02:02,  8.73s/it]
 37%|███▋      | 14043/37963 [33:46:20<55:36:41,  8.37s/it]
 37%|███▋      | 14044/37963 [33:46:28<53:41:48,  8.08s/it]
 37%|███▋      | 14045/37963 [33:46:35<52:39:39,  7.93s/it]
 37%|███▋      | 14046/37963 [33:46:43<51:12:41,  7.71s/it]
 37%|███▋      | 14047/37963 [33:46:56<62:53:56,  9.47s/it]
 37%|███▋      | 14048/37963 [33:47:03<58:38:05,  8.83s/it]
 37%|███▋      | 14049/37963 [33:47:11<56:06:32,  8.45s/it]
 37%|███▋      | 14050/37963 [33:47:19<54:13:54,  8.16s/it]
                                                           
{'loss': '0.316', 'grad_norm': '1.513', 'learning_rate': '1.452e-05', 'epoch': '0.3701'}

 37%|███▋      | 14050/37963 [33:47:19<54:13:54,  8.16s/it]
 37%|███▋      | 14051/37963 [33:47:39<78:25:56, 11.81s/it]
 37%|███▋      | 14052/37963 [33:47:46<70:08:10, 10.56s/it]
 37%|███▋      | 14053/37963 [33:47:54<64:09:28,  9.66s/it]
 37%|███▋      | 14054/37963 [33:48:02<60:00:42,  9.04s/it]
 37%|███▋      | 14055/37963 [33:48:09<57:13:32,  8.62s/it]
 37%|███▋      | 14056/37963 [33:48:17<55:07:38,  8.30s/it]
 37%|███▋      | 14057/37963 [33:48:24<53:37:29,  8.08s/it]
 37%|███▋      | 14058/37963 [33:48:32<52:45:53,  7.95s/it]
 37%|███▋      | 14059/37963 [33:48:40<52:09:34,  7.86s/it]
 37%|███▋      | 14060/37963 [33:48:47<51:33:44,  7.77s/it]
                                                           
{'loss': '2.357', 'grad_norm': '8.188', 'learning_rate': '1.452e-05', 'epoch': '0.3704'}

 37%|███▋      | 14060/37963 [33:48:47<51:33:44,  7.77s/it]
 37%|███▋      | 14061/37963 [33:48:55<51:17:06,  7.72s/it]
 37%|███▋      | 14062/37963 [33:49:02<51:02:42,  7.69s/it]
 37%|███▋      | 14063/37963 [33:49:10<51:03:01,  7.69s/it]
 37%|███▋      | 14064/37963 [33:49:18<50:41:09,  7.64s/it]
 37%|███▋      | 14065/37963 [33:49:25<50:29:40,  7.61s/it]
 37%|███▋      | 14066/37963 [33:49:33<50:28:12,  7.60s/it]
 37%|███▋      | 14067/37963 [33:49:40<50:17:37,  7.58s/it]
 37%|███▋      | 14068/37963 [33:49:54<63:24:52,  9.55s/it]
 37%|███▋      | 14069/37963 [33:50:02<59:16:58,  8.93s/it]
 37%|███▋      | 14070/37963 [33:50:09<56:26:06,  8.50s/it]
                                                           
{'loss': '0.1805', 'grad_norm': '2.49', 'learning_rate': '1.451e-05', 'epoch': '0.3706'}

 37%|███▋      | 14070/37963 [33:50:09<56:26:06,  8.50s/it]
 37%|███▋      | 14071/37963 [33:50:17<54:26:29,  8.20s/it]
 37%|███▋      | 14072/37963 [33:50:25<53:17:32,  8.03s/it]
 37%|███▋      | 14073/37963 [33:50:39<65:27:58,  9.87s/it]
 37%|███▋      | 14074/37963 [33:50:46<60:47:40,  9.16s/it]
 37%|███▋      | 14075/37963 [33:50:54<57:32:05,  8.67s/it]
 37%|███▋      | 14076/37963 [33:51:01<55:07:57,  8.31s/it]
 37%|███▋      | 14077/37963 [33:51:15<66:20:52, 10.00s/it]
 37%|███▋      | 14078/37963 [33:51:23<61:29:01,  9.27s/it]
 37%|███▋      | 14079/37963 [33:51:30<58:11:57,  8.77s/it]
 37%|███▋      | 14080/37963 [33:51:44<68:40:48, 10.35s/it]
                                                           
{'loss': '0.188', 'grad_norm': '1.298', 'learning_rate': '1.45e-05', 'epoch': '0.3709'}

 37%|███▋      | 14080/37963 [33:51:44<68:40:48, 10.35s/it]
 37%|███▋      | 14081/37963 [33:51:52<63:03:54,  9.51s/it]
 37%|███▋      | 14082/37963 [33:51:59<59:07:19,  8.91s/it]
 37%|███▋      | 14083/37963 [33:52:07<56:20:22,  8.49s/it]
 37%|███▋      | 14084/37963 [33:52:14<54:17:07,  8.18s/it]
 37%|███▋      | 14085/37963 [33:52:22<53:05:32,  8.00s/it]
 37%|███▋      | 14086/37963 [33:52:30<52:10:44,  7.87s/it]
 37%|███▋      | 14087/37963 [33:52:44<64:20:41,  9.70s/it]
 37%|███▋      | 14088/37963 [33:52:51<59:53:42,  9.03s/it]
 37%|███▋      | 14089/37963 [33:52:58<56:49:53,  8.57s/it]
 37%|███▋      | 14090/37963 [33:53:06<54:23:27,  8.20s/it]
                                                           
{'loss': '0.1699', 'grad_norm': '2.631', 'learning_rate': '1.449e-05', 'epoch': '0.3712'}

 37%|███▋      | 14090/37963 [33:53:06<54:23:27,  8.20s/it]
 37%|███▋      | 14091/37963 [33:53:13<52:57:42,  7.99s/it]
 37%|███▋      | 14092/37963 [33:53:27<65:05:50,  9.82s/it]
 37%|███▋      | 14093/37963 [33:53:35<60:12:40,  9.08s/it]
 37%|███▋      | 14094/37963 [33:53:42<56:46:10,  8.56s/it]
 37%|███▋      | 14095/37963 [33:53:50<54:41:24,  8.25s/it]
 37%|███▋      | 14096/37963 [33:53:57<52:40:27,  7.95s/it]
 37%|███▋      | 14097/37963 [33:54:04<51:24:49,  7.76s/it]
 37%|███▋      | 14098/37963 [33:54:12<51:05:22,  7.71s/it]
 37%|███▋      | 14099/37963 [33:54:19<50:41:17,  7.65s/it]
 37%|███▋      | 14100/37963 [33:54:27<50:28:24,  7.61s/it]
                                                           
{'loss': '0.1736', 'grad_norm': '1.416', 'learning_rate': '1.449e-05', 'epoch': '0.3714'}

 37%|███▋      | 14100/37963 [33:54:27<50:28:24,  7.61s/it]
 37%|███▋      | 14101/37963 [33:54:34<50:17:41,  7.59s/it]
 37%|███▋      | 14102/37963 [33:54:42<50:06:42,  7.56s/it]
 37%|███▋      | 14103/37963 [33:54:56<62:56:41,  9.50s/it]
 37%|███▋      | 14104/37963 [33:55:03<58:56:36,  8.89s/it]
 37%|███▋      | 14105/37963 [33:55:17<68:54:47, 10.40s/it]
 37%|███▋      | 14106/37963 [33:55:25<63:16:55,  9.55s/it]
 37%|███▋      | 14107/37963 [33:55:32<59:14:42,  8.94s/it]
 37%|███▋      | 14108/37963 [33:55:40<56:29:10,  8.52s/it]
 37%|███▋      | 14109/37963 [33:55:47<54:18:26,  8.20s/it]
 37%|███▋      | 14110/37963 [33:55:55<53:05:04,  8.01s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.974', 'learning_rate': '1.448e-05', 'epoch': '0.3717'}

 37%|███▋      | 14110/37963 [33:55:55<53:05:04,  8.01s/it]
 37%|███▋      | 14111/37963 [33:56:02<52:08:52,  7.87s/it]
 37%|███▋      | 14112/37963 [33:56:10<51:24:29,  7.76s/it]
 37%|███▋      | 14113/37963 [33:56:17<50:58:00,  7.69s/it]
 37%|███▋      | 14114/37963 [33:56:25<50:19:53,  7.60s/it]
 37%|███▋      | 14115/37963 [33:56:32<50:11:15,  7.58s/it]
 37%|███▋      | 14116/37963 [33:56:40<49:47:32,  7.52s/it]
 37%|███▋      | 14117/37963 [33:56:54<63:01:32,  9.51s/it]
 37%|███▋      | 14118/37963 [33:57:02<59:10:12,  8.93s/it]
 37%|███▋      | 14119/37963 [33:57:09<56:32:59,  8.54s/it]
 37%|███▋      | 14120/37963 [33:57:23<67:00:11, 10.12s/it]
                                                           
{'loss': '0.163', 'grad_norm': '1.344', 'learning_rate': '1.447e-05', 'epoch': '0.3719'}

 37%|███▋      | 14120/37963 [33:57:23<67:00:11, 10.12s/it]
 37%|███▋      | 14121/37963 [33:57:30<61:38:16,  9.31s/it]
 37%|███▋      | 14122/37963 [33:57:38<58:02:50,  8.77s/it]
 37%|███▋      | 14123/37963 [33:57:45<55:25:57,  8.37s/it]
 37%|███▋      | 14124/37963 [33:57:53<53:21:06,  8.06s/it]
 37%|███▋      | 14125/37963 [33:58:00<52:17:39,  7.90s/it]
 37%|███▋      | 14126/37963 [33:58:08<51:48:28,  7.82s/it]
 37%|███▋      | 14127/37963 [33:58:15<51:24:36,  7.76s/it]
 37%|███▋      | 14128/37963 [33:58:23<50:02:58,  7.56s/it]
 37%|███▋      | 14129/37963 [33:58:30<50:05:20,  7.57s/it]
 37%|███▋      | 14130/37963 [33:58:38<49:48:45,  7.52s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '4.898', 'learning_rate': '1.446e-05', 'epoch': '0.3722'}

 37%|███▋      | 14130/37963 [33:58:38<49:48:45,  7.52s/it]
 37%|███▋      | 14131/37963 [33:58:45<49:18:22,  7.45s/it]
 37%|███▋      | 14132/37963 [33:58:52<49:38:38,  7.50s/it]
 37%|███▋      | 14133/37963 [33:59:06<62:26:59,  9.43s/it]
 37%|███▋      | 14134/37963 [33:59:14<58:38:08,  8.86s/it]
 37%|███▋      | 14135/37963 [33:59:21<55:36:39,  8.40s/it]
 37%|███▋      | 14136/37963 [33:59:28<53:22:08,  8.06s/it]
 37%|███▋      | 14137/37963 [33:59:36<52:21:36,  7.91s/it]
 37%|███▋      | 14138/37963 [33:59:43<51:22:15,  7.76s/it]
 37%|███▋      | 14139/37963 [33:59:51<51:03:47,  7.72s/it]
 37%|███▋      | 14140/37963 [33:59:59<50:52:52,  7.69s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.586', 'learning_rate': '1.445e-05', 'epoch': '0.3725'}

 37%|███▋      | 14140/37963 [33:59:59<50:52:52,  7.69s/it]
 37%|███▋      | 14141/37963 [34:00:19<75:58:52, 11.48s/it]
 37%|███▋      | 14142/37963 [34:00:27<68:04:35, 10.29s/it]
 37%|███▋      | 14143/37963 [34:00:34<62:20:47,  9.42s/it]
 37%|███▋      | 14144/37963 [34:00:41<58:10:27,  8.79s/it]
 37%|███▋      | 14145/37963 [34:00:49<55:40:10,  8.41s/it]
 37%|███▋      | 14146/37963 [34:00:56<53:47:24,  8.13s/it]
 37%|███▋      | 14147/37963 [34:01:04<52:30:20,  7.94s/it]
 37%|███▋      | 14148/37963 [34:01:11<51:19:19,  7.76s/it]
 37%|███▋      | 14149/37963 [34:01:25<62:56:32,  9.52s/it]
 37%|███▋      | 14150/37963 [34:01:32<58:57:12,  8.91s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '2.504', 'learning_rate': '1.445e-05', 'epoch': '0.3727'}

 37%|███▋      | 14150/37963 [34:01:32<58:57:12,  8.91s/it]
 37%|███▋      | 14151/37963 [34:01:40<56:24:34,  8.53s/it]
 37%|███▋      | 14152/37963 [34:01:47<54:10:25,  8.19s/it]
 37%|███▋      | 14153/37963 [34:01:55<53:00:40,  8.02s/it]
 37%|███▋      | 14154/37963 [34:02:02<52:02:49,  7.87s/it]
 37%|███▋      | 14155/37963 [34:02:10<51:26:45,  7.78s/it]
 37%|███▋      | 14156/37963 [34:02:17<50:46:40,  7.68s/it]
 37%|███▋      | 14157/37963 [34:02:25<50:27:45,  7.63s/it]
 37%|███▋      | 14158/37963 [34:02:32<49:55:36,  7.55s/it]
 37%|███▋      | 14159/37963 [34:02:46<62:42:23,  9.48s/it]
 37%|███▋      | 14160/37963 [34:02:54<58:44:27,  8.88s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.068', 'learning_rate': '1.444e-05', 'epoch': '0.373'}

 37%|███▋      | 14160/37963 [34:02:54<58:44:27,  8.88s/it]
 37%|███▋      | 14161/37963 [34:03:02<56:31:49,  8.55s/it]
 37%|███▋      | 14162/37963 [34:03:09<54:34:11,  8.25s/it]
 37%|███▋      | 14163/37963 [34:03:17<53:07:26,  8.04s/it]
 37%|███▋      | 14164/37963 [34:03:24<52:07:06,  7.88s/it]
 37%|███▋      | 14165/37963 [34:03:38<64:25:05,  9.74s/it]
 37%|███▋      | 14166/37963 [34:03:52<73:18:24, 11.09s/it]
 37%|███▋      | 14167/37963 [34:04:00<65:59:57,  9.98s/it]
 37%|███▋      | 14168/37963 [34:04:07<61:19:48,  9.28s/it]
 37%|███▋      | 14169/37963 [34:04:15<57:32:02,  8.70s/it]
 37%|███▋      | 14170/37963 [34:04:29<67:46:57, 10.26s/it]
                                                           
{'loss': '0.1652', 'grad_norm': '1.505', 'learning_rate': '1.443e-05', 'epoch': '0.3733'}

 37%|███▋      | 14170/37963 [34:04:29<67:46:57, 10.26s/it]
 37%|███▋      | 14171/37963 [34:04:36<62:34:01,  9.47s/it]
 37%|███▋      | 14172/37963 [34:04:44<58:29:12,  8.85s/it]
 37%|███▋      | 14173/37963 [34:04:51<55:51:08,  8.45s/it]
 37%|███▋      | 14174/37963 [34:04:59<54:06:31,  8.19s/it]
 37%|███▋      | 14175/37963 [34:05:06<52:50:13,  8.00s/it]
 37%|███▋      | 14176/37963 [34:05:14<51:50:41,  7.85s/it]
 37%|███▋      | 14177/37963 [34:05:22<51:28:31,  7.79s/it]
 37%|███▋      | 14178/37963 [34:05:29<50:37:02,  7.66s/it]
 37%|███▋      | 14179/37963 [34:05:36<50:21:39,  7.62s/it]
 37%|███▋      | 14180/37963 [34:05:44<49:53:44,  7.55s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '2.213', 'learning_rate': '1.442e-05', 'epoch': '0.3735'}

 37%|███▋      | 14180/37963 [34:05:44<49:53:44,  7.55s/it]
 37%|███▋      | 14181/37963 [34:05:51<49:51:17,  7.55s/it]
 37%|███▋      | 14182/37963 [34:05:59<50:03:42,  7.58s/it]
 37%|███▋      | 14183/37963 [34:06:07<50:02:13,  7.57s/it]
 37%|███▋      | 14184/37963 [34:06:14<50:02:01,  7.57s/it]
 37%|███▋      | 14185/37963 [34:06:28<62:19:59,  9.44s/it]
 37%|███▋      | 14186/37963 [34:06:36<59:12:07,  8.96s/it]
 37%|███▋      | 14187/37963 [34:06:43<56:20:45,  8.53s/it]
 37%|███▋      | 14188/37963 [34:06:51<54:56:21,  8.32s/it]
 37%|███▋      | 14189/37963 [34:06:59<53:22:54,  8.08s/it]
 37%|███▋      | 14190/37963 [34:07:13<65:13:58,  9.88s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '0.7367', 'learning_rate': '1.442e-05', 'epoch': '0.3738'}

 37%|███▋      | 14190/37963 [34:07:13<65:13:58,  9.88s/it]
 37%|███▋      | 14191/37963 [34:07:20<60:33:04,  9.17s/it]
 37%|███▋      | 14192/37963 [34:07:28<57:10:13,  8.66s/it]
 37%|███▋      | 14193/37963 [34:07:35<54:20:40,  8.23s/it]
 37%|███▋      | 14194/37963 [34:07:49<65:53:16,  9.98s/it]
 37%|███▋      | 14195/37963 [34:07:56<60:52:00,  9.22s/it]
 37%|███▋      | 14196/37963 [34:08:04<57:40:39,  8.74s/it]
 37%|███▋      | 14197/37963 [34:08:18<67:58:05, 10.30s/it]
 37%|███▋      | 14198/37963 [34:08:25<62:08:02,  9.41s/it]
 37%|███▋      | 14199/37963 [34:08:33<58:18:57,  8.83s/it]
 37%|███▋      | 14200/37963 [34:08:40<55:46:07,  8.45s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '2.636', 'learning_rate': '1.441e-05', 'epoch': '0.374'}

 37%|███▋      | 14200/37963 [34:08:40<55:46:07,  8.45s/it]
 37%|███▋      | 14201/37963 [34:08:48<53:12:31,  8.06s/it]
 37%|███▋      | 14202/37963 [34:08:55<51:28:48,  7.80s/it]
 37%|███▋      | 14203/37963 [34:09:02<50:02:54,  7.58s/it]
 37%|███▋      | 14204/37963 [34:09:09<49:56:31,  7.57s/it]
 37%|███▋      | 14205/37963 [34:09:17<49:43:09,  7.53s/it]
 37%|███▋      | 14206/37963 [34:09:24<49:52:00,  7.56s/it]
 37%|███▋      | 14207/37963 [34:09:32<49:57:32,  7.57s/it]
 37%|███▋      | 14208/37963 [34:09:40<49:52:35,  7.56s/it]
 37%|███▋      | 14209/37963 [34:09:47<50:12:48,  7.61s/it]
 37%|███▋      | 14210/37963 [34:09:55<49:58:36,  7.57s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '3.111', 'learning_rate': '1.44e-05', 'epoch': '0.3743'}

 37%|███▋      | 14210/37963 [34:09:55<49:58:36,  7.57s/it]
 37%|███▋      | 14211/37963 [34:10:02<49:52:29,  7.56s/it]
 37%|███▋      | 14212/37963 [34:10:10<49:56:26,  7.57s/it]
 37%|███▋      | 14213/37963 [34:10:37<88:42:57, 13.45s/it]
 37%|███▋      | 14214/37963 [34:10:45<77:05:33, 11.69s/it]
 37%|███▋      | 14215/37963 [34:10:52<68:48:07, 10.43s/it]
 37%|███▋      | 14216/37963 [34:11:00<63:16:46,  9.59s/it]
 37%|███▋      | 14217/37963 [34:11:07<58:46:39,  8.91s/it]
 37%|███▋      | 14218/37963 [34:11:14<55:43:03,  8.45s/it]
 37%|███▋      | 14219/37963 [34:11:22<53:54:37,  8.17s/it]
 37%|███▋      | 14220/37963 [34:11:30<52:54:37,  8.02s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.626', 'learning_rate': '1.439e-05', 'epoch': '0.3746'}

 37%|███▋      | 14220/37963 [34:11:30<52:54:37,  8.02s/it]
 37%|███▋      | 14221/37963 [34:11:37<51:59:26,  7.88s/it]
 37%|███▋      | 14222/37963 [34:11:45<51:11:53,  7.76s/it]
 37%|███▋      | 14223/37963 [34:11:59<63:23:25,  9.61s/it]
 37%|███▋      | 14224/37963 [34:12:06<59:13:28,  8.98s/it]
 37%|███▋      | 14225/37963 [34:12:14<56:15:20,  8.53s/it]
 37%|███▋      | 14226/37963 [34:12:21<54:19:04,  8.24s/it]
 37%|███▋      | 14227/37963 [34:12:29<52:48:36,  8.01s/it]
 37%|███▋      | 14228/37963 [34:12:36<51:47:43,  7.86s/it]
 37%|███▋      | 14229/37963 [34:12:44<51:10:16,  7.76s/it]
 37%|███▋      | 14230/37963 [34:12:51<50:30:38,  7.66s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '3.343', 'learning_rate': '1.439e-05', 'epoch': '0.3748'}

 37%|███▋      | 14230/37963 [34:12:51<50:30:38,  7.66s/it]
 37%|███▋      | 14231/37963 [34:12:59<50:12:45,  7.62s/it]
 37%|███▋      | 14232/37963 [34:13:06<50:02:42,  7.59s/it]
 37%|███▋      | 14233/37963 [34:13:14<49:34:57,  7.52s/it]
 37%|███▋      | 14234/37963 [34:13:21<49:35:40,  7.52s/it]
 37%|███▋      | 14235/37963 [34:13:28<48:48:58,  7.41s/it]
 37%|███▋      | 14236/37963 [34:13:42<62:02:37,  9.41s/it]
 38%|███▊      | 14237/37963 [34:13:56<71:11:13, 10.80s/it]
 38%|███▊      | 14238/37963 [34:14:04<64:46:59,  9.83s/it]
 38%|███▊      | 14239/37963 [34:14:11<60:20:49,  9.16s/it]
 38%|███▊      | 14240/37963 [34:14:19<57:00:26,  8.65s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '2.122', 'learning_rate': '1.438e-05', 'epoch': '0.3751'}

 38%|███▊      | 14240/37963 [34:14:19<57:00:26,  8.65s/it]
 38%|███▊      | 14241/37963 [34:14:33<67:12:58, 10.20s/it]
 38%|███▊      | 14242/37963 [34:14:40<61:39:21,  9.36s/it]
 38%|███▊      | 14243/37963 [34:14:48<58:03:36,  8.81s/it]
 38%|███▊      | 14244/37963 [34:14:55<55:41:51,  8.45s/it]
 38%|███▊      | 14245/37963 [34:15:09<65:37:27,  9.96s/it]
 38%|███▊      | 14246/37963 [34:15:16<60:40:46,  9.21s/it]
 38%|███▊      | 14247/37963 [34:15:24<57:21:29,  8.71s/it]
 38%|███▊      | 14248/37963 [34:15:31<55:03:13,  8.36s/it]
 38%|███▊      | 14249/37963 [34:15:39<53:23:02,  8.10s/it]
 38%|███▊      | 14250/37963 [34:15:46<52:10:45,  7.92s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '1.323', 'learning_rate': '1.437e-05', 'epoch': '0.3754'}

 38%|███▊      | 14250/37963 [34:15:46<52:10:45,  7.92s/it]
 38%|███▊      | 14251/37963 [34:15:54<51:23:51,  7.80s/it]
 38%|███▊      | 14252/37963 [34:16:01<50:47:08,  7.71s/it]
 38%|███▊      | 14253/37963 [34:16:09<50:22:02,  7.65s/it]
 38%|███▊      | 14254/37963 [34:16:16<50:15:00,  7.63s/it]
 38%|███▊      | 14255/37963 [34:16:24<50:18:46,  7.64s/it]
 38%|███▊      | 14256/37963 [34:16:31<49:34:21,  7.53s/it]
 38%|███▊      | 14257/37963 [34:16:46<62:56:36,  9.56s/it]
 38%|███▊      | 14258/37963 [34:16:53<58:34:24,  8.90s/it]
 38%|███▊      | 14259/37963 [34:17:00<55:09:10,  8.38s/it]
 38%|███▊      | 14260/37963 [34:17:08<53:38:03,  8.15s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '1.631', 'learning_rate': '1.436e-05', 'epoch': '0.3756'}

 38%|███▊      | 14260/37963 [34:17:08<53:38:03,  8.15s/it]
 38%|███▊      | 14261/37963 [34:17:15<52:25:32,  7.96s/it]
 38%|███▊      | 14262/37963 [34:17:23<51:06:04,  7.76s/it]
 38%|███▊      | 14263/37963 [34:17:30<50:40:44,  7.70s/it]
 38%|███▊      | 14264/37963 [34:17:38<50:17:46,  7.64s/it]
 38%|███▊      | 14265/37963 [34:17:51<62:16:44,  9.46s/it]
 38%|███▊      | 14266/37963 [34:17:59<58:46:26,  8.93s/it]
 38%|███▊      | 14267/37963 [34:18:13<68:23:52, 10.39s/it]
 38%|███▊      | 14268/37963 [34:18:21<62:59:49,  9.57s/it]
 38%|███▊      | 14269/37963 [34:18:35<71:58:00, 10.93s/it]
 38%|███▊      | 14270/37963 [34:18:42<65:19:58,  9.93s/it]
                                                           
{'loss': '0.1618', 'grad_norm': '0.8983', 'learning_rate': '1.436e-05', 'epoch': '0.3759'}

 38%|███▊      | 14270/37963 [34:18:42<65:19:58,  9.93s/it]
 38%|███▊      | 14271/37963 [34:18:50<60:42:10,  9.22s/it]
 38%|███▊      | 14272/37963 [34:18:57<57:06:28,  8.68s/it]
 38%|███▊      | 14273/37963 [34:19:05<54:48:54,  8.33s/it]
 38%|███▊      | 14274/37963 [34:19:12<53:18:14,  8.10s/it]
 38%|███▊      | 14275/37963 [34:19:20<52:22:57,  7.96s/it]
 38%|███▊      | 14276/37963 [34:19:27<51:28:11,  7.82s/it]
 38%|███▊      | 14277/37963 [34:19:35<51:07:02,  7.77s/it]
 38%|███▊      | 14278/37963 [34:19:42<50:14:59,  7.64s/it]
 38%|███▊      | 14279/37963 [34:19:50<50:03:27,  7.61s/it]
 38%|███▊      | 14280/37963 [34:19:57<49:35:33,  7.54s/it]
                                                           
{'loss': '0.1773', 'grad_norm': '1.105', 'learning_rate': '1.435e-05', 'epoch': '0.3762'}

 38%|███▊      | 14280/37963 [34:19:57<49:35:33,  7.54s/it]
 38%|███▊      | 14281/37963 [34:20:05<49:31:40,  7.53s/it]
 38%|███▊      | 14282/37963 [34:20:12<49:31:48,  7.53s/it]
 38%|███▊      | 14283/37963 [34:20:20<49:45:47,  7.57s/it]
 38%|███▊      | 14284/37963 [34:20:34<62:22:58,  9.48s/it]
 38%|███▊      | 14285/37963 [34:20:42<58:35:09,  8.91s/it]
 38%|███▊      | 14286/37963 [34:20:49<55:04:16,  8.37s/it]
 38%|███▊      | 14287/37963 [34:20:56<53:18:13,  8.10s/it]
 38%|███▊      | 14288/37963 [34:21:10<64:13:02,  9.76s/it]
 38%|███▊      | 14289/37963 [34:21:17<59:57:02,  9.12s/it]
 38%|███▊      | 14290/37963 [34:21:32<69:52:49, 10.63s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '2.355', 'learning_rate': '1.434e-05', 'epoch': '0.3764'}

 38%|███▊      | 14290/37963 [34:21:32<69:52:49, 10.63s/it]
 38%|███▊      | 14291/37963 [34:21:39<63:54:56,  9.72s/it]
 38%|███▊      | 14292/37963 [34:21:47<59:31:45,  9.05s/it]
 38%|███▊      | 14293/37963 [34:21:54<56:31:44,  8.60s/it]
 38%|███▊      | 14294/37963 [34:22:02<54:33:22,  8.30s/it]
 38%|███▊      | 14295/37963 [34:22:09<52:57:33,  8.06s/it]
 38%|███▊      | 14296/37963 [34:22:17<51:59:31,  7.91s/it]
 38%|███▊      | 14297/37963 [34:22:24<51:11:35,  7.79s/it]
 38%|███▊      | 14298/37963 [34:22:32<50:41:05,  7.71s/it]
 38%|███▊      | 14299/37963 [34:22:46<63:09:27,  9.61s/it]
 38%|███▊      | 14300/37963 [34:22:53<59:07:09,  8.99s/it]
                                                           
{'loss': '0.1748', 'grad_norm': '4.608', 'learning_rate': '1.433e-05', 'epoch': '0.3767'}

 38%|███▊      | 14300/37963 [34:22:53<59:07:09,  8.99s/it]
 38%|███▊      | 14301/37963 [34:23:01<56:17:55,  8.57s/it]
 38%|███▊      | 14302/37963 [34:23:09<54:26:49,  8.28s/it]
 38%|███▊      | 14303/37963 [34:23:16<52:58:01,  8.06s/it]
 38%|███▊      | 14304/37963 [34:23:30<64:32:32,  9.82s/it]
 38%|███▊      | 14305/37963 [34:23:38<59:54:55,  9.12s/it]
 38%|███▊      | 14306/37963 [34:23:45<56:15:40,  8.56s/it]
 38%|███▊      | 14307/37963 [34:23:52<54:16:08,  8.26s/it]
 38%|███▊      | 14308/37963 [34:24:00<52:44:42,  8.03s/it]
 38%|███▊      | 14309/37963 [34:24:07<51:43:37,  7.87s/it]
 38%|███▊      | 14310/37963 [34:24:15<50:59:02,  7.76s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.089', 'learning_rate': '1.432e-05', 'epoch': '0.3769'}

 38%|███▊      | 14310/37963 [34:24:15<50:59:02,  7.76s/it]
 38%|███▊      | 14311/37963 [34:24:22<49:52:18,  7.59s/it]
 38%|███▊      | 14312/37963 [34:24:30<49:41:11,  7.56s/it]
 38%|███▊      | 14313/37963 [34:24:44<62:22:09,  9.49s/it]
 38%|███▊      | 14314/37963 [34:24:51<57:51:25,  8.81s/it]
 38%|███▊      | 14315/37963 [34:24:58<55:12:00,  8.40s/it]
 38%|███▊      | 14316/37963 [34:25:06<53:23:27,  8.13s/it]
 38%|███▊      | 14317/37963 [34:25:13<52:12:29,  7.95s/it]
 38%|███▊      | 14318/37963 [34:25:21<51:24:17,  7.83s/it]
 38%|███▊      | 14319/37963 [34:25:28<50:48:23,  7.74s/it]
 38%|███▊      | 14320/37963 [34:25:42<62:50:52,  9.57s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '0.8234', 'learning_rate': '1.432e-05', 'epoch': '0.3772'}

 38%|███▊      | 14320/37963 [34:25:42<62:50:52,  9.57s/it]
 38%|███▊      | 14321/37963 [34:25:56<71:48:30, 10.93s/it]
 38%|███▊      | 14322/37963 [34:26:04<65:13:46,  9.93s/it]
 38%|███▊      | 14323/37963 [34:26:11<60:26:11,  9.20s/it]
 38%|███▊      | 14324/37963 [34:26:19<57:01:31,  8.68s/it]
 38%|███▊      | 14325/37963 [34:26:26<54:24:40,  8.29s/it]
 38%|███▊      | 14326/37963 [34:26:34<52:41:53,  8.03s/it]
 38%|███▊      | 14327/37963 [34:26:41<51:41:25,  7.87s/it]
 38%|███▊      | 14328/37963 [34:26:49<50:56:08,  7.76s/it]
 38%|███▊      | 14329/37963 [34:27:02<62:32:00,  9.53s/it]
 38%|███▊      | 14330/37963 [34:27:09<57:50:10,  8.81s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '1.585', 'learning_rate': '1.431e-05', 'epoch': '0.3775'}

 38%|███▊      | 14330/37963 [34:27:09<57:50:10,  8.81s/it]
 38%|███▊      | 14331/37963 [34:27:17<55:17:35,  8.42s/it]
 38%|███▊      | 14332/37963 [34:27:25<53:40:48,  8.18s/it]
 38%|███▊      | 14333/37963 [34:27:32<51:57:01,  7.91s/it]
 38%|███▊      | 14334/37963 [34:27:39<51:11:41,  7.80s/it]
 38%|███▊      | 14335/37963 [34:27:47<50:42:45,  7.73s/it]
 38%|███▊      | 14336/37963 [34:27:55<50:24:30,  7.68s/it]
 38%|███▊      | 14337/37963 [34:28:02<50:14:22,  7.66s/it]
 38%|███▊      | 14338/37963 [34:28:16<61:57:33,  9.44s/it]
 38%|███▊      | 14339/37963 [34:28:30<70:57:22, 10.81s/it]
 38%|███▊      | 14340/37963 [34:28:37<64:28:31,  9.83s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '0.9053', 'learning_rate': '1.43e-05', 'epoch': '0.3777'}

 38%|███▊      | 14340/37963 [34:28:37<64:28:31,  9.83s/it]
 38%|███▊      | 14341/37963 [34:28:45<59:55:19,  9.13s/it]
 38%|███▊      | 14342/37963 [34:28:52<56:33:42,  8.62s/it]
 38%|███▊      | 14343/37963 [34:29:00<54:32:34,  8.31s/it]
 38%|███▊      | 14344/37963 [34:29:07<52:42:57,  8.03s/it]
 38%|███▊      | 14345/37963 [34:29:15<51:47:12,  7.89s/it]
 38%|███▊      | 14346/37963 [34:29:22<50:48:26,  7.74s/it]
 38%|███▊      | 14347/37963 [34:29:30<50:12:11,  7.65s/it]
 38%|███▊      | 14348/37963 [34:29:44<63:25:59,  9.67s/it]
 38%|███▊      | 14349/37963 [34:29:58<71:22:36, 10.88s/it]
 38%|███▊      | 14350/37963 [34:30:05<64:48:11,  9.88s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '2.63', 'learning_rate': '1.429e-05', 'epoch': '0.378'}

 38%|███▊      | 14350/37963 [34:30:05<64:48:11,  9.88s/it]
 38%|███▊      | 14351/37963 [34:30:13<60:18:32,  9.19s/it]
 38%|███▊      | 14352/37963 [34:30:20<57:12:17,  8.72s/it]
 38%|███▊      | 14353/37963 [34:30:28<54:49:31,  8.36s/it]
 38%|███▊      | 14354/37963 [34:30:35<53:09:37,  8.11s/it]
 38%|███▊      | 14355/37963 [34:30:43<51:59:38,  7.93s/it]
 38%|███▊      | 14356/37963 [34:30:51<51:20:51,  7.83s/it]
 38%|███▊      | 14357/37963 [34:30:58<50:35:35,  7.72s/it]
 38%|███▊      | 14358/37963 [34:31:06<50:08:33,  7.65s/it]
 38%|███▊      | 14359/37963 [34:31:13<49:02:28,  7.48s/it]
 38%|███▊      | 14360/37963 [34:31:20<49:04:33,  7.49s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.816', 'learning_rate': '1.429e-05', 'epoch': '0.3783'}

 38%|███▊      | 14360/37963 [34:31:20<49:04:33,  7.49s/it]
 38%|███▊      | 14361/37963 [34:31:27<48:32:54,  7.41s/it]
 38%|███▊      | 14362/37963 [34:31:35<48:56:40,  7.47s/it]
 38%|███▊      | 14363/37963 [34:31:42<49:04:55,  7.49s/it]
 38%|███▊      | 14364/37963 [34:31:50<49:10:08,  7.50s/it]
 38%|███▊      | 14365/37963 [34:31:58<49:08:53,  7.50s/it]
 38%|███▊      | 14366/37963 [34:32:11<61:48:41,  9.43s/it]
 38%|███▊      | 14367/37963 [34:32:19<57:59:45,  8.85s/it]
 38%|███▊      | 14368/37963 [34:32:26<55:02:52,  8.40s/it]
 38%|███▊      | 14369/37963 [34:32:40<65:16:14,  9.96s/it]
 38%|███▊      | 14370/37963 [34:32:47<60:39:36,  9.26s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '2.044', 'learning_rate': '1.428e-05', 'epoch': '0.3785'}

 38%|███▊      | 14370/37963 [34:32:47<60:39:36,  9.26s/it]
 38%|███▊      | 14371/37963 [34:32:55<57:13:42,  8.73s/it]
 38%|███▊      | 14372/37963 [34:33:03<54:48:50,  8.36s/it]
 38%|███▊      | 14373/37963 [34:33:16<65:23:16,  9.98s/it]
 38%|███▊      | 14374/37963 [34:33:24<60:36:41,  9.25s/it]
 38%|███▊      | 14375/37963 [34:33:31<57:05:51,  8.71s/it]
 38%|███▊      | 14376/37963 [34:33:45<66:48:24, 10.20s/it]
 38%|███▊      | 14377/37963 [34:33:52<61:35:40,  9.40s/it]
 38%|███▊      | 14378/37963 [34:34:00<57:31:49,  8.78s/it]
 38%|███▊      | 14379/37963 [34:34:07<55:02:07,  8.40s/it]
 38%|███▊      | 14380/37963 [34:34:15<53:05:11,  8.10s/it]
                                                           
{'loss': '0.1632', 'grad_norm': '1.594', 'learning_rate': '1.427e-05', 'epoch': '0.3788'}

 38%|███▊      | 14380/37963 [34:34:15<53:05:11,  8.10s/it]
 38%|███▊      | 14381/37963 [34:34:22<52:06:34,  7.96s/it]
 38%|███▊      | 14382/37963 [34:34:36<63:58:51,  9.77s/it]
 38%|███▊      | 14383/37963 [34:34:50<72:13:41, 11.03s/it]
 38%|███▊      | 14384/37963 [34:34:58<65:19:45,  9.97s/it]
 38%|███▊      | 14385/37963 [34:35:05<59:49:27,  9.13s/it]
 38%|███▊      | 14386/37963 [34:35:13<56:39:01,  8.65s/it]
 38%|███▊      | 14387/37963 [34:35:20<54:32:54,  8.33s/it]
 38%|███▊      | 14388/37963 [34:35:28<52:51:05,  8.07s/it]
 38%|███▊      | 14389/37963 [34:35:35<51:55:56,  7.93s/it]
 38%|███▊      | 14390/37963 [34:35:43<51:12:49,  7.82s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '2.456', 'learning_rate': '1.426e-05', 'epoch': '0.3791'}

 38%|███▊      | 14390/37963 [34:35:43<51:12:49,  7.82s/it]
 38%|███▊      | 14391/37963 [34:35:50<50:23:40,  7.70s/it]
 38%|███▊      | 14392/37963 [34:35:58<50:30:31,  7.71s/it]
 38%|███▊      | 14393/37963 [34:36:05<49:32:06,  7.57s/it]
 38%|███▊      | 14394/37963 [34:36:13<49:41:52,  7.59s/it]
 38%|███▊      | 14395/37963 [34:36:26<61:09:07,  9.34s/it]
 38%|███▊      | 14396/37963 [34:36:34<57:32:34,  8.79s/it]
 38%|███▊      | 14397/37963 [34:36:47<67:10:38, 10.26s/it]
 38%|███▊      | 14398/37963 [34:36:55<62:00:35,  9.47s/it]
 38%|███▊      | 14399/37963 [34:37:02<58:00:38,  8.86s/it]
 38%|███▊      | 14400/37963 [34:37:10<55:03:15,  8.41s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '2.478', 'learning_rate': '1.426e-05', 'epoch': '0.3793'}

 38%|███▊      | 14400/37963 [34:37:10<55:03:15,  8.41s/it]
 38%|███▊      | 14401/37963 [34:37:17<53:00:01,  8.10s/it]
 38%|███▊      | 14402/37963 [34:37:25<52:07:53,  7.97s/it]
 38%|███▊      | 14403/37963 [34:37:32<51:22:51,  7.85s/it]
 38%|███▊      | 14404/37963 [34:37:40<50:45:53,  7.76s/it]
 38%|███▊      | 14405/37963 [34:37:48<50:20:18,  7.69s/it]
 38%|███▊      | 14406/37963 [34:37:55<49:55:24,  7.63s/it]
 38%|███▊      | 14407/37963 [34:38:03<49:58:38,  7.64s/it]
 38%|███▊      | 14408/37963 [34:38:10<49:26:43,  7.56s/it]
 38%|███▊      | 14409/37963 [34:38:17<48:59:45,  7.49s/it]
 38%|███▊      | 14410/37963 [34:38:25<48:29:04,  7.41s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.16', 'learning_rate': '1.425e-05', 'epoch': '0.3796'}

 38%|███▊      | 14410/37963 [34:38:25<48:29:04,  7.41s/it]
 38%|███▊      | 14411/37963 [34:38:32<48:36:52,  7.43s/it]
 38%|███▊      | 14412/37963 [34:38:40<48:50:17,  7.47s/it]
 38%|███▊      | 14413/37963 [34:38:47<49:05:12,  7.50s/it]
 38%|███▊      | 14414/37963 [34:38:54<48:38:52,  7.44s/it]
 38%|███▊      | 14415/37963 [34:39:08<61:28:25,  9.40s/it]
 38%|███▊      | 14416/37963 [34:39:22<70:32:42, 10.79s/it]
 38%|███▊      | 14417/37963 [34:39:36<76:18:19, 11.67s/it]
 38%|███▊      | 14418/37963 [34:39:44<68:06:03, 10.41s/it]
 38%|███▊      | 14419/37963 [34:39:51<62:21:56,  9.54s/it]
 38%|███▊      | 14420/37963 [34:39:59<58:41:01,  8.97s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '1.411', 'learning_rate': '1.424e-05', 'epoch': '0.3798'}

 38%|███▊      | 14420/37963 [34:39:59<58:41:01,  8.97s/it]
 38%|███▊      | 14421/37963 [34:40:06<55:46:21,  8.53s/it]
 38%|███▊      | 14422/37963 [34:40:14<53:44:37,  8.22s/it]
 38%|███▊      | 14423/37963 [34:40:21<51:57:11,  7.95s/it]
 38%|███▊      | 14424/37963 [34:40:29<51:03:32,  7.81s/it]
 38%|███▊      | 14425/37963 [34:40:36<50:34:20,  7.73s/it]
 38%|███▊      | 14426/37963 [34:40:50<62:44:13,  9.60s/it]
 38%|███▊      | 14427/37963 [34:40:58<58:37:19,  8.97s/it]
 38%|███▊      | 14428/37963 [34:41:05<55:23:36,  8.47s/it]
 38%|███▊      | 14429/37963 [34:41:12<53:19:13,  8.16s/it]
 38%|███▊      | 14430/37963 [34:41:20<52:05:29,  7.97s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '2.474', 'learning_rate': '1.423e-05', 'epoch': '0.3801'}

 38%|███▊      | 14430/37963 [34:41:20<52:05:29,  7.97s/it]
 38%|███▊      | 14431/37963 [34:41:34<64:17:11,  9.83s/it]
 38%|███▊      | 14432/37963 [34:41:42<59:45:04,  9.14s/it]
 38%|███▊      | 14433/37963 [34:41:56<69:49:39, 10.68s/it]
 38%|███▊      | 14434/37963 [34:42:03<63:38:23,  9.74s/it]
 38%|███▊      | 14435/37963 [34:42:11<59:27:30,  9.10s/it]
 38%|███▊      | 14436/37963 [34:42:19<56:19:26,  8.62s/it]
 38%|███▊      | 14437/37963 [34:42:26<54:16:24,  8.31s/it]
 38%|███▊      | 14438/37963 [34:42:34<52:36:35,  8.05s/it]
 38%|███▊      | 14439/37963 [34:42:41<51:28:14,  7.88s/it]
 38%|███▊      | 14440/37963 [34:42:49<51:05:48,  7.82s/it]
                                                           
{'loss': '0.1666', 'grad_norm': '1.537', 'learning_rate': '1.422e-05', 'epoch': '0.3804'}

 38%|███▊      | 14440/37963 [34:42:49<51:05:48,  7.82s/it]
 38%|███▊      | 14441/37963 [34:42:56<50:27:31,  7.72s/it]
 38%|███▊      | 14442/37963 [34:43:10<62:54:37,  9.63s/it]
 38%|███▊      | 14443/37963 [34:43:18<58:57:15,  9.02s/it]
 38%|███▊      | 14444/37963 [34:43:25<55:49:19,  8.54s/it]
 38%|███▊      | 14445/37963 [34:43:33<53:52:18,  8.25s/it]
 38%|███▊      | 14446/37963 [34:43:40<52:31:04,  8.04s/it]
 38%|███▊      | 14447/37963 [34:43:54<64:00:00,  9.80s/it]
 38%|███▊      | 14448/37963 [34:44:02<59:55:31,  9.17s/it]
 38%|███▊      | 14449/37963 [34:44:10<56:58:09,  8.72s/it]
 38%|███▊      | 14450/37963 [34:44:17<54:34:28,  8.36s/it]
                                                           
{'loss': '0.1605', 'grad_norm': '3.197', 'learning_rate': '1.422e-05', 'epoch': '0.3806'}

 38%|███▊      | 14450/37963 [34:44:17<54:34:28,  8.36s/it]
 38%|███▊      | 14451/37963 [34:44:24<52:25:59,  8.03s/it]
 38%|███▊      | 14452/37963 [34:44:32<51:28:21,  7.88s/it]
 38%|███▊      | 14453/37963 [34:44:40<50:50:09,  7.78s/it]
 38%|███▊      | 14454/37963 [34:44:47<50:12:45,  7.69s/it]
 38%|███▊      | 14455/37963 [34:44:55<49:54:43,  7.64s/it]
 38%|███▊      | 14456/37963 [34:45:02<49:29:34,  7.58s/it]
 38%|███▊      | 14457/37963 [34:45:10<49:24:18,  7.57s/it]
 38%|███▊      | 14458/37963 [34:45:17<49:18:29,  7.55s/it]
 38%|███▊      | 14459/37963 [34:45:31<61:39:05,  9.44s/it]
 38%|███▊      | 14460/37963 [34:45:38<57:57:30,  8.88s/it]
                                                           
{'loss': '0.151', 'grad_norm': '3.291', 'learning_rate': '1.421e-05', 'epoch': '0.3809'}

 38%|███▊      | 14460/37963 [34:45:38<57:57:30,  8.88s/it]
 38%|███▊      | 14461/37963 [34:45:52<67:17:30, 10.31s/it]
 38%|███▊      | 14462/37963 [34:46:00<61:59:00,  9.49s/it]
 38%|███▊      | 14463/37963 [34:46:07<58:14:49,  8.92s/it]
 38%|███▊      | 14464/37963 [34:46:15<55:32:34,  8.51s/it]
 38%|███▊      | 14465/37963 [34:46:23<53:53:40,  8.26s/it]
 38%|███▊      | 14466/37963 [34:46:30<52:32:58,  8.05s/it]
 38%|███▊      | 14467/37963 [34:46:37<50:59:54,  7.81s/it]
 38%|███▊      | 14468/37963 [34:46:45<50:22:37,  7.72s/it]
 38%|███▊      | 14469/37963 [34:46:52<50:04:18,  7.67s/it]
 38%|███▊      | 14470/37963 [34:47:00<49:37:39,  7.60s/it]
                                                           
{'loss': '0.163', 'grad_norm': '2.438', 'learning_rate': '1.42e-05', 'epoch': '0.3812'}

 38%|███▊      | 14470/37963 [34:47:00<49:37:39,  7.60s/it]
 38%|███▊      | 14471/37963 [34:47:13<61:03:32,  9.36s/it]
 38%|███▊      | 14472/37963 [34:47:21<57:37:00,  8.83s/it]
 38%|███▊      | 14473/37963 [34:47:28<55:12:47,  8.46s/it]
 38%|███▊      | 14474/37963 [34:47:42<65:58:44, 10.11s/it]
 38%|███▊      | 14475/37963 [34:47:50<61:12:59,  9.38s/it]
 38%|███▊      | 14476/37963 [34:48:04<70:29:32, 10.80s/it]
 38%|███▊      | 14477/37963 [34:48:12<64:10:35,  9.84s/it]
 38%|███▊      | 14478/37963 [34:48:19<59:21:02,  9.10s/it]
 38%|███▊      | 14479/37963 [34:48:27<56:14:55,  8.62s/it]
 38%|███▊      | 14480/37963 [34:48:40<66:08:41, 10.14s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.316', 'learning_rate': '1.419e-05', 'epoch': '0.3814'}

 38%|███▊      | 14480/37963 [34:48:40<66:08:41, 10.14s/it]
 38%|███▊      | 14481/37963 [34:48:48<61:06:03,  9.37s/it]
 38%|███▊      | 14482/37963 [34:48:55<57:29:27,  8.81s/it]
 38%|███▊      | 14483/37963 [34:49:03<54:57:48,  8.43s/it]
 38%|███▊      | 14484/37963 [34:49:10<52:51:51,  8.11s/it]
 38%|███▊      | 14485/37963 [34:49:18<51:48:07,  7.94s/it]
 38%|███▊      | 14486/37963 [34:49:25<50:54:40,  7.81s/it]
 38%|███▊      | 14487/37963 [34:49:33<50:44:22,  7.78s/it]
 38%|███▊      | 14488/37963 [34:49:41<50:02:27,  7.67s/it]
 38%|███▊      | 14489/37963 [34:49:48<49:46:50,  7.63s/it]
 38%|███▊      | 14490/37963 [34:49:56<49:33:17,  7.60s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.368', 'learning_rate': '1.419e-05', 'epoch': '0.3817'}

 38%|███▊      | 14490/37963 [34:49:56<49:33:17,  7.60s/it]
 38%|███▊      | 14491/37963 [34:50:03<49:27:36,  7.59s/it]
 38%|███▊      | 14492/37963 [34:50:11<49:06:45,  7.53s/it]
 38%|███▊      | 14493/37963 [34:50:25<61:40:06,  9.46s/it]
 38%|███▊      | 14494/37963 [34:50:32<57:40:05,  8.85s/it]
 38%|███▊      | 14495/37963 [34:50:40<55:07:06,  8.46s/it]
 38%|███▊      | 14496/37963 [34:50:47<53:13:51,  8.17s/it]
 38%|███▊      | 14497/37963 [34:50:55<52:12:01,  8.01s/it]
 38%|███▊      | 14498/37963 [34:51:09<63:41:02,  9.77s/it]
 38%|███▊      | 14499/37963 [34:51:16<59:17:41,  9.10s/it]
 38%|███▊      | 14500/37963 [34:51:23<55:35:14,  8.53s/it]
                                                           
{'loss': '0.148', 'grad_norm': '3.457', 'learning_rate': '1.418e-05', 'epoch': '0.382'}

 38%|███▊      | 14500/37963 [34:51:23<55:35:14,  8.53s/it]
 38%|███▊      | 14501/37963 [34:51:31<53:39:48,  8.23s/it]
 38%|███▊      | 14502/37963 [34:51:38<52:27:15,  8.05s/it]
 38%|███▊      | 14503/37963 [34:51:46<51:04:42,  7.84s/it]
 38%|███▊      | 14504/37963 [34:51:53<49:38:57,  7.62s/it]
 38%|███▊      | 14505/37963 [34:52:00<49:28:52,  7.59s/it]
 38%|███▊      | 14506/37963 [34:52:08<49:25:57,  7.59s/it]
 38%|███▊      | 14507/37963 [34:52:15<48:54:34,  7.51s/it]
 38%|███▊      | 14508/37963 [34:52:23<48:52:37,  7.50s/it]
 38%|███▊      | 14509/37963 [34:52:30<48:55:09,  7.51s/it]
 38%|███▊      | 14510/37963 [34:52:38<49:03:13,  7.53s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '5.099', 'learning_rate': '1.417e-05', 'epoch': '0.3822'}

 38%|███▊      | 14510/37963 [34:52:38<49:03:13,  7.53s/it]
 38%|███▊      | 14511/37963 [34:52:45<49:01:35,  7.53s/it]
 38%|███▊      | 14512/37963 [34:52:53<48:58:30,  7.52s/it]
 38%|███▊      | 14513/37963 [34:53:13<74:04:09, 11.37s/it]
 38%|███▊      | 14514/37963 [34:53:21<66:23:52, 10.19s/it]
 38%|███▊      | 14515/37963 [34:53:28<60:39:55,  9.31s/it]
 38%|███▊      | 14516/37963 [34:53:35<57:08:12,  8.77s/it]
 38%|███▊      | 14517/37963 [34:53:50<67:27:13, 10.36s/it]
 38%|███▊      | 14518/37963 [34:53:57<61:55:18,  9.51s/it]
 38%|███▊      | 14519/37963 [34:54:11<70:20:09, 10.80s/it]
 38%|███▊      | 14520/37963 [34:54:18<63:52:35,  9.81s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '2.359', 'learning_rate': '1.416e-05', 'epoch': '0.3825'}

 38%|███▊      | 14520/37963 [34:54:18<63:52:35,  9.81s/it]
 38%|███▊      | 14521/37963 [34:54:26<59:01:51,  9.07s/it]
 38%|███▊      | 14522/37963 [34:54:33<56:25:00,  8.66s/it]
 38%|███▊      | 14523/37963 [34:54:47<66:39:51, 10.24s/it]
 38%|███▊      | 14524/37963 [34:54:55<61:08:39,  9.39s/it]
 38%|███▊      | 14525/37963 [34:55:02<57:35:18,  8.85s/it]
 38%|███▊      | 14526/37963 [34:55:10<55:13:21,  8.48s/it]
 38%|███▊      | 14527/37963 [34:55:17<53:18:37,  8.19s/it]
 38%|███▊      | 14528/37963 [34:55:25<52:26:17,  8.06s/it]
 38%|███▊      | 14529/37963 [34:55:33<51:23:49,  7.90s/it]
 38%|███▊      | 14530/37963 [34:55:47<63:08:59,  9.70s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.65', 'learning_rate': '1.415e-05', 'epoch': '0.3827'}

 38%|███▊      | 14530/37963 [34:55:47<63:08:59,  9.70s/it]
 38%|███▊      | 14531/37963 [34:55:54<59:00:49,  9.07s/it]
 38%|███▊      | 14532/37963 [34:56:01<55:27:57,  8.52s/it]
 38%|███▊      | 14533/37963 [34:56:09<53:32:52,  8.23s/it]
 38%|███▊      | 14534/37963 [34:56:17<52:05:25,  8.00s/it]
 38%|███▊      | 14535/37963 [34:56:24<51:08:05,  7.86s/it]
 38%|███▊      | 14536/37963 [34:56:32<50:30:03,  7.76s/it]
 38%|███▊      | 14537/37963 [34:56:39<49:57:49,  7.68s/it]
 38%|███▊      | 14538/37963 [34:56:53<61:43:27,  9.49s/it]
 38%|███▊      | 14539/37963 [34:57:00<57:51:38,  8.89s/it]
 38%|███▊      | 14540/37963 [34:57:08<55:29:11,  8.53s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '0.8389', 'learning_rate': '1.415e-05', 'epoch': '0.383'}

 38%|███▊      | 14540/37963 [34:57:08<55:29:11,  8.53s/it]
 38%|███▊      | 14541/37963 [34:57:15<53:05:51,  8.16s/it]
 38%|███▊      | 14542/37963 [34:57:23<51:19:38,  7.89s/it]
 38%|███▊      | 14543/37963 [34:57:30<50:32:39,  7.77s/it]
 38%|███▊      | 14544/37963 [34:57:38<50:20:54,  7.74s/it]
 38%|███▊      | 14545/37963 [34:57:45<49:54:32,  7.67s/it]
 38%|███▊      | 14546/37963 [34:57:53<49:46:00,  7.65s/it]
 38%|███▊      | 14547/37963 [34:58:00<49:29:43,  7.61s/it]
 38%|███▊      | 14548/37963 [34:58:08<49:26:52,  7.60s/it]
 38%|███▊      | 14549/37963 [34:58:15<49:13:30,  7.57s/it]
 38%|███▊      | 14550/37963 [34:58:29<61:47:45,  9.50s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '1.072', 'learning_rate': '1.414e-05', 'epoch': '0.3833'}

 38%|███▊      | 14550/37963 [34:58:29<61:47:45,  9.50s/it]
 38%|███▊      | 14551/37963 [34:58:37<57:12:22,  8.80s/it]
 38%|███▊      | 14552/37963 [34:58:44<54:50:49,  8.43s/it]
 38%|███▊      | 14553/37963 [34:58:52<53:04:38,  8.16s/it]
 38%|███▊      | 14554/37963 [34:58:59<51:45:12,  7.96s/it]
 38%|███▊      | 14555/37963 [34:59:07<51:03:36,  7.85s/it]
 38%|███▊      | 14556/37963 [34:59:14<50:30:50,  7.77s/it]
 38%|███▊      | 14557/37963 [34:59:22<50:14:32,  7.73s/it]
 38%|███▊      | 14558/37963 [34:59:29<49:28:36,  7.61s/it]
 38%|███▊      | 14559/37963 [34:59:37<49:17:31,  7.58s/it]
 38%|███▊      | 14560/37963 [34:59:44<48:52:08,  7.52s/it]
                                                           
{'loss': '0.1785', 'grad_norm': '1.49', 'learning_rate': '1.413e-05', 'epoch': '0.3835'}

 38%|███▊      | 14560/37963 [34:59:44<48:52:08,  7.52s/it]
 38%|███▊      | 14561/37963 [35:00:04<73:20:33, 11.28s/it]
 38%|███▊      | 14562/37963 [35:00:18<79:09:08, 12.18s/it]
 38%|███▊      | 14563/37963 [35:00:26<70:13:45, 10.80s/it]
 38%|███▊      | 14564/37963 [35:00:34<63:46:06,  9.81s/it]
 38%|███▊      | 14565/37963 [35:00:41<59:20:42,  9.13s/it]
 38%|███▊      | 14566/37963 [35:00:48<55:43:15,  8.57s/it]
 38%|███▊      | 14567/37963 [35:00:56<53:30:05,  8.23s/it]
 38%|███▊      | 14568/37963 [35:01:03<52:08:34,  8.02s/it]
 38%|███▊      | 14569/37963 [35:01:11<51:11:39,  7.88s/it]
 38%|███▊      | 14570/37963 [35:01:25<63:07:41,  9.71s/it]
                                                           
{'loss': '0.1515', 'grad_norm': '0.6924', 'learning_rate': '1.412e-05', 'epoch': '0.3838'}

 38%|███▊      | 14570/37963 [35:01:25<63:07:41,  9.71s/it]
 38%|███▊      | 14571/37963 [35:01:33<59:20:35,  9.13s/it]
 38%|███▊      | 14572/37963 [35:01:40<56:09:12,  8.64s/it]
 38%|███▊      | 14573/37963 [35:01:48<53:54:02,  8.30s/it]
 38%|███▊      | 14574/37963 [35:02:01<64:36:25,  9.94s/it]
 38%|███▊      | 14575/37963 [35:02:09<60:00:38,  9.24s/it]
 38%|███▊      | 14576/37963 [35:02:17<56:37:53,  8.72s/it]
 38%|███▊      | 14577/37963 [35:02:24<54:19:59,  8.36s/it]
 38%|███▊      | 14578/37963 [35:02:32<52:39:49,  8.11s/it]
 38%|███▊      | 14579/37963 [35:02:46<64:04:40,  9.86s/it]
 38%|███▊      | 14580/37963 [35:02:53<59:30:51,  9.16s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.488', 'learning_rate': '1.412e-05', 'epoch': '0.3841'}

 38%|███▊      | 14580/37963 [35:02:53<59:30:51,  9.16s/it]
 38%|███▊      | 14581/37963 [35:03:01<56:06:48,  8.64s/it]
 38%|███▊      | 14582/37963 [35:03:08<53:56:48,  8.31s/it]
 38%|███▊      | 14583/37963 [35:03:16<52:32:21,  8.09s/it]
 38%|███▊      | 14584/37963 [35:03:23<51:25:38,  7.92s/it]
 38%|███▊      | 14585/37963 [35:03:31<50:44:17,  7.81s/it]
 38%|███▊      | 14586/37963 [35:03:38<50:12:33,  7.73s/it]
 38%|███▊      | 14587/37963 [35:03:46<49:41:49,  7.65s/it]
 38%|███▊      | 14588/37963 [35:03:53<49:22:39,  7.60s/it]
 38%|███▊      | 14589/37963 [35:04:01<49:01:55,  7.55s/it]
 38%|███▊      | 14590/37963 [35:04:15<61:58:06,  9.54s/it]
                                                           
{'loss': '0.158', 'grad_norm': '4.82', 'learning_rate': '1.411e-05', 'epoch': '0.3843'}

 38%|███▊      | 14590/37963 [35:04:15<61:58:06,  9.54s/it]
 38%|███▊      | 14591/37963 [35:04:22<58:16:22,  8.98s/it]
 38%|███▊      | 14592/37963 [35:04:30<55:39:13,  8.57s/it]
 38%|███▊      | 14593/37963 [35:04:38<53:50:12,  8.29s/it]
 38%|███▊      | 14594/37963 [35:04:46<52:47:52,  8.13s/it]
 38%|███▊      | 14595/37963 [35:04:53<51:05:11,  7.87s/it]
 38%|███▊      | 14596/37963 [35:05:00<50:32:10,  7.79s/it]
 38%|███▊      | 14597/37963 [35:05:08<50:02:19,  7.71s/it]
 38%|███▊      | 14598/37963 [35:05:15<49:39:27,  7.65s/it]
 38%|███▊      | 14599/37963 [35:05:29<61:55:06,  9.54s/it]
 38%|███▊      | 14600/37963 [35:05:37<58:06:18,  8.95s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '3.144', 'learning_rate': '1.41e-05', 'epoch': '0.3846'}

 38%|███▊      | 14600/37963 [35:05:37<58:06:18,  8.95s/it]
 38%|███▊      | 14601/37963 [35:05:44<55:16:43,  8.52s/it]
 38%|███▊      | 14602/37963 [35:05:52<52:58:04,  8.16s/it]
 38%|███▊      | 14603/37963 [35:05:59<51:32:22,  7.94s/it]
 38%|███▊      | 14604/37963 [35:06:06<50:07:41,  7.73s/it]
 38%|███▊      | 14605/37963 [35:06:14<49:44:55,  7.67s/it]
 38%|███▊      | 14606/37963 [35:06:21<48:53:53,  7.54s/it]
 38%|███▊      | 14607/37963 [35:06:29<48:49:35,  7.53s/it]
 38%|███▊      | 14608/37963 [35:06:36<48:28:53,  7.47s/it]
 38%|███▊      | 14609/37963 [35:06:44<48:30:12,  7.48s/it]
 38%|███▊      | 14610/37963 [35:06:58<61:19:03,  9.45s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.033', 'learning_rate': '1.409e-05', 'epoch': '0.3848'}

 38%|███▊      | 14610/37963 [35:06:58<61:19:03,  9.45s/it]
 38%|███▊      | 14611/37963 [35:07:18<83:00:12, 12.80s/it]
 38%|███▊      | 14612/37963 [35:07:26<72:43:05, 11.21s/it]
 38%|███▊      | 14613/37963 [35:07:33<64:58:39, 10.02s/it]
 38%|███▊      | 14614/37963 [35:07:40<60:08:06,  9.27s/it]
 38%|███▊      | 14615/37963 [35:07:48<55:48:52,  8.61s/it]
 39%|███▊      | 14616/37963 [35:07:55<53:54:09,  8.31s/it]
 39%|███▊      | 14617/37963 [35:08:03<52:22:14,  8.08s/it]
 39%|███▊      | 14618/37963 [35:08:17<63:40:20,  9.82s/it]
 39%|███▊      | 14619/37963 [35:08:24<58:55:52,  9.09s/it]
 39%|███▊      | 14620/37963 [35:08:31<55:25:40,  8.55s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.82', 'learning_rate': '1.408e-05', 'epoch': '0.3851'}

 39%|███▊      | 14620/37963 [35:08:31<55:25:40,  8.55s/it]
 39%|███▊      | 14621/37963 [35:08:39<53:25:31,  8.24s/it]
 39%|███▊      | 14622/37963 [35:08:46<52:01:55,  8.03s/it]
 39%|███▊      | 14623/37963 [35:09:00<64:01:26,  9.88s/it]
 39%|███▊      | 14624/37963 [35:09:08<59:25:50,  9.17s/it]
 39%|███▊      | 14625/37963 [35:09:16<56:20:40,  8.69s/it]
 39%|███▊      | 14626/37963 [35:09:29<66:26:29, 10.25s/it]
 39%|███▊      | 14627/37963 [35:09:37<61:15:03,  9.45s/it]
 39%|███▊      | 14628/37963 [35:09:44<56:49:46,  8.77s/it]
 39%|███▊      | 14629/37963 [35:09:52<54:24:48,  8.39s/it]
 39%|███▊      | 14630/37963 [35:09:59<52:24:22,  8.09s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.096', 'learning_rate': '1.408e-05', 'epoch': '0.3854'}

 39%|███▊      | 14630/37963 [35:09:59<52:24:22,  8.09s/it]
 39%|███▊      | 14631/37963 [35:10:06<50:49:36,  7.84s/it]
 39%|███▊      | 14632/37963 [35:10:14<50:26:05,  7.78s/it]
 39%|███▊      | 14633/37963 [35:10:22<49:57:54,  7.71s/it]
 39%|███▊      | 14634/37963 [35:10:29<49:52:44,  7.70s/it]
 39%|███▊      | 14635/37963 [35:10:37<49:21:07,  7.62s/it]
 39%|███▊      | 14636/37963 [35:10:51<61:58:02,  9.56s/it]
 39%|███▊      | 14637/37963 [35:10:58<57:58:34,  8.95s/it]
 39%|███▊      | 14638/37963 [35:11:06<55:11:13,  8.52s/it]
 39%|███▊      | 14639/37963 [35:11:13<53:12:38,  8.21s/it]
 39%|███▊      | 14640/37963 [35:11:21<51:55:13,  8.01s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.33', 'learning_rate': '1.407e-05', 'epoch': '0.3856'}

 39%|███▊      | 14640/37963 [35:11:21<51:55:13,  8.01s/it]
 39%|███▊      | 14641/37963 [35:11:28<51:02:39,  7.88s/it]
 39%|███▊      | 14642/37963 [35:11:36<50:13:49,  7.75s/it]
 39%|███▊      | 14643/37963 [35:11:50<62:44:06,  9.68s/it]
 39%|███▊      | 14644/37963 [35:11:57<58:20:34,  9.01s/it]
 39%|███▊      | 14645/37963 [35:12:05<55:37:48,  8.59s/it]
 39%|███▊      | 14646/37963 [35:12:13<53:52:46,  8.32s/it]
 39%|███▊      | 14647/37963 [35:12:20<52:15:33,  8.07s/it]
 39%|███▊      | 14648/37963 [35:12:28<51:18:29,  7.92s/it]
 39%|███▊      | 14649/37963 [35:12:35<50:05:54,  7.74s/it]
 39%|███▊      | 14650/37963 [35:12:43<49:22:40,  7.62s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.059', 'learning_rate': '1.406e-05', 'epoch': '0.3859'}

 39%|███▊      | 14650/37963 [35:12:43<49:22:40,  7.62s/it]
 39%|███▊      | 14651/37963 [35:12:50<49:01:04,  7.57s/it]
 39%|███▊      | 14652/37963 [35:12:58<49:01:48,  7.57s/it]
 39%|███▊      | 14653/37963 [35:13:05<48:26:27,  7.48s/it]
 39%|███▊      | 14654/37963 [35:13:12<48:35:44,  7.51s/it]
 39%|███▊      | 14655/37963 [35:13:20<48:47:50,  7.54s/it]
 39%|███▊      | 14656/37963 [35:13:28<49:00:42,  7.57s/it]
 39%|███▊      | 14657/37963 [35:13:35<48:50:44,  7.55s/it]
 39%|███▊      | 14658/37963 [35:13:43<48:56:32,  7.56s/it]
 39%|███▊      | 14659/37963 [35:13:57<61:17:16,  9.47s/it]
 39%|███▊      | 14660/37963 [35:14:04<57:29:46,  8.88s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.695', 'learning_rate': '1.405e-05', 'epoch': '0.3862'}

 39%|███▊      | 14660/37963 [35:14:04<57:29:46,  8.88s/it]
 39%|███▊      | 14661/37963 [35:14:12<55:10:29,  8.52s/it]
 39%|███▊      | 14662/37963 [35:14:19<53:06:25,  8.21s/it]
 39%|███▊      | 14663/37963 [35:14:27<51:35:42,  7.97s/it]
 39%|███▊      | 14664/37963 [35:14:34<50:45:28,  7.84s/it]
 39%|███▊      | 14665/37963 [35:15:01<88:11:08, 13.63s/it]
 39%|███▊      | 14666/37963 [35:15:09<76:28:59, 11.82s/it]
 39%|███▊      | 14667/37963 [35:15:16<68:03:04, 10.52s/it]
 39%|███▊      | 14668/37963 [35:15:24<62:00:03,  9.58s/it]
 39%|███▊      | 14669/37963 [35:15:31<57:55:13,  8.95s/it]
 39%|███▊      | 14670/37963 [35:15:39<55:04:52,  8.51s/it]
                                                           
{'loss': '0.1603', 'grad_norm': '1.93', 'learning_rate': '1.405e-05', 'epoch': '0.3864'}

 39%|███▊      | 14670/37963 [35:15:39<55:04:52,  8.51s/it]
 39%|███▊      | 14671/37963 [35:15:53<65:59:10, 10.20s/it]
 39%|███▊      | 14672/37963 [35:16:01<60:54:23,  9.41s/it]
 39%|███▊      | 14673/37963 [35:16:08<56:52:11,  8.79s/it]
 39%|███▊      | 14674/37963 [35:16:15<54:27:48,  8.42s/it]
 39%|███▊      | 14675/37963 [35:16:30<65:39:44, 10.15s/it]
 39%|███▊      | 14676/37963 [35:16:37<60:37:30,  9.37s/it]
 39%|███▊      | 14677/37963 [35:16:45<57:14:33,  8.85s/it]
 39%|███▊      | 14678/37963 [35:16:52<54:17:18,  8.39s/it]
 39%|███▊      | 14679/37963 [35:17:00<52:55:04,  8.18s/it]
 39%|███▊      | 14680/37963 [35:17:14<64:16:03,  9.94s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.424', 'learning_rate': '1.404e-05', 'epoch': '0.3867'}

 39%|███▊      | 14680/37963 [35:17:14<64:16:03,  9.94s/it]
 39%|███▊      | 14681/37963 [35:17:21<58:57:45,  9.12s/it]
 39%|███▊      | 14682/37963 [35:17:29<55:51:46,  8.64s/it]
 39%|███▊      | 14683/37963 [35:17:36<53:48:38,  8.32s/it]
 39%|███▊      | 14684/37963 [35:17:44<52:19:02,  8.09s/it]
 39%|███▊      | 14685/37963 [35:17:51<50:53:04,  7.87s/it]
 39%|███▊      | 14686/37963 [35:17:59<50:09:41,  7.76s/it]
 39%|███▊      | 14687/37963 [35:18:06<50:02:40,  7.74s/it]
 39%|███▊      | 14688/37963 [35:18:14<49:33:37,  7.67s/it]
 39%|███▊      | 14689/37963 [35:18:21<49:22:04,  7.64s/it]
 39%|███▊      | 14690/37963 [35:18:35<61:43:22,  9.55s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.654', 'learning_rate': '1.403e-05', 'epoch': '0.387'}

 39%|███▊      | 14690/37963 [35:18:35<61:43:22,  9.55s/it]
 39%|███▊      | 14691/37963 [35:18:43<58:09:20,  9.00s/it]
 39%|███▊      | 14692/37963 [35:18:51<55:23:12,  8.57s/it]
 39%|███▊      | 14693/37963 [35:18:58<53:23:12,  8.26s/it]
 39%|███▊      | 14694/37963 [35:19:06<52:17:00,  8.09s/it]
 39%|███▊      | 14695/37963 [35:19:13<51:23:00,  7.95s/it]
 39%|███▊      | 14696/37963 [35:19:21<49:59:55,  7.74s/it]
 39%|███▊      | 14697/37963 [35:19:28<49:34:34,  7.67s/it]
 39%|███▊      | 14698/37963 [35:19:36<49:21:30,  7.64s/it]
 39%|███▊      | 14699/37963 [35:19:43<48:54:00,  7.57s/it]
 39%|███▊      | 14700/37963 [35:19:51<48:46:32,  7.55s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.76', 'learning_rate': '1.402e-05', 'epoch': '0.3872'}

 39%|███▊      | 14700/37963 [35:19:51<48:46:32,  7.55s/it]
 39%|███▊      | 14701/37963 [35:19:58<48:39:41,  7.53s/it]
 39%|███▊      | 14702/37963 [35:20:06<48:43:19,  7.54s/it]
 39%|███▊      | 14703/37963 [35:20:13<48:03:09,  7.44s/it]
 39%|███▊      | 14704/37963 [35:20:20<48:11:54,  7.46s/it]
 39%|███▊      | 14705/37963 [35:20:28<48:39:15,  7.53s/it]
 39%|███▊      | 14706/37963 [35:20:36<48:40:20,  7.53s/it]
 39%|███▊      | 14707/37963 [35:20:43<48:38:05,  7.53s/it]
 39%|███▊      | 14708/37963 [35:20:51<48:36:57,  7.53s/it]
 39%|███▊      | 14709/37963 [35:20:58<48:34:58,  7.52s/it]
 39%|███▊      | 14710/37963 [35:21:12<61:10:04,  9.47s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '1.606', 'learning_rate': '1.401e-05', 'epoch': '0.3875'}

 39%|███▊      | 14710/37963 [35:21:12<61:10:04,  9.47s/it]
 39%|███▉      | 14711/37963 [35:21:20<57:45:41,  8.94s/it]
 39%|███▉      | 14712/37963 [35:21:28<55:02:24,  8.52s/it]
 39%|███▉      | 14713/37963 [35:21:42<65:47:07, 10.19s/it]
 39%|███▉      | 14714/37963 [35:21:49<60:41:36,  9.40s/it]
 39%|███▉      | 14715/37963 [35:22:03<69:14:32, 10.72s/it]
 39%|███▉      | 14716/37963 [35:22:10<62:45:32,  9.72s/it]
 39%|███▉      | 14717/37963 [35:22:18<58:26:44,  9.05s/it]
 39%|███▉      | 14718/37963 [35:22:25<55:26:15,  8.59s/it]
 39%|███▉      | 14719/37963 [35:22:46<78:29:23, 12.16s/it]
 39%|███▉      | 14720/37963 [35:22:53<69:30:22, 10.77s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.755', 'learning_rate': '1.401e-05', 'epoch': '0.3877'}

 39%|███▉      | 14720/37963 [35:22:53<69:30:22, 10.77s/it]
 39%|███▉      | 14721/37963 [35:23:01<63:14:12,  9.79s/it]
 39%|███▉      | 14722/37963 [35:23:08<58:54:37,  9.13s/it]
 39%|███▉      | 14723/37963 [35:23:16<55:50:12,  8.65s/it]
 39%|███▉      | 14724/37963 [35:23:23<53:34:58,  8.30s/it]
 39%|███▉      | 14725/37963 [35:23:31<52:01:14,  8.06s/it]
 39%|███▉      | 14726/37963 [35:23:39<51:17:36,  7.95s/it]
 39%|███▉      | 14727/37963 [35:23:46<50:18:31,  7.79s/it]
 39%|███▉      | 14728/37963 [35:23:54<49:46:53,  7.71s/it]
 39%|███▉      | 14729/37963 [35:24:07<61:18:29,  9.50s/it]
 39%|███▉      | 14730/37963 [35:24:15<57:25:49,  8.90s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '2.214', 'learning_rate': '1.4e-05', 'epoch': '0.388'}

 39%|███▉      | 14730/37963 [35:24:15<57:25:49,  8.90s/it]
 39%|███▉      | 14731/37963 [35:24:22<54:52:25,  8.50s/it]
 39%|███▉      | 14732/37963 [35:24:30<52:51:59,  8.19s/it]
 39%|███▉      | 14733/37963 [35:24:37<51:30:25,  7.98s/it]
 39%|███▉      | 14734/37963 [35:24:45<50:12:53,  7.78s/it]
 39%|███▉      | 14735/37963 [35:24:52<49:40:06,  7.70s/it]
 39%|███▉      | 14736/37963 [35:25:00<49:13:27,  7.63s/it]
 39%|███▉      | 14737/37963 [35:25:07<48:42:29,  7.55s/it]
 39%|███▉      | 14738/37963 [35:25:21<61:41:21,  9.56s/it]
 39%|███▉      | 14739/37963 [35:25:29<58:00:49,  8.99s/it]
 39%|███▉      | 14740/37963 [35:25:37<55:30:19,  8.60s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.705', 'learning_rate': '1.399e-05', 'epoch': '0.3883'}

 39%|███▉      | 14740/37963 [35:25:37<55:30:19,  8.60s/it]
 39%|███▉      | 14741/37963 [35:25:44<53:38:41,  8.32s/it]
 39%|███▉      | 14742/37963 [35:25:51<51:35:11,  8.00s/it]
 39%|███▉      | 14743/37963 [35:25:59<50:53:36,  7.89s/it]
 39%|███▉      | 14744/37963 [35:26:07<50:16:00,  7.79s/it]
 39%|███▉      | 14745/37963 [35:26:14<49:48:00,  7.72s/it]
 39%|███▉      | 14746/37963 [35:26:22<48:57:54,  7.59s/it]
 39%|███▉      | 14747/37963 [35:26:29<48:49:24,  7.57s/it]
 39%|███▉      | 14748/37963 [35:26:36<48:29:22,  7.52s/it]
 39%|███▉      | 14749/37963 [35:26:44<48:26:48,  7.51s/it]
 39%|███▉      | 14750/37963 [35:26:51<48:30:41,  7.52s/it]
                                                           
{'loss': '0.1746', 'grad_norm': '1.43', 'learning_rate': '1.398e-05', 'epoch': '0.3885'}

 39%|███▉      | 14750/37963 [35:26:51<48:30:41,  7.52s/it]
 39%|███▉      | 14751/37963 [35:26:59<48:27:49,  7.52s/it]
 39%|███▉      | 14752/37963 [35:27:07<48:34:06,  7.53s/it]
 39%|███▉      | 14753/37963 [35:27:14<48:39:45,  7.55s/it]
 39%|███▉      | 14754/37963 [35:27:22<48:27:35,  7.52s/it]
 39%|███▉      | 14755/37963 [35:27:29<48:27:06,  7.52s/it]
 39%|███▉      | 14756/37963 [35:27:37<48:37:17,  7.54s/it]
 39%|███▉      | 14757/37963 [35:27:44<48:35:50,  7.54s/it]
 39%|███▉      | 14758/37963 [35:27:52<48:30:48,  7.53s/it]
 39%|███▉      | 14759/37963 [35:27:59<48:36:25,  7.54s/it]
 39%|███▉      | 14760/37963 [35:28:13<60:22:22,  9.37s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '2.874', 'learning_rate': '1.398e-05', 'epoch': '0.3888'}

 39%|███▉      | 14760/37963 [35:28:13<60:22:22,  9.37s/it]
 39%|███▉      | 14761/37963 [35:28:20<56:46:56,  8.81s/it]
 39%|███▉      | 14762/37963 [35:28:28<54:36:48,  8.47s/it]
 39%|███▉      | 14763/37963 [35:28:36<52:56:03,  8.21s/it]
 39%|███▉      | 14764/37963 [35:28:50<64:39:44, 10.03s/it]
 39%|███▉      | 14765/37963 [35:29:04<72:14:42, 11.21s/it]
 39%|███▉      | 14766/37963 [35:29:18<77:02:29, 11.96s/it]
 39%|███▉      | 14767/37963 [35:29:32<80:54:38, 12.56s/it]
 39%|███▉      | 14768/37963 [35:29:39<71:29:30, 11.10s/it]
 39%|███▉      | 14769/37963 [35:29:53<76:58:26, 11.95s/it]
 39%|███▉      | 14770/37963 [35:30:01<68:24:38, 10.62s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '2.28', 'learning_rate': '1.397e-05', 'epoch': '0.3891'}

 39%|███▉      | 14770/37963 [35:30:01<68:24:38, 10.62s/it]
 39%|███▉      | 14771/37963 [35:30:08<62:29:05,  9.70s/it]
 39%|███▉      | 14772/37963 [35:30:16<58:15:32,  9.04s/it]
 39%|███▉      | 14773/37963 [35:30:30<67:25:16, 10.47s/it]
 39%|███▉      | 14774/37963 [35:30:37<62:05:33,  9.64s/it]
 39%|███▉      | 14775/37963 [35:30:45<57:38:02,  8.95s/it]
 39%|███▉      | 14776/37963 [35:30:52<54:55:11,  8.53s/it]
 39%|███▉      | 14777/37963 [35:31:00<52:55:22,  8.22s/it]
 39%|███▉      | 14778/37963 [35:31:07<51:17:11,  7.96s/it]
 39%|███▉      | 14779/37963 [35:31:15<50:24:30,  7.83s/it]
 39%|███▉      | 14780/37963 [35:31:22<49:50:13,  7.74s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2.527', 'learning_rate': '1.396e-05', 'epoch': '0.3893'}

 39%|███▉      | 14780/37963 [35:31:22<49:50:13,  7.74s/it]
 39%|███▉      | 14781/37963 [35:31:30<49:30:15,  7.69s/it]
 39%|███▉      | 14782/37963 [35:31:37<49:13:15,  7.64s/it]
 39%|███▉      | 14783/37963 [35:31:45<49:09:32,  7.63s/it]
 39%|███▉      | 14784/37963 [35:31:52<48:59:54,  7.61s/it]
 39%|███▉      | 14785/37963 [35:32:00<49:03:13,  7.62s/it]
 39%|███▉      | 14786/37963 [35:32:14<61:16:45,  9.52s/it]
 39%|███▉      | 14787/37963 [35:32:21<57:22:10,  8.91s/it]
 39%|███▉      | 14788/37963 [35:32:29<54:41:55,  8.50s/it]
 39%|███▉      | 14789/37963 [35:32:37<53:04:34,  8.25s/it]
 39%|███▉      | 14790/37963 [35:32:44<51:40:48,  8.03s/it]
                                                           
{'loss': '0.1624', 'grad_norm': '3.599', 'learning_rate': '1.395e-05', 'epoch': '0.3896'}

 39%|███▉      | 14790/37963 [35:32:44<51:40:48,  8.03s/it]
 39%|███▉      | 14791/37963 [35:32:52<50:47:14,  7.89s/it]
 39%|███▉      | 14792/37963 [35:32:59<50:17:01,  7.81s/it]
 39%|███▉      | 14793/37963 [35:33:07<50:11:58,  7.80s/it]
 39%|███▉      | 14794/37963 [35:33:15<49:33:50,  7.70s/it]
 39%|███▉      | 14795/37963 [35:33:22<49:00:10,  7.61s/it]
 39%|███▉      | 14796/37963 [35:33:30<48:52:49,  7.60s/it]
 39%|███▉      | 14797/37963 [35:33:37<48:41:53,  7.57s/it]
 39%|███▉      | 14798/37963 [35:33:45<48:47:10,  7.58s/it]
 39%|███▉      | 14799/37963 [35:33:52<48:37:15,  7.56s/it]
 39%|███▉      | 14800/37963 [35:34:00<48:27:53,  7.53s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '1.013', 'learning_rate': '1.394e-05', 'epoch': '0.3899'}

 39%|███▉      | 14800/37963 [35:34:00<48:27:53,  7.53s/it]
 39%|███▉      | 14801/37963 [35:34:07<48:26:25,  7.53s/it]
 39%|███▉      | 14802/37963 [35:34:15<48:27:05,  7.53s/it]
 39%|███▉      | 14803/37963 [35:34:22<48:22:59,  7.52s/it]
 39%|███▉      | 14804/37963 [35:34:30<48:29:23,  7.54s/it]
 39%|███▉      | 14805/37963 [35:34:37<48:34:31,  7.55s/it]
 39%|███▉      | 14806/37963 [35:34:45<48:26:37,  7.53s/it]
 39%|███▉      | 14807/37963 [35:34:52<48:11:50,  7.49s/it]
 39%|███▉      | 14808/37963 [35:35:06<60:09:27,  9.35s/it]
 39%|███▉      | 14809/37963 [35:35:13<56:33:47,  8.79s/it]
 39%|███▉      | 14810/37963 [35:35:27<66:20:30, 10.32s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '3.075', 'learning_rate': '1.394e-05', 'epoch': '0.3901'}

 39%|███▉      | 14810/37963 [35:35:27<66:20:30, 10.32s/it]
 39%|███▉      | 14811/37963 [35:35:35<61:14:27,  9.52s/it]
 39%|███▉      | 14812/37963 [35:35:49<69:37:28, 10.83s/it]
 39%|███▉      | 14813/37963 [35:35:57<63:37:53,  9.90s/it]
 39%|███▉      | 14814/37963 [35:36:04<59:25:51,  9.24s/it]
 39%|███▉      | 14815/37963 [35:36:25<80:56:18, 12.59s/it]
 39%|███▉      | 14816/37963 [35:36:32<71:22:21, 11.10s/it]
 39%|███▉      | 14817/37963 [35:36:46<76:42:04, 11.93s/it]
 39%|███▉      | 14818/37963 [35:37:00<80:57:36, 12.59s/it]
 39%|███▉      | 14819/37963 [35:37:08<71:17:15, 11.09s/it]
 39%|███▉      | 14820/37963 [35:37:15<64:24:50, 10.02s/it]
                                                           
{'loss': '0.1607', 'grad_norm': '4.501', 'learning_rate': '1.393e-05', 'epoch': '0.3904'}

 39%|███▉      | 14820/37963 [35:37:15<64:24:50, 10.02s/it]
 39%|███▉      | 14821/37963 [35:37:23<59:36:45,  9.27s/it]
 39%|███▉      | 14822/37963 [35:37:31<56:22:28,  8.77s/it]
 39%|███▉      | 14823/37963 [35:37:38<53:31:53,  8.33s/it]
 39%|███▉      | 14824/37963 [35:37:45<51:46:02,  8.05s/it]
 39%|███▉      | 14825/37963 [35:37:53<50:45:41,  7.90s/it]
 39%|███▉      | 14826/37963 [35:38:00<49:59:16,  7.78s/it]
 39%|███▉      | 14827/37963 [35:38:08<49:14:12,  7.66s/it]
 39%|███▉      | 14828/37963 [35:38:15<49:05:41,  7.64s/it]
 39%|███▉      | 14829/37963 [35:38:23<48:47:12,  7.59s/it]
 39%|███▉      | 14830/37963 [35:38:30<48:34:09,  7.56s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '2.4', 'learning_rate': '1.392e-05', 'epoch': '0.3906'}

 39%|███▉      | 14830/37963 [35:38:30<48:34:09,  7.56s/it]
 39%|███▉      | 14831/37963 [35:38:38<48:46:18,  7.59s/it]
 39%|███▉      | 14832/37963 [35:38:45<48:41:08,  7.58s/it]
 39%|███▉      | 14833/37963 [35:38:53<48:52:36,  7.61s/it]
 39%|███▉      | 14834/37963 [35:39:01<48:52:51,  7.61s/it]
 39%|███▉      | 14835/37963 [35:39:15<61:49:16,  9.62s/it]
 39%|███▉      | 14836/37963 [35:39:23<57:38:07,  8.97s/it]
 39%|███▉      | 14837/37963 [35:39:30<54:30:19,  8.48s/it]
 39%|███▉      | 14838/37963 [35:39:37<52:40:52,  8.20s/it]
 39%|███▉      | 14839/37963 [35:39:45<51:19:34,  7.99s/it]
 39%|███▉      | 14840/37963 [35:39:52<49:47:58,  7.75s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '1.766', 'learning_rate': '1.391e-05', 'epoch': '0.3909'}

 39%|███▉      | 14840/37963 [35:39:52<49:47:58,  7.75s/it]
 39%|███▉      | 14841/37963 [35:40:00<49:18:08,  7.68s/it]
 39%|███▉      | 14842/37963 [35:40:07<49:01:48,  7.63s/it]
 39%|███▉      | 14843/37963 [35:40:15<48:58:42,  7.63s/it]
 39%|███▉      | 14844/37963 [35:40:22<48:37:34,  7.57s/it]
 39%|███▉      | 14845/37963 [35:40:30<48:38:03,  7.57s/it]
 39%|███▉      | 14846/37963 [35:40:37<48:30:28,  7.55s/it]
 39%|███▉      | 14847/37963 [35:40:45<48:06:09,  7.49s/it]
 39%|███▉      | 14848/37963 [35:40:52<48:17:54,  7.52s/it]
 39%|███▉      | 14849/37963 [35:41:00<48:22:48,  7.54s/it]
 39%|███▉      | 14850/37963 [35:41:07<48:23:57,  7.54s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '1.992', 'learning_rate': '1.39e-05', 'epoch': '0.3912'}

 39%|███▉      | 14850/37963 [35:41:07<48:23:57,  7.54s/it]
 39%|███▉      | 14851/37963 [35:41:15<48:21:16,  7.53s/it]
 39%|███▉      | 14852/37963 [35:41:22<48:09:29,  7.50s/it]
 39%|███▉      | 14853/37963 [35:41:30<48:32:39,  7.56s/it]
 39%|███▉      | 14854/37963 [35:41:38<48:29:00,  7.55s/it]
 39%|███▉      | 14855/37963 [35:41:45<48:38:48,  7.58s/it]
 39%|███▉      | 14856/37963 [35:42:00<61:50:12,  9.63s/it]
 39%|███▉      | 14857/37963 [35:42:07<57:40:26,  8.99s/it]
 39%|███▉      | 14858/37963 [35:42:15<54:52:47,  8.55s/it]
 39%|███▉      | 14859/37963 [35:42:29<65:26:53, 10.20s/it]
 39%|███▉      | 14860/37963 [35:42:42<72:26:05, 11.29s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.976', 'learning_rate': '1.39e-05', 'epoch': '0.3914'}

 39%|███▉      | 14860/37963 [35:42:42<72:26:05, 11.29s/it]
 39%|███▉      | 14861/37963 [35:43:02<89:05:14, 13.88s/it]
 39%|███▉      | 14862/37963 [35:43:10<76:50:52, 11.98s/it]
 39%|███▉      | 14863/37963 [35:43:18<68:22:50, 10.66s/it]
 39%|███▉      | 14864/37963 [35:43:31<74:45:15, 11.65s/it]
 39%|███▉      | 14865/37963 [35:43:46<79:46:38, 12.43s/it]
 39%|███▉      | 14866/37963 [35:43:53<70:34:56, 11.00s/it]
 39%|███▉      | 14867/37963 [35:44:01<64:17:20, 10.02s/it]
 39%|███▉      | 14868/37963 [35:44:08<59:07:54,  9.22s/it]
 39%|███▉      | 14869/37963 [35:44:16<55:45:59,  8.69s/it]
 39%|███▉      | 14870/37963 [35:44:24<53:44:05,  8.38s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '3.607', 'learning_rate': '1.389e-05', 'epoch': '0.3917'}

 39%|███▉      | 14870/37963 [35:44:24<53:44:05,  8.38s/it]
 39%|███▉      | 14871/37963 [35:44:31<52:17:30,  8.15s/it]
 39%|███▉      | 14872/37963 [35:44:38<50:16:28,  7.84s/it]
 39%|███▉      | 14873/37963 [35:44:46<49:40:31,  7.74s/it]
 39%|███▉      | 14874/37963 [35:44:53<49:20:51,  7.69s/it]
 39%|███▉      | 14875/37963 [35:45:01<49:05:02,  7.65s/it]
 39%|███▉      | 14876/37963 [35:45:09<48:50:08,  7.62s/it]
 39%|███▉      | 14877/37963 [35:45:16<48:34:59,  7.58s/it]
 39%|███▉      | 14878/37963 [35:45:24<48:29:07,  7.56s/it]
 39%|███▉      | 14879/37963 [35:45:31<48:18:59,  7.54s/it]
 39%|███▉      | 14880/37963 [35:45:39<48:42:33,  7.60s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.708', 'learning_rate': '1.388e-05', 'epoch': '0.392'}

 39%|███▉      | 14880/37963 [35:45:39<48:42:33,  7.60s/it]
 39%|███▉      | 14881/37963 [35:45:46<48:34:36,  7.58s/it]
 39%|███▉      | 14882/37963 [35:45:54<48:27:57,  7.56s/it]
 39%|███▉      | 14883/37963 [35:46:01<48:27:29,  7.56s/it]
 39%|███▉      | 14884/37963 [35:46:09<48:41:56,  7.60s/it]
 39%|███▉      | 14885/37963 [35:46:17<48:46:04,  7.61s/it]
 39%|███▉      | 14886/37963 [35:46:24<49:02:36,  7.65s/it]
 39%|███▉      | 14887/37963 [35:46:38<60:09:41,  9.39s/it]
 39%|███▉      | 14888/37963 [35:46:45<56:46:18,  8.86s/it]
 39%|███▉      | 14889/37963 [35:46:53<54:25:52,  8.49s/it]
 39%|███▉      | 14890/37963 [35:47:01<52:32:50,  8.20s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '1.515', 'learning_rate': '1.387e-05', 'epoch': '0.3922'}

 39%|███▉      | 14890/37963 [35:47:01<52:32:50,  8.20s/it]
 39%|███▉      | 14891/37963 [35:47:08<51:18:23,  8.01s/it]
 39%|███▉      | 14892/37963 [35:47:16<50:22:53,  7.86s/it]
 39%|███▉      | 14893/37963 [35:47:23<49:44:23,  7.76s/it]
 39%|███▉      | 14894/37963 [35:47:30<48:46:09,  7.61s/it]
 39%|███▉      | 14895/37963 [35:47:38<49:04:35,  7.66s/it]
 39%|███▉      | 14896/37963 [35:47:46<48:53:21,  7.63s/it]
 39%|███▉      | 14897/37963 [35:47:53<48:49:49,  7.62s/it]
 39%|███▉      | 14898/37963 [35:48:01<48:38:55,  7.59s/it]
 39%|███▉      | 14899/37963 [35:48:09<48:37:00,  7.59s/it]
 39%|███▉      | 14900/37963 [35:48:16<48:30:21,  7.57s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.738', 'learning_rate': '1.387e-05', 'epoch': '0.3925'}

 39%|███▉      | 14900/37963 [35:48:16<48:30:21,  7.57s/it]
 39%|███▉      | 14901/37963 [35:48:24<48:23:28,  7.55s/it]
 39%|███▉      | 14902/37963 [35:48:31<48:16:36,  7.54s/it]
 39%|███▉      | 14903/37963 [35:48:45<61:03:17,  9.53s/it]
 39%|███▉      | 14904/37963 [35:48:59<68:56:14, 10.76s/it]
 39%|███▉      | 14905/37963 [35:49:13<75:33:22, 11.80s/it]
 39%|███▉      | 14906/37963 [35:49:21<67:31:24, 10.54s/it]
 39%|███▉      | 14907/37963 [35:49:34<73:32:13, 11.48s/it]
 39%|███▉      | 14908/37963 [35:49:42<65:56:41, 10.30s/it]
 39%|███▉      | 14909/37963 [35:49:56<73:29:45, 11.48s/it]
 39%|███▉      | 14910/37963 [35:50:04<66:11:22, 10.34s/it]
                                                           
{'loss': '0.1709', 'grad_norm': '1.295', 'learning_rate': '1.386e-05', 'epoch': '0.3928'}

 39%|███▉      | 14910/37963 [35:50:04<66:11:22, 10.34s/it]
 39%|███▉      | 14911/37963 [35:50:11<60:54:44,  9.51s/it]
 39%|███▉      | 14912/37963 [35:50:25<69:19:03, 10.83s/it]
 39%|███▉      | 14913/37963 [35:50:33<63:12:14,  9.87s/it]
 39%|███▉      | 14914/37963 [35:50:41<58:49:39,  9.19s/it]
 39%|███▉      | 14915/37963 [35:50:54<67:44:46, 10.58s/it]
 39%|███▉      | 14916/37963 [35:51:02<61:56:39,  9.68s/it]
 39%|███▉      | 14917/37963 [35:51:09<57:50:11,  9.03s/it]
 39%|███▉      | 14918/37963 [35:51:17<54:14:21,  8.47s/it]
 39%|███▉      | 14919/37963 [35:51:24<52:22:21,  8.18s/it]
 39%|███▉      | 14920/37963 [35:51:32<50:53:37,  7.95s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.408', 'learning_rate': '1.385e-05', 'epoch': '0.393'}

 39%|███▉      | 14920/37963 [35:51:32<50:53:37,  7.95s/it]
 39%|███▉      | 14921/37963 [35:51:39<49:33:10,  7.74s/it]
 39%|███▉      | 14922/37963 [35:51:46<49:20:47,  7.71s/it]
 39%|███▉      | 14923/37963 [35:51:54<48:41:31,  7.61s/it]
 39%|███▉      | 14924/37963 [35:52:01<48:24:32,  7.56s/it]
 39%|███▉      | 14925/37963 [35:52:09<48:08:57,  7.52s/it]
 39%|███▉      | 14926/37963 [35:52:16<48:23:22,  7.56s/it]
 39%|███▉      | 14927/37963 [35:52:24<48:27:09,  7.57s/it]
 39%|███▉      | 14928/37963 [35:52:31<47:46:16,  7.47s/it]
 39%|███▉      | 14929/37963 [35:52:39<48:09:22,  7.53s/it]
 39%|███▉      | 14930/37963 [35:52:46<48:03:41,  7.51s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '1.736', 'learning_rate': '1.384e-05', 'epoch': '0.3933'}

 39%|███▉      | 14930/37963 [35:52:46<48:03:41,  7.51s/it]
 39%|███▉      | 14931/37963 [35:52:54<47:45:46,  7.47s/it]
 39%|███▉      | 14932/37963 [35:53:01<47:42:27,  7.46s/it]
 39%|███▉      | 14933/37963 [35:53:09<47:46:57,  7.47s/it]
 39%|███▉      | 14934/37963 [35:53:22<59:35:46,  9.32s/it]
 39%|███▉      | 14935/37963 [35:53:30<56:02:15,  8.76s/it]
 39%|███▉      | 14936/37963 [35:53:37<53:17:20,  8.33s/it]
 39%|███▉      | 14937/37963 [35:53:44<51:25:34,  8.04s/it]
 39%|███▉      | 14938/37963 [35:53:52<50:24:40,  7.88s/it]
 39%|███▉      | 14939/37963 [35:53:59<49:51:47,  7.80s/it]
 39%|███▉      | 14940/37963 [35:54:07<49:41:53,  7.77s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '3.379', 'learning_rate': '1.383e-05', 'epoch': '0.3935'}

 39%|███▉      | 14940/37963 [35:54:07<49:41:53,  7.77s/it]
 39%|███▉      | 14941/37963 [35:54:15<49:04:44,  7.67s/it]
 39%|███▉      | 14942/37963 [35:54:22<48:21:46,  7.56s/it]
 39%|███▉      | 14943/37963 [35:54:30<48:18:59,  7.56s/it]
 39%|███▉      | 14944/37963 [35:54:37<48:10:41,  7.53s/it]
 39%|███▉      | 14945/37963 [35:54:45<48:08:04,  7.53s/it]
 39%|███▉      | 14946/37963 [35:54:52<48:31:32,  7.59s/it]
 39%|███▉      | 14947/37963 [35:55:00<48:14:40,  7.55s/it]
 39%|███▉      | 14948/37963 [35:55:07<48:15:24,  7.55s/it]
 39%|███▉      | 14949/37963 [35:55:21<60:26:46,  9.46s/it]
 39%|███▉      | 14950/37963 [35:55:29<56:48:07,  8.89s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '3.678', 'learning_rate': '1.383e-05', 'epoch': '0.3938'}

 39%|███▉      | 14950/37963 [35:55:29<56:48:07,  8.89s/it]
 39%|███▉      | 14951/37963 [35:55:36<54:23:38,  8.51s/it]
 39%|███▉      | 14952/37963 [35:55:43<51:49:12,  8.11s/it]
 39%|███▉      | 14953/37963 [35:55:51<50:12:53,  7.86s/it]
 39%|███▉      | 14954/37963 [35:55:58<49:46:56,  7.79s/it]
 39%|███▉      | 14955/37963 [35:56:19<74:06:10, 11.59s/it]
 39%|███▉      | 14956/37963 [35:56:33<78:28:07, 12.28s/it]
 39%|███▉      | 14957/37963 [35:56:40<69:24:46, 10.86s/it]
 39%|███▉      | 14958/37963 [35:56:54<75:07:02, 11.75s/it]
 39%|███▉      | 14959/37963 [35:57:02<67:16:42, 10.53s/it]
 39%|███▉      | 14960/37963 [35:57:09<61:31:14,  9.63s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.125', 'learning_rate': '1.382e-05', 'epoch': '0.3941'}

 39%|███▉      | 14960/37963 [35:57:09<61:31:14,  9.63s/it]
 39%|███▉      | 14961/37963 [35:57:17<57:26:38,  8.99s/it]
 39%|███▉      | 14962/37963 [35:57:24<54:09:33,  8.48s/it]
 39%|███▉      | 14963/37963 [35:57:31<52:01:10,  8.14s/it]
 39%|███▉      | 14964/37963 [35:57:45<63:13:47,  9.90s/it]
 39%|███▉      | 14965/37963 [35:57:59<71:07:10, 11.13s/it]
 39%|███▉      | 14966/37963 [35:58:07<64:20:34, 10.07s/it]
 39%|███▉      | 14967/37963 [35:58:15<59:27:24,  9.31s/it]
 39%|███▉      | 14968/37963 [35:58:22<56:05:16,  8.78s/it]
 39%|███▉      | 14969/37963 [35:58:30<53:34:34,  8.39s/it]
 39%|███▉      | 14970/37963 [35:58:37<51:47:55,  8.11s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.56', 'learning_rate': '1.381e-05', 'epoch': '0.3943'}

 39%|███▉      | 14970/37963 [35:58:37<51:47:55,  8.11s/it]
 39%|███▉      | 14971/37963 [35:58:45<50:41:20,  7.94s/it]
 39%|███▉      | 14972/37963 [35:58:52<50:03:08,  7.84s/it]
 39%|███▉      | 14973/37963 [35:59:00<49:40:08,  7.78s/it]
 39%|███▉      | 14974/37963 [35:59:07<49:16:46,  7.72s/it]
 39%|███▉      | 14975/37963 [35:59:15<48:49:18,  7.65s/it]
 39%|███▉      | 14976/37963 [35:59:23<48:47:27,  7.64s/it]
 39%|███▉      | 14977/37963 [35:59:30<48:29:20,  7.59s/it]
 39%|███▉      | 14978/37963 [35:59:44<60:58:33,  9.55s/it]
 39%|███▉      | 14979/37963 [35:59:52<57:06:34,  8.95s/it]
 39%|███▉      | 14980/37963 [35:59:59<54:29:14,  8.53s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '0.9577', 'learning_rate': '1.38e-05', 'epoch': '0.3946'}

 39%|███▉      | 14980/37963 [35:59:59<54:29:14,  8.53s/it]
 39%|███▉      | 14981/37963 [36:00:07<52:07:54,  8.17s/it]
 39%|███▉      | 14982/37963 [36:00:14<50:54:28,  7.97s/it]
 39%|███▉      | 14983/37963 [36:00:21<49:44:19,  7.79s/it]
 39%|███▉      | 14984/37963 [36:00:29<49:22:02,  7.73s/it]
 39%|███▉      | 14985/37963 [36:00:37<49:04:48,  7.69s/it]
 39%|███▉      | 14986/37963 [36:00:44<48:45:10,  7.64s/it]
 39%|███▉      | 14987/37963 [36:00:52<48:29:01,  7.60s/it]
 39%|███▉      | 14988/37963 [36:00:59<48:37:58,  7.62s/it]
 39%|███▉      | 14989/37963 [36:01:07<48:02:28,  7.53s/it]
 39%|███▉      | 14990/37963 [36:01:14<48:01:00,  7.52s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '2.258', 'learning_rate': '1.379e-05', 'epoch': '0.3949'}

 39%|███▉      | 14990/37963 [36:01:14<48:01:00,  7.52s/it]
 39%|███▉      | 14991/37963 [36:01:22<48:02:58,  7.53s/it]
 39%|███▉      | 14992/37963 [36:01:29<48:01:29,  7.53s/it]
 39%|███▉      | 14993/37963 [36:01:43<60:15:22,  9.44s/it]
 39%|███▉      | 14994/37963 [36:01:51<56:33:57,  8.87s/it]
 39%|███▉      | 14995/37963 [36:01:58<53:54:02,  8.45s/it]
 40%|███▉      | 14996/37963 [36:02:06<52:11:12,  8.18s/it]
 40%|███▉      | 14997/37963 [36:02:13<51:06:27,  8.01s/it]
 40%|███▉      | 14998/37963 [36:02:21<50:17:37,  7.88s/it]
 40%|███▉      | 14999/37963 [36:02:28<49:01:24,  7.69s/it]
 40%|███▉      | 15000/37963 [36:02:36<48:30:32,  7.60s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.908', 'learning_rate': '1.379e-05', 'epoch': '0.3951'}

 40%|███▉      | 15000/37963 [36:02:36<48:30:32,  7.60s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.41s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.41s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 40%|███▉      | 15001/37963 [36:03:37<151:14:19, 23.71s/it]
 40%|███▉      | 15002/37963 [36:03:44<120:14:39, 18.85s/it]
 40%|███▉      | 15003/37963 [36:03:58<110:50:46, 17.38s/it]
 40%|███▉      | 15004/37963 [36:04:06<92:01:08, 14.43s/it] 
 40%|███▉      | 15005/37963 [36:04:13<78:38:44, 12.33s/it]
 40%|███▉      | 15006/37963 [36:04:21<69:26:19, 10.89s/it]
 40%|███▉      | 15007/37963 [36:04:35<75:11:55, 11.79s/it]
 40%|███▉      | 15008/37963 [36:04:49<79:46:47, 12.51s/it]
 40%|███▉      | 15009/37963 [36:04:56<70:13:43, 11.01s/it]
 40%|███▉      | 15010/37963 [36:05:04<63:31:19,  9.96s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '3.841', 'learning_rate': '1.378e-05', 'epoch': '0.3954'}

 40%|███▉      | 15010/37963 [36:05:04<63:31:19,  9.96s/it]
 40%|███▉      | 15011/37963 [36:05:18<70:51:16, 11.11s/it]
 40%|███▉      | 15012/37963 [36:05:25<63:56:20, 10.03s/it]
 40%|███▉      | 15013/37963 [36:05:33<59:27:49,  9.33s/it]
 40%|███▉      | 15014/37963 [36:05:41<56:09:42,  8.81s/it]
 40%|███▉      | 15015/37963 [36:05:54<65:48:34, 10.32s/it]
 40%|███▉      | 15016/37963 [36:06:02<60:38:39,  9.51s/it]
 40%|███▉      | 15017/37963 [36:06:09<56:38:25,  8.89s/it]
 40%|███▉      | 15018/37963 [36:06:17<54:03:13,  8.48s/it]
 40%|███▉      | 15019/37963 [36:06:25<52:35:49,  8.25s/it]
 40%|███▉      | 15020/37963 [36:06:32<51:10:40,  8.03s/it]
                                                           
{'loss': '0.1635', 'grad_norm': '2.14', 'learning_rate': '1.377e-05', 'epoch': '0.3956'}

 40%|███▉      | 15020/37963 [36:06:32<51:10:40,  8.03s/it]
 40%|███▉      | 15021/37963 [36:06:39<49:42:47,  7.80s/it]
 40%|███▉      | 15022/37963 [36:06:47<49:16:48,  7.73s/it]
 40%|███▉      | 15023/37963 [36:06:54<48:48:10,  7.66s/it]
 40%|███▉      | 15024/37963 [36:07:09<61:15:55,  9.61s/it]
 40%|███▉      | 15025/37963 [36:07:16<57:14:17,  8.98s/it]
 40%|███▉      | 15026/37963 [36:07:24<54:46:21,  8.60s/it]
 40%|███▉      | 15027/37963 [36:07:31<52:22:18,  8.22s/it]
 40%|███▉      | 15028/37963 [36:07:39<51:07:40,  8.03s/it]
 40%|███▉      | 15029/37963 [36:07:46<49:52:03,  7.83s/it]
 40%|███▉      | 15030/37963 [36:07:54<49:17:58,  7.74s/it]
                                                           
{'loss': '0.1614', 'grad_norm': '1.277', 'learning_rate': '1.376e-05', 'epoch': '0.3959'}

 40%|███▉      | 15030/37963 [36:07:54<49:17:58,  7.74s/it]
 40%|███▉      | 15031/37963 [36:08:01<48:57:43,  7.69s/it]
 40%|███▉      | 15032/37963 [36:08:09<49:00:05,  7.69s/it]
 40%|███▉      | 15033/37963 [36:08:16<48:29:56,  7.61s/it]
 40%|███▉      | 15034/37963 [36:08:24<48:16:17,  7.58s/it]
 40%|███▉      | 15035/37963 [36:08:31<48:11:09,  7.57s/it]
 40%|███▉      | 15036/37963 [36:08:39<48:14:05,  7.57s/it]
 40%|███▉      | 15037/37963 [36:08:46<47:48:21,  7.51s/it]
 40%|███▉      | 15038/37963 [36:08:54<47:46:20,  7.50s/it]
 40%|███▉      | 15039/37963 [36:09:01<47:58:00,  7.53s/it]
 40%|███▉      | 15040/37963 [36:09:09<47:54:04,  7.52s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '4.164', 'learning_rate': '1.375e-05', 'epoch': '0.3962'}

 40%|███▉      | 15040/37963 [36:09:09<47:54:04,  7.52s/it]
 40%|███▉      | 15041/37963 [36:09:16<47:51:07,  7.52s/it]
 40%|███▉      | 15042/37963 [36:09:24<47:45:56,  7.50s/it]
 40%|███▉      | 15043/37963 [36:09:31<47:52:31,  7.52s/it]
 40%|███▉      | 15044/37963 [36:09:46<60:22:26,  9.48s/it]
 40%|███▉      | 15045/37963 [36:09:53<56:35:35,  8.89s/it]
 40%|███▉      | 15046/37963 [36:10:00<53:46:37,  8.45s/it]
 40%|███▉      | 15047/37963 [36:10:08<52:06:28,  8.19s/it]
 40%|███▉      | 15048/37963 [36:10:22<63:06:12,  9.91s/it]
 40%|███▉      | 15049/37963 [36:10:30<58:45:04,  9.23s/it]
 40%|███▉      | 15050/37963 [36:10:37<55:35:09,  8.73s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.359', 'learning_rate': '1.375e-05', 'epoch': '0.3964'}

 40%|███▉      | 15050/37963 [36:10:37<55:35:09,  8.73s/it]
 40%|███▉      | 15051/37963 [36:10:45<53:17:53,  8.37s/it]
 40%|███▉      | 15052/37963 [36:10:52<51:55:46,  8.16s/it]
 40%|███▉      | 15053/37963 [36:11:00<50:49:21,  7.99s/it]
 40%|███▉      | 15054/37963 [36:11:20<74:06:40, 11.65s/it]
 40%|███▉      | 15055/37963 [36:11:28<66:16:32, 10.42s/it]
 40%|███▉      | 15056/37963 [36:11:35<60:23:31,  9.49s/it]
 40%|███▉      | 15057/37963 [36:11:49<68:54:03, 10.83s/it]
 40%|███▉      | 15058/37963 [36:11:57<62:32:57,  9.83s/it]
 40%|███▉      | 15059/37963 [36:12:10<69:33:56, 10.93s/it]
 40%|███▉      | 15060/37963 [36:12:18<63:12:45,  9.94s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.394', 'learning_rate': '1.374e-05', 'epoch': '0.3967'}

 40%|███▉      | 15060/37963 [36:12:18<63:12:45,  9.94s/it]
 40%|███▉      | 15061/37963 [36:12:25<58:34:13,  9.21s/it]
 40%|███▉      | 15062/37963 [36:12:33<55:41:19,  8.75s/it]
 40%|███▉      | 15063/37963 [36:12:40<53:05:47,  8.35s/it]
 40%|███▉      | 15064/37963 [36:12:48<51:15:56,  8.06s/it]
 40%|███▉      | 15065/37963 [36:12:55<49:59:52,  7.86s/it]
 40%|███▉      | 15066/37963 [36:13:03<49:27:38,  7.78s/it]
 40%|███▉      | 15067/37963 [36:13:10<49:02:45,  7.71s/it]
 40%|███▉      | 15068/37963 [36:13:18<49:03:20,  7.71s/it]
 40%|███▉      | 15069/37963 [36:13:32<60:25:02,  9.50s/it]
 40%|███▉      | 15070/37963 [36:13:39<56:05:25,  8.82s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.4', 'learning_rate': '1.373e-05', 'epoch': '0.397'}

 40%|███▉      | 15070/37963 [36:13:39<56:05:25,  8.82s/it]
 40%|███▉      | 15071/37963 [36:13:46<53:28:25,  8.41s/it]
 40%|███▉      | 15072/37963 [36:14:00<64:07:06, 10.08s/it]
 40%|███▉      | 15073/37963 [36:14:08<59:13:09,  9.31s/it]
 40%|███▉      | 15074/37963 [36:14:15<55:30:36,  8.73s/it]
 40%|███▉      | 15075/37963 [36:14:22<52:47:35,  8.30s/it]
 40%|███▉      | 15076/37963 [36:14:30<51:21:05,  8.08s/it]
 40%|███▉      | 15077/37963 [36:14:37<50:08:51,  7.89s/it]
 40%|███▉      | 15078/37963 [36:14:45<48:57:02,  7.70s/it]
 40%|███▉      | 15079/37963 [36:14:52<48:44:08,  7.67s/it]
 40%|███▉      | 15080/37963 [36:15:00<48:13:12,  7.59s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '4.255', 'learning_rate': '1.372e-05', 'epoch': '0.3972'}

 40%|███▉      | 15080/37963 [36:15:00<48:13:12,  7.59s/it]
 40%|███▉      | 15081/37963 [36:15:07<48:04:33,  7.56s/it]
 40%|███▉      | 15082/37963 [36:15:15<48:07:02,  7.57s/it]
 40%|███▉      | 15083/37963 [36:15:22<47:52:53,  7.53s/it]
 40%|███▉      | 15084/37963 [36:15:30<47:42:51,  7.51s/it]
 40%|███▉      | 15085/37963 [36:15:37<47:50:38,  7.53s/it]
 40%|███▉      | 15086/37963 [36:15:44<47:13:28,  7.43s/it]
 40%|███▉      | 15087/37963 [36:15:52<47:23:04,  7.46s/it]
 40%|███▉      | 15088/37963 [36:15:59<47:31:02,  7.48s/it]
 40%|███▉      | 15089/37963 [36:16:07<47:35:00,  7.49s/it]
 40%|███▉      | 15090/37963 [36:16:15<47:43:02,  7.51s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.072', 'learning_rate': '1.372e-05', 'epoch': '0.3975'}

 40%|███▉      | 15090/37963 [36:16:15<47:43:02,  7.51s/it]
 40%|███▉      | 15091/37963 [36:16:22<47:50:48,  7.53s/it]
 40%|███▉      | 15092/37963 [36:16:36<59:45:08,  9.41s/it]
 40%|███▉      | 15093/37963 [36:16:44<56:24:26,  8.88s/it]
 40%|███▉      | 15094/37963 [36:16:51<53:36:34,  8.44s/it]
 40%|███▉      | 15095/37963 [36:16:59<51:58:40,  8.18s/it]
 40%|███▉      | 15096/37963 [36:17:06<50:40:15,  7.98s/it]
 40%|███▉      | 15097/37963 [36:17:20<62:10:49,  9.79s/it]
 40%|███▉      | 15098/37963 [36:17:28<57:47:05,  9.10s/it]
 40%|███▉      | 15099/37963 [36:17:35<54:42:30,  8.61s/it]
 40%|███▉      | 15100/37963 [36:17:43<52:52:09,  8.32s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.091', 'learning_rate': '1.371e-05', 'epoch': '0.3978'}

 40%|███▉      | 15100/37963 [36:17:43<52:52:09,  8.32s/it]
 40%|███▉      | 15101/37963 [36:17:50<51:30:58,  8.11s/it]
 40%|███▉      | 15102/37963 [36:18:04<62:29:00,  9.84s/it]
 40%|███▉      | 15103/37963 [36:18:12<58:08:41,  9.16s/it]
 40%|███▉      | 15104/37963 [36:18:32<79:17:13, 12.49s/it]
 40%|███▉      | 15105/37963 [36:18:46<82:15:56, 12.96s/it]
 40%|███▉      | 15106/37963 [36:18:54<71:55:43, 11.33s/it]
 40%|███▉      | 15107/37963 [36:19:01<64:44:59, 10.20s/it]
 40%|███▉      | 15108/37963 [36:19:09<59:40:06,  9.40s/it]
 40%|███▉      | 15109/37963 [36:19:16<56:07:21,  8.84s/it]
 40%|███▉      | 15110/37963 [36:19:24<53:21:12,  8.40s/it]
                                                           
{'loss': '0.1536', 'grad_norm': '2.763', 'learning_rate': '1.37e-05', 'epoch': '0.398'}

 40%|███▉      | 15110/37963 [36:19:24<53:21:12,  8.40s/it]
 40%|███▉      | 15111/37963 [36:19:31<51:33:26,  8.12s/it]
 40%|███▉      | 15112/37963 [36:19:39<50:22:16,  7.94s/it]
 40%|███▉      | 15113/37963 [36:19:46<49:31:08,  7.80s/it]
 40%|███▉      | 15114/37963 [36:19:54<48:58:42,  7.72s/it]
 40%|███▉      | 15115/37963 [36:20:01<48:34:54,  7.65s/it]
 40%|███▉      | 15116/37963 [36:20:09<48:20:23,  7.62s/it]
 40%|███▉      | 15117/37963 [36:20:22<60:10:06,  9.48s/it]
 40%|███▉      | 15118/37963 [36:20:30<56:19:44,  8.88s/it]
 40%|███▉      | 15119/37963 [36:20:37<53:39:42,  8.46s/it]
 40%|███▉      | 15120/37963 [36:20:45<52:03:55,  8.21s/it]
                                                           
{'loss': '0.159', 'grad_norm': '1.626', 'learning_rate': '1.369e-05', 'epoch': '0.3983'}

 40%|███▉      | 15120/37963 [36:20:45<52:03:55,  8.21s/it]
 40%|███▉      | 15121/37963 [36:20:59<62:48:56,  9.90s/it]
 40%|███▉      | 15122/37963 [36:21:06<58:29:29,  9.22s/it]
 40%|███▉      | 15123/37963 [36:21:14<55:44:20,  8.79s/it]
 40%|███▉      | 15124/37963 [36:21:22<53:24:41,  8.42s/it]
 40%|███▉      | 15125/37963 [36:21:30<52:02:20,  8.20s/it]
 40%|███▉      | 15126/37963 [36:21:37<50:48:01,  8.01s/it]
 40%|███▉      | 15127/37963 [36:21:45<49:57:12,  7.87s/it]
 40%|███▉      | 15128/37963 [36:21:52<49:18:52,  7.77s/it]
 40%|███▉      | 15129/37963 [36:22:00<48:47:15,  7.69s/it]
 40%|███▉      | 15130/37963 [36:22:07<48:13:49,  7.60s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.705', 'learning_rate': '1.368e-05', 'epoch': '0.3985'}

 40%|███▉      | 15130/37963 [36:22:07<48:13:49,  7.60s/it]
 40%|███▉      | 15131/37963 [36:22:15<47:56:13,  7.56s/it]
 40%|███▉      | 15132/37963 [36:22:22<48:02:27,  7.58s/it]
 40%|███▉      | 15133/37963 [36:22:30<47:52:28,  7.55s/it]
 40%|███▉      | 15134/37963 [36:22:37<47:49:48,  7.54s/it]
 40%|███▉      | 15135/37963 [36:22:45<47:37:13,  7.51s/it]
 40%|███▉      | 15136/37963 [36:22:58<59:40:12,  9.41s/it]
 40%|███▉      | 15137/37963 [36:23:06<56:08:29,  8.85s/it]
 40%|███▉      | 15138/37963 [36:23:14<53:41:28,  8.47s/it]
 40%|███▉      | 15139/37963 [36:23:21<52:02:21,  8.21s/it]
 40%|███▉      | 15140/37963 [36:23:29<50:55:02,  8.03s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.897', 'learning_rate': '1.368e-05', 'epoch': '0.3988'}

 40%|███▉      | 15140/37963 [36:23:29<50:55:02,  8.03s/it]
 40%|███▉      | 15141/37963 [36:23:36<49:51:06,  7.86s/it]
 40%|███▉      | 15142/37963 [36:23:44<49:32:23,  7.81s/it]
 40%|███▉      | 15143/37963 [36:23:51<48:36:07,  7.67s/it]
 40%|███▉      | 15144/37963 [36:23:59<48:31:50,  7.66s/it]
 40%|███▉      | 15145/37963 [36:24:06<48:11:19,  7.60s/it]
 40%|███▉      | 15146/37963 [36:24:14<48:01:17,  7.58s/it]
 40%|███▉      | 15147/37963 [36:24:21<47:41:04,  7.52s/it]
 40%|███▉      | 15148/37963 [36:24:35<59:39:21,  9.41s/it]
 40%|███▉      | 15149/37963 [36:24:49<68:10:09, 10.76s/it]
 40%|███▉      | 15150/37963 [36:24:57<62:06:06,  9.80s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.192', 'learning_rate': '1.367e-05', 'epoch': '0.3991'}

 40%|███▉      | 15150/37963 [36:24:57<62:06:06,  9.80s/it]
 40%|███▉      | 15151/37963 [36:25:11<70:10:05, 11.07s/it]
 40%|███▉      | 15152/37963 [36:25:18<63:45:17, 10.06s/it]
 40%|███▉      | 15153/37963 [36:25:33<71:56:27, 11.35s/it]
 40%|███▉      | 15154/37963 [36:25:40<64:57:54, 10.25s/it]
 40%|███▉      | 15155/37963 [36:25:48<59:52:43,  9.45s/it]
 40%|███▉      | 15156/37963 [36:25:55<56:08:09,  8.86s/it]
 40%|███▉      | 15157/37963 [36:26:03<52:52:50,  8.35s/it]
 40%|███▉      | 15158/37963 [36:26:10<51:17:29,  8.10s/it]
 40%|███▉      | 15159/37963 [36:26:18<50:01:22,  7.90s/it]
 40%|███▉      | 15160/37963 [36:26:25<49:23:24,  7.80s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '3.494', 'learning_rate': '1.366e-05', 'epoch': '0.3993'}

 40%|███▉      | 15160/37963 [36:26:25<49:23:24,  7.80s/it]
 40%|███▉      | 15161/37963 [36:26:32<48:06:03,  7.59s/it]
 40%|███▉      | 15162/37963 [36:26:40<47:55:16,  7.57s/it]
 40%|███▉      | 15163/37963 [36:26:47<47:49:31,  7.55s/it]
 40%|███▉      | 15164/37963 [36:26:54<47:08:46,  7.44s/it]
 40%|███▉      | 15165/37963 [36:27:02<47:21:48,  7.48s/it]
 40%|███▉      | 15166/37963 [36:27:15<58:23:21,  9.22s/it]
 40%|███▉      | 15167/37963 [36:27:23<55:05:51,  8.70s/it]
 40%|███▉      | 15168/37963 [36:27:30<52:45:43,  8.33s/it]
 40%|███▉      | 15169/37963 [36:27:44<62:52:52,  9.93s/it]
 40%|███▉      | 15170/37963 [36:27:51<58:13:38,  9.20s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '3.175', 'learning_rate': '1.365e-05', 'epoch': '0.3996'}

 40%|███▉      | 15170/37963 [36:27:51<58:13:38,  9.20s/it]
 40%|███▉      | 15171/37963 [36:27:59<55:07:42,  8.71s/it]
 40%|███▉      | 15172/37963 [36:28:06<52:52:05,  8.35s/it]
 40%|███▉      | 15173/37963 [36:28:14<51:16:02,  8.10s/it]
 40%|███▉      | 15174/37963 [36:28:22<50:14:43,  7.94s/it]
 40%|███▉      | 15175/37963 [36:28:29<49:20:02,  7.79s/it]
 40%|███▉      | 15176/37963 [36:28:37<48:48:18,  7.71s/it]
 40%|███▉      | 15177/37963 [36:28:44<48:29:57,  7.66s/it]
 40%|███▉      | 15178/37963 [36:28:52<48:13:50,  7.62s/it]
 40%|███▉      | 15179/37963 [36:28:59<47:32:17,  7.51s/it]
 40%|███▉      | 15180/37963 [36:29:06<47:31:52,  7.51s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.711', 'learning_rate': '1.364e-05', 'epoch': '0.3999'}

 40%|███▉      | 15180/37963 [36:29:06<47:31:52,  7.51s/it]
 40%|███▉      | 15181/37963 [36:29:14<47:29:00,  7.50s/it]
 40%|███▉      | 15182/37963 [36:29:21<47:10:18,  7.45s/it]
 40%|███▉      | 15183/37963 [36:29:29<47:19:40,  7.48s/it]
 40%|███▉      | 15184/37963 [36:29:43<59:44:49,  9.44s/it]
 40%|███▉      | 15185/37963 [36:29:50<56:08:15,  8.87s/it]
 40%|████      | 15186/37963 [36:29:58<53:28:30,  8.45s/it]
 40%|████      | 15187/37963 [36:30:05<51:42:56,  8.17s/it]
 40%|████      | 15188/37963 [36:30:13<50:44:00,  8.02s/it]
 40%|████      | 15189/37963 [36:30:20<49:43:04,  7.86s/it]
 40%|████      | 15190/37963 [36:30:28<48:48:02,  7.71s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '2.013', 'learning_rate': '1.364e-05', 'epoch': '0.4001'}

 40%|████      | 15190/37963 [36:30:28<48:48:02,  7.71s/it]
 40%|████      | 15191/37963 [36:30:35<48:25:55,  7.66s/it]
 40%|████      | 15192/37963 [36:30:43<48:14:06,  7.63s/it]
 40%|████      | 15193/37963 [36:30:50<47:34:42,  7.52s/it]
 40%|████      | 15194/37963 [36:30:58<47:40:33,  7.54s/it]
 40%|████      | 15195/37963 [36:31:05<47:30:21,  7.51s/it]
 40%|████      | 15196/37963 [36:31:26<72:07:27, 11.40s/it]
 40%|████      | 15197/37963 [36:31:40<76:59:46, 12.18s/it]
 40%|████      | 15198/37963 [36:31:47<68:02:12, 10.76s/it]
 40%|████      | 15199/37963 [36:32:01<74:00:57, 11.71s/it]
 40%|████      | 15200/37963 [36:32:09<66:04:30, 10.45s/it]
                                                           
{'loss': '0.154', 'grad_norm': '2.329', 'learning_rate': '1.363e-05', 'epoch': '0.4004'}

 40%|████      | 15200/37963 [36:32:09<66:04:30, 10.45s/it]
 40%|████      | 15201/37963 [36:32:16<60:37:40,  9.59s/it]
 40%|████      | 15202/37963 [36:32:24<56:42:42,  8.97s/it]
 40%|████      | 15203/37963 [36:32:31<54:09:43,  8.57s/it]
 40%|████      | 15204/37963 [36:32:39<51:59:50,  8.22s/it]
 40%|████      | 15205/37963 [36:32:46<50:44:34,  8.03s/it]
 40%|████      | 15206/37963 [36:33:00<62:04:40,  9.82s/it]
 40%|████      | 15207/37963 [36:33:08<57:46:13,  9.14s/it]
 40%|████      | 15208/37963 [36:33:15<54:45:58,  8.66s/it]
 40%|████      | 15209/37963 [36:33:23<52:23:13,  8.29s/it]
 40%|████      | 15210/37963 [36:33:30<50:56:36,  8.06s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.973', 'learning_rate': '1.362e-05', 'epoch': '0.4007'}

 40%|████      | 15210/37963 [36:33:30<50:56:36,  8.06s/it]
 40%|████      | 15211/37963 [36:33:38<49:46:36,  7.88s/it]
 40%|████      | 15212/37963 [36:33:45<49:09:40,  7.78s/it]
 40%|████      | 15213/37963 [36:33:53<48:33:22,  7.68s/it]
 40%|████      | 15214/37963 [36:34:00<47:36:30,  7.53s/it]
 40%|████      | 15215/37963 [36:34:08<47:40:45,  7.55s/it]
 40%|████      | 15216/37963 [36:34:21<59:51:30,  9.47s/it]
 40%|████      | 15217/37963 [36:34:29<56:31:18,  8.95s/it]
 40%|████      | 15218/37963 [36:34:37<53:49:49,  8.52s/it]
 40%|████      | 15219/37963 [36:34:44<51:26:15,  8.14s/it]
 40%|████      | 15220/37963 [36:34:52<50:23:59,  7.98s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.449', 'learning_rate': '1.361e-05', 'epoch': '0.4009'}

 40%|████      | 15220/37963 [36:34:52<50:23:59,  7.98s/it]
 40%|████      | 15221/37963 [36:34:59<49:40:32,  7.86s/it]
 40%|████      | 15222/37963 [36:35:13<61:17:25,  9.70s/it]
 40%|████      | 15223/37963 [36:35:20<56:42:21,  8.98s/it]
 40%|████      | 15224/37963 [36:35:28<53:41:43,  8.50s/it]
 40%|████      | 15225/37963 [36:35:35<51:47:27,  8.20s/it]
 40%|████      | 15226/37963 [36:35:43<50:33:07,  8.00s/it]
 40%|████      | 15227/37963 [36:35:51<49:47:34,  7.88s/it]
 40%|████      | 15228/37963 [36:35:58<49:03:16,  7.77s/it]
 40%|████      | 15229/37963 [36:36:06<48:39:44,  7.71s/it]
 40%|████      | 15230/37963 [36:36:13<48:18:48,  7.65s/it]
                                                           
{'loss': '0.154', 'grad_norm': '2.867', 'learning_rate': '1.36e-05', 'epoch': '0.4012'}

 40%|████      | 15230/37963 [36:36:13<48:18:48,  7.65s/it]
 40%|████      | 15231/37963 [36:36:21<48:14:48,  7.64s/it]
 40%|████      | 15232/37963 [36:36:35<60:16:50,  9.55s/it]
 40%|████      | 15233/37963 [36:36:42<56:03:28,  8.88s/it]
 40%|████      | 15234/37963 [36:36:49<53:22:53,  8.45s/it]
 40%|████      | 15235/37963 [36:36:57<51:30:47,  8.16s/it]
 40%|████      | 15236/37963 [36:37:04<50:15:50,  7.96s/it]
 40%|████      | 15237/37963 [36:37:12<49:28:53,  7.84s/it]
 40%|████      | 15238/37963 [36:37:20<49:06:24,  7.78s/it]
 40%|████      | 15239/37963 [36:37:27<47:58:16,  7.60s/it]
 40%|████      | 15240/37963 [36:37:34<47:55:50,  7.59s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.261', 'learning_rate': '1.36e-05', 'epoch': '0.4014'}

 40%|████      | 15240/37963 [36:37:34<47:55:50,  7.59s/it]
 40%|████      | 15241/37963 [36:37:42<47:56:35,  7.60s/it]
 40%|████      | 15242/37963 [36:37:56<60:14:26,  9.54s/it]
 40%|████      | 15243/37963 [36:38:10<69:05:20, 10.95s/it]
 40%|████      | 15244/37963 [36:38:18<62:16:11,  9.87s/it]
 40%|████      | 15245/37963 [36:38:25<57:01:18,  9.04s/it]
 40%|████      | 15246/37963 [36:38:39<66:22:54, 10.52s/it]
 40%|████      | 15247/37963 [36:38:53<73:23:00, 11.63s/it]
 40%|████      | 15248/37963 [36:39:01<65:41:56, 10.41s/it]
 40%|████      | 15249/37963 [36:39:08<60:25:18,  9.58s/it]
 40%|████      | 15250/37963 [36:39:22<68:14:34, 10.82s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.121', 'learning_rate': '1.359e-05', 'epoch': '0.4017'}

 40%|████      | 15250/37963 [36:39:22<68:14:34, 10.82s/it]
 40%|████      | 15251/37963 [36:39:29<61:55:40,  9.82s/it]
 40%|████      | 15252/37963 [36:39:37<57:52:48,  9.17s/it]
 40%|████      | 15253/37963 [36:39:45<55:26:11,  8.79s/it]
 40%|████      | 15254/37963 [36:39:52<53:04:33,  8.41s/it]
 40%|████      | 15255/37963 [36:40:00<51:47:30,  8.21s/it]
 40%|████      | 15256/37963 [36:40:08<50:19:45,  7.98s/it]
 40%|████      | 15257/37963 [36:40:15<49:32:56,  7.86s/it]
 40%|████      | 15258/37963 [36:40:23<49:03:07,  7.78s/it]
 40%|████      | 15259/37963 [36:40:30<48:35:07,  7.70s/it]
 40%|████      | 15260/37963 [36:40:38<48:05:00,  7.62s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '2.21', 'learning_rate': '1.358e-05', 'epoch': '0.402'}

 40%|████      | 15260/37963 [36:40:38<48:05:00,  7.62s/it]
 40%|████      | 15261/37963 [36:40:45<47:52:23,  7.59s/it]
 40%|████      | 15262/37963 [36:40:53<47:55:35,  7.60s/it]
 40%|████      | 15263/37963 [36:41:00<47:40:53,  7.56s/it]
 40%|████      | 15264/37963 [36:41:08<47:33:26,  7.54s/it]
 40%|████      | 15265/37963 [36:41:21<59:02:23,  9.36s/it]
 40%|████      | 15266/37963 [36:41:29<55:54:44,  8.87s/it]
 40%|████      | 15267/37963 [36:41:37<53:20:48,  8.46s/it]
 40%|████      | 15268/37963 [36:41:44<51:24:40,  8.16s/it]
 40%|████      | 15269/37963 [36:41:52<49:59:15,  7.93s/it]
 40%|████      | 15270/37963 [36:41:59<49:11:27,  7.80s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '2.152', 'learning_rate': '1.357e-05', 'epoch': '0.4022'}

 40%|████      | 15270/37963 [36:41:59<49:11:27,  7.80s/it]
 40%|████      | 15271/37963 [36:42:13<60:44:43,  9.64s/it]
 40%|████      | 15272/37963 [36:42:21<57:02:19,  9.05s/it]
 40%|████      | 15273/37963 [36:42:28<54:06:52,  8.59s/it]
 40%|████      | 15274/37963 [36:42:36<52:03:24,  8.26s/it]
 40%|████      | 15275/37963 [36:42:43<50:33:57,  8.02s/it]
 40%|████      | 15276/37963 [36:42:51<49:43:50,  7.89s/it]
 40%|████      | 15277/37963 [36:42:58<49:26:19,  7.85s/it]
 40%|████      | 15278/37963 [36:43:06<48:40:45,  7.73s/it]
 40%|████      | 15279/37963 [36:43:20<60:24:45,  9.59s/it]
 40%|████      | 15280/37963 [36:43:27<56:36:09,  8.98s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.843', 'learning_rate': '1.356e-05', 'epoch': '0.4025'}

 40%|████      | 15280/37963 [36:43:27<56:36:09,  8.98s/it]
 40%|████      | 15281/37963 [36:43:35<53:55:37,  8.56s/it]
 40%|████      | 15282/37963 [36:43:43<52:04:22,  8.27s/it]
 40%|████      | 15283/37963 [36:43:50<50:44:39,  8.05s/it]
 40%|████      | 15284/37963 [36:43:58<49:37:30,  7.88s/it]
 40%|████      | 15285/37963 [36:44:05<48:54:15,  7.76s/it]
 40%|████      | 15286/37963 [36:44:13<48:31:33,  7.70s/it]
 40%|████      | 15287/37963 [36:44:20<48:11:26,  7.65s/it]
 40%|████      | 15288/37963 [36:44:28<48:05:10,  7.63s/it]
 40%|████      | 15289/37963 [36:44:35<48:03:15,  7.63s/it]
 40%|████      | 15290/37963 [36:44:43<48:08:26,  7.64s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.586', 'learning_rate': '1.356e-05', 'epoch': '0.4028'}

 40%|████      | 15290/37963 [36:44:43<48:08:26,  7.64s/it]
 40%|████      | 15291/37963 [36:44:57<60:04:54,  9.54s/it]
 40%|████      | 15292/37963 [36:45:11<68:35:42, 10.89s/it]
 40%|████      | 15293/37963 [36:45:25<74:30:59, 11.83s/it]
 40%|████      | 15294/37963 [36:45:33<66:23:26, 10.54s/it]
 40%|████      | 15295/37963 [36:45:40<61:18:08,  9.74s/it]
 40%|████      | 15296/37963 [36:45:54<68:38:35, 10.90s/it]
 40%|████      | 15297/37963 [36:46:01<61:58:07,  9.84s/it]
 40%|████      | 15298/37963 [36:46:09<57:30:30,  9.13s/it]
 40%|████      | 15299/37963 [36:46:16<53:47:28,  8.54s/it]
 40%|████      | 15300/37963 [36:46:24<51:45:58,  8.22s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '3.491', 'learning_rate': '1.355e-05', 'epoch': '0.403'}

 40%|████      | 15300/37963 [36:46:24<51:45:58,  8.22s/it]
 40%|████      | 15301/37963 [36:46:31<50:34:34,  8.03s/it]
 40%|████      | 15302/37963 [36:46:39<49:46:52,  7.91s/it]
 40%|████      | 15303/37963 [36:46:47<49:28:27,  7.86s/it]
 40%|████      | 15304/37963 [36:47:01<61:05:46,  9.71s/it]
 40%|████      | 15305/37963 [36:47:08<56:35:49,  8.99s/it]
 40%|████      | 15306/37963 [36:47:15<53:47:58,  8.55s/it]
 40%|████      | 15307/37963 [36:47:23<51:55:18,  8.25s/it]
 40%|████      | 15308/37963 [36:47:30<50:33:35,  8.03s/it]
 40%|████      | 15309/37963 [36:47:38<49:43:30,  7.90s/it]
 40%|████      | 15310/37963 [36:47:45<48:20:24,  7.68s/it]
                                                           
{'loss': '0.1602', 'grad_norm': '2.183', 'learning_rate': '1.354e-05', 'epoch': '0.4033'}

 40%|████      | 15310/37963 [36:47:45<48:20:24,  7.68s/it]
 40%|████      | 15311/37963 [36:47:53<47:51:03,  7.60s/it]
 40%|████      | 15312/37963 [36:48:00<47:42:55,  7.58s/it]
 40%|████      | 15313/37963 [36:48:08<47:39:21,  7.57s/it]
 40%|████      | 15314/37963 [36:48:15<47:33:25,  7.56s/it]
 40%|████      | 15315/37963 [36:48:30<60:07:11,  9.56s/it]
 40%|████      | 15316/37963 [36:48:44<68:48:16, 10.94s/it]
 40%|████      | 15317/37963 [36:48:51<62:07:19,  9.88s/it]
 40%|████      | 15318/37963 [36:48:59<57:51:51,  9.20s/it]
 40%|████      | 15319/37963 [36:49:06<54:50:26,  8.72s/it]
 40%|████      | 15320/37963 [36:49:14<52:59:18,  8.42s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '1.838', 'learning_rate': '1.353e-05', 'epoch': '0.4036'}

 40%|████      | 15320/37963 [36:49:14<52:59:18,  8.42s/it]
 40%|████      | 15321/37963 [36:49:22<51:16:25,  8.15s/it]
 40%|████      | 15322/37963 [36:49:35<61:45:00,  9.82s/it]
 40%|████      | 15323/37963 [36:49:43<57:11:14,  9.09s/it]
 40%|████      | 15324/37963 [36:49:50<54:12:22,  8.62s/it]
 40%|████      | 15325/37963 [36:49:58<52:07:12,  8.29s/it]
 40%|████      | 15326/37963 [36:50:05<50:49:45,  8.08s/it]
 40%|████      | 15327/37963 [36:50:13<50:01:08,  7.95s/it]
 40%|████      | 15328/37963 [36:50:20<49:12:40,  7.83s/it]
 40%|████      | 15329/37963 [36:50:28<48:46:03,  7.76s/it]
 40%|████      | 15330/37963 [36:50:36<48:36:08,  7.73s/it]
                                                           
{'loss': '0.1546', 'grad_norm': '1.077', 'learning_rate': '1.352e-05', 'epoch': '0.4038'}

 40%|████      | 15330/37963 [36:50:36<48:36:08,  7.73s/it]
 40%|████      | 15331/37963 [36:50:43<47:47:45,  7.60s/it]
 40%|████      | 15332/37963 [36:50:51<47:43:14,  7.59s/it]
 40%|████      | 15333/37963 [36:50:58<47:44:56,  7.60s/it]
 40%|████      | 15334/37963 [36:51:06<47:50:54,  7.61s/it]
 40%|████      | 15335/37963 [36:51:13<47:30:57,  7.56s/it]
 40%|████      | 15336/37963 [36:51:21<47:46:33,  7.60s/it]
 40%|████      | 15337/37963 [36:51:29<47:43:11,  7.59s/it]
 40%|████      | 15338/37963 [36:51:36<47:14:53,  7.52s/it]
 40%|████      | 15339/37963 [36:51:49<58:41:23,  9.34s/it]
 40%|████      | 15340/37963 [36:52:03<67:01:30, 10.67s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.736', 'learning_rate': '1.352e-05', 'epoch': '0.4041'}

 40%|████      | 15340/37963 [36:52:03<67:01:30, 10.67s/it]
 40%|████      | 15341/37963 [36:52:11<61:10:38,  9.74s/it]
 40%|████      | 15342/37963 [36:52:18<57:10:31,  9.10s/it]
 40%|████      | 15343/37963 [36:52:26<54:08:05,  8.62s/it]
 40%|████      | 15344/37963 [36:52:33<52:01:04,  8.28s/it]
 40%|████      | 15345/37963 [36:52:47<62:41:56,  9.98s/it]
 40%|████      | 15346/37963 [36:52:55<58:04:02,  9.24s/it]
 40%|████      | 15347/37963 [36:53:09<66:41:45, 10.62s/it]
 40%|████      | 15348/37963 [36:53:16<60:52:34,  9.69s/it]
 40%|████      | 15349/37963 [36:53:24<56:50:30,  9.05s/it]
 40%|████      | 15350/37963 [36:53:31<54:09:33,  8.62s/it]
                                                           
{'loss': '0.1574', 'grad_norm': '1.876', 'learning_rate': '1.351e-05', 'epoch': '0.4043'}

 40%|████      | 15350/37963 [36:53:31<54:09:33,  8.62s/it]
 40%|████      | 15351/37963 [36:53:39<52:24:25,  8.34s/it]
 40%|████      | 15352/37963 [36:53:53<62:59:50, 10.03s/it]
 40%|████      | 15353/37963 [36:54:01<58:37:05,  9.33s/it]
 40%|████      | 15354/37963 [36:54:09<55:38:24,  8.86s/it]
 40%|████      | 15355/37963 [36:54:16<52:59:37,  8.44s/it]
 40%|████      | 15356/37963 [36:54:23<51:12:33,  8.15s/it]
 40%|████      | 15357/37963 [36:54:31<50:02:48,  7.97s/it]
 40%|████      | 15358/37963 [36:54:38<49:06:33,  7.82s/it]
 40%|████      | 15359/37963 [36:54:46<48:42:13,  7.76s/it]
 40%|████      | 15360/37963 [36:54:53<47:53:54,  7.63s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.442', 'learning_rate': '1.35e-05', 'epoch': '0.4046'}

 40%|████      | 15360/37963 [36:54:53<47:53:54,  7.63s/it]
 40%|████      | 15361/37963 [36:55:01<47:44:43,  7.60s/it]
 40%|████      | 15362/37963 [36:55:09<47:43:03,  7.60s/it]
 40%|████      | 15363/37963 [36:55:23<59:38:37,  9.50s/it]
 40%|████      | 15364/37963 [36:55:37<68:40:15, 10.94s/it]
 40%|████      | 15365/37963 [36:55:44<61:50:59,  9.85s/it]
 40%|████      | 15366/37963 [36:55:52<57:27:32,  9.15s/it]
 40%|████      | 15367/37963 [36:55:59<54:19:58,  8.66s/it]
 40%|████      | 15368/37963 [36:56:07<52:25:38,  8.35s/it]
 40%|████      | 15369/37963 [36:56:14<51:01:45,  8.13s/it]
 40%|████      | 15370/37963 [36:56:22<49:58:47,  7.96s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '2.485', 'learning_rate': '1.349e-05', 'epoch': '0.4049'}

 40%|████      | 15370/37963 [36:56:22<49:58:47,  7.96s/it]
 40%|████      | 15371/37963 [36:56:30<49:26:19,  7.88s/it]
 40%|████      | 15372/37963 [36:56:37<48:54:10,  7.79s/it]
 40%|████      | 15373/37963 [36:56:45<48:23:44,  7.71s/it]
 40%|████      | 15374/37963 [36:56:52<48:08:14,  7.67s/it]
 40%|████      | 15375/37963 [36:57:00<47:39:58,  7.60s/it]
 41%|████      | 15376/37963 [36:57:07<47:17:09,  7.54s/it]
 41%|████      | 15377/37963 [36:57:21<59:40:36,  9.51s/it]
 41%|████      | 15378/37963 [36:57:29<56:02:05,  8.93s/it]
 41%|████      | 15379/37963 [36:57:36<52:38:28,  8.39s/it]
 41%|████      | 15380/37963 [36:57:44<51:01:57,  8.14s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '1.307', 'learning_rate': '1.348e-05', 'epoch': '0.4051'}

 41%|████      | 15380/37963 [36:57:44<51:01:57,  8.14s/it]
 41%|████      | 15381/37963 [36:57:51<49:17:25,  7.86s/it]
 41%|████      | 15382/37963 [36:57:58<48:25:52,  7.72s/it]
 41%|████      | 15383/37963 [36:58:06<47:58:28,  7.65s/it]
 41%|████      | 15384/37963 [36:58:13<47:15:08,  7.53s/it]
 41%|████      | 15385/37963 [36:58:20<47:19:29,  7.55s/it]
 41%|████      | 15386/37963 [36:58:28<47:16:59,  7.54s/it]
 41%|████      | 15387/37963 [36:58:48<71:33:43, 11.41s/it]
 41%|████      | 15388/37963 [36:58:56<64:22:08, 10.26s/it]
 41%|████      | 15389/37963 [36:59:03<58:35:23,  9.34s/it]
 41%|████      | 15390/37963 [36:59:17<67:13:40, 10.72s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '4.127', 'learning_rate': '1.348e-05', 'epoch': '0.4054'}

 41%|████      | 15390/37963 [36:59:17<67:13:40, 10.72s/it]
 41%|████      | 15391/37963 [36:59:25<61:14:44,  9.77s/it]
 41%|████      | 15392/37963 [36:59:32<56:37:08,  9.03s/it]
 41%|████      | 15393/37963 [36:59:46<65:51:06, 10.50s/it]
 41%|████      | 15394/37963 [36:59:54<60:26:24,  9.64s/it]
 41%|████      | 15395/37963 [37:00:01<56:45:47,  9.05s/it]
 41%|████      | 15396/37963 [37:00:09<53:51:56,  8.59s/it]
 41%|████      | 15397/37963 [37:00:16<51:45:48,  8.26s/it]
 41%|████      | 15398/37963 [37:00:24<49:57:48,  7.97s/it]
 41%|████      | 15399/37963 [37:00:31<49:12:42,  7.85s/it]
 41%|████      | 15400/37963 [37:00:39<48:49:44,  7.79s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.205', 'learning_rate': '1.347e-05', 'epoch': '0.4057'}

 41%|████      | 15400/37963 [37:00:39<48:49:44,  7.79s/it]
 41%|████      | 15401/37963 [37:00:46<48:32:46,  7.75s/it]
 41%|████      | 15402/37963 [37:00:54<48:31:41,  7.74s/it]
 41%|████      | 15403/37963 [37:01:08<60:16:48,  9.62s/it]
 41%|████      | 15404/37963 [37:01:16<56:21:18,  8.99s/it]
 41%|████      | 15405/37963 [37:01:23<53:28:24,  8.53s/it]
 41%|████      | 15406/37963 [37:01:31<51:31:54,  8.22s/it]
 41%|████      | 15407/37963 [37:01:38<49:48:06,  7.95s/it]
 41%|████      | 15408/37963 [37:01:45<48:47:20,  7.79s/it]
 41%|████      | 15409/37963 [37:02:05<71:52:59, 11.47s/it]
 41%|████      | 15410/37963 [37:02:13<64:36:01, 10.31s/it]
                                                           
{'loss': '0.1573', 'grad_norm': '1.067', 'learning_rate': '1.346e-05', 'epoch': '0.4059'}

 41%|████      | 15410/37963 [37:02:13<64:36:01, 10.31s/it]
 41%|████      | 15411/37963 [37:02:21<59:26:16,  9.49s/it]
 41%|████      | 15412/37963 [37:02:28<55:56:55,  8.93s/it]
 41%|████      | 15413/37963 [37:02:36<53:18:57,  8.51s/it]
 41%|████      | 15414/37963 [37:02:43<51:40:43,  8.25s/it]
 41%|████      | 15415/37963 [37:02:51<50:29:38,  8.06s/it]
 41%|████      | 15416/37963 [37:02:58<49:00:34,  7.83s/it]
 41%|████      | 15417/37963 [37:03:06<48:34:48,  7.76s/it]
 41%|████      | 15418/37963 [37:03:14<48:21:58,  7.72s/it]
 41%|████      | 15419/37963 [37:03:21<47:56:14,  7.66s/it]
 41%|████      | 15420/37963 [37:03:29<47:48:53,  7.64s/it]
                                                           
{'loss': '0.15', 'grad_norm': '1.708', 'learning_rate': '1.345e-05', 'epoch': '0.4062'}

 41%|████      | 15420/37963 [37:03:29<47:48:53,  7.64s/it]
 41%|████      | 15421/37963 [37:03:36<47:37:18,  7.61s/it]
 41%|████      | 15422/37963 [37:03:44<47:21:30,  7.56s/it]
 41%|████      | 15423/37963 [37:03:51<46:52:11,  7.49s/it]
 41%|████      | 15424/37963 [37:03:58<46:55:24,  7.49s/it]
 41%|████      | 15425/37963 [37:04:06<46:59:20,  7.51s/it]
 41%|████      | 15426/37963 [37:04:14<47:01:23,  7.51s/it]
 41%|████      | 15427/37963 [37:04:21<47:04:27,  7.52s/it]
 41%|████      | 15428/37963 [37:04:29<47:01:14,  7.51s/it]
 41%|████      | 15429/37963 [37:04:36<47:11:19,  7.54s/it]
 41%|████      | 15430/37963 [37:04:44<47:20:42,  7.56s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '2.425', 'learning_rate': '1.344e-05', 'epoch': '0.4064'}

 41%|████      | 15430/37963 [37:04:44<47:20:42,  7.56s/it]
 41%|████      | 15431/37963 [37:04:58<59:18:06,  9.47s/it]
 41%|████      | 15432/37963 [37:05:05<55:51:14,  8.92s/it]
 41%|████      | 15433/37963 [37:05:20<65:50:15, 10.52s/it]
 41%|████      | 15434/37963 [37:05:27<59:48:39,  9.56s/it]
 41%|████      | 15435/37963 [37:05:34<56:06:17,  8.97s/it]
 41%|████      | 15436/37963 [37:05:48<64:50:26, 10.36s/it]
 41%|████      | 15437/37963 [37:05:56<59:34:35,  9.52s/it]
 41%|████      | 15438/37963 [37:06:03<55:44:13,  8.91s/it]
 41%|████      | 15439/37963 [37:06:11<53:04:21,  8.48s/it]
 41%|████      | 15440/37963 [37:06:18<50:50:02,  8.13s/it]
                                                           
{'loss': '0.1507', 'grad_norm': '2.155', 'learning_rate': '1.344e-05', 'epoch': '0.4067'}

 41%|████      | 15440/37963 [37:06:18<50:50:02,  8.13s/it]
 41%|████      | 15441/37963 [37:06:32<62:09:30,  9.94s/it]
 41%|████      | 15442/37963 [37:06:39<57:05:47,  9.13s/it]
 41%|████      | 15443/37963 [37:06:53<66:12:25, 10.58s/it]
 41%|████      | 15444/37963 [37:07:01<60:25:15,  9.66s/it]
 41%|████      | 15445/37963 [37:07:08<56:25:30,  9.02s/it]
 41%|████      | 15446/37963 [37:07:16<53:37:17,  8.57s/it]
 41%|████      | 15447/37963 [37:07:23<51:48:07,  8.28s/it]
 41%|████      | 15448/37963 [37:07:31<50:22:00,  8.05s/it]
 41%|████      | 15449/37963 [37:07:39<49:32:55,  7.92s/it]
 41%|████      | 15450/37963 [37:07:46<48:34:18,  7.77s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '1.924', 'learning_rate': '1.343e-05', 'epoch': '0.407'}

 41%|████      | 15450/37963 [37:07:46<48:34:18,  7.77s/it]
 41%|████      | 15451/37963 [37:07:54<48:10:12,  7.70s/it]
 41%|████      | 15452/37963 [37:08:01<47:55:04,  7.66s/it]
 41%|████      | 15453/37963 [37:08:15<59:43:45,  9.55s/it]
 41%|████      | 15454/37963 [37:08:23<55:48:27,  8.93s/it]
 41%|████      | 15455/37963 [37:08:30<53:04:06,  8.49s/it]
 41%|████      | 15456/37963 [37:08:44<62:59:01, 10.07s/it]
 41%|████      | 15457/37963 [37:08:51<58:27:00,  9.35s/it]
 41%|████      | 15458/37963 [37:08:59<54:58:14,  8.79s/it]
 41%|████      | 15459/37963 [37:09:06<52:37:10,  8.42s/it]
 41%|████      | 15460/37963 [37:09:14<51:03:21,  8.17s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '4.145', 'learning_rate': '1.342e-05', 'epoch': '0.4072'}

 41%|████      | 15460/37963 [37:09:14<51:03:21,  8.17s/it]
 41%|████      | 15461/37963 [37:09:22<50:05:47,  8.01s/it]
 41%|████      | 15462/37963 [37:09:29<49:10:38,  7.87s/it]
 41%|████      | 15463/37963 [37:09:43<60:53:36,  9.74s/it]
 41%|████      | 15464/37963 [37:09:51<56:44:17,  9.08s/it]
 41%|████      | 15465/37963 [37:09:59<54:00:13,  8.64s/it]
 41%|████      | 15466/37963 [37:10:06<52:06:47,  8.34s/it]
 41%|████      | 15467/37963 [37:10:14<50:39:54,  8.11s/it]
 41%|████      | 15468/37963 [37:10:21<49:42:37,  7.96s/it]
 41%|████      | 15469/37963 [37:10:29<48:48:28,  7.81s/it]
 41%|████      | 15470/37963 [37:10:36<48:06:14,  7.70s/it]
                                                           
{'loss': '0.137', 'grad_norm': '1.245', 'learning_rate': '1.341e-05', 'epoch': '0.4075'}

 41%|████      | 15470/37963 [37:10:36<48:06:14,  7.70s/it]
 41%|████      | 15471/37963 [37:10:44<47:18:29,  7.57s/it]
 41%|████      | 15472/37963 [37:10:51<46:40:26,  7.47s/it]
 41%|████      | 15473/37963 [37:10:58<46:19:13,  7.41s/it]
 41%|████      | 15474/37963 [37:11:05<45:54:57,  7.35s/it]
 41%|████      | 15475/37963 [37:11:13<46:15:54,  7.41s/it]
 41%|████      | 15476/37963 [37:11:20<46:28:26,  7.44s/it]
 41%|████      | 15477/37963 [37:11:28<46:07:07,  7.38s/it]
 41%|████      | 15478/37963 [37:11:35<46:23:14,  7.43s/it]
 41%|████      | 15479/37963 [37:11:49<58:42:46,  9.40s/it]
 41%|████      | 15480/37963 [37:11:57<55:16:53,  8.85s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.085', 'learning_rate': '1.34e-05', 'epoch': '0.4078'}

 41%|████      | 15480/37963 [37:11:57<55:16:53,  8.85s/it]
 41%|████      | 15481/37963 [37:12:11<64:57:26, 10.40s/it]
 41%|████      | 15482/37963 [37:12:18<59:28:33,  9.52s/it]
 41%|████      | 15483/37963 [37:12:26<55:40:01,  8.91s/it]
 41%|████      | 15484/37963 [37:12:33<52:51:15,  8.46s/it]
 41%|████      | 15485/37963 [37:12:40<50:38:41,  8.11s/it]
 41%|████      | 15486/37963 [37:12:48<49:17:49,  7.90s/it]
 41%|████      | 15487/37963 [37:12:55<48:29:46,  7.77s/it]
 41%|████      | 15488/37963 [37:13:09<60:24:12,  9.68s/it]
 41%|████      | 15489/37963 [37:13:17<56:26:35,  9.04s/it]
 41%|████      | 15490/37963 [37:13:25<53:52:58,  8.63s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '2.443', 'learning_rate': '1.34e-05', 'epoch': '0.408'}

 41%|████      | 15490/37963 [37:13:25<53:52:58,  8.63s/it]
 41%|████      | 15491/37963 [37:13:39<63:56:52, 10.24s/it]
 41%|████      | 15492/37963 [37:13:46<58:49:41,  9.42s/it]
 41%|████      | 15493/37963 [37:13:54<55:31:35,  8.90s/it]
 41%|████      | 15494/37963 [37:14:01<52:55:51,  8.48s/it]
 41%|████      | 15495/37963 [37:14:15<63:17:18, 10.14s/it]
 41%|████      | 15496/37963 [37:14:23<58:20:42,  9.35s/it]
 41%|████      | 15497/37963 [37:14:37<66:37:20, 10.68s/it]
 41%|████      | 15498/37963 [37:14:44<60:49:13,  9.75s/it]
 41%|████      | 15499/37963 [37:14:52<56:31:32,  9.06s/it]
 41%|████      | 15500/37963 [37:14:59<53:36:21,  8.59s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.354', 'learning_rate': '1.339e-05', 'epoch': '0.4083'}

 41%|████      | 15500/37963 [37:14:59<53:36:21,  8.59s/it]
 41%|████      | 15501/37963 [37:15:07<51:32:37,  8.26s/it]
 41%|████      | 15502/37963 [37:15:14<50:21:16,  8.07s/it]
 41%|████      | 15503/37963 [37:15:21<48:49:45,  7.83s/it]
 41%|████      | 15504/37963 [37:15:29<48:16:08,  7.74s/it]
 41%|████      | 15505/37963 [37:15:36<47:43:10,  7.65s/it]
 41%|████      | 15506/37963 [37:15:44<47:50:32,  7.67s/it]
 41%|████      | 15507/37963 [37:15:52<47:46:53,  7.66s/it]
 41%|████      | 15508/37963 [37:16:06<59:53:45,  9.60s/it]
 41%|████      | 15509/37963 [37:16:20<68:01:58, 10.91s/it]
 41%|████      | 15510/37963 [37:16:27<61:46:57,  9.91s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '1.434', 'learning_rate': '1.338e-05', 'epoch': '0.4086'}

 41%|████      | 15510/37963 [37:16:27<61:46:57,  9.91s/it]
 41%|████      | 15511/37963 [37:16:35<57:19:50,  9.19s/it]
 41%|████      | 15512/37963 [37:16:43<54:28:30,  8.74s/it]
 41%|████      | 15513/37963 [37:16:50<51:25:22,  8.25s/it]
 41%|████      | 15514/37963 [37:16:57<50:04:56,  8.03s/it]
 41%|████      | 15515/37963 [37:17:05<49:04:07,  7.87s/it]
 41%|████      | 15516/37963 [37:17:12<47:47:18,  7.66s/it]
 41%|████      | 15517/37963 [37:17:19<47:28:21,  7.61s/it]
 41%|████      | 15518/37963 [37:17:27<47:27:58,  7.61s/it]
 41%|████      | 15519/37963 [37:17:35<47:12:13,  7.57s/it]
 41%|████      | 15520/37963 [37:17:42<46:30:48,  7.46s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '2.891', 'learning_rate': '1.337e-05', 'epoch': '0.4088'}

 41%|████      | 15520/37963 [37:17:42<46:30:48,  7.46s/it]
 41%|████      | 15521/37963 [37:17:49<46:44:29,  7.50s/it]
 41%|████      | 15522/37963 [37:17:57<46:46:57,  7.50s/it]
 41%|████      | 15523/37963 [37:18:04<46:44:53,  7.50s/it]
 41%|████      | 15524/37963 [37:18:12<47:02:26,  7.55s/it]
 41%|████      | 15525/37963 [37:18:19<46:58:52,  7.54s/it]
 41%|████      | 15526/37963 [37:18:27<46:54:40,  7.53s/it]
 41%|████      | 15527/37963 [37:18:35<47:08:15,  7.56s/it]
 41%|████      | 15528/37963 [37:18:49<59:13:05,  9.50s/it]
 41%|████      | 15529/37963 [37:18:56<55:08:16,  8.85s/it]
 41%|████      | 15530/37963 [37:19:10<64:32:42, 10.36s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.011', 'learning_rate': '1.336e-05', 'epoch': '0.4091'}

 41%|████      | 15530/37963 [37:19:10<64:32:42, 10.36s/it]
 41%|████      | 15531/37963 [37:19:18<59:31:25,  9.55s/it]
 41%|████      | 15532/37963 [37:19:25<55:21:26,  8.88s/it]
 41%|████      | 15533/37963 [37:19:32<52:31:53,  8.43s/it]
 41%|████      | 15534/37963 [37:19:40<50:51:40,  8.16s/it]
 41%|████      | 15535/37963 [37:19:47<49:44:05,  7.98s/it]
 41%|████      | 15536/37963 [37:19:55<48:46:34,  7.83s/it]
 41%|████      | 15537/37963 [37:20:02<48:01:13,  7.71s/it]
 41%|████      | 15538/37963 [37:20:10<47:52:31,  7.69s/it]
 41%|████      | 15539/37963 [37:20:24<59:50:32,  9.61s/it]
 41%|████      | 15540/37963 [37:20:38<67:55:51, 10.91s/it]
                                                           
{'loss': '0.16', 'grad_norm': '1.559', 'learning_rate': '1.336e-05', 'epoch': '0.4093'}

 41%|████      | 15540/37963 [37:20:38<67:55:51, 10.91s/it]
 41%|████      | 15541/37963 [37:20:45<61:21:30,  9.85s/it]
 41%|████      | 15542/37963 [37:20:59<69:09:07, 11.10s/it]
 41%|████      | 15543/37963 [37:21:07<62:19:38, 10.01s/it]
 41%|████      | 15544/37963 [37:21:14<57:44:23,  9.27s/it]
 41%|████      | 15545/37963 [37:21:22<54:38:17,  8.77s/it]
 41%|████      | 15546/37963 [37:21:30<52:27:10,  8.42s/it]
 41%|████      | 15547/37963 [37:21:37<50:32:16,  8.12s/it]
 41%|████      | 15548/37963 [37:21:44<48:56:33,  7.86s/it]
 41%|████      | 15549/37963 [37:21:58<59:25:13,  9.54s/it]
 41%|████      | 15550/37963 [37:22:05<55:39:26,  8.94s/it]
                                                           
{'loss': '0.1557', 'grad_norm': '0.99', 'learning_rate': '1.335e-05', 'epoch': '0.4096'}

 41%|████      | 15550/37963 [37:22:05<55:39:26,  8.94s/it]
 41%|████      | 15551/37963 [37:22:13<53:14:01,  8.55s/it]
 41%|████      | 15552/37963 [37:22:20<51:17:39,  8.24s/it]
 41%|████      | 15553/37963 [37:22:28<50:21:55,  8.09s/it]
 41%|████      | 15554/37963 [37:22:42<61:46:42,  9.92s/it]
 41%|████      | 15555/37963 [37:22:50<57:30:38,  9.24s/it]
 41%|████      | 15556/37963 [37:23:04<66:13:04, 10.64s/it]
 41%|████      | 15557/37963 [37:23:11<60:15:07,  9.68s/it]
 41%|████      | 15558/37963 [37:23:19<56:18:25,  9.05s/it]
 41%|████      | 15559/37963 [37:23:26<53:26:45,  8.59s/it]
 41%|████      | 15560/37963 [37:23:34<51:28:46,  8.27s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '1.975', 'learning_rate': '1.334e-05', 'epoch': '0.4099'}

 41%|████      | 15560/37963 [37:23:34<51:28:46,  8.27s/it]
 41%|████      | 15561/37963 [37:23:41<49:59:24,  8.03s/it]
 41%|████      | 15562/37963 [37:23:49<49:23:03,  7.94s/it]
 41%|████      | 15563/37963 [37:23:57<48:37:38,  7.82s/it]
 41%|████      | 15564/37963 [37:24:04<47:53:39,  7.70s/it]
 41%|████      | 15565/37963 [37:24:12<47:26:47,  7.63s/it]
 41%|████      | 15566/37963 [37:24:19<47:23:27,  7.62s/it]
 41%|████      | 15567/37963 [37:24:27<47:03:57,  7.57s/it]
 41%|████      | 15568/37963 [37:24:34<47:17:44,  7.60s/it]
 41%|████      | 15569/37963 [37:24:42<47:15:09,  7.60s/it]
 41%|████      | 15570/37963 [37:24:49<47:06:15,  7.57s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.418', 'learning_rate': '1.333e-05', 'epoch': '0.4101'}

 41%|████      | 15570/37963 [37:24:49<47:06:15,  7.57s/it]
 41%|████      | 15571/37963 [37:24:57<47:02:15,  7.56s/it]
 41%|████      | 15572/37963 [37:25:04<47:04:23,  7.57s/it]
 41%|████      | 15573/37963 [37:25:12<47:05:52,  7.57s/it]
 41%|████      | 15574/37963 [37:25:20<47:09:06,  7.58s/it]
 41%|████      | 15575/37963 [37:25:27<47:00:52,  7.56s/it]
 41%|████      | 15576/37963 [37:25:41<58:45:38,  9.45s/it]
 41%|████      | 15577/37963 [37:25:49<55:06:21,  8.86s/it]
 41%|████      | 15578/37963 [37:25:56<52:35:36,  8.46s/it]
 41%|████      | 15579/37963 [37:26:10<62:57:56, 10.13s/it]
 41%|████      | 15580/37963 [37:26:17<57:49:25,  9.30s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '1.206', 'learning_rate': '1.332e-05', 'epoch': '0.4104'}

 41%|████      | 15580/37963 [37:26:17<57:49:25,  9.30s/it]
 41%|████      | 15581/37963 [37:26:25<54:22:33,  8.75s/it]
 41%|████      | 15582/37963 [37:26:32<52:14:06,  8.40s/it]
 41%|████      | 15583/37963 [37:26:40<50:55:31,  8.19s/it]
 41%|████      | 15584/37963 [37:26:47<49:13:41,  7.92s/it]
 41%|████      | 15585/37963 [37:26:55<48:24:24,  7.79s/it]
 41%|████      | 15586/37963 [37:27:03<48:06:22,  7.74s/it]
 41%|████      | 15587/37963 [37:27:16<59:33:32,  9.58s/it]
 41%|████      | 15588/37963 [37:27:31<68:10:58, 10.97s/it]
 41%|████      | 15589/37963 [37:27:38<62:12:19, 10.01s/it]
 41%|████      | 15590/37963 [37:27:46<58:00:51,  9.33s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '4.047', 'learning_rate': '1.332e-05', 'epoch': '0.4107'}

 41%|████      | 15590/37963 [37:27:46<58:00:51,  9.33s/it]
 41%|████      | 15591/37963 [37:27:54<54:37:33,  8.79s/it]
 41%|████      | 15592/37963 [37:28:08<64:00:27, 10.30s/it]
 41%|████      | 15593/37963 [37:28:15<58:40:49,  9.44s/it]
 41%|████      | 15594/37963 [37:28:23<55:09:00,  8.88s/it]
 41%|████      | 15595/37963 [37:28:30<52:26:01,  8.44s/it]
 41%|████      | 15596/37963 [37:28:37<50:27:37,  8.12s/it]
 41%|████      | 15597/37963 [37:28:51<61:28:32,  9.90s/it]
 41%|████      | 15598/37963 [37:28:59<56:56:37,  9.17s/it]
 41%|████      | 15599/37963 [37:29:06<53:52:11,  8.67s/it]
 41%|████      | 15600/37963 [37:29:14<51:40:05,  8.32s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.159', 'learning_rate': '1.331e-05', 'epoch': '0.4109'}

 41%|████      | 15600/37963 [37:29:14<51:40:05,  8.32s/it]
 41%|████      | 15601/37963 [37:29:21<50:07:40,  8.07s/it]
 41%|████      | 15602/37963 [37:29:35<61:17:03,  9.87s/it]
 41%|████      | 15603/37963 [37:29:43<57:18:12,  9.23s/it]
 41%|████      | 15604/37963 [37:29:51<54:10:51,  8.72s/it]
 41%|████      | 15605/37963 [37:29:58<51:53:47,  8.36s/it]
 41%|████      | 15606/37963 [37:30:06<50:20:44,  8.11s/it]
 41%|████      | 15607/37963 [37:30:13<48:47:17,  7.86s/it]
 41%|████      | 15608/37963 [37:30:27<59:43:12,  9.62s/it]
 41%|████      | 15609/37963 [37:30:34<55:09:46,  8.88s/it]
 41%|████      | 15610/37963 [37:30:41<52:28:00,  8.45s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.31', 'learning_rate': '1.33e-05', 'epoch': '0.4112'}

 41%|████      | 15610/37963 [37:30:41<52:28:00,  8.45s/it]
 41%|████      | 15611/37963 [37:30:49<50:52:37,  8.19s/it]
 41%|████      | 15612/37963 [37:30:56<49:31:18,  7.98s/it]
 41%|████      | 15613/37963 [37:31:04<48:40:53,  7.84s/it]
 41%|████      | 15614/37963 [37:31:12<48:24:51,  7.80s/it]
 41%|████      | 15615/37963 [37:31:19<48:06:34,  7.75s/it]
 41%|████      | 15616/37963 [37:31:27<47:38:35,  7.68s/it]
 41%|████      | 15617/37963 [37:31:34<47:18:10,  7.62s/it]
 41%|████      | 15618/37963 [37:31:42<47:23:33,  7.64s/it]
 41%|████      | 15619/37963 [37:31:49<47:15:04,  7.61s/it]
 41%|████      | 15620/37963 [37:32:03<58:57:09,  9.50s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.031', 'learning_rate': '1.329e-05', 'epoch': '0.4115'}

 41%|████      | 15620/37963 [37:32:03<58:57:09,  9.50s/it]
 41%|████      | 15621/37963 [37:32:11<55:29:08,  8.94s/it]
 41%|████      | 15622/37963 [37:32:18<52:32:05,  8.47s/it]
 41%|████      | 15623/37963 [37:32:26<50:42:36,  8.17s/it]
 41%|████      | 15624/37963 [37:32:33<49:28:40,  7.97s/it]
 41%|████      | 15625/37963 [37:32:41<48:38:09,  7.84s/it]
 41%|████      | 15626/37963 [37:32:48<47:26:21,  7.65s/it]
 41%|████      | 15627/37963 [37:32:56<47:31:45,  7.66s/it]
 41%|████      | 15628/37963 [37:33:03<47:14:49,  7.62s/it]
 41%|████      | 15629/37963 [37:33:11<47:19:17,  7.63s/it]
 41%|████      | 15630/37963 [37:33:18<47:10:06,  7.60s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '1.015', 'learning_rate': '1.328e-05', 'epoch': '0.4117'}

 41%|████      | 15630/37963 [37:33:18<47:10:06,  7.60s/it]
 41%|████      | 15631/37963 [37:33:26<46:59:50,  7.58s/it]
 41%|████      | 15632/37963 [37:33:33<46:49:42,  7.55s/it]
 41%|████      | 15633/37963 [37:33:47<58:12:06,  9.38s/it]
 41%|████      | 15634/37963 [37:33:54<54:22:09,  8.77s/it]
 41%|████      | 15635/37963 [37:34:02<52:00:32,  8.39s/it]
 41%|████      | 15636/37963 [37:34:16<62:18:30, 10.05s/it]
 41%|████      | 15637/37963 [37:34:30<70:15:53, 11.33s/it]
 41%|████      | 15638/37963 [37:34:38<63:07:05, 10.18s/it]
 41%|████      | 15639/37963 [37:34:45<57:51:44,  9.33s/it]
 41%|████      | 15640/37963 [37:34:53<54:32:39,  8.80s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '1.562', 'learning_rate': '1.328e-05', 'epoch': '0.412'}

 41%|████      | 15640/37963 [37:34:53<54:32:39,  8.80s/it]
 41%|████      | 15641/37963 [37:35:07<64:06:50, 10.34s/it]
 41%|████      | 15642/37963 [37:35:14<58:50:31,  9.49s/it]
 41%|████      | 15643/37963 [37:35:22<55:24:54,  8.94s/it]
 41%|████      | 15644/37963 [37:35:29<52:31:16,  8.47s/it]
 41%|████      | 15645/37963 [37:35:36<50:30:19,  8.15s/it]
 41%|████      | 15646/37963 [37:35:44<49:19:01,  7.96s/it]
 41%|████      | 15647/37963 [37:35:51<48:29:57,  7.82s/it]
 41%|████      | 15648/37963 [37:36:05<59:52:40,  9.66s/it]
 41%|████      | 15649/37963 [37:36:13<55:50:03,  9.01s/it]
 41%|████      | 15650/37963 [37:36:21<53:32:08,  8.64s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '3.141', 'learning_rate': '1.327e-05', 'epoch': '0.4122'}

 41%|████      | 15650/37963 [37:36:21<53:32:08,  8.64s/it]
 41%|████      | 15651/37963 [37:36:28<51:37:50,  8.33s/it]
 41%|████      | 15652/37963 [37:36:42<61:59:03, 10.00s/it]
 41%|████      | 15653/37963 [37:36:50<57:18:01,  9.25s/it]
 41%|████      | 15654/37963 [37:36:57<54:10:49,  8.74s/it]
 41%|████      | 15655/37963 [37:37:05<51:54:00,  8.38s/it]
 41%|████      | 15656/37963 [37:37:19<62:19:59, 10.06s/it]
 41%|████      | 15657/37963 [37:37:26<57:33:18,  9.29s/it]
 41%|████      | 15658/37963 [37:37:34<54:38:51,  8.82s/it]
 41%|████      | 15659/37963 [37:37:41<51:35:13,  8.33s/it]
 41%|████▏     | 15660/37963 [37:37:49<50:18:59,  8.12s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '0.92', 'learning_rate': '1.326e-05', 'epoch': '0.4125'}

 41%|████▏     | 15660/37963 [37:37:49<50:18:59,  8.12s/it]
 41%|████▏     | 15661/37963 [37:37:56<49:29:10,  7.99s/it]
 41%|████▏     | 15662/37963 [37:38:04<48:35:19,  7.84s/it]
 41%|████▏     | 15663/37963 [37:38:11<47:56:33,  7.74s/it]
 41%|████▏     | 15664/37963 [37:38:19<47:30:48,  7.67s/it]
 41%|████▏     | 15665/37963 [37:38:27<47:28:31,  7.66s/it]
 41%|████▏     | 15666/37963 [37:38:34<47:24:06,  7.65s/it]
 41%|████▏     | 15667/37963 [37:38:42<47:20:11,  7.64s/it]
 41%|████▏     | 15668/37963 [37:38:56<59:21:52,  9.59s/it]
 41%|████▏     | 15669/37963 [37:39:04<55:34:32,  8.97s/it]
 41%|████▏     | 15670/37963 [37:39:11<53:04:31,  8.57s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.652', 'learning_rate': '1.325e-05', 'epoch': '0.4128'}

 41%|████▏     | 15670/37963 [37:39:11<53:04:31,  8.57s/it]
 41%|████▏     | 15671/37963 [37:39:19<51:04:23,  8.25s/it]
 41%|████▏     | 15672/37963 [37:39:26<49:47:21,  8.04s/it]
 41%|████▏     | 15673/37963 [37:39:34<48:54:49,  7.90s/it]
 41%|████▏     | 15674/37963 [37:39:41<48:15:13,  7.79s/it]
 41%|████▏     | 15675/37963 [37:39:49<47:49:19,  7.72s/it]
 41%|████▏     | 15676/37963 [37:39:56<47:28:09,  7.67s/it]
 41%|████▏     | 15677/37963 [37:40:04<47:05:20,  7.61s/it]
 41%|████▏     | 15678/37963 [37:40:11<46:52:52,  7.57s/it]
 41%|████▏     | 15679/37963 [37:40:19<46:55:50,  7.58s/it]
 41%|████▏     | 15680/37963 [37:40:33<58:48:58,  9.50s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.504', 'learning_rate': '1.324e-05', 'epoch': '0.413'}

 41%|████▏     | 15680/37963 [37:40:33<58:48:58,  9.50s/it]
 41%|████▏     | 15681/37963 [37:40:47<67:10:48, 10.85s/it]
 41%|████▏     | 15682/37963 [37:40:55<61:06:27,  9.87s/it]
 41%|████▏     | 15683/37963 [37:41:02<56:08:41,  9.07s/it]
 41%|████▏     | 15684/37963 [37:41:16<65:53:33, 10.65s/it]
 41%|████▏     | 15685/37963 [37:41:30<71:46:42, 11.60s/it]
 41%|████▏     | 15686/37963 [37:41:37<63:58:27, 10.34s/it]
 41%|████▏     | 15687/37963 [37:41:45<58:56:24,  9.53s/it]
 41%|████▏     | 15688/37963 [37:41:52<55:12:11,  8.92s/it]
 41%|████▏     | 15689/37963 [37:42:00<52:42:39,  8.52s/it]
 41%|████▏     | 15690/37963 [37:42:08<51:06:57,  8.26s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '0.9724', 'learning_rate': '1.324e-05', 'epoch': '0.4133'}

 41%|████▏     | 15690/37963 [37:42:08<51:06:57,  8.26s/it]
 41%|████▏     | 15691/37963 [37:42:15<49:29:42,  8.00s/it]
 41%|████▏     | 15692/37963 [37:42:23<48:28:17,  7.84s/it]
 41%|████▏     | 15693/37963 [37:42:30<47:51:57,  7.74s/it]
 41%|████▏     | 15694/37963 [37:42:37<47:13:12,  7.63s/it]
 41%|████▏     | 15695/37963 [37:42:45<47:13:03,  7.63s/it]
 41%|████▏     | 15696/37963 [37:43:06<71:07:45, 11.50s/it]
 41%|████▏     | 15697/37963 [37:43:13<63:19:02, 10.24s/it]
 41%|████▏     | 15698/37963 [37:43:21<58:25:29,  9.45s/it]
 41%|████▏     | 15699/37963 [37:43:28<54:25:37,  8.80s/it]
 41%|████▏     | 15700/37963 [37:43:36<52:22:28,  8.47s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '3.276', 'learning_rate': '1.323e-05', 'epoch': '0.4136'}

 41%|████▏     | 15700/37963 [37:43:36<52:22:28,  8.47s/it]
 41%|████▏     | 15701/37963 [37:43:43<50:45:50,  8.21s/it]
 41%|████▏     | 15702/37963 [37:43:51<49:38:25,  8.03s/it]
 41%|████▏     | 15703/37963 [37:43:58<48:21:50,  7.82s/it]
 41%|████▏     | 15704/37963 [37:44:06<47:45:08,  7.72s/it]
 41%|████▏     | 15705/37963 [37:44:13<47:26:06,  7.67s/it]
 41%|████▏     | 15706/37963 [37:44:21<47:05:24,  7.62s/it]
 41%|████▏     | 15707/37963 [37:44:35<59:19:12,  9.60s/it]
 41%|████▏     | 15708/37963 [37:44:42<55:27:31,  8.97s/it]
 41%|████▏     | 15709/37963 [37:44:50<52:46:07,  8.54s/it]
 41%|████▏     | 15710/37963 [37:44:57<50:49:17,  8.22s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.938', 'learning_rate': '1.322e-05', 'epoch': '0.4138'}

 41%|████▏     | 15710/37963 [37:44:57<50:49:17,  8.22s/it]
 41%|████▏     | 15711/37963 [37:45:05<49:41:00,  8.04s/it]
 41%|████▏     | 15712/37963 [37:45:12<48:26:17,  7.84s/it]
 41%|████▏     | 15713/37963 [37:45:20<47:20:48,  7.66s/it]
 41%|████▏     | 15714/37963 [37:45:27<47:01:01,  7.61s/it]
 41%|████▏     | 15715/37963 [37:45:35<46:49:30,  7.58s/it]
 41%|████▏     | 15716/37963 [37:45:42<46:47:02,  7.57s/it]
 41%|████▏     | 15717/37963 [37:45:50<46:33:03,  7.53s/it]
 41%|████▏     | 15718/37963 [37:45:57<46:20:23,  7.50s/it]
 41%|████▏     | 15719/37963 [37:46:05<46:26:35,  7.52s/it]
 41%|████▏     | 15720/37963 [37:46:12<46:35:33,  7.54s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.645', 'learning_rate': '1.321e-05', 'epoch': '0.4141'}

 41%|████▏     | 15720/37963 [37:46:12<46:35:33,  7.54s/it]
 41%|████▏     | 15721/37963 [37:46:20<46:50:56,  7.58s/it]
 41%|████▏     | 15722/37963 [37:46:34<58:50:39,  9.52s/it]
 41%|████▏     | 15723/37963 [37:46:41<55:05:05,  8.92s/it]
 41%|████▏     | 15724/37963 [37:46:49<52:38:31,  8.52s/it]
 41%|████▏     | 15725/37963 [37:47:03<62:52:00, 10.18s/it]
 41%|████▏     | 15726/37963 [37:47:11<58:11:30,  9.42s/it]
 41%|████▏     | 15727/37963 [37:47:18<54:40:36,  8.85s/it]
 41%|████▏     | 15728/37963 [37:47:32<64:04:53, 10.38s/it]
 41%|████▏     | 15729/37963 [37:47:40<58:50:59,  9.53s/it]
 41%|████▏     | 15730/37963 [37:47:53<66:48:43, 10.82s/it]
                                                           
{'loss': '0.1628', 'grad_norm': '2.233', 'learning_rate': '1.32e-05', 'epoch': '0.4144'}

 41%|████▏     | 15730/37963 [37:47:53<66:48:43, 10.82s/it]
 41%|████▏     | 15731/37963 [37:48:01<60:19:57,  9.77s/it]
 41%|████▏     | 15732/37963 [37:48:08<56:17:38,  9.12s/it]
 41%|████▏     | 15733/37963 [37:48:16<53:26:45,  8.66s/it]
 41%|████▏     | 15734/37963 [37:48:23<51:18:47,  8.31s/it]
 41%|████▏     | 15735/37963 [37:48:31<50:06:20,  8.11s/it]
 41%|████▏     | 15736/37963 [37:48:45<60:47:00,  9.84s/it]
 41%|████▏     | 15737/37963 [37:48:53<56:33:53,  9.16s/it]
 41%|████▏     | 15738/37963 [37:49:00<53:15:28,  8.63s/it]
 41%|████▏     | 15739/37963 [37:49:08<51:16:08,  8.30s/it]
 41%|████▏     | 15740/37963 [37:49:15<50:04:40,  8.11s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.084', 'learning_rate': '1.32e-05', 'epoch': '0.4146'}

 41%|████▏     | 15740/37963 [37:49:15<50:04:40,  8.11s/it]
 41%|████▏     | 15741/37963 [37:49:23<48:46:35,  7.90s/it]
 41%|████▏     | 15742/37963 [37:49:30<48:02:44,  7.78s/it]
 41%|████▏     | 15743/37963 [37:49:38<47:36:06,  7.71s/it]
 41%|████▏     | 15744/37963 [37:49:58<71:47:29, 11.63s/it]
 41%|████▏     | 15745/37963 [37:50:06<64:06:19, 10.39s/it]
 41%|████▏     | 15746/37963 [37:50:13<58:55:32,  9.55s/it]
 41%|████▏     | 15747/37963 [37:50:21<55:36:20,  9.01s/it]
 41%|████▏     | 15748/37963 [37:50:29<53:04:58,  8.60s/it]
 41%|████▏     | 15749/37963 [37:50:36<50:31:17,  8.19s/it]
 41%|████▏     | 15750/37963 [37:50:44<49:29:00,  8.02s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '2.618', 'learning_rate': '1.319e-05', 'epoch': '0.4149'}

 41%|████▏     | 15750/37963 [37:50:44<49:29:00,  8.02s/it]
 41%|████▏     | 15751/37963 [37:50:51<48:40:39,  7.89s/it]
 41%|████▏     | 15752/37963 [37:50:59<48:12:56,  7.81s/it]
 41%|████▏     | 15753/37963 [37:51:06<47:07:06,  7.64s/it]
 41%|████▏     | 15754/37963 [37:51:14<46:51:27,  7.60s/it]
 42%|████▏     | 15755/37963 [37:51:21<46:16:55,  7.50s/it]
 42%|████▏     | 15756/37963 [37:51:35<58:20:16,  9.46s/it]
 42%|████▏     | 15757/37963 [37:51:43<54:49:43,  8.89s/it]
 42%|████▏     | 15758/37963 [37:51:50<52:16:14,  8.47s/it]
 42%|████▏     | 15759/37963 [37:51:58<50:24:55,  8.17s/it]
 42%|████▏     | 15760/37963 [37:52:05<48:49:57,  7.92s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '2.757', 'learning_rate': '1.318e-05', 'epoch': '0.4151'}

 42%|████▏     | 15760/37963 [37:52:05<48:49:57,  7.92s/it]
 42%|████▏     | 15761/37963 [37:52:12<47:49:28,  7.75s/it]
 42%|████▏     | 15762/37963 [37:52:20<47:22:40,  7.68s/it]
 42%|████▏     | 15763/37963 [37:52:27<46:59:39,  7.62s/it]
 42%|████▏     | 15764/37963 [37:52:35<46:27:45,  7.53s/it]
 42%|████▏     | 15765/37963 [37:52:42<46:28:07,  7.54s/it]
 42%|████▏     | 15766/37963 [37:52:56<58:23:23,  9.47s/it]
 42%|████▏     | 15767/37963 [37:53:04<54:44:49,  8.88s/it]
 42%|████▏     | 15768/37963 [37:53:11<52:10:39,  8.46s/it]
 42%|████▏     | 15769/37963 [37:53:19<50:33:02,  8.20s/it]
 42%|████▏     | 15770/37963 [37:53:26<49:19:19,  8.00s/it]
                                                           
{'loss': '0.1633', 'grad_norm': '1.789', 'learning_rate': '1.317e-05', 'epoch': '0.4154'}

 42%|████▏     | 15770/37963 [37:53:26<49:19:19,  8.00s/it]
 42%|████▏     | 15771/37963 [37:53:34<48:23:09,  7.85s/it]
 42%|████▏     | 15772/37963 [37:53:41<47:50:07,  7.76s/it]
 42%|████▏     | 15773/37963 [37:53:55<58:59:31,  9.57s/it]
 42%|████▏     | 15774/37963 [37:54:03<55:08:13,  8.95s/it]
 42%|████▏     | 15775/37963 [37:54:10<52:25:15,  8.51s/it]
 42%|████▏     | 15776/37963 [37:54:17<50:18:51,  8.16s/it]
 42%|████▏     | 15777/37963 [37:54:25<49:02:24,  7.96s/it]
 42%|████▏     | 15778/37963 [37:54:32<47:45:38,  7.75s/it]
 42%|████▏     | 15779/37963 [37:54:40<47:21:40,  7.69s/it]
 42%|████▏     | 15780/37963 [37:54:54<58:56:43,  9.57s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.346', 'learning_rate': '1.316e-05', 'epoch': '0.4157'}

 42%|████▏     | 15780/37963 [37:54:54<58:56:43,  9.57s/it]
 42%|████▏     | 15781/37963 [37:55:01<55:00:11,  8.93s/it]
 42%|████▏     | 15782/37963 [37:55:15<64:16:53, 10.43s/it]
 42%|████▏     | 15783/37963 [37:55:29<70:50:42, 11.50s/it]
 42%|████▏     | 15784/37963 [37:55:37<63:39:48, 10.33s/it]
 42%|████▏     | 15785/37963 [37:55:44<58:49:10,  9.55s/it]
 42%|████▏     | 15786/37963 [37:55:52<55:03:40,  8.94s/it]
 42%|████▏     | 15787/37963 [37:55:59<52:27:02,  8.51s/it]
 42%|████▏     | 15788/37963 [37:56:07<50:32:27,  8.21s/it]
 42%|████▏     | 15789/37963 [37:56:14<49:23:21,  8.02s/it]
 42%|████▏     | 15790/37963 [37:56:28<60:01:40,  9.75s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '0.979', 'learning_rate': '1.315e-05', 'epoch': '0.4159'}

 42%|████▏     | 15790/37963 [37:56:28<60:01:40,  9.75s/it]
 42%|████▏     | 15791/37963 [37:56:42<67:54:07, 11.03s/it]
 42%|████▏     | 15792/37963 [37:56:50<61:33:08,  9.99s/it]
 42%|████▏     | 15793/37963 [37:56:57<57:06:33,  9.27s/it]
 42%|████▏     | 15794/37963 [37:57:05<53:50:16,  8.74s/it]
 42%|████▏     | 15795/37963 [37:57:12<51:14:36,  8.32s/it]
 42%|████▏     | 15796/37963 [37:57:20<49:35:13,  8.05s/it]
 42%|████▏     | 15797/37963 [37:57:27<48:35:55,  7.89s/it]
 42%|████▏     | 15798/37963 [37:57:35<47:44:17,  7.75s/it]
 42%|████▏     | 15799/37963 [37:57:42<46:53:11,  7.62s/it]
 42%|████▏     | 15800/37963 [37:57:49<46:40:11,  7.58s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '1.207', 'learning_rate': '1.315e-05', 'epoch': '0.4162'}

 42%|████▏     | 15800/37963 [37:57:49<46:40:11,  7.58s/it]
 42%|████▏     | 15801/37963 [37:57:57<46:45:31,  7.60s/it]
 42%|████▏     | 15802/37963 [37:58:05<46:53:19,  7.62s/it]
 42%|████▏     | 15803/37963 [37:58:12<46:46:13,  7.60s/it]
 42%|████▏     | 15804/37963 [37:58:26<58:04:20,  9.43s/it]
 42%|████▏     | 15805/37963 [37:58:34<54:37:30,  8.87s/it]
 42%|████▏     | 15806/37963 [37:58:41<52:10:33,  8.48s/it]
 42%|████▏     | 15807/37963 [37:58:49<50:23:00,  8.19s/it]
 42%|████▏     | 15808/37963 [37:58:56<48:47:15,  7.93s/it]
 42%|████▏     | 15809/37963 [37:59:03<48:04:48,  7.81s/it]
 42%|████▏     | 15810/37963 [37:59:11<47:38:14,  7.74s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '1.214', 'learning_rate': '1.314e-05', 'epoch': '0.4165'}

 42%|████▏     | 15810/37963 [37:59:11<47:38:14,  7.74s/it]
 42%|████▏     | 15811/37963 [37:59:19<47:13:22,  7.67s/it]
 42%|████▏     | 15812/37963 [37:59:26<47:03:48,  7.65s/it]
 42%|████▏     | 15813/37963 [37:59:33<46:28:23,  7.55s/it]
 42%|████▏     | 15814/37963 [37:59:41<46:31:40,  7.56s/it]
 42%|████▏     | 15815/37963 [37:59:48<46:14:03,  7.52s/it]
 42%|████▏     | 15816/37963 [37:59:56<45:58:08,  7.47s/it]
 42%|████▏     | 15817/37963 [38:00:03<46:00:42,  7.48s/it]
 42%|████▏     | 15818/37963 [38:00:11<46:04:55,  7.49s/it]
 42%|████▏     | 15819/37963 [38:00:19<46:25:35,  7.55s/it]
 42%|████▏     | 15820/37963 [38:00:32<57:39:40,  9.37s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '3.676', 'learning_rate': '1.313e-05', 'epoch': '0.4167'}

 42%|████▏     | 15820/37963 [38:00:32<57:39:40,  9.37s/it]
 42%|████▏     | 15821/37963 [38:00:40<54:23:51,  8.84s/it]
 42%|████▏     | 15822/37963 [38:00:47<52:01:44,  8.46s/it]
 42%|████▏     | 15823/37963 [38:00:55<50:04:02,  8.14s/it]
 42%|████▏     | 15824/37963 [38:01:09<61:40:17, 10.03s/it]
 42%|████▏     | 15825/37963 [38:01:17<57:11:17,  9.30s/it]
 42%|████▏     | 15826/37963 [38:01:24<53:14:13,  8.66s/it]
 42%|████▏     | 15827/37963 [38:01:38<62:59:05, 10.24s/it]
 42%|████▏     | 15828/37963 [38:01:52<70:00:35, 11.39s/it]
 42%|████▏     | 15829/37963 [38:01:59<62:46:57, 10.21s/it]
 42%|████▏     | 15830/37963 [38:02:13<69:16:14, 11.27s/it]
                                                           
{'loss': '0.1551', 'grad_norm': '1.043', 'learning_rate': '1.312e-05', 'epoch': '0.417'}

 42%|████▏     | 15830/37963 [38:02:13<69:16:14, 11.27s/it]
 42%|████▏     | 15831/37963 [38:02:21<62:36:05, 10.18s/it]
 42%|████▏     | 15832/37963 [38:02:28<57:42:45,  9.39s/it]
 42%|████▏     | 15833/37963 [38:02:35<53:36:32,  8.72s/it]
 42%|████▏     | 15834/37963 [38:02:43<51:06:38,  8.31s/it]
 42%|████▏     | 15835/37963 [38:02:50<49:21:52,  8.03s/it]
 42%|████▏     | 15836/37963 [38:02:58<48:47:58,  7.94s/it]
 42%|████▏     | 15837/37963 [38:03:06<48:10:09,  7.84s/it]
 42%|████▏     | 15838/37963 [38:03:13<47:38:49,  7.75s/it]
 42%|████▏     | 15839/37963 [38:03:21<47:29:08,  7.73s/it]
 42%|████▏     | 15840/37963 [38:03:34<58:32:08,  9.53s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '0.7181', 'learning_rate': '1.311e-05', 'epoch': '0.4172'}

 42%|████▏     | 15840/37963 [38:03:34<58:32:08,  9.53s/it]
 42%|████▏     | 15841/37963 [38:03:48<66:23:12, 10.80s/it]
 42%|████▏     | 15842/37963 [38:03:56<60:26:38,  9.84s/it]
 42%|████▏     | 15843/37963 [38:04:03<56:20:59,  9.17s/it]
 42%|████▏     | 15844/37963 [38:04:11<53:22:12,  8.69s/it]
 42%|████▏     | 15845/37963 [38:04:18<51:00:47,  8.30s/it]
 42%|████▏     | 15846/37963 [38:04:26<49:40:16,  8.09s/it]
 42%|████▏     | 15847/37963 [38:04:33<48:18:25,  7.86s/it]
 42%|████▏     | 15848/37963 [38:04:41<47:40:23,  7.76s/it]
 42%|████▏     | 15849/37963 [38:04:48<46:29:25,  7.57s/it]
 42%|████▏     | 15850/37963 [38:04:55<45:58:10,  7.48s/it]
                                                           
{'loss': '0.136', 'grad_norm': '1.126', 'learning_rate': '1.311e-05', 'epoch': '0.4175'}

 42%|████▏     | 15850/37963 [38:04:55<45:58:10,  7.48s/it]
 42%|████▏     | 15851/37963 [38:05:03<45:51:29,  7.47s/it]
 42%|████▏     | 15852/37963 [38:05:10<46:02:55,  7.50s/it]
 42%|████▏     | 15853/37963 [38:05:24<58:06:52,  9.46s/it]
 42%|████▏     | 15854/37963 [38:05:32<54:18:49,  8.84s/it]
 42%|████▏     | 15855/37963 [38:05:39<52:03:52,  8.48s/it]
 42%|████▏     | 15856/37963 [38:05:47<50:22:13,  8.20s/it]
 42%|████▏     | 15857/37963 [38:05:54<49:11:08,  8.01s/it]
 42%|████▏     | 15858/37963 [38:06:02<48:27:42,  7.89s/it]
 42%|████▏     | 15859/37963 [38:06:10<47:58:00,  7.81s/it]
 42%|████▏     | 15860/37963 [38:06:17<47:31:14,  7.74s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '1.107', 'learning_rate': '1.31e-05', 'epoch': '0.4178'}

 42%|████▏     | 15860/37963 [38:06:17<47:31:14,  7.74s/it]
 42%|████▏     | 15861/37963 [38:06:25<47:09:59,  7.68s/it]
 42%|████▏     | 15862/37963 [38:06:32<46:56:23,  7.65s/it]
 42%|████▏     | 15863/37963 [38:06:40<46:38:53,  7.60s/it]
 42%|████▏     | 15864/37963 [38:06:48<46:47:47,  7.62s/it]
 42%|████▏     | 15865/37963 [38:06:55<46:21:20,  7.55s/it]
 42%|████▏     | 15866/37963 [38:07:02<46:18:20,  7.54s/it]
 42%|████▏     | 15867/37963 [38:07:10<46:28:19,  7.57s/it]
 42%|████▏     | 15868/37963 [38:07:17<45:46:19,  7.46s/it]
 42%|████▏     | 15869/37963 [38:07:25<45:56:10,  7.48s/it]
 42%|████▏     | 15870/37963 [38:07:32<45:50:52,  7.47s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '4.836', 'learning_rate': '1.309e-05', 'epoch': '0.418'}

 42%|████▏     | 15870/37963 [38:07:32<45:50:52,  7.47s/it]
 42%|████▏     | 15871/37963 [38:07:46<57:14:26,  9.33s/it]
 42%|████▏     | 15872/37963 [38:07:53<53:57:54,  8.79s/it]
 42%|████▏     | 15873/37963 [38:08:01<51:35:43,  8.41s/it]
 42%|████▏     | 15874/37963 [38:08:15<62:22:32, 10.17s/it]
 42%|████▏     | 15875/37963 [38:08:23<57:36:18,  9.39s/it]
 42%|████▏     | 15876/37963 [38:08:30<54:24:59,  8.87s/it]
 42%|████▏     | 15877/37963 [38:08:38<52:05:24,  8.49s/it]
 42%|████▏     | 15878/37963 [38:08:53<63:02:57, 10.28s/it]
 42%|████▏     | 15879/37963 [38:09:00<58:04:32,  9.47s/it]
 42%|████▏     | 15880/37963 [38:09:08<54:25:26,  8.87s/it]
                                                           
{'loss': '0.1533', 'grad_norm': '0.9539', 'learning_rate': '1.308e-05', 'epoch': '0.4183'}

 42%|████▏     | 15880/37963 [38:09:08<54:25:26,  8.87s/it]
 42%|████▏     | 15881/37963 [38:09:28<75:55:28, 12.38s/it]
 42%|████▏     | 15882/37963 [38:09:36<67:04:19, 10.94s/it]
 42%|████▏     | 15883/37963 [38:09:43<60:43:58,  9.90s/it]
 42%|████▏     | 15884/37963 [38:09:51<56:30:49,  9.21s/it]
 42%|████▏     | 15885/37963 [38:09:58<52:50:49,  8.62s/it]
 42%|████▏     | 15886/37963 [38:10:12<63:20:53, 10.33s/it]
 42%|████▏     | 15887/37963 [38:10:20<57:35:01,  9.39s/it]
 42%|████▏     | 15888/37963 [38:10:34<66:04:36, 10.78s/it]
 42%|████▏     | 15889/37963 [38:10:41<60:12:14,  9.82s/it]
 42%|████▏     | 15890/37963 [38:10:49<55:59:56,  9.13s/it]
                                                           
{'loss': '0.1541', 'grad_norm': '1.655', 'learning_rate': '1.307e-05', 'epoch': '0.4186'}

 42%|████▏     | 15890/37963 [38:10:49<55:59:56,  9.13s/it]
 42%|████▏     | 15891/37963 [38:10:56<53:01:19,  8.65s/it]
 42%|████▏     | 15892/37963 [38:11:04<50:50:51,  8.29s/it]
 42%|████▏     | 15893/37963 [38:11:11<49:41:23,  8.11s/it]
 42%|████▏     | 15894/37963 [38:11:19<48:49:10,  7.96s/it]
 42%|████▏     | 15895/37963 [38:11:27<47:59:14,  7.83s/it]
 42%|████▏     | 15896/37963 [38:11:34<46:57:58,  7.66s/it]
 42%|████▏     | 15897/37963 [38:11:41<46:30:22,  7.59s/it]
 42%|████▏     | 15898/37963 [38:11:48<45:57:41,  7.50s/it]
 42%|████▏     | 15899/37963 [38:11:56<45:28:54,  7.42s/it]
 42%|████▏     | 15900/37963 [38:12:09<56:58:20,  9.30s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '3.228', 'learning_rate': '1.307e-05', 'epoch': '0.4188'}

 42%|████▏     | 15900/37963 [38:12:09<56:58:20,  9.30s/it]
 42%|████▏     | 15901/37963 [38:12:17<53:44:56,  8.77s/it]
 42%|████▏     | 15902/37963 [38:12:24<51:30:57,  8.41s/it]
 42%|████▏     | 15903/37963 [38:12:32<49:47:11,  8.12s/it]
 42%|████▏     | 15904/37963 [38:12:40<48:50:45,  7.97s/it]
 42%|████▏     | 15905/37963 [38:12:47<47:28:05,  7.75s/it]
 42%|████▏     | 15906/37963 [38:12:54<46:40:05,  7.62s/it]
 42%|████▏     | 15907/37963 [38:13:02<46:33:26,  7.60s/it]
 42%|████▏     | 15908/37963 [38:13:09<46:24:58,  7.58s/it]
 42%|████▏     | 15909/37963 [38:13:17<46:16:35,  7.55s/it]
 42%|████▏     | 15910/37963 [38:13:24<46:08:22,  7.53s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '0.9207', 'learning_rate': '1.306e-05', 'epoch': '0.4191'}

 42%|████▏     | 15910/37963 [38:13:24<46:08:22,  7.53s/it]
 42%|████▏     | 15911/37963 [38:13:32<45:45:48,  7.47s/it]
 42%|████▏     | 15912/37963 [38:13:39<45:55:11,  7.50s/it]
 42%|████▏     | 15913/37963 [38:13:47<46:02:18,  7.52s/it]
 42%|████▏     | 15914/37963 [38:13:54<45:45:24,  7.47s/it]
 42%|████▏     | 15915/37963 [38:14:01<45:47:31,  7.48s/it]
 42%|████▏     | 15916/37963 [38:14:09<45:51:36,  7.49s/it]
 42%|████▏     | 15917/37963 [38:14:16<45:44:08,  7.47s/it]
 42%|████▏     | 15918/37963 [38:14:31<58:01:28,  9.48s/it]
 42%|████▏     | 15919/37963 [38:14:38<53:55:53,  8.81s/it]
 42%|████▏     | 15920/37963 [38:14:52<63:06:50, 10.31s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.5', 'learning_rate': '1.305e-05', 'epoch': '0.4194'}

 42%|████▏     | 15920/37963 [38:14:52<63:06:50, 10.31s/it]
 42%|████▏     | 15921/37963 [38:14:59<58:03:02,  9.48s/it]
 42%|████▏     | 15922/37963 [38:15:07<54:32:02,  8.91s/it]
 42%|████▏     | 15923/37963 [38:15:14<52:05:52,  8.51s/it]
 42%|████▏     | 15924/37963 [38:15:22<49:47:29,  8.13s/it]
 42%|████▏     | 15925/37963 [38:15:29<48:46:26,  7.97s/it]
 42%|████▏     | 15926/37963 [38:15:43<60:00:57,  9.80s/it]
 42%|████▏     | 15927/37963 [38:15:51<55:49:25,  9.12s/it]
 42%|████▏     | 15928/37963 [38:15:58<52:25:17,  8.56s/it]
 42%|████▏     | 15929/37963 [38:16:06<50:28:31,  8.25s/it]
 42%|████▏     | 15930/37963 [38:16:20<61:01:57,  9.97s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '0.696', 'learning_rate': '1.304e-05', 'epoch': '0.4196'}

 42%|████▏     | 15930/37963 [38:16:20<61:01:57,  9.97s/it]
 42%|████▏     | 15931/37963 [38:16:27<56:45:07,  9.27s/it]
 42%|████▏     | 15932/37963 [38:16:35<53:35:20,  8.76s/it]
 42%|████▏     | 15933/37963 [38:16:48<62:43:29, 10.25s/it]
 42%|████▏     | 15934/37963 [38:16:56<57:45:26,  9.44s/it]
 42%|████▏     | 15935/37963 [38:17:10<65:47:47, 10.75s/it]
 42%|████▏     | 15936/37963 [38:17:17<59:57:05,  9.80s/it]
 42%|████▏     | 15937/37963 [38:17:25<55:33:04,  9.08s/it]
 42%|████▏     | 15938/37963 [38:17:39<64:43:56, 10.58s/it]
 42%|████▏     | 15939/37963 [38:17:46<59:00:12,  9.64s/it]
 42%|████▏     | 15940/37963 [38:17:54<54:57:05,  8.98s/it]
                                                           
{'loss': '0.152', 'grad_norm': '1.526', 'learning_rate': '1.303e-05', 'epoch': '0.4199'}

 42%|████▏     | 15940/37963 [38:17:54<54:57:05,  8.98s/it]
 42%|████▏     | 15941/37963 [38:18:01<52:05:00,  8.51s/it]
 42%|████▏     | 15942/37963 [38:18:09<50:22:59,  8.24s/it]
 42%|████▏     | 15943/37963 [38:18:16<48:46:19,  7.97s/it]
 42%|████▏     | 15944/37963 [38:18:24<48:07:20,  7.87s/it]
 42%|████▏     | 15945/37963 [38:18:31<47:03:27,  7.69s/it]
 42%|████▏     | 15946/37963 [38:18:38<46:14:10,  7.56s/it]
 42%|████▏     | 15947/37963 [38:18:46<46:07:41,  7.54s/it]
 42%|████▏     | 15948/37963 [38:18:53<45:39:09,  7.47s/it]
 42%|████▏     | 15949/37963 [38:19:07<56:52:20,  9.30s/it]
 42%|████▏     | 15950/37963 [38:19:14<52:39:04,  8.61s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '1.263', 'learning_rate': '1.302e-05', 'epoch': '0.4201'}

 42%|████▏     | 15950/37963 [38:19:14<52:39:04,  8.61s/it]
 42%|████▏     | 15951/37963 [38:19:21<50:36:10,  8.28s/it]
 42%|████▏     | 15952/37963 [38:19:29<49:08:23,  8.04s/it]
 42%|████▏     | 15953/37963 [38:19:36<47:36:10,  7.79s/it]
 42%|████▏     | 15954/37963 [38:19:43<47:08:40,  7.71s/it]
 42%|████▏     | 15955/37963 [38:19:51<46:40:00,  7.63s/it]
 42%|████▏     | 15956/37963 [38:19:58<46:32:11,  7.61s/it]
 42%|████▏     | 15957/37963 [38:20:06<46:21:06,  7.58s/it]
 42%|████▏     | 15958/37963 [38:20:13<46:03:24,  7.53s/it]
 42%|████▏     | 15959/37963 [38:20:21<46:15:32,  7.57s/it]
 42%|████▏     | 15960/37963 [38:20:29<46:08:30,  7.55s/it]
                                                           
{'loss': '0.1671', 'grad_norm': '0.9072', 'learning_rate': '1.302e-05', 'epoch': '0.4204'}

 42%|████▏     | 15960/37963 [38:20:29<46:08:30,  7.55s/it]
 42%|████▏     | 15961/37963 [38:20:36<46:12:51,  7.56s/it]
 42%|████▏     | 15962/37963 [38:20:44<46:15:42,  7.57s/it]
 42%|████▏     | 15963/37963 [38:20:51<46:16:02,  7.57s/it]
 42%|████▏     | 15964/37963 [38:20:59<46:04:04,  7.54s/it]
 42%|████▏     | 15965/37963 [38:21:06<46:11:25,  7.56s/it]
 42%|████▏     | 15966/37963 [38:21:14<46:00:15,  7.53s/it]
 42%|████▏     | 15967/37963 [38:21:21<46:10:46,  7.56s/it]
 42%|████▏     | 15968/37963 [38:21:41<68:42:25, 11.25s/it]
 42%|████▏     | 15969/37963 [38:21:49<62:03:16, 10.16s/it]
 42%|████▏     | 15970/37963 [38:21:56<57:18:41,  9.38s/it]
                                                           
{'loss': '0.1601', 'grad_norm': '1.493', 'learning_rate': '1.301e-05', 'epoch': '0.4207'}

 42%|████▏     | 15970/37963 [38:21:56<57:18:41,  9.38s/it]
 42%|████▏     | 15971/37963 [38:22:04<54:05:41,  8.86s/it]
 42%|████▏     | 15972/37963 [38:22:12<51:46:18,  8.48s/it]
 42%|████▏     | 15973/37963 [38:22:19<49:58:09,  8.18s/it]
 42%|████▏     | 15974/37963 [38:22:33<60:35:50,  9.92s/it]
 42%|████▏     | 15975/37963 [38:22:41<56:23:43,  9.23s/it]
 42%|████▏     | 15976/37963 [38:22:48<53:17:45,  8.73s/it]
 42%|████▏     | 15977/37963 [38:22:56<51:03:58,  8.36s/it]
 42%|████▏     | 15978/37963 [38:23:09<60:33:32,  9.92s/it]
 42%|████▏     | 15979/37963 [38:23:17<56:07:52,  9.19s/it]
 42%|████▏     | 15980/37963 [38:23:25<53:14:53,  8.72s/it]
                                                           
{'loss': '0.1588', 'grad_norm': '2.794', 'learning_rate': '1.3e-05', 'epoch': '0.4209'}

 42%|████▏     | 15980/37963 [38:23:25<53:14:53,  8.72s/it]
 42%|████▏     | 15981/37963 [38:23:32<51:22:09,  8.41s/it]
 42%|████▏     | 15982/37963 [38:23:46<61:42:00, 10.11s/it]
 42%|████▏     | 15983/37963 [38:23:54<56:52:51,  9.32s/it]
 42%|████▏     | 15984/37963 [38:24:01<53:29:51,  8.76s/it]
 42%|████▏     | 15985/37963 [38:24:15<62:48:09, 10.29s/it]
 42%|████▏     | 15986/37963 [38:24:23<57:57:11,  9.49s/it]
 42%|████▏     | 15987/37963 [38:24:30<53:57:40,  8.84s/it]
 42%|████▏     | 15988/37963 [38:24:37<50:55:45,  8.34s/it]
 42%|████▏     | 15989/37963 [38:24:45<49:53:50,  8.17s/it]
 42%|████▏     | 15990/37963 [38:24:52<48:16:27,  7.91s/it]
                                                           
{'loss': '0.1538', 'grad_norm': '1.985', 'learning_rate': '1.299e-05', 'epoch': '0.4212'}

 42%|████▏     | 15990/37963 [38:24:52<48:16:27,  7.91s/it]
 42%|████▏     | 15991/37963 [38:25:00<47:41:13,  7.81s/it]
 42%|████▏     | 15992/37963 [38:25:08<47:24:13,  7.77s/it]
 42%|████▏     | 15993/37963 [38:25:15<47:02:18,  7.71s/it]
 42%|████▏     | 15994/37963 [38:25:23<46:57:25,  7.69s/it]
 42%|████▏     | 15995/37963 [38:25:30<46:38:05,  7.64s/it]
 42%|████▏     | 15996/37963 [38:25:38<46:28:18,  7.62s/it]
 42%|████▏     | 15997/37963 [38:25:45<45:59:14,  7.54s/it]
 42%|████▏     | 15998/37963 [38:25:52<45:33:09,  7.47s/it]
 42%|████▏     | 15999/37963 [38:26:00<45:46:12,  7.50s/it]
 42%|████▏     | 16000/37963 [38:26:07<45:22:16,  7.44s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.136', 'learning_rate': '1.298e-05', 'epoch': '0.4215'}

 42%|████▏     | 16000/37963 [38:26:07<45:22:16,  7.44s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.46s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.46s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 42%|████▏     | 16001/37963 [38:27:11<148:02:05, 24.27s/it]
 42%|████▏     | 16002/37963 [38:27:18<117:24:12, 19.25s/it]
 42%|████▏     | 16003/37963 [38:27:26<96:05:00, 15.75s/it] 
 42%|████▏     | 16004/37963 [38:27:33<80:54:06, 13.26s/it]
 42%|████▏     | 16005/37963 [38:27:41<70:23:32, 11.54s/it]
 42%|████▏     | 16006/37963 [38:27:49<63:03:05, 10.34s/it]
 42%|████▏     | 16007/37963 [38:27:56<57:54:54,  9.50s/it]
 42%|████▏     | 16008/37963 [38:28:04<54:21:08,  8.91s/it]
 42%|████▏     | 16009/37963 [38:28:11<52:03:46,  8.54s/it]
 42%|████▏     | 16010/37963 [38:28:18<49:17:23,  8.08s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.07', 'learning_rate': '1.298e-05', 'epoch': '0.4217'}

 42%|████▏     | 16010/37963 [38:28:18<49:17:23,  8.08s/it]
 42%|████▏     | 16011/37963 [38:28:26<48:13:51,  7.91s/it]
 42%|████▏     | 16012/37963 [38:28:33<47:35:59,  7.81s/it]
 42%|████▏     | 16013/37963 [38:28:41<47:07:49,  7.73s/it]
 42%|████▏     | 16014/37963 [38:28:48<46:43:52,  7.66s/it]
 42%|████▏     | 16015/37963 [38:28:56<46:24:07,  7.61s/it]
 42%|████▏     | 16016/37963 [38:29:04<46:27:59,  7.62s/it]
 42%|████▏     | 16017/37963 [38:29:11<46:19:24,  7.60s/it]
 42%|████▏     | 16018/37963 [38:29:19<45:59:50,  7.55s/it]
 42%|████▏     | 16019/37963 [38:29:39<70:17:50, 11.53s/it]
 42%|████▏     | 16020/37963 [38:29:47<62:32:25, 10.26s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '3.427', 'learning_rate': '1.297e-05', 'epoch': '0.422'}

 42%|████▏     | 16020/37963 [38:29:47<62:32:25, 10.26s/it]
 42%|████▏     | 16021/37963 [38:30:01<69:17:41, 11.37s/it]
 42%|████▏     | 16022/37963 [38:30:08<62:18:51, 10.22s/it]
 42%|████▏     | 16023/37963 [38:30:22<68:44:49, 11.28s/it]
 42%|████▏     | 16024/37963 [38:30:30<62:11:01, 10.20s/it]
 42%|████▏     | 16025/37963 [38:30:37<56:36:46,  9.29s/it]
 42%|████▏     | 16026/37963 [38:30:44<53:32:47,  8.79s/it]
 42%|████▏     | 16027/37963 [38:30:52<51:17:01,  8.42s/it]
 42%|████▏     | 16028/37963 [38:31:06<61:51:23, 10.15s/it]
 42%|████▏     | 16029/37963 [38:31:14<56:57:18,  9.35s/it]
 42%|████▏     | 16030/37963 [38:31:21<53:34:35,  8.79s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.395', 'learning_rate': '1.296e-05', 'epoch': '0.4223'}

 42%|████▏     | 16030/37963 [38:31:21<53:34:35,  8.79s/it]
 42%|████▏     | 16031/37963 [38:31:29<51:11:52,  8.40s/it]
 42%|████▏     | 16032/37963 [38:31:36<49:37:49,  8.15s/it]
 42%|████▏     | 16033/37963 [38:31:50<60:11:28,  9.88s/it]
 42%|████▏     | 16034/37963 [38:31:58<56:08:41,  9.22s/it]
 42%|████▏     | 16035/37963 [38:32:12<64:55:09, 10.66s/it]
 42%|████▏     | 16036/37963 [38:32:19<59:18:22,  9.74s/it]
 42%|████▏     | 16037/37963 [38:32:27<55:12:33,  9.06s/it]
 42%|████▏     | 16038/37963 [38:32:34<52:24:28,  8.61s/it]
 42%|████▏     | 16039/37963 [38:32:42<50:34:28,  8.30s/it]
 42%|████▏     | 16040/37963 [38:32:49<49:09:32,  8.07s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '2.33', 'learning_rate': '1.295e-05', 'epoch': '0.4225'}

 42%|████▏     | 16040/37963 [38:32:49<49:09:32,  8.07s/it]
 42%|████▏     | 16041/37963 [38:32:57<48:14:06,  7.92s/it]
 42%|████▏     | 16042/37963 [38:33:05<47:30:51,  7.80s/it]
 42%|████▏     | 16043/37963 [38:33:12<46:59:47,  7.72s/it]
 42%|████▏     | 16044/37963 [38:33:20<46:27:05,  7.63s/it]
 42%|████▏     | 16045/37963 [38:33:27<46:23:46,  7.62s/it]
 42%|████▏     | 16046/37963 [38:33:35<46:13:01,  7.59s/it]
 42%|████▏     | 16047/37963 [38:33:42<46:03:03,  7.56s/it]
 42%|████▏     | 16048/37963 [38:33:50<46:00:48,  7.56s/it]
 42%|████▏     | 16049/37963 [38:33:57<45:57:37,  7.55s/it]
 42%|████▏     | 16050/37963 [38:34:05<45:58:07,  7.55s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '1.386', 'learning_rate': '1.294e-05', 'epoch': '0.4228'}

 42%|████▏     | 16050/37963 [38:34:05<45:58:07,  7.55s/it]
 42%|████▏     | 16051/37963 [38:34:12<45:45:20,  7.52s/it]
 42%|████▏     | 16052/37963 [38:34:20<45:38:47,  7.50s/it]
 42%|████▏     | 16053/37963 [38:34:27<45:40:45,  7.51s/it]
 42%|████▏     | 16054/37963 [38:34:35<45:48:28,  7.53s/it]
 42%|████▏     | 16055/37963 [38:34:49<57:41:15,  9.48s/it]
 42%|████▏     | 16056/37963 [38:34:56<54:14:51,  8.91s/it]
 42%|████▏     | 16057/37963 [38:35:04<51:44:45,  8.50s/it]
 42%|████▏     | 16058/37963 [38:35:11<49:23:53,  8.12s/it]
 42%|████▏     | 16059/37963 [38:35:19<48:08:20,  7.91s/it]
 42%|████▏     | 16060/37963 [38:35:26<47:05:45,  7.74s/it]
                                                           
{'loss': '0.1622', 'grad_norm': '0.8549', 'learning_rate': '1.294e-05', 'epoch': '0.423'}

 42%|████▏     | 16060/37963 [38:35:26<47:05:45,  7.74s/it]
 42%|████▏     | 16061/37963 [38:35:33<46:23:31,  7.63s/it]
 42%|████▏     | 16062/37963 [38:35:41<46:15:54,  7.60s/it]
 42%|████▏     | 16063/37963 [38:35:48<46:09:55,  7.59s/it]
 42%|████▏     | 16064/37963 [38:35:56<46:00:52,  7.56s/it]
 42%|████▏     | 16065/37963 [38:36:03<45:53:19,  7.54s/it]
 42%|████▏     | 16066/37963 [38:36:11<45:42:57,  7.52s/it]
 42%|████▏     | 16067/37963 [38:36:19<46:02:48,  7.57s/it]
 42%|████▏     | 16068/37963 [38:36:26<46:04:52,  7.58s/it]
 42%|████▏     | 16069/37963 [38:36:40<58:06:10,  9.55s/it]
 42%|████▏     | 16070/37963 [38:36:48<54:31:57,  8.97s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.109', 'learning_rate': '1.293e-05', 'epoch': '0.4233'}

 42%|████▏     | 16070/37963 [38:36:48<54:31:57,  8.97s/it]
 42%|████▏     | 16071/37963 [38:37:02<63:49:07, 10.49s/it]
 42%|████▏     | 16072/37963 [38:37:10<58:28:21,  9.62s/it]
 42%|████▏     | 16073/37963 [38:37:23<66:02:29, 10.86s/it]
 42%|████▏     | 16074/37963 [38:37:37<71:30:32, 11.76s/it]
 42%|████▏     | 16075/37963 [38:37:45<63:49:35, 10.50s/it]
 42%|████▏     | 16076/37963 [38:37:59<70:08:11, 11.54s/it]
 42%|████▏     | 16077/37963 [38:38:13<74:28:36, 12.25s/it]
 42%|████▏     | 16078/37963 [38:38:20<66:21:44, 10.92s/it]
 42%|████▏     | 16079/37963 [38:38:28<60:27:43,  9.95s/it]
 42%|████▏     | 16080/37963 [38:38:42<68:11:11, 11.22s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '1.554', 'learning_rate': '1.292e-05', 'epoch': '0.4236'}

 42%|████▏     | 16080/37963 [38:38:42<68:11:11, 11.22s/it]
 42%|████▏     | 16081/37963 [38:38:50<61:03:26, 10.05s/it]
 42%|████▏     | 16082/37963 [38:38:57<56:27:12,  9.29s/it]
 42%|████▏     | 16083/37963 [38:39:05<53:09:35,  8.75s/it]
 42%|████▏     | 16084/37963 [38:39:12<50:52:13,  8.37s/it]
 42%|████▏     | 16085/37963 [38:39:20<49:19:56,  8.12s/it]
 42%|████▏     | 16086/37963 [38:39:27<48:19:52,  7.95s/it]
 42%|████▏     | 16087/37963 [38:39:35<47:58:09,  7.89s/it]
 42%|████▏     | 16088/37963 [38:39:42<47:13:18,  7.77s/it]
 42%|████▏     | 16089/37963 [38:39:50<46:44:22,  7.69s/it]
 42%|████▏     | 16090/37963 [38:39:57<46:04:02,  7.58s/it]
                                                           
{'loss': '0.158', 'grad_norm': '2.061', 'learning_rate': '1.291e-05', 'epoch': '0.4238'}

 42%|████▏     | 16090/37963 [38:39:57<46:04:02,  7.58s/it]
 42%|████▏     | 16091/37963 [38:40:05<46:04:15,  7.58s/it]
 42%|████▏     | 16092/37963 [38:40:12<46:11:23,  7.60s/it]
 42%|████▏     | 16093/37963 [38:40:20<46:41:37,  7.69s/it]
 42%|████▏     | 16094/37963 [38:40:27<45:27:36,  7.48s/it]
 42%|████▏     | 16095/37963 [38:40:35<45:33:43,  7.50s/it]
 42%|████▏     | 16096/37963 [38:40:42<45:39:08,  7.52s/it]
 42%|████▏     | 16097/37963 [38:40:50<45:39:23,  7.52s/it]
 42%|████▏     | 16098/37963 [38:40:58<45:45:06,  7.53s/it]
 42%|████▏     | 16099/37963 [38:41:05<45:26:39,  7.48s/it]
 42%|████▏     | 16100/37963 [38:41:13<45:47:19,  7.54s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '0.7226', 'learning_rate': '1.29e-05', 'epoch': '0.4241'}

 42%|████▏     | 16100/37963 [38:41:13<45:47:19,  7.54s/it]
 42%|████▏     | 16101/37963 [38:41:20<45:35:06,  7.51s/it]
 42%|████▏     | 16102/37963 [38:41:28<45:38:45,  7.52s/it]
 42%|████▏     | 16103/37963 [38:41:35<45:41:47,  7.53s/it]
 42%|████▏     | 16104/37963 [38:41:49<57:08:49,  9.41s/it]
 42%|████▏     | 16105/37963 [38:41:56<53:37:23,  8.83s/it]
 42%|████▏     | 16106/37963 [38:42:04<51:09:23,  8.43s/it]
 42%|████▏     | 16107/37963 [38:42:11<49:28:02,  8.15s/it]
 42%|████▏     | 16108/37963 [38:42:18<47:33:39,  7.83s/it]
 42%|████▏     | 16109/37963 [38:42:26<46:58:11,  7.74s/it]
 42%|████▏     | 16110/37963 [38:42:33<46:20:55,  7.64s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '0.9733', 'learning_rate': '1.289e-05', 'epoch': '0.4244'}

 42%|████▏     | 16110/37963 [38:42:33<46:20:55,  7.64s/it]
 42%|████▏     | 16111/37963 [38:42:41<46:11:58,  7.61s/it]
 42%|████▏     | 16112/37963 [38:42:48<46:04:13,  7.59s/it]
 42%|████▏     | 16113/37963 [38:42:56<45:49:05,  7.55s/it]
 42%|████▏     | 16114/37963 [38:43:04<46:02:34,  7.59s/it]
 42%|████▏     | 16115/37963 [38:43:11<45:52:06,  7.56s/it]
 42%|████▏     | 16116/37963 [38:43:19<45:54:11,  7.56s/it]
 42%|████▏     | 16117/37963 [38:43:33<57:44:17,  9.51s/it]
 42%|████▏     | 16118/37963 [38:43:47<65:58:48, 10.87s/it]
 42%|████▏     | 16119/37963 [38:44:01<71:41:03, 11.81s/it]
 42%|████▏     | 16120/37963 [38:44:08<63:53:04, 10.53s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.731', 'learning_rate': '1.289e-05', 'epoch': '0.4246'}

 42%|████▏     | 16120/37963 [38:44:08<63:53:04, 10.53s/it]
 42%|████▏     | 16121/37963 [38:44:16<58:37:39,  9.66s/it]
 42%|████▏     | 16122/37963 [38:44:23<54:39:11,  9.01s/it]
 42%|████▏     | 16123/37963 [38:44:31<51:34:07,  8.50s/it]
 42%|████▏     | 16124/37963 [38:44:38<49:46:45,  8.21s/it]
 42%|████▏     | 16125/37963 [38:44:59<72:14:20, 11.91s/it]
 42%|████▏     | 16126/37963 [38:45:06<63:52:23, 10.53s/it]
 42%|████▏     | 16127/37963 [38:45:20<70:26:59, 11.61s/it]
 42%|████▏     | 16128/37963 [38:45:28<63:01:06, 10.39s/it]
 42%|████▏     | 16129/37963 [38:45:42<69:27:32, 11.45s/it]
 42%|████▏     | 16130/37963 [38:45:49<62:08:36, 10.25s/it]
                                                           
{'loss': '0.1586', 'grad_norm': '2.587', 'learning_rate': '1.288e-05', 'epoch': '0.4249'}

 42%|████▏     | 16130/37963 [38:45:49<62:08:36, 10.25s/it]
 42%|████▏     | 16131/37963 [38:45:57<57:06:42,  9.42s/it]
 42%|████▏     | 16132/37963 [38:46:04<53:32:09,  8.83s/it]
 42%|████▏     | 16133/37963 [38:46:12<51:16:54,  8.46s/it]
 42%|████▏     | 16134/37963 [38:46:19<49:40:32,  8.19s/it]
 43%|████▎     | 16135/37963 [38:46:27<48:31:05,  8.00s/it]
 43%|████▎     | 16136/37963 [38:46:34<47:37:28,  7.85s/it]
 43%|████▎     | 16137/37963 [38:46:42<47:16:13,  7.80s/it]
 43%|████▎     | 16138/37963 [38:46:50<46:51:43,  7.73s/it]
 43%|████▎     | 16139/37963 [38:46:57<46:37:50,  7.69s/it]
 43%|████▎     | 16140/37963 [38:47:05<46:00:08,  7.59s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.183', 'learning_rate': '1.287e-05', 'epoch': '0.4252'}

 43%|████▎     | 16140/37963 [38:47:05<46:00:08,  7.59s/it]
 43%|████▎     | 16141/37963 [38:47:12<45:57:37,  7.58s/it]
 43%|████▎     | 16142/37963 [38:47:20<45:44:43,  7.55s/it]
 43%|████▎     | 16143/37963 [38:47:27<45:48:31,  7.56s/it]
 43%|████▎     | 16144/37963 [38:47:35<45:48:17,  7.56s/it]
 43%|████▎     | 16145/37963 [38:47:42<45:23:18,  7.49s/it]
 43%|████▎     | 16146/37963 [38:47:50<45:25:22,  7.50s/it]
 43%|████▎     | 16147/37963 [38:47:57<45:17:24,  7.47s/it]
 43%|████▎     | 16148/37963 [38:48:05<45:26:31,  7.50s/it]
 43%|████▎     | 16149/37963 [38:48:12<45:39:54,  7.54s/it]
 43%|████▎     | 16150/37963 [38:48:26<57:33:50,  9.50s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '1.854', 'learning_rate': '1.286e-05', 'epoch': '0.4254'}

 43%|████▎     | 16150/37963 [38:48:26<57:33:50,  9.50s/it]
 43%|████▎     | 16151/37963 [38:48:34<54:22:52,  8.98s/it]
 43%|████▎     | 16152/37963 [38:48:42<51:50:22,  8.56s/it]
 43%|████▎     | 16153/37963 [38:48:49<50:23:35,  8.32s/it]
 43%|████▎     | 16154/37963 [38:48:57<48:49:36,  8.06s/it]
 43%|████▎     | 16155/37963 [38:49:04<47:47:00,  7.89s/it]
 43%|████▎     | 16156/37963 [38:49:12<47:14:47,  7.80s/it]
 43%|████▎     | 16157/37963 [38:49:19<46:40:38,  7.71s/it]
 43%|████▎     | 16158/37963 [38:49:27<46:26:31,  7.67s/it]
 43%|████▎     | 16159/37963 [38:49:35<46:35:26,  7.69s/it]
 43%|████▎     | 16160/37963 [38:49:42<46:18:06,  7.65s/it]
                                                           
{'loss': '0.1684', 'grad_norm': '2.638', 'learning_rate': '1.285e-05', 'epoch': '0.4257'}

 43%|████▎     | 16160/37963 [38:49:42<46:18:06,  7.65s/it]
 43%|████▎     | 16161/37963 [38:49:50<45:59:10,  7.59s/it]
 43%|████▎     | 16162/37963 [38:50:04<57:44:00,  9.53s/it]
 43%|████▎     | 16163/37963 [38:50:11<53:54:28,  8.90s/it]
 43%|████▎     | 16164/37963 [38:50:19<51:21:36,  8.48s/it]
 43%|████▎     | 16165/37963 [38:50:26<49:36:54,  8.19s/it]
 43%|████▎     | 16166/37963 [38:50:34<48:13:34,  7.97s/it]
 43%|████▎     | 16167/37963 [38:50:41<47:09:30,  7.79s/it]
 43%|████▎     | 16168/37963 [38:50:49<46:40:59,  7.71s/it]
 43%|████▎     | 16169/37963 [38:51:03<58:36:05,  9.68s/it]
 43%|████▎     | 16170/37963 [38:51:10<54:45:26,  9.05s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.027', 'learning_rate': '1.285e-05', 'epoch': '0.4259'}

 43%|████▎     | 16170/37963 [38:51:10<54:45:26,  9.05s/it]
 43%|████▎     | 16171/37963 [38:51:18<51:54:31,  8.58s/it]
 43%|████▎     | 16172/37963 [38:51:25<49:50:42,  8.23s/it]
 43%|████▎     | 16173/37963 [38:51:39<60:05:13,  9.93s/it]
 43%|████▎     | 16174/37963 [38:51:53<67:29:35, 11.15s/it]
 43%|████▎     | 16175/37963 [38:52:01<61:22:49, 10.14s/it]
 43%|████▎     | 16176/37963 [38:52:15<67:57:08, 11.23s/it]
 43%|████▎     | 16177/37963 [38:52:29<72:58:53, 12.06s/it]
 43%|████▎     | 16178/37963 [38:52:36<64:44:57, 10.70s/it]
 43%|████▎     | 16179/37963 [38:52:51<71:19:08, 11.79s/it]
 43%|████▎     | 16180/37963 [38:52:58<63:17:57, 10.46s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '0.6473', 'learning_rate': '1.284e-05', 'epoch': '0.4262'}

 43%|████▎     | 16180/37963 [38:52:58<63:17:57, 10.46s/it]
 43%|████▎     | 16181/37963 [38:53:05<57:57:21,  9.58s/it]
 43%|████▎     | 16182/37963 [38:53:13<54:15:12,  8.97s/it]
 43%|████▎     | 16183/37963 [38:53:21<51:36:59,  8.53s/it]
 43%|████▎     | 16184/37963 [38:53:28<49:42:18,  8.22s/it]
 43%|████▎     | 16185/37963 [38:53:35<48:22:19,  8.00s/it]
 43%|████▎     | 16186/37963 [38:53:43<47:32:14,  7.86s/it]
 43%|████▎     | 16187/37963 [38:53:51<46:53:40,  7.75s/it]
 43%|████▎     | 16188/37963 [38:53:58<46:23:48,  7.67s/it]
 43%|████▎     | 16189/37963 [38:54:05<45:38:51,  7.55s/it]
 43%|████▎     | 16190/37963 [38:54:13<45:51:29,  7.58s/it]
                                                           
{'loss': '0.1513', 'grad_norm': '1.366', 'learning_rate': '1.283e-05', 'epoch': '0.4265'}

 43%|████▎     | 16190/37963 [38:54:13<45:51:29,  7.58s/it]
 43%|████▎     | 16191/37963 [38:54:20<45:48:47,  7.58s/it]
 43%|████▎     | 16192/37963 [38:54:28<45:35:06,  7.54s/it]
 43%|████▎     | 16193/37963 [38:54:35<45:31:13,  7.53s/it]
 43%|████▎     | 16194/37963 [38:54:49<57:20:14,  9.48s/it]
 43%|████▎     | 16195/37963 [38:54:57<54:04:21,  8.94s/it]
 43%|████▎     | 16196/37963 [38:55:05<51:39:24,  8.54s/it]
 43%|████▎     | 16197/37963 [38:55:12<49:45:52,  8.23s/it]
 43%|████▎     | 16198/37963 [38:55:20<48:26:56,  8.01s/it]
 43%|████▎     | 16199/37963 [38:55:27<47:27:25,  7.85s/it]
 43%|████▎     | 16200/37963 [38:55:34<46:20:03,  7.66s/it]
                                                           
{'loss': '0.1611', 'grad_norm': '1.961', 'learning_rate': '1.282e-05', 'epoch': '0.4267'}

 43%|████▎     | 16200/37963 [38:55:34<46:20:03,  7.66s/it]
 43%|████▎     | 16201/37963 [38:55:42<46:04:58,  7.62s/it]
 43%|████▎     | 16202/37963 [38:55:50<45:50:45,  7.58s/it]
 43%|████▎     | 16203/37963 [38:55:57<45:34:33,  7.54s/it]
 43%|████▎     | 16204/37963 [38:56:04<44:50:08,  7.42s/it]
 43%|████▎     | 16205/37963 [38:56:12<44:51:43,  7.42s/it]
 43%|████▎     | 16206/37963 [38:56:19<44:39:35,  7.39s/it]
 43%|████▎     | 16207/37963 [38:56:26<45:02:24,  7.45s/it]
 43%|████▎     | 16208/37963 [38:56:34<44:50:01,  7.42s/it]
 43%|████▎     | 16209/37963 [38:56:41<44:58:04,  7.44s/it]
 43%|████▎     | 16210/37963 [38:56:55<56:55:45,  9.42s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.614', 'learning_rate': '1.281e-05', 'epoch': '0.427'}

 43%|████▎     | 16210/37963 [38:56:55<56:55:45,  9.42s/it]
 43%|████▎     | 16211/37963 [38:57:03<53:36:31,  8.87s/it]
 43%|████▎     | 16212/37963 [38:57:10<51:10:49,  8.47s/it]
 43%|████▎     | 16213/37963 [38:57:18<49:21:54,  8.17s/it]
 43%|████▎     | 16214/37963 [38:57:25<48:14:49,  7.99s/it]
 43%|████▎     | 16215/37963 [38:57:33<47:26:20,  7.85s/it]
 43%|████▎     | 16216/37963 [38:57:41<46:58:37,  7.78s/it]
 43%|████▎     | 16217/37963 [38:57:48<46:48:46,  7.75s/it]
 43%|████▎     | 16218/37963 [38:58:02<57:35:53,  9.54s/it]
 43%|████▎     | 16219/37963 [38:58:10<54:07:02,  8.96s/it]
 43%|████▎     | 16220/37963 [38:58:17<51:41:49,  8.56s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.678', 'learning_rate': '1.28e-05', 'epoch': '0.4273'}

 43%|████▎     | 16220/37963 [38:58:17<51:41:49,  8.56s/it]
 43%|████▎     | 16221/37963 [38:58:31<61:26:15, 10.17s/it]
 43%|████▎     | 16222/37963 [38:58:38<55:47:36,  9.24s/it]
 43%|████▎     | 16223/37963 [38:58:52<64:01:36, 10.60s/it]
 43%|████▎     | 16224/37963 [38:58:59<58:15:32,  9.65s/it]
 43%|████▎     | 16225/37963 [38:59:07<54:33:59,  9.04s/it]
 43%|████▎     | 16226/37963 [38:59:15<51:45:47,  8.57s/it]
 43%|████▎     | 16227/37963 [38:59:35<73:39:12, 12.20s/it]
 43%|████▎     | 16228/37963 [38:59:50<77:30:09, 12.84s/it]
 43%|████▎     | 16229/37963 [38:59:57<68:09:00, 11.29s/it]
 43%|████▎     | 16230/37963 [39:00:05<61:19:01, 10.16s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '1.883', 'learning_rate': '1.28e-05', 'epoch': '0.4275'}

 43%|████▎     | 16230/37963 [39:00:05<61:19:01, 10.16s/it]
 43%|████▎     | 16231/37963 [39:00:12<56:25:17,  9.35s/it]
 43%|████▎     | 16232/37963 [39:00:20<53:07:10,  8.80s/it]
 43%|████▎     | 16233/37963 [39:00:27<50:55:58,  8.44s/it]
 43%|████▎     | 16234/37963 [39:00:35<49:13:56,  8.16s/it]
 43%|████▎     | 16235/37963 [39:00:42<48:13:19,  7.99s/it]
 43%|████▎     | 16236/37963 [39:00:50<47:43:36,  7.91s/it]
 43%|████▎     | 16237/37963 [39:00:58<46:48:46,  7.76s/it]
 43%|████▎     | 16238/37963 [39:01:05<46:23:42,  7.69s/it]
 43%|████▎     | 16239/37963 [39:01:13<46:02:45,  7.63s/it]
 43%|████▎     | 16240/37963 [39:01:20<45:45:27,  7.58s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '3.558', 'learning_rate': '1.279e-05', 'epoch': '0.4278'}

 43%|████▎     | 16240/37963 [39:01:20<45:45:27,  7.58s/it]
 43%|████▎     | 16241/37963 [39:01:28<45:48:59,  7.59s/it]
 43%|████▎     | 16242/37963 [39:01:35<45:59:23,  7.62s/it]
 43%|████▎     | 16243/37963 [39:01:43<45:38:06,  7.56s/it]
 43%|████▎     | 16244/37963 [39:01:50<45:54:17,  7.61s/it]
 43%|████▎     | 16245/37963 [39:01:58<45:38:22,  7.57s/it]
 43%|████▎     | 16246/37963 [39:02:05<45:32:17,  7.55s/it]
 43%|████▎     | 16247/37963 [39:02:13<45:39:19,  7.57s/it]
 43%|████▎     | 16248/37963 [39:02:27<57:31:01,  9.54s/it]
 43%|████▎     | 16249/37963 [39:02:35<53:53:31,  8.93s/it]
 43%|████▎     | 16250/37963 [39:02:42<51:21:22,  8.51s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '0.9227', 'learning_rate': '1.278e-05', 'epoch': '0.428'}

 43%|████▎     | 16250/37963 [39:02:42<51:21:22,  8.51s/it]
 43%|████▎     | 16251/37963 [39:02:49<48:42:18,  8.08s/it]
 43%|████▎     | 16252/37963 [39:02:57<47:30:37,  7.88s/it]
 43%|████▎     | 16253/37963 [39:03:04<46:25:24,  7.70s/it]
 43%|████▎     | 16254/37963 [39:03:11<46:05:14,  7.64s/it]
 43%|████▎     | 16255/37963 [39:03:25<56:55:16,  9.44s/it]
 43%|████▎     | 16256/37963 [39:03:33<53:22:14,  8.85s/it]
 43%|████▎     | 16257/37963 [39:03:40<51:18:12,  8.51s/it]
 43%|████▎     | 16258/37963 [39:03:48<49:29:45,  8.21s/it]
 43%|████▎     | 16259/37963 [39:03:55<48:21:04,  8.02s/it]
 43%|████▎     | 16260/37963 [39:04:03<47:02:29,  7.80s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '2.433', 'learning_rate': '1.277e-05', 'epoch': '0.4283'}

 43%|████▎     | 16260/37963 [39:04:03<47:02:29,  7.80s/it]
 43%|████▎     | 16261/37963 [39:04:10<46:22:58,  7.69s/it]
 43%|████▎     | 16262/37963 [39:04:24<57:42:54,  9.57s/it]
 43%|████▎     | 16263/37963 [39:04:32<54:19:31,  9.01s/it]
 43%|████▎     | 16264/37963 [39:04:39<51:13:44,  8.50s/it]
 43%|████▎     | 16265/37963 [39:04:47<49:41:36,  8.24s/it]
 43%|████▎     | 16266/37963 [39:04:54<48:44:57,  8.09s/it]
 43%|████▎     | 16267/37963 [39:05:02<47:50:47,  7.94s/it]
 43%|████▎     | 16268/37963 [39:05:09<46:55:44,  7.79s/it]
 43%|████▎     | 16269/37963 [39:05:17<46:04:36,  7.65s/it]
 43%|████▎     | 16270/37963 [39:05:30<56:43:11,  9.41s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '4.114', 'learning_rate': '1.276e-05', 'epoch': '0.4286'}

 43%|████▎     | 16270/37963 [39:05:30<56:43:11,  9.41s/it]
 43%|████▎     | 16271/37963 [39:05:38<53:12:04,  8.83s/it]
 43%|████▎     | 16272/37963 [39:05:45<51:07:27,  8.48s/it]
 43%|████▎     | 16273/37963 [39:05:53<49:21:57,  8.19s/it]
 43%|████▎     | 16274/37963 [39:06:01<48:11:37,  8.00s/it]
 43%|████▎     | 16275/37963 [39:06:21<70:45:46, 11.75s/it]
 43%|████▎     | 16276/37963 [39:06:28<62:53:46, 10.44s/it]
 43%|████▎     | 16277/37963 [39:06:36<57:44:52,  9.59s/it]
 43%|████▎     | 16278/37963 [39:06:57<77:25:17, 12.85s/it]
 43%|████▎     | 16279/37963 [39:07:04<67:38:01, 11.23s/it]
 43%|████▎     | 16280/37963 [39:07:12<61:09:26, 10.15s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.127', 'learning_rate': '1.276e-05', 'epoch': '0.4288'}

 43%|████▎     | 16280/37963 [39:07:12<61:09:26, 10.15s/it]
 43%|████▎     | 16281/37963 [39:07:19<56:24:45,  9.37s/it]
 43%|████▎     | 16282/37963 [39:07:27<53:07:05,  8.82s/it]
 43%|████▎     | 16283/37963 [39:07:34<50:24:30,  8.37s/it]
 43%|████▎     | 16284/37963 [39:07:41<48:38:38,  8.08s/it]
 43%|████▎     | 16285/37963 [39:07:49<47:35:20,  7.90s/it]
 43%|████▎     | 16286/37963 [39:07:56<46:55:13,  7.79s/it]
 43%|████▎     | 16287/37963 [39:08:04<46:33:49,  7.73s/it]
 43%|████▎     | 16288/37963 [39:08:12<46:22:53,  7.70s/it]
 43%|████▎     | 16289/37963 [39:08:19<46:14:49,  7.68s/it]
 43%|████▎     | 16290/37963 [39:08:27<45:34:07,  7.57s/it]
                                                           
{'loss': '0.157', 'grad_norm': '1.943', 'learning_rate': '1.275e-05', 'epoch': '0.4291'}

 43%|████▎     | 16290/37963 [39:08:27<45:34:07,  7.57s/it]
 43%|████▎     | 16291/37963 [39:08:34<44:47:23,  7.44s/it]
 43%|████▎     | 16292/37963 [39:08:41<44:59:01,  7.47s/it]
 43%|████▎     | 16293/37963 [39:08:49<45:06:15,  7.49s/it]
 43%|████▎     | 16294/37963 [39:08:56<44:30:29,  7.39s/it]
 43%|████▎     | 16295/37963 [39:09:04<44:47:58,  7.44s/it]
 43%|████▎     | 16296/37963 [39:09:11<45:02:31,  7.48s/it]
 43%|████▎     | 16297/37963 [39:09:18<44:51:45,  7.45s/it]
 43%|████▎     | 16298/37963 [39:09:32<56:40:47,  9.42s/it]
 43%|████▎     | 16299/37963 [39:09:40<53:17:55,  8.86s/it]
 43%|████▎     | 16300/37963 [39:09:48<50:56:22,  8.47s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '0.7446', 'learning_rate': '1.274e-05', 'epoch': '0.4294'}

 43%|████▎     | 16300/37963 [39:09:48<50:56:22,  8.47s/it]
 43%|████▎     | 16301/37963 [39:09:55<48:57:23,  8.14s/it]
 43%|████▎     | 16302/37963 [39:10:02<47:51:42,  7.95s/it]
 43%|████▎     | 16303/37963 [39:10:16<58:43:46,  9.76s/it]
 43%|████▎     | 16304/37963 [39:10:24<54:22:12,  9.04s/it]
 43%|████▎     | 16305/37963 [39:10:31<51:50:58,  8.62s/it]
 43%|████▎     | 16306/37963 [39:10:45<61:29:31, 10.22s/it]
 43%|████▎     | 16307/37963 [39:10:53<56:48:07,  9.44s/it]
 43%|████▎     | 16308/37963 [39:11:01<53:16:19,  8.86s/it]
 43%|████▎     | 16309/37963 [39:11:08<51:03:26,  8.49s/it]
 43%|████▎     | 16310/37963 [39:11:16<49:11:10,  8.18s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '3.261', 'learning_rate': '1.273e-05', 'epoch': '0.4296'}

 43%|████▎     | 16310/37963 [39:11:16<49:11:10,  8.18s/it]
 43%|████▎     | 16311/37963 [39:11:23<47:48:17,  7.95s/it]
 43%|████▎     | 16312/37963 [39:11:31<47:16:43,  7.86s/it]
 43%|████▎     | 16313/37963 [39:11:38<46:42:38,  7.77s/it]
 43%|████▎     | 16314/37963 [39:11:46<45:57:51,  7.64s/it]
 43%|████▎     | 16315/37963 [39:11:53<45:43:55,  7.61s/it]
 43%|████▎     | 16316/37963 [39:12:01<45:25:12,  7.55s/it]
 43%|████▎     | 16317/37963 [39:12:08<45:20:35,  7.54s/it]
 43%|████▎     | 16318/37963 [39:12:16<45:20:40,  7.54s/it]
 43%|████▎     | 16319/37963 [39:12:23<45:14:00,  7.52s/it]
 43%|████▎     | 16320/37963 [39:12:31<45:13:20,  7.52s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '3.783', 'learning_rate': '1.272e-05', 'epoch': '0.4299'}

 43%|████▎     | 16320/37963 [39:12:31<45:13:20,  7.52s/it]
 43%|████▎     | 16321/37963 [39:12:38<45:08:38,  7.51s/it]
 43%|████▎     | 16322/37963 [39:12:52<56:58:23,  9.48s/it]
 43%|████▎     | 16323/37963 [39:13:00<53:21:40,  8.88s/it]
 43%|████▎     | 16324/37963 [39:13:07<50:51:06,  8.46s/it]
 43%|████▎     | 16325/37963 [39:13:14<48:31:01,  8.07s/it]
 43%|████▎     | 16326/37963 [39:13:22<47:30:31,  7.90s/it]
 43%|████▎     | 16327/37963 [39:13:29<46:45:25,  7.78s/it]
 43%|████▎     | 16328/37963 [39:13:37<46:06:28,  7.67s/it]
 43%|████▎     | 16329/37963 [39:13:51<57:25:22,  9.56s/it]
 43%|████▎     | 16330/37963 [39:14:05<65:39:23, 10.93s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '1.258', 'learning_rate': '1.271e-05', 'epoch': '0.4302'}

 43%|████▎     | 16330/37963 [39:14:05<65:39:23, 10.93s/it]
 43%|████▎     | 16331/37963 [39:14:12<59:12:14,  9.85s/it]
 43%|████▎     | 16332/37963 [39:14:26<66:44:25, 11.11s/it]
 43%|████▎     | 16333/37963 [39:14:34<60:22:00, 10.05s/it]
 43%|████▎     | 16334/37963 [39:14:41<55:47:01,  9.28s/it]
 43%|████▎     | 16335/37963 [39:14:49<53:08:27,  8.85s/it]
 43%|████▎     | 16336/37963 [39:14:57<50:43:58,  8.44s/it]
 43%|████▎     | 16337/37963 [39:15:04<49:03:24,  8.17s/it]
 43%|████▎     | 16338/37963 [39:15:11<47:37:04,  7.93s/it]
 43%|████▎     | 16339/37963 [39:15:19<46:40:53,  7.77s/it]
 43%|████▎     | 16340/37963 [39:15:26<46:23:07,  7.72s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '2.439', 'learning_rate': '1.271e-05', 'epoch': '0.4304'}

 43%|████▎     | 16340/37963 [39:15:26<46:23:07,  7.72s/it]
 43%|████▎     | 16341/37963 [39:15:34<45:36:44,  7.59s/it]
 43%|████▎     | 16342/37963 [39:15:41<45:43:26,  7.61s/it]
 43%|████▎     | 16343/37963 [39:15:49<45:26:55,  7.57s/it]
 43%|████▎     | 16344/37963 [39:15:56<45:24:01,  7.56s/it]
 43%|████▎     | 16345/37963 [39:16:10<56:50:36,  9.47s/it]
 43%|████▎     | 16346/37963 [39:16:18<53:11:38,  8.86s/it]
 43%|████▎     | 16347/37963 [39:16:25<50:38:41,  8.43s/it]
 43%|████▎     | 16348/37963 [39:16:33<48:48:45,  8.13s/it]
 43%|████▎     | 16349/37963 [39:16:40<47:45:58,  7.96s/it]
 43%|████▎     | 16350/37963 [39:16:48<47:06:28,  7.85s/it]
                                                           
{'loss': '0.1604', 'grad_norm': '4.307', 'learning_rate': '1.27e-05', 'epoch': '0.4307'}

 43%|████▎     | 16350/37963 [39:16:48<47:06:28,  7.85s/it]
 43%|████▎     | 16351/37963 [39:16:55<46:22:43,  7.73s/it]
 43%|████▎     | 16352/37963 [39:17:09<57:44:32,  9.62s/it]
 43%|████▎     | 16353/37963 [39:17:17<54:12:28,  9.03s/it]
 43%|████▎     | 16354/37963 [39:17:24<51:25:42,  8.57s/it]
 43%|████▎     | 16355/37963 [39:17:39<61:38:50, 10.27s/it]
 43%|████▎     | 16356/37963 [39:17:46<56:32:49,  9.42s/it]
 43%|████▎     | 16357/37963 [39:17:54<53:15:02,  8.87s/it]
 43%|████▎     | 16358/37963 [39:18:01<50:49:35,  8.47s/it]
 43%|████▎     | 16359/37963 [39:18:09<49:09:49,  8.19s/it]
 43%|████▎     | 16360/37963 [39:18:16<47:44:10,  7.95s/it]
                                                           
{'loss': '0.168', 'grad_norm': '1.471', 'learning_rate': '1.269e-05', 'epoch': '0.4309'}

 43%|████▎     | 16360/37963 [39:18:16<47:44:10,  7.95s/it]
 43%|████▎     | 16361/37963 [39:18:24<47:08:00,  7.85s/it]
 43%|████▎     | 16362/37963 [39:18:31<46:04:24,  7.68s/it]
 43%|████▎     | 16363/37963 [39:18:39<45:44:55,  7.62s/it]
 43%|████▎     | 16364/37963 [39:18:46<45:34:03,  7.59s/it]
 43%|████▎     | 16365/37963 [39:18:53<45:06:14,  7.52s/it]
 43%|████▎     | 16366/37963 [39:19:01<45:07:47,  7.52s/it]
 43%|████▎     | 16367/37963 [39:19:09<45:15:07,  7.54s/it]
 43%|████▎     | 16368/37963 [39:19:16<45:09:33,  7.53s/it]
 43%|████▎     | 16369/37963 [39:19:23<44:46:11,  7.46s/it]
 43%|████▎     | 16370/37963 [39:19:37<56:27:29,  9.41s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.59', 'learning_rate': '1.268e-05', 'epoch': '0.4312'}

 43%|████▎     | 16370/37963 [39:19:37<56:27:29,  9.41s/it]
 43%|████▎     | 16371/37963 [39:19:45<52:59:28,  8.84s/it]
 43%|████▎     | 16372/37963 [39:19:52<50:35:54,  8.44s/it]
 43%|████▎     | 16373/37963 [39:20:00<49:10:09,  8.20s/it]
 43%|████▎     | 16374/37963 [39:20:08<48:06:37,  8.02s/it]
 43%|████▎     | 16375/37963 [39:20:28<70:19:27, 11.73s/it]
 43%|████▎     | 16376/37963 [39:20:35<62:50:28, 10.48s/it]
 43%|████▎     | 16377/37963 [39:20:43<57:42:22,  9.62s/it]
 43%|████▎     | 16378/37963 [39:20:57<65:41:14, 10.96s/it]
 43%|████▎     | 16379/37963 [39:21:05<59:29:38,  9.92s/it]
 43%|████▎     | 16380/37963 [39:21:12<55:15:32,  9.22s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.903', 'learning_rate': '1.267e-05', 'epoch': '0.4315'}

 43%|████▎     | 16380/37963 [39:21:12<55:15:32,  9.22s/it]
 43%|████▎     | 16381/37963 [39:21:19<51:26:57,  8.58s/it]
 43%|████▎     | 16382/37963 [39:21:27<49:50:05,  8.31s/it]
 43%|████▎     | 16383/37963 [39:21:35<48:38:34,  8.11s/it]
 43%|████▎     | 16384/37963 [39:21:49<59:07:51,  9.86s/it]
 43%|████▎     | 16385/37963 [39:21:56<55:09:01,  9.20s/it]
 43%|████▎     | 16386/37963 [39:22:04<52:01:54,  8.68s/it]
 43%|████▎     | 16387/37963 [39:22:11<49:56:11,  8.33s/it]
 43%|████▎     | 16388/37963 [39:22:19<48:14:35,  8.05s/it]
 43%|████▎     | 16389/37963 [39:22:26<47:15:34,  7.89s/it]
 43%|████▎     | 16390/37963 [39:22:34<46:26:49,  7.75s/it]
                                                           
{'loss': '0.1582', 'grad_norm': '0.9304', 'learning_rate': '1.267e-05', 'epoch': '0.4317'}

 43%|████▎     | 16390/37963 [39:22:34<46:26:49,  7.75s/it]
 43%|████▎     | 16391/37963 [39:22:41<46:04:40,  7.69s/it]
 43%|████▎     | 16392/37963 [39:22:49<45:57:45,  7.67s/it]
 43%|████▎     | 16393/37963 [39:23:03<57:12:29,  9.55s/it]
 43%|████▎     | 16394/37963 [39:23:10<53:27:12,  8.92s/it]
 43%|████▎     | 16395/37963 [39:23:18<50:55:24,  8.50s/it]
 43%|████▎     | 16396/37963 [39:23:25<49:27:58,  8.26s/it]
 43%|████▎     | 16397/37963 [39:23:33<48:02:20,  8.02s/it]
 43%|████▎     | 16398/37963 [39:23:40<46:54:44,  7.83s/it]
 43%|████▎     | 16399/37963 [39:23:48<46:22:30,  7.74s/it]
 43%|████▎     | 16400/37963 [39:23:55<46:11:04,  7.71s/it]
                                                           
{'loss': '0.1626', 'grad_norm': '3.578', 'learning_rate': '1.266e-05', 'epoch': '0.432'}

 43%|████▎     | 16400/37963 [39:23:55<46:11:04,  7.71s/it]
 43%|████▎     | 16401/37963 [39:24:10<57:38:22,  9.62s/it]
 43%|████▎     | 16402/37963 [39:24:17<53:28:23,  8.93s/it]
 43%|████▎     | 16403/37963 [39:24:31<62:23:11, 10.42s/it]
 43%|████▎     | 16404/37963 [39:24:38<57:07:59,  9.54s/it]
 43%|████▎     | 16405/37963 [39:24:46<53:43:06,  8.97s/it]
 43%|████▎     | 16406/37963 [39:24:53<50:23:08,  8.41s/it]
 43%|████▎     | 16407/37963 [39:25:00<48:48:03,  8.15s/it]
 43%|████▎     | 16408/37963 [39:25:08<47:42:10,  7.97s/it]
 43%|████▎     | 16409/37963 [39:25:15<46:45:54,  7.81s/it]
 43%|████▎     | 16410/37963 [39:25:23<46:13:27,  7.72s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.472', 'learning_rate': '1.265e-05', 'epoch': '0.4323'}

 43%|████▎     | 16410/37963 [39:25:23<46:13:27,  7.72s/it]
 43%|████▎     | 16411/37963 [39:25:30<45:35:48,  7.62s/it]
 43%|████▎     | 16412/37963 [39:25:38<45:21:56,  7.58s/it]
 43%|████▎     | 16413/37963 [39:25:45<45:24:33,  7.59s/it]
 43%|████▎     | 16414/37963 [39:25:53<44:52:56,  7.50s/it]
 43%|████▎     | 16415/37963 [39:26:00<44:29:54,  7.43s/it]
 43%|████▎     | 16416/37963 [39:26:07<44:21:33,  7.41s/it]
 43%|████▎     | 16417/37963 [39:26:15<44:38:11,  7.46s/it]
 43%|████▎     | 16418/37963 [39:26:23<44:49:03,  7.49s/it]
 43%|████▎     | 16419/37963 [39:26:36<56:16:54,  9.40s/it]
 43%|████▎     | 16420/37963 [39:26:44<52:50:05,  8.83s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '0.8417', 'learning_rate': '1.264e-05', 'epoch': '0.4325'}

 43%|████▎     | 16420/37963 [39:26:44<52:50:05,  8.83s/it]
 43%|████▎     | 16421/37963 [39:26:51<50:28:48,  8.44s/it]
 43%|████▎     | 16422/37963 [39:26:59<48:50:18,  8.16s/it]
 43%|████▎     | 16423/37963 [39:27:13<59:58:58, 10.03s/it]
 43%|████▎     | 16424/37963 [39:27:27<66:52:48, 11.18s/it]
 43%|████▎     | 16425/37963 [39:27:35<60:15:56, 10.07s/it]
 43%|████▎     | 16426/37963 [39:27:49<67:06:25, 11.22s/it]
 43%|████▎     | 16427/37963 [39:27:56<60:15:39, 10.07s/it]
 43%|████▎     | 16428/37963 [39:28:03<55:26:13,  9.27s/it]
 43%|████▎     | 16429/37963 [39:28:11<52:15:56,  8.74s/it]
 43%|████▎     | 16430/37963 [39:28:18<49:51:26,  8.34s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '0.5785', 'learning_rate': '1.263e-05', 'epoch': '0.4328'}

 43%|████▎     | 16430/37963 [39:28:18<49:51:26,  8.34s/it]
 43%|████▎     | 16431/37963 [39:28:26<48:21:22,  8.08s/it]
 43%|████▎     | 16432/37963 [39:28:33<47:05:12,  7.87s/it]
 43%|████▎     | 16433/37963 [39:28:40<45:52:52,  7.67s/it]
 43%|████▎     | 16434/37963 [39:28:48<45:35:54,  7.62s/it]
 43%|████▎     | 16435/37963 [39:28:55<45:39:34,  7.64s/it]
 43%|████▎     | 16436/37963 [39:29:03<45:27:44,  7.60s/it]
 43%|████▎     | 16437/37963 [39:29:17<56:41:35,  9.48s/it]
 43%|████▎     | 16438/37963 [39:29:24<52:47:40,  8.83s/it]
 43%|████▎     | 16439/37963 [39:29:32<50:24:45,  8.43s/it]
 43%|████▎     | 16440/37963 [39:29:39<48:59:26,  8.19s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.645', 'learning_rate': '1.262e-05', 'epoch': '0.4331'}

 43%|████▎     | 16440/37963 [39:29:39<48:59:26,  8.19s/it]
 43%|████▎     | 16441/37963 [39:29:47<47:30:34,  7.95s/it]
 43%|████▎     | 16442/37963 [39:29:54<47:00:18,  7.86s/it]
 43%|████▎     | 16443/37963 [39:30:02<46:09:28,  7.72s/it]
 43%|████▎     | 16444/37963 [39:30:09<45:47:24,  7.66s/it]
 43%|████▎     | 16445/37963 [39:30:17<45:30:57,  7.61s/it]
 43%|████▎     | 16446/37963 [39:30:24<45:20:37,  7.59s/it]
 43%|████▎     | 16447/37963 [39:30:32<45:13:10,  7.57s/it]
 43%|████▎     | 16448/37963 [39:30:46<56:34:51,  9.47s/it]
 43%|████▎     | 16449/37963 [39:30:53<53:03:18,  8.88s/it]
 43%|████▎     | 16450/37963 [39:31:01<50:45:22,  8.49s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.3', 'learning_rate': '1.262e-05', 'epoch': '0.4333'}

 43%|████▎     | 16450/37963 [39:31:01<50:45:22,  8.49s/it]
 43%|████▎     | 16451/37963 [39:31:08<49:00:51,  8.20s/it]
 43%|████▎     | 16452/37963 [39:31:22<58:42:36,  9.83s/it]
 43%|████▎     | 16453/37963 [39:31:30<54:41:23,  9.15s/it]
 43%|████▎     | 16454/37963 [39:31:37<51:52:22,  8.68s/it]
 43%|████▎     | 16455/37963 [39:31:45<49:54:36,  8.35s/it]
 43%|████▎     | 16456/37963 [39:31:52<48:37:56,  8.14s/it]
 43%|████▎     | 16457/37963 [39:32:00<47:31:03,  7.95s/it]
 43%|████▎     | 16458/37963 [39:32:07<46:50:50,  7.84s/it]
 43%|████▎     | 16459/37963 [39:32:15<46:20:20,  7.76s/it]
 43%|████▎     | 16460/37963 [39:32:22<45:49:49,  7.67s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '2.755', 'learning_rate': '1.261e-05', 'epoch': '0.4336'}

 43%|████▎     | 16460/37963 [39:32:22<45:49:49,  7.67s/it]
 43%|████▎     | 16461/37963 [39:32:30<45:33:55,  7.63s/it]
 43%|████▎     | 16462/37963 [39:32:38<45:28:48,  7.61s/it]
 43%|████▎     | 16463/37963 [39:32:45<44:54:29,  7.52s/it]
 43%|████▎     | 16464/37963 [39:32:52<44:52:35,  7.51s/it]
 43%|████▎     | 16465/37963 [39:33:00<44:49:34,  7.51s/it]
 43%|████▎     | 16466/37963 [39:33:07<44:24:31,  7.44s/it]
 43%|████▎     | 16467/37963 [39:33:15<44:46:13,  7.50s/it]
 43%|████▎     | 16468/37963 [39:33:29<55:57:53,  9.37s/it]
 43%|████▎     | 16469/37963 [39:33:49<76:21:56, 12.79s/it]
 43%|████▎     | 16470/37963 [39:33:57<66:57:36, 11.22s/it]
                                                           
{'loss': '0.1639', 'grad_norm': '0.5891', 'learning_rate': '1.26e-05', 'epoch': '0.4338'}

 43%|████▎     | 16470/37963 [39:33:57<66:57:36, 11.22s/it]
 43%|████▎     | 16471/37963 [39:34:04<60:03:17, 10.06s/it]
 43%|████▎     | 16472/37963 [39:34:12<55:32:32,  9.30s/it]
 43%|████▎     | 16473/37963 [39:34:19<52:22:57,  8.78s/it]
 43%|████▎     | 16474/37963 [39:34:27<50:16:17,  8.42s/it]
 43%|████▎     | 16475/37963 [39:34:34<48:43:08,  8.16s/it]
 43%|████▎     | 16476/37963 [39:34:42<47:40:19,  7.99s/it]
 43%|████▎     | 16477/37963 [39:34:50<46:48:01,  7.84s/it]
 43%|████▎     | 16478/37963 [39:34:57<45:56:22,  7.70s/it]
 43%|████▎     | 16479/37963 [39:35:11<57:02:53,  9.56s/it]
 43%|████▎     | 16480/37963 [39:35:18<53:40:58,  9.00s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '2.424', 'learning_rate': '1.259e-05', 'epoch': '0.4341'}

 43%|████▎     | 16480/37963 [39:35:18<53:40:58,  9.00s/it]
 43%|████▎     | 16481/37963 [39:35:26<50:57:40,  8.54s/it]
 43%|████▎     | 16482/37963 [39:35:33<49:08:17,  8.24s/it]
 43%|████▎     | 16483/37963 [39:35:41<47:25:36,  7.95s/it]
 43%|████▎     | 16484/37963 [39:35:48<46:21:07,  7.77s/it]
 43%|████▎     | 16485/37963 [39:36:02<57:20:33,  9.61s/it]
 43%|████▎     | 16486/37963 [39:36:10<53:42:59,  9.00s/it]
 43%|████▎     | 16487/37963 [39:36:23<62:16:35, 10.44s/it]
 43%|████▎     | 16488/37963 [39:36:31<57:13:00,  9.59s/it]
 43%|████▎     | 16489/37963 [39:36:38<53:17:13,  8.93s/it]
 43%|████▎     | 16490/37963 [39:36:46<50:46:03,  8.51s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '1.459', 'learning_rate': '1.258e-05', 'epoch': '0.4344'}

 43%|████▎     | 16490/37963 [39:36:46<50:46:03,  8.51s/it]
 43%|████▎     | 16491/37963 [39:36:53<48:36:30,  8.15s/it]
 43%|████▎     | 16492/37963 [39:37:01<47:34:01,  7.98s/it]
 43%|████▎     | 16493/37963 [39:37:08<46:47:30,  7.85s/it]
 43%|████▎     | 16494/37963 [39:37:16<45:51:35,  7.69s/it]
 43%|████▎     | 16495/37963 [39:37:23<45:41:52,  7.66s/it]
 43%|████▎     | 16496/37963 [39:37:31<45:28:23,  7.63s/it]
 43%|████▎     | 16497/37963 [39:37:45<56:27:54,  9.47s/it]
 43%|████▎     | 16498/37963 [39:37:58<64:21:39, 10.79s/it]
 43%|████▎     | 16499/37963 [39:38:06<58:35:53,  9.83s/it]
 43%|████▎     | 16500/37963 [39:38:14<54:36:31,  9.16s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '2.032', 'learning_rate': '1.257e-05', 'epoch': '0.4346'}

 43%|████▎     | 16500/37963 [39:38:14<54:36:31,  9.16s/it]
 43%|████▎     | 16501/37963 [39:38:21<51:41:50,  8.67s/it]
 43%|████▎     | 16502/37963 [39:38:29<49:27:06,  8.30s/it]
 43%|████▎     | 16503/37963 [39:38:36<47:57:03,  8.04s/it]
 43%|████▎     | 16504/37963 [39:38:44<47:28:09,  7.96s/it]
 43%|████▎     | 16505/37963 [39:38:51<46:45:57,  7.85s/it]
 43%|████▎     | 16506/37963 [39:38:59<46:12:07,  7.75s/it]
 43%|████▎     | 16507/37963 [39:39:06<45:38:48,  7.66s/it]
 43%|████▎     | 16508/37963 [39:39:14<45:22:22,  7.61s/it]
 43%|████▎     | 16509/37963 [39:39:21<44:51:03,  7.53s/it]
 43%|████▎     | 16510/37963 [39:39:29<44:53:17,  7.53s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '0.8174', 'learning_rate': '1.257e-05', 'epoch': '0.4349'}

 43%|████▎     | 16510/37963 [39:39:29<44:53:17,  7.53s/it]
 43%|████▎     | 16511/37963 [39:39:36<44:58:05,  7.55s/it]
 43%|████▎     | 16512/37963 [39:39:44<44:53:16,  7.53s/it]
 43%|████▎     | 16513/37963 [39:39:51<45:04:31,  7.57s/it]
 44%|████▎     | 16514/37963 [39:40:05<56:26:31,  9.47s/it]
 44%|████▎     | 16515/37963 [39:40:13<53:06:47,  8.91s/it]
 44%|████▎     | 16516/37963 [39:40:27<61:56:35, 10.40s/it]
 44%|████▎     | 16517/37963 [39:40:34<56:47:00,  9.53s/it]
 44%|████▎     | 16518/37963 [39:40:42<53:23:22,  8.96s/it]
 44%|████▎     | 16519/37963 [39:40:56<61:43:42, 10.36s/it]
 44%|████▎     | 16520/37963 [39:41:03<56:41:30,  9.52s/it]
                                                           
{'loss': '0.147', 'grad_norm': '1.258', 'learning_rate': '1.256e-05', 'epoch': '0.4352'}

 44%|████▎     | 16520/37963 [39:41:03<56:41:30,  9.52s/it]
 44%|████▎     | 16521/37963 [39:41:10<52:28:23,  8.81s/it]
 44%|████▎     | 16522/37963 [39:41:18<50:07:46,  8.42s/it]
 44%|████▎     | 16523/37963 [39:41:25<48:21:59,  8.12s/it]
 44%|████▎     | 16524/37963 [39:41:33<47:15:09,  7.93s/it]
 44%|████▎     | 16525/37963 [39:41:40<46:22:48,  7.79s/it]
 44%|████▎     | 16526/37963 [39:41:48<45:44:01,  7.68s/it]
 44%|████▎     | 16527/37963 [39:41:55<45:18:41,  7.61s/it]
 44%|████▎     | 16528/37963 [39:42:03<45:05:16,  7.57s/it]
 44%|████▎     | 16529/37963 [39:42:10<45:16:02,  7.60s/it]
 44%|████▎     | 16530/37963 [39:42:18<45:06:13,  7.58s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.595', 'learning_rate': '1.255e-05', 'epoch': '0.4354'}

 44%|████▎     | 16530/37963 [39:42:18<45:06:13,  7.58s/it]
 44%|████▎     | 16531/37963 [39:42:25<45:05:56,  7.58s/it]
 44%|████▎     | 16532/37963 [39:42:39<56:47:16,  9.54s/it]
 44%|████▎     | 16533/37963 [39:42:47<53:08:25,  8.93s/it]
 44%|████▎     | 16534/37963 [39:43:01<62:02:46, 10.42s/it]
 44%|████▎     | 16535/37963 [39:43:08<56:55:20,  9.56s/it]
 44%|████▎     | 16536/37963 [39:43:16<53:13:14,  8.94s/it]
 44%|████▎     | 16537/37963 [39:43:23<50:37:13,  8.51s/it]
 44%|████▎     | 16538/37963 [39:43:31<48:49:20,  8.20s/it]
 44%|████▎     | 16539/37963 [39:43:38<47:40:07,  8.01s/it]
 44%|████▎     | 16540/37963 [39:43:52<58:10:08,  9.77s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.513', 'learning_rate': '1.254e-05', 'epoch': '0.4357'}

 44%|████▎     | 16540/37963 [39:43:52<58:10:08,  9.77s/it]
 44%|████▎     | 16541/37963 [39:44:00<54:14:02,  9.11s/it]
 44%|████▎     | 16542/37963 [39:44:07<51:21:06,  8.63s/it]
 44%|████▎     | 16543/37963 [39:44:21<60:40:12, 10.20s/it]
 44%|████▎     | 16544/37963 [39:44:29<56:02:17,  9.42s/it]
 44%|████▎     | 16545/37963 [39:44:36<52:41:42,  8.86s/it]
 44%|████▎     | 16546/37963 [39:44:51<62:05:54, 10.44s/it]
 44%|████▎     | 16547/37963 [39:44:58<56:57:53,  9.58s/it]
 44%|████▎     | 16548/37963 [39:45:06<53:26:46,  8.98s/it]
 44%|████▎     | 16549/37963 [39:45:13<51:05:56,  8.59s/it]
 44%|████▎     | 16550/37963 [39:45:21<49:36:31,  8.34s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '2.04', 'learning_rate': '1.253e-05', 'epoch': '0.436'}

 44%|████▎     | 16550/37963 [39:45:21<49:36:31,  8.34s/it]
 44%|████▎     | 16551/37963 [39:45:29<48:18:03,  8.12s/it]
 44%|████▎     | 16552/37963 [39:45:36<46:50:21,  7.88s/it]
 44%|████▎     | 16553/37963 [39:45:44<46:14:30,  7.78s/it]
 44%|████▎     | 16554/37963 [39:45:51<45:43:21,  7.69s/it]
 44%|████▎     | 16555/37963 [39:45:59<45:16:35,  7.61s/it]
 44%|████▎     | 16556/37963 [39:46:06<45:03:15,  7.58s/it]
 44%|████▎     | 16557/37963 [39:46:14<44:58:58,  7.57s/it]
 44%|████▎     | 16558/37963 [39:46:21<44:54:18,  7.55s/it]
 44%|████▎     | 16559/37963 [39:46:29<44:46:34,  7.53s/it]
 44%|████▎     | 16560/37963 [39:46:36<44:39:00,  7.51s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '0.8721', 'learning_rate': '1.252e-05', 'epoch': '0.4362'}

 44%|████▎     | 16560/37963 [39:46:36<44:39:00,  7.51s/it]
 44%|████▎     | 16561/37963 [39:46:50<55:58:48,  9.42s/it]
 44%|████▎     | 16562/37963 [39:46:58<52:44:00,  8.87s/it]
 44%|████▎     | 16563/37963 [39:47:05<49:59:45,  8.41s/it]
 44%|████▎     | 16564/37963 [39:47:19<59:51:55, 10.07s/it]
 44%|████▎     | 16565/37963 [39:47:26<55:01:01,  9.26s/it]
 44%|████▎     | 16566/37963 [39:47:34<52:11:25,  8.78s/it]
 44%|████▎     | 16567/37963 [39:47:41<49:55:57,  8.40s/it]
 44%|████▎     | 16568/37963 [39:47:49<48:12:36,  8.11s/it]
 44%|████▎     | 16569/37963 [39:47:56<46:48:42,  7.88s/it]
 44%|████▎     | 16570/37963 [39:48:10<57:29:03,  9.67s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '1.113', 'learning_rate': '1.252e-05', 'epoch': '0.4365'}

 44%|████▎     | 16570/37963 [39:48:10<57:29:03,  9.67s/it]
 44%|████▎     | 16571/37963 [39:48:17<53:11:38,  8.95s/it]
 44%|████▎     | 16572/37963 [39:48:25<50:22:32,  8.48s/it]
 44%|████▎     | 16573/37963 [39:48:32<48:44:20,  8.20s/it]
 44%|████▎     | 16574/37963 [39:48:40<47:32:20,  8.00s/it]
 44%|████▎     | 16575/37963 [39:48:47<46:44:27,  7.87s/it]
 44%|████▎     | 16576/37963 [39:48:55<46:04:41,  7.76s/it]
 44%|████▎     | 16577/37963 [39:49:02<45:42:04,  7.69s/it]
 44%|████▎     | 16578/37963 [39:49:09<44:38:28,  7.52s/it]
 44%|████▎     | 16579/37963 [39:49:17<44:40:33,  7.52s/it]
 44%|████▎     | 16580/37963 [39:49:37<67:16:17, 11.33s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.715', 'learning_rate': '1.251e-05', 'epoch': '0.4367'}

 44%|████▎     | 16580/37963 [39:49:37<67:16:17, 11.33s/it]
 44%|████▎     | 16581/37963 [39:49:45<60:26:21, 10.18s/it]
 44%|████▎     | 16582/37963 [39:49:52<55:38:19,  9.37s/it]
 44%|████▎     | 16583/37963 [39:50:00<52:09:32,  8.78s/it]
 44%|████▎     | 16584/37963 [39:50:07<49:57:49,  8.41s/it]
 44%|████▎     | 16585/37963 [39:50:15<48:27:02,  8.16s/it]
 44%|████▎     | 16586/37963 [39:50:22<46:51:48,  7.89s/it]
 44%|████▎     | 16587/37963 [39:50:29<46:11:29,  7.78s/it]
 44%|████▎     | 16588/37963 [39:50:37<45:42:48,  7.70s/it]
 44%|████▎     | 16589/37963 [39:50:44<44:54:45,  7.56s/it]
 44%|████▎     | 16590/37963 [39:50:51<44:16:43,  7.46s/it]
                                                           
{'loss': '0.1641', 'grad_norm': '1.457', 'learning_rate': '1.25e-05', 'epoch': '0.437'}

 44%|████▎     | 16590/37963 [39:50:51<44:16:43,  7.46s/it]
 44%|████▎     | 16591/37963 [39:51:05<56:03:59,  9.44s/it]
 44%|████▎     | 16592/37963 [39:51:20<64:58:41, 10.95s/it]
 44%|████▎     | 16593/37963 [39:51:27<58:55:06,  9.93s/it]
 44%|████▎     | 16594/37963 [39:51:35<54:51:29,  9.24s/it]
 44%|████▎     | 16595/37963 [39:51:43<52:01:58,  8.77s/it]
 44%|████▎     | 16596/37963 [39:51:50<49:44:36,  8.38s/it]
 44%|████▎     | 16597/37963 [39:51:58<47:58:58,  8.08s/it]
 44%|████▎     | 16598/37963 [39:52:05<46:58:51,  7.92s/it]
 44%|████▎     | 16599/37963 [39:52:13<46:23:14,  7.82s/it]
 44%|████▎     | 16600/37963 [39:52:27<57:30:19,  9.69s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '3.516', 'learning_rate': '1.249e-05', 'epoch': '0.4373'}

 44%|████▎     | 16600/37963 [39:52:27<57:30:19,  9.69s/it]
 44%|████▎     | 16601/37963 [39:52:34<53:48:47,  9.07s/it]
 44%|████▎     | 16602/37963 [39:52:42<51:08:56,  8.62s/it]
 44%|████▎     | 16603/37963 [39:52:50<49:09:18,  8.28s/it]
 44%|████▎     | 16604/37963 [39:52:57<47:48:47,  8.06s/it]
 44%|████▎     | 16605/37963 [39:53:05<46:58:18,  7.92s/it]
 44%|████▎     | 16606/37963 [39:53:12<46:16:55,  7.80s/it]
 44%|████▎     | 16607/37963 [39:53:26<57:30:05,  9.69s/it]
 44%|████▎     | 16608/37963 [39:53:34<53:47:55,  9.07s/it]
 44%|████▍     | 16609/37963 [39:53:41<50:48:22,  8.57s/it]
 44%|████▍     | 16610/37963 [39:53:49<48:56:38,  8.25s/it]
                                                           
{'loss': '0.1597', 'grad_norm': '3.25', 'learning_rate': '1.248e-05', 'epoch': '0.4375'}

 44%|████▍     | 16610/37963 [39:53:49<48:56:38,  8.25s/it]
 44%|████▍     | 16611/37963 [39:53:56<47:22:04,  7.99s/it]
 44%|████▍     | 16612/37963 [39:54:04<46:37:26,  7.86s/it]
 44%|████▍     | 16613/37963 [39:54:11<45:51:27,  7.73s/it]
 44%|████▍     | 16614/37963 [39:54:19<45:19:25,  7.64s/it]
 44%|████▍     | 16615/37963 [39:54:33<56:49:56,  9.58s/it]
 44%|████▍     | 16616/37963 [39:54:47<64:44:37, 10.92s/it]
 44%|████▍     | 16617/37963 [39:54:54<58:59:06,  9.95s/it]
 44%|████▍     | 16618/37963 [39:55:02<54:53:43,  9.26s/it]
 44%|████▍     | 16619/37963 [39:55:09<51:34:31,  8.70s/it]
 44%|████▍     | 16620/37963 [39:55:17<49:09:59,  8.29s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '0.7402', 'learning_rate': '1.248e-05', 'epoch': '0.4378'}

 44%|████▍     | 16620/37963 [39:55:17<49:09:59,  8.29s/it]
 44%|████▍     | 16621/37963 [39:55:24<47:33:44,  8.02s/it]
 44%|████▍     | 16622/37963 [39:55:32<46:46:21,  7.89s/it]
 44%|████▍     | 16623/37963 [39:55:39<45:51:27,  7.74s/it]
 44%|████▍     | 16624/37963 [39:55:47<45:25:58,  7.66s/it]
 44%|████▍     | 16625/37963 [39:55:54<44:51:23,  7.57s/it]
 44%|████▍     | 16626/37963 [39:56:08<56:39:23,  9.56s/it]
 44%|████▍     | 16627/37963 [39:56:22<64:34:19, 10.90s/it]
 44%|████▍     | 16628/37963 [39:56:30<58:34:37,  9.88s/it]
 44%|████▍     | 16629/37963 [39:56:37<54:18:21,  9.16s/it]
 44%|████▍     | 16630/37963 [39:56:45<51:29:26,  8.69s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.474', 'learning_rate': '1.247e-05', 'epoch': '0.4381'}

 44%|████▍     | 16630/37963 [39:56:45<51:29:26,  8.69s/it]
 44%|████▍     | 16631/37963 [39:56:52<49:39:02,  8.38s/it]
 44%|████▍     | 16632/37963 [39:57:00<48:11:33,  8.13s/it]
 44%|████▍     | 16633/37963 [39:57:08<47:06:31,  7.95s/it]
 44%|████▍     | 16634/37963 [39:57:15<46:43:34,  7.89s/it]
 44%|████▍     | 16635/37963 [39:57:23<46:22:08,  7.83s/it]
 44%|████▍     | 16636/37963 [39:57:31<45:59:31,  7.76s/it]
 44%|████▍     | 16637/37963 [39:57:45<57:02:14,  9.63s/it]
 44%|████▍     | 16638/37963 [39:57:52<53:11:55,  8.98s/it]
 44%|████▍     | 16639/37963 [39:58:00<50:33:56,  8.54s/it]
 44%|████▍     | 16640/37963 [39:58:14<60:27:58, 10.21s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.741', 'learning_rate': '1.246e-05', 'epoch': '0.4383'}

 44%|████▍     | 16640/37963 [39:58:14<60:27:58, 10.21s/it]
 44%|████▍     | 16641/37963 [39:58:21<55:24:36,  9.36s/it]
 44%|████▍     | 16642/37963 [39:58:28<51:43:25,  8.73s/it]
 44%|████▍     | 16643/37963 [39:58:36<49:33:21,  8.37s/it]
 44%|████▍     | 16644/37963 [39:58:43<47:45:59,  8.07s/it]
 44%|████▍     | 16645/37963 [39:58:51<46:38:02,  7.88s/it]
 44%|████▍     | 16646/37963 [39:58:58<45:55:58,  7.76s/it]
 44%|████▍     | 16647/37963 [39:59:06<45:33:10,  7.69s/it]
 44%|████▍     | 16648/37963 [39:59:13<44:58:42,  7.60s/it]
 44%|████▍     | 16649/37963 [39:59:21<44:52:13,  7.58s/it]
 44%|████▍     | 16650/37963 [39:59:34<55:46:05,  9.42s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '0.9391', 'learning_rate': '1.245e-05', 'epoch': '0.4386'}

 44%|████▍     | 16650/37963 [39:59:34<55:46:05,  9.42s/it]
 44%|████▍     | 16651/37963 [39:59:42<52:25:27,  8.86s/it]
 44%|████▍     | 16652/37963 [39:59:49<50:00:35,  8.45s/it]
 44%|████▍     | 16653/37963 [39:59:57<48:29:23,  8.19s/it]
 44%|████▍     | 16654/37963 [40:00:04<47:21:40,  8.00s/it]
 44%|████▍     | 16655/37963 [40:00:12<46:33:05,  7.86s/it]
 44%|████▍     | 16656/37963 [40:00:19<45:51:24,  7.75s/it]
 44%|████▍     | 16657/37963 [40:00:34<57:06:17,  9.65s/it]
 44%|████▍     | 16658/37963 [40:00:41<53:31:17,  9.04s/it]
 44%|████▍     | 16659/37963 [40:00:49<50:46:21,  8.58s/it]
 44%|████▍     | 16660/37963 [40:01:03<60:09:12, 10.17s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '0.7547', 'learning_rate': '1.244e-05', 'epoch': '0.4388'}

 44%|████▍     | 16660/37963 [40:01:03<60:09:12, 10.17s/it]
 44%|████▍     | 16661/37963 [40:01:10<55:02:08,  9.30s/it]
 44%|████▍     | 16662/37963 [40:01:24<63:38:30, 10.76s/it]
 44%|████▍     | 16663/37963 [40:01:31<57:35:01,  9.73s/it]
 44%|████▍     | 16664/37963 [40:01:39<53:37:58,  9.07s/it]
 44%|████▍     | 16665/37963 [40:01:46<50:43:45,  8.57s/it]
 44%|████▍     | 16666/37963 [40:01:54<48:46:42,  8.25s/it]
 44%|████▍     | 16667/37963 [40:02:01<47:18:30,  8.00s/it]
 44%|████▍     | 16668/37963 [40:02:09<46:36:07,  7.88s/it]
 44%|████▍     | 16669/37963 [40:02:16<45:56:52,  7.77s/it]
 44%|████▍     | 16670/37963 [40:02:24<45:27:53,  7.69s/it]
                                                           
{'loss': '0.147', 'grad_norm': '1.673', 'learning_rate': '1.243e-05', 'epoch': '0.4391'}

 44%|████▍     | 16670/37963 [40:02:24<45:27:53,  7.69s/it]
 44%|████▍     | 16671/37963 [40:02:38<56:36:03,  9.57s/it]
 44%|████▍     | 16672/37963 [40:02:45<53:10:48,  8.99s/it]
 44%|████▍     | 16673/37963 [40:02:53<50:28:35,  8.54s/it]
 44%|████▍     | 16674/37963 [40:03:06<59:31:55, 10.07s/it]
 44%|████▍     | 16675/37963 [40:03:14<55:04:12,  9.31s/it]
 44%|████▍     | 16676/37963 [40:03:22<52:06:05,  8.81s/it]
 44%|████▍     | 16677/37963 [40:03:29<49:44:27,  8.41s/it]
 44%|████▍     | 16678/37963 [40:03:37<48:06:08,  8.14s/it]
 44%|████▍     | 16679/37963 [40:03:44<47:07:48,  7.97s/it]
 44%|████▍     | 16680/37963 [40:03:52<46:01:24,  7.78s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '2.79', 'learning_rate': '1.243e-05', 'epoch': '0.4394'}

 44%|████▍     | 16680/37963 [40:03:52<46:01:24,  7.78s/it]
 44%|████▍     | 16681/37963 [40:03:59<45:31:10,  7.70s/it]
 44%|████▍     | 16682/37963 [40:04:07<45:11:52,  7.65s/it]
 44%|████▍     | 16683/37963 [40:04:14<44:55:44,  7.60s/it]
 44%|████▍     | 16684/37963 [40:04:22<44:49:11,  7.58s/it]
 44%|████▍     | 16685/37963 [40:04:29<44:35:12,  7.54s/it]
 44%|████▍     | 16686/37963 [40:04:43<55:57:46,  9.47s/it]
 44%|████▍     | 16687/37963 [40:04:51<52:34:55,  8.90s/it]
 44%|████▍     | 16688/37963 [40:04:58<50:08:06,  8.48s/it]
 44%|████▍     | 16689/37963 [40:05:12<59:47:45, 10.12s/it]
 44%|████▍     | 16690/37963 [40:05:19<54:45:41,  9.27s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '3.458', 'learning_rate': '1.242e-05', 'epoch': '0.4396'}

 44%|████▍     | 16690/37963 [40:05:19<54:45:41,  9.27s/it]
 44%|████▍     | 16691/37963 [40:05:27<51:42:21,  8.75s/it]
 44%|████▍     | 16692/37963 [40:05:34<49:32:11,  8.38s/it]
 44%|████▍     | 16693/37963 [40:05:42<48:03:29,  8.13s/it]
 44%|████▍     | 16694/37963 [40:05:49<46:35:26,  7.89s/it]
 44%|████▍     | 16695/37963 [40:05:57<45:52:44,  7.77s/it]
 44%|████▍     | 16696/37963 [40:06:05<45:49:29,  7.76s/it]
 44%|████▍     | 16697/37963 [40:06:18<56:04:45,  9.49s/it]
 44%|████▍     | 16698/37963 [40:06:25<52:22:21,  8.87s/it]
 44%|████▍     | 16699/37963 [40:06:33<49:57:35,  8.46s/it]
 44%|████▍     | 16700/37963 [40:06:40<48:18:24,  8.18s/it]
                                                           
{'loss': '0.144', 'grad_norm': '3.698', 'learning_rate': '1.241e-05', 'epoch': '0.4399'}

 44%|████▍     | 16700/37963 [40:06:40<48:18:24,  8.18s/it]
 44%|████▍     | 16701/37963 [40:06:54<58:31:53,  9.91s/it]
 44%|████▍     | 16702/37963 [40:07:02<53:34:40,  9.07s/it]
 44%|████▍     | 16703/37963 [40:07:09<50:50:49,  8.61s/it]
 44%|████▍     | 16704/37963 [40:07:17<49:05:53,  8.31s/it]
 44%|████▍     | 16705/37963 [40:07:24<47:47:28,  8.09s/it]
 44%|████▍     | 16706/37963 [40:07:32<46:36:38,  7.89s/it]
 44%|████▍     | 16707/37963 [40:07:39<45:53:19,  7.77s/it]
 44%|████▍     | 16708/37963 [40:07:53<56:46:08,  9.62s/it]
 44%|████▍     | 16709/37963 [40:08:01<53:17:39,  9.03s/it]
 44%|████▍     | 16710/37963 [40:08:15<61:39:47, 10.45s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '1.756', 'learning_rate': '1.24e-05', 'epoch': '0.4402'}

 44%|████▍     | 16710/37963 [40:08:15<61:39:47, 10.45s/it]
 44%|████▍     | 16711/37963 [40:08:22<56:07:46,  9.51s/it]
 44%|████▍     | 16712/37963 [40:08:29<52:37:36,  8.92s/it]
 44%|████▍     | 16713/37963 [40:08:37<50:00:39,  8.47s/it]
 44%|████▍     | 16714/37963 [40:08:44<48:20:53,  8.19s/it]
 44%|████▍     | 16715/37963 [40:08:52<46:40:40,  7.91s/it]
 44%|████▍     | 16716/37963 [40:08:59<45:37:49,  7.73s/it]
 44%|████▍     | 16717/37963 [40:09:06<45:04:00,  7.64s/it]
 44%|████▍     | 16718/37963 [40:09:14<44:38:43,  7.57s/it]
 44%|████▍     | 16719/37963 [40:09:28<55:57:31,  9.48s/it]
 44%|████▍     | 16720/37963 [40:09:35<52:14:18,  8.85s/it]
                                                           
{'loss': '0.1623', 'grad_norm': '3.67', 'learning_rate': '1.239e-05', 'epoch': '0.4404'}

 44%|████▍     | 16720/37963 [40:09:35<52:14:18,  8.85s/it]
 44%|████▍     | 16721/37963 [40:09:43<49:53:41,  8.46s/it]
 44%|████▍     | 16722/37963 [40:09:50<48:17:47,  8.19s/it]
 44%|████▍     | 16723/37963 [40:09:58<46:50:38,  7.94s/it]
 44%|████▍     | 16724/37963 [40:10:05<45:50:11,  7.77s/it]
 44%|████▍     | 16725/37963 [40:10:13<45:32:34,  7.72s/it]
 44%|████▍     | 16726/37963 [40:10:20<45:35:14,  7.73s/it]
 44%|████▍     | 16727/37963 [40:10:28<45:12:46,  7.66s/it]
 44%|████▍     | 16728/37963 [40:10:42<56:26:24,  9.57s/it]
 44%|████▍     | 16729/37963 [40:10:49<53:04:25,  9.00s/it]
 44%|████▍     | 16730/37963 [40:10:57<50:23:36,  8.54s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.009', 'learning_rate': '1.238e-05', 'epoch': '0.4407'}

 44%|████▍     | 16730/37963 [40:10:57<50:23:36,  8.54s/it]
 44%|████▍     | 16731/37963 [40:11:04<48:38:57,  8.25s/it]
 44%|████▍     | 16732/37963 [40:11:12<47:20:08,  8.03s/it]
 44%|████▍     | 16733/37963 [40:11:20<46:30:32,  7.89s/it]
 44%|████▍     | 16734/37963 [40:11:27<45:54:26,  7.78s/it]
 44%|████▍     | 16735/37963 [40:11:41<56:50:09,  9.64s/it]
 44%|████▍     | 16736/37963 [40:11:49<53:01:34,  8.99s/it]
 44%|████▍     | 16737/37963 [40:11:56<50:32:12,  8.57s/it]
 44%|████▍     | 16738/37963 [40:12:04<48:47:50,  8.28s/it]
 44%|████▍     | 16739/37963 [40:12:11<47:34:55,  8.07s/it]
 44%|████▍     | 16740/37963 [40:12:25<57:42:11,  9.79s/it]
                                                           
{'loss': '0.1627', 'grad_norm': '0.6554', 'learning_rate': '1.238e-05', 'epoch': '0.441'}

 44%|████▍     | 16740/37963 [40:12:25<57:42:11,  9.79s/it]
 44%|████▍     | 16741/37963 [40:12:33<54:15:17,  9.20s/it]
 44%|████▍     | 16742/37963 [40:12:40<51:09:16,  8.68s/it]
 44%|████▍     | 16743/37963 [40:12:48<49:04:32,  8.33s/it]
 44%|████▍     | 16744/37963 [40:12:55<47:29:15,  8.06s/it]
 44%|████▍     | 16745/37963 [40:13:09<57:04:37,  9.68s/it]
 44%|████▍     | 16746/37963 [40:13:16<52:32:47,  8.92s/it]
 44%|████▍     | 16747/37963 [40:13:23<49:50:44,  8.46s/it]
 44%|████▍     | 16748/37963 [40:13:31<48:11:07,  8.18s/it]
 44%|████▍     | 16749/37963 [40:13:45<58:25:58,  9.92s/it]
 44%|████▍     | 16750/37963 [40:13:52<54:25:50,  9.24s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '1.478', 'learning_rate': '1.237e-05', 'epoch': '0.4412'}

 44%|████▍     | 16750/37963 [40:13:52<54:25:50,  9.24s/it]
 44%|████▍     | 16751/37963 [40:14:00<51:35:24,  8.76s/it]
 44%|████▍     | 16752/37963 [40:14:08<49:22:12,  8.38s/it]
 44%|████▍     | 16753/37963 [40:14:15<47:47:05,  8.11s/it]
 44%|████▍     | 16754/37963 [40:14:23<47:12:57,  8.01s/it]
 44%|████▍     | 16755/37963 [40:14:30<46:13:59,  7.85s/it]
 44%|████▍     | 16756/37963 [40:14:38<45:47:13,  7.77s/it]
 44%|████▍     | 16757/37963 [40:14:45<45:00:59,  7.64s/it]
 44%|████▍     | 16758/37963 [40:14:53<44:52:17,  7.62s/it]
 44%|████▍     | 16759/37963 [40:15:00<44:47:09,  7.60s/it]
 44%|████▍     | 16760/37963 [40:15:14<55:59:18,  9.51s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '1.542', 'learning_rate': '1.236e-05', 'epoch': '0.4415'}

 44%|████▍     | 16760/37963 [40:15:14<55:59:18,  9.51s/it]
 44%|████▍     | 16761/37963 [40:15:22<52:27:31,  8.91s/it]
 44%|████▍     | 16762/37963 [40:15:36<61:01:07, 10.36s/it]
 44%|████▍     | 16763/37963 [40:15:43<56:14:12,  9.55s/it]
 44%|████▍     | 16764/37963 [40:15:51<52:38:29,  8.94s/it]
 44%|████▍     | 16765/37963 [40:15:58<50:03:37,  8.50s/it]
 44%|████▍     | 16766/37963 [40:16:06<48:21:45,  8.21s/it]
 44%|████▍     | 16767/37963 [40:16:13<47:02:35,  7.99s/it]
 44%|████▍     | 16768/37963 [40:16:27<57:32:42,  9.77s/it]
 44%|████▍     | 16769/37963 [40:16:35<53:41:15,  9.12s/it]
 44%|████▍     | 16770/37963 [40:16:42<51:05:57,  8.68s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.747', 'learning_rate': '1.235e-05', 'epoch': '0.4417'}

 44%|████▍     | 16770/37963 [40:16:42<51:05:57,  8.68s/it]
 44%|████▍     | 16771/37963 [40:16:50<48:53:43,  8.31s/it]
 44%|████▍     | 16772/37963 [40:16:58<47:48:59,  8.12s/it]
 44%|████▍     | 16773/37963 [40:17:05<46:48:17,  7.95s/it]
 44%|████▍     | 16774/37963 [40:17:13<46:16:03,  7.86s/it]
 44%|████▍     | 16775/37963 [40:17:20<45:39:47,  7.76s/it]
 44%|████▍     | 16776/37963 [40:17:34<56:50:06,  9.66s/it]
 44%|████▍     | 16777/37963 [40:17:42<53:10:57,  9.04s/it]
 44%|████▍     | 16778/37963 [40:17:50<50:28:58,  8.58s/it]
 44%|████▍     | 16779/37963 [40:17:57<48:32:53,  8.25s/it]
 44%|████▍     | 16780/37963 [40:18:04<46:56:22,  7.98s/it]
                                                           
{'loss': '0.1606', 'grad_norm': '2.249', 'learning_rate': '1.234e-05', 'epoch': '0.442'}

 44%|████▍     | 16780/37963 [40:18:04<46:56:22,  7.98s/it]
 44%|████▍     | 16781/37963 [40:18:12<46:15:37,  7.86s/it]
 44%|████▍     | 16782/37963 [40:18:19<45:40:11,  7.76s/it]
 44%|████▍     | 16783/37963 [40:18:34<56:48:32,  9.66s/it]
 44%|████▍     | 16784/37963 [40:18:41<53:06:16,  9.03s/it]
 44%|████▍     | 16785/37963 [40:18:49<50:31:46,  8.59s/it]
 44%|████▍     | 16786/37963 [40:18:56<48:31:18,  8.25s/it]
 44%|████▍     | 16787/37963 [40:19:03<46:53:53,  7.97s/it]
 44%|████▍     | 16788/37963 [40:19:17<56:33:47,  9.62s/it]
 44%|████▍     | 16789/37963 [40:19:25<53:05:28,  9.03s/it]
 44%|████▍     | 16790/37963 [40:19:39<62:21:27, 10.60s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.477', 'learning_rate': '1.233e-05', 'epoch': '0.4423'}

 44%|████▍     | 16790/37963 [40:19:39<62:21:27, 10.60s/it]
 44%|████▍     | 16791/37963 [40:19:46<57:05:37,  9.71s/it]
 44%|████▍     | 16792/37963 [40:19:54<53:25:25,  9.08s/it]
 44%|████▍     | 16793/37963 [40:20:02<50:52:13,  8.65s/it]
 44%|████▍     | 16794/37963 [40:20:09<48:51:19,  8.31s/it]
 44%|████▍     | 16795/37963 [40:20:17<47:26:38,  8.07s/it]
 44%|████▍     | 16796/37963 [40:20:31<57:36:24,  9.80s/it]
 44%|████▍     | 16797/37963 [40:20:38<53:51:02,  9.16s/it]
 44%|████▍     | 16798/37963 [40:20:46<51:05:50,  8.69s/it]
 44%|████▍     | 16799/37963 [40:20:53<49:10:09,  8.36s/it]
 44%|████▍     | 16800/37963 [40:21:01<47:39:56,  8.11s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.761', 'learning_rate': '1.233e-05', 'epoch': '0.4425'}

 44%|████▍     | 16800/37963 [40:21:01<47:39:56,  8.11s/it]
 44%|████▍     | 16801/37963 [40:21:08<46:39:19,  7.94s/it]
 44%|████▍     | 16802/37963 [40:21:16<46:13:24,  7.86s/it]
 44%|████▍     | 16803/37963 [40:21:24<45:49:22,  7.80s/it]
 44%|████▍     | 16804/37963 [40:21:31<45:16:47,  7.70s/it]
 44%|████▍     | 16805/37963 [40:21:39<44:46:11,  7.62s/it]
 44%|████▍     | 16806/37963 [40:21:46<44:37:52,  7.59s/it]
 44%|████▍     | 16807/37963 [40:21:54<44:30:49,  7.57s/it]
 44%|████▍     | 16808/37963 [40:22:07<54:49:18,  9.33s/it]
 44%|████▍     | 16809/37963 [40:22:15<51:47:00,  8.81s/it]
 44%|████▍     | 16810/37963 [40:22:22<49:37:54,  8.45s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.923', 'learning_rate': '1.232e-05', 'epoch': '0.4428'}

 44%|████▍     | 16810/37963 [40:22:22<49:37:54,  8.45s/it]
 44%|████▍     | 16811/37963 [40:22:30<47:59:07,  8.17s/it]
 44%|████▍     | 16812/37963 [40:22:37<46:28:35,  7.91s/it]
 44%|████▍     | 16813/37963 [40:22:51<57:07:42,  9.72s/it]
 44%|████▍     | 16814/37963 [40:22:59<53:02:33,  9.03s/it]
 44%|████▍     | 16815/37963 [40:23:06<50:17:30,  8.56s/it]
 44%|████▍     | 16816/37963 [40:23:20<59:45:45, 10.17s/it]
 44%|████▍     | 16817/37963 [40:23:28<55:05:13,  9.38s/it]
 44%|████▍     | 16818/37963 [40:23:35<51:33:16,  8.78s/it]
 44%|████▍     | 16819/37963 [40:23:42<49:12:18,  8.38s/it]
 44%|████▍     | 16820/37963 [40:23:50<47:26:17,  8.08s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '2.06', 'learning_rate': '1.231e-05', 'epoch': '0.4431'}

 44%|████▍     | 16820/37963 [40:23:50<47:26:17,  8.08s/it]
 44%|████▍     | 16821/37963 [40:23:57<46:35:13,  7.93s/it]
 44%|████▍     | 16822/37963 [40:24:05<45:59:59,  7.83s/it]
 44%|████▍     | 16823/37963 [40:24:19<56:42:41,  9.66s/it]
 44%|████▍     | 16824/37963 [40:24:26<52:41:57,  8.97s/it]
 44%|████▍     | 16825/37963 [40:24:34<49:46:52,  8.48s/it]
 44%|████▍     | 16826/37963 [40:24:41<48:00:56,  8.18s/it]
 44%|████▍     | 16827/37963 [40:24:48<46:35:42,  7.94s/it]
 44%|████▍     | 16828/37963 [40:24:56<45:54:20,  7.82s/it]
 44%|████▍     | 16829/37963 [40:25:10<56:34:53,  9.64s/it]
 44%|████▍     | 16830/37963 [40:25:17<53:03:24,  9.04s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '0.9308', 'learning_rate': '1.23e-05', 'epoch': '0.4433'}

 44%|████▍     | 16830/37963 [40:25:17<53:03:24,  9.04s/it]
 44%|████▍     | 16831/37963 [40:25:25<50:24:42,  8.59s/it]
 44%|████▍     | 16832/37963 [40:25:33<48:58:54,  8.34s/it]
 44%|████▍     | 16833/37963 [40:25:40<47:35:40,  8.11s/it]
 44%|████▍     | 16834/37963 [40:25:48<46:42:16,  7.96s/it]
 44%|████▍     | 16835/37963 [40:25:55<46:01:19,  7.84s/it]
 44%|████▍     | 16836/37963 [40:26:03<45:38:29,  7.78s/it]
 44%|████▍     | 16837/37963 [40:26:11<45:23:30,  7.74s/it]
 44%|████▍     | 16838/37963 [40:26:25<56:51:14,  9.69s/it]
 44%|████▍     | 16839/37963 [40:26:33<53:14:12,  9.07s/it]
 44%|████▍     | 16840/37963 [40:26:40<50:17:47,  8.57s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '2.579', 'learning_rate': '1.229e-05', 'epoch': '0.4436'}

 44%|████▍     | 16840/37963 [40:26:40<50:17:47,  8.57s/it]
 44%|████▍     | 16841/37963 [40:26:48<48:24:43,  8.25s/it]
 44%|████▍     | 16842/37963 [40:27:01<57:58:39,  9.88s/it]
 44%|████▍     | 16843/37963 [40:27:15<65:04:01, 11.09s/it]
 44%|████▍     | 16844/37963 [40:27:23<58:46:30, 10.02s/it]
 44%|████▍     | 16845/37963 [40:27:30<54:20:49,  9.26s/it]
 44%|████▍     | 16846/37963 [40:27:38<51:19:42,  8.75s/it]
 44%|████▍     | 16847/37963 [40:27:45<49:04:47,  8.37s/it]
 44%|████▍     | 16848/37963 [40:27:53<47:28:35,  8.09s/it]
 44%|████▍     | 16849/37963 [40:28:00<46:23:30,  7.91s/it]
 44%|████▍     | 16850/37963 [40:28:07<45:22:24,  7.74s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '0.8827', 'learning_rate': '1.228e-05', 'epoch': '0.4439'}

 44%|████▍     | 16850/37963 [40:28:07<45:22:24,  7.74s/it]
 44%|████▍     | 16851/37963 [40:28:15<44:12:57,  7.54s/it]
 44%|████▍     | 16852/37963 [40:28:22<44:07:35,  7.52s/it]
 44%|████▍     | 16853/37963 [40:28:29<43:45:44,  7.46s/it]
 44%|████▍     | 16854/37963 [40:28:37<43:36:43,  7.44s/it]
 44%|████▍     | 16855/37963 [40:28:44<43:08:02,  7.36s/it]
 44%|████▍     | 16856/37963 [40:28:51<43:29:23,  7.42s/it]
 44%|████▍     | 16857/37963 [40:28:59<43:46:28,  7.47s/it]
 44%|████▍     | 16858/37963 [40:29:06<43:42:25,  7.46s/it]
 44%|████▍     | 16859/37963 [40:29:14<44:04:29,  7.52s/it]
 44%|████▍     | 16860/37963 [40:29:28<55:41:17,  9.50s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '2.115', 'learning_rate': '1.228e-05', 'epoch': '0.4441'}

 44%|████▍     | 16860/37963 [40:29:28<55:41:17,  9.50s/it]
 44%|████▍     | 16861/37963 [40:29:36<51:58:40,  8.87s/it]
 44%|████▍     | 16862/37963 [40:29:43<49:48:32,  8.50s/it]
 44%|████▍     | 16863/37963 [40:29:51<48:09:51,  8.22s/it]
 44%|████▍     | 16864/37963 [40:30:05<57:44:10,  9.85s/it]
 44%|████▍     | 16865/37963 [40:30:18<64:41:58, 11.04s/it]
 44%|████▍     | 16866/37963 [40:30:26<58:24:49,  9.97s/it]
 44%|████▍     | 16867/37963 [40:30:39<64:57:21, 11.08s/it]
 44%|████▍     | 16868/37963 [40:30:47<58:48:56, 10.04s/it]
 44%|████▍     | 16869/37963 [40:30:55<54:18:43,  9.27s/it]
 44%|████▍     | 16870/37963 [40:31:02<51:01:34,  8.71s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '3.668', 'learning_rate': '1.227e-05', 'epoch': '0.4444'}

 44%|████▍     | 16870/37963 [40:31:02<51:01:34,  8.71s/it]
 44%|████▍     | 16871/37963 [40:31:09<48:58:53,  8.36s/it]
 44%|████▍     | 16872/37963 [40:31:17<47:29:59,  8.11s/it]
 44%|████▍     | 16873/37963 [40:31:25<46:29:13,  7.94s/it]
 44%|████▍     | 16874/37963 [40:31:32<45:46:22,  7.81s/it]
 44%|████▍     | 16875/37963 [40:31:40<45:19:55,  7.74s/it]
 44%|████▍     | 16876/37963 [40:31:47<44:40:10,  7.63s/it]
 44%|████▍     | 16877/37963 [40:32:01<55:25:30,  9.46s/it]
 44%|████▍     | 16878/37963 [40:32:08<51:50:27,  8.85s/it]
 44%|████▍     | 16879/37963 [40:32:16<49:29:20,  8.45s/it]
 44%|████▍     | 16880/37963 [40:32:23<47:18:35,  8.08s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.397', 'learning_rate': '1.226e-05', 'epoch': '0.4446'}

 44%|████▍     | 16880/37963 [40:32:23<47:18:35,  8.08s/it]
 44%|████▍     | 16881/37963 [40:32:31<46:27:54,  7.93s/it]
 44%|████▍     | 16882/37963 [40:32:38<45:26:20,  7.76s/it]
 44%|████▍     | 16883/37963 [40:32:45<45:06:04,  7.70s/it]
 44%|████▍     | 16884/37963 [40:32:53<44:55:01,  7.67s/it]
 44%|████▍     | 16885/37963 [40:33:01<44:39:40,  7.63s/it]
 44%|████▍     | 16886/37963 [40:33:14<55:32:56,  9.49s/it]
 44%|████▍     | 16887/37963 [40:33:22<52:12:49,  8.92s/it]
 44%|████▍     | 16888/37963 [40:33:36<60:59:51, 10.42s/it]
 44%|████▍     | 16889/37963 [40:33:43<55:57:47,  9.56s/it]
 44%|████▍     | 16890/37963 [40:33:51<52:09:34,  8.91s/it]
                                                           
{'loss': '0.1505', 'grad_norm': '2.702', 'learning_rate': '1.225e-05', 'epoch': '0.4449'}

 44%|████▍     | 16890/37963 [40:33:51<52:09:34,  8.91s/it]
 44%|████▍     | 16891/37963 [40:33:58<49:39:12,  8.48s/it]
 44%|████▍     | 16892/37963 [40:34:12<59:36:45, 10.18s/it]
 44%|████▍     | 16893/37963 [40:34:20<54:57:06,  9.39s/it]
 45%|████▍     | 16894/37963 [40:34:28<51:42:48,  8.84s/it]
 45%|████▍     | 16895/37963 [40:34:35<49:09:21,  8.40s/it]
 45%|████▍     | 16896/37963 [40:34:43<47:41:07,  8.15s/it]
 45%|████▍     | 16897/37963 [40:34:50<46:31:33,  7.95s/it]
 45%|████▍     | 16898/37963 [40:34:58<45:49:25,  7.83s/it]
 45%|████▍     | 16899/37963 [40:35:05<45:21:47,  7.75s/it]
 45%|████▍     | 16900/37963 [40:35:13<44:43:39,  7.64s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '0.9987', 'learning_rate': '1.224e-05', 'epoch': '0.4452'}

 45%|████▍     | 16900/37963 [40:35:13<44:43:39,  7.64s/it]
 45%|████▍     | 16901/37963 [40:35:20<44:33:35,  7.62s/it]
 45%|████▍     | 16902/37963 [40:35:28<44:25:33,  7.59s/it]
 45%|████▍     | 16903/37963 [40:35:35<44:09:09,  7.55s/it]
 45%|████▍     | 16904/37963 [40:35:43<44:09:40,  7.55s/it]
 45%|████▍     | 16905/37963 [40:35:57<55:22:30,  9.47s/it]
 45%|████▍     | 16906/37963 [40:36:04<52:06:38,  8.91s/it]
 45%|████▍     | 16907/37963 [40:36:11<49:21:08,  8.44s/it]
 45%|████▍     | 16908/37963 [40:36:19<47:38:04,  8.14s/it]
 45%|████▍     | 16909/37963 [40:36:33<57:41:34,  9.86s/it]
 45%|████▍     | 16910/37963 [40:36:40<53:17:40,  9.11s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '1.823', 'learning_rate': '1.223e-05', 'epoch': '0.4454'}

 45%|████▍     | 16910/37963 [40:36:40<53:17:40,  9.11s/it]
 45%|████▍     | 16911/37963 [40:36:48<50:28:57,  8.63s/it]
 45%|████▍     | 16912/37963 [40:36:55<48:33:40,  8.30s/it]
 45%|████▍     | 16913/37963 [40:37:03<47:05:29,  8.05s/it]
 45%|████▍     | 16914/37963 [40:37:10<46:01:51,  7.87s/it]
 45%|████▍     | 16915/37963 [40:37:18<45:48:54,  7.84s/it]
 45%|████▍     | 16916/37963 [40:37:33<57:46:47,  9.88s/it]
 45%|████▍     | 16917/37963 [40:37:40<53:55:37,  9.22s/it]
 45%|████▍     | 16918/37963 [40:37:54<62:15:52, 10.65s/it]
 45%|████▍     | 16919/37963 [40:38:02<57:02:35,  9.76s/it]
 45%|████▍     | 16920/37963 [40:38:09<53:01:52,  9.07s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '1.176', 'learning_rate': '1.223e-05', 'epoch': '0.4457'}

 45%|████▍     | 16920/37963 [40:38:09<53:01:52,  9.07s/it]
 45%|████▍     | 16921/37963 [40:38:17<50:20:17,  8.61s/it]
 45%|████▍     | 16922/37963 [40:38:25<48:49:01,  8.35s/it]
 45%|████▍     | 16923/37963 [40:38:32<47:43:43,  8.17s/it]
 45%|████▍     | 16924/37963 [40:38:40<46:30:41,  7.96s/it]
 45%|████▍     | 16925/37963 [40:38:47<45:45:37,  7.83s/it]
 45%|████▍     | 16926/37963 [40:38:55<45:15:30,  7.74s/it]
 45%|████▍     | 16927/37963 [40:39:02<44:55:14,  7.69s/it]
 45%|████▍     | 16928/37963 [40:39:16<55:41:57,  9.53s/it]
 45%|████▍     | 16929/37963 [40:39:24<52:14:08,  8.94s/it]
 45%|████▍     | 16930/37963 [40:39:38<61:09:24, 10.47s/it]
                                                           
{'loss': '0.142', 'grad_norm': '2.014', 'learning_rate': '1.222e-05', 'epoch': '0.446'}

 45%|████▍     | 16930/37963 [40:39:38<61:09:24, 10.47s/it]
 45%|████▍     | 16931/37963 [40:39:45<55:51:54,  9.56s/it]
 45%|████▍     | 16932/37963 [40:39:53<52:22:05,  8.96s/it]
 45%|████▍     | 16933/37963 [40:40:00<49:30:49,  8.48s/it]
 45%|████▍     | 16934/37963 [40:40:14<59:21:35, 10.16s/it]
 45%|████▍     | 16935/37963 [40:40:22<54:43:21,  9.37s/it]
 45%|████▍     | 16936/37963 [40:40:29<51:33:33,  8.83s/it]
 45%|████▍     | 16937/37963 [40:40:43<60:42:17, 10.39s/it]
 45%|████▍     | 16938/37963 [40:40:51<55:42:53,  9.54s/it]
 45%|████▍     | 16939/37963 [40:40:58<51:49:26,  8.87s/it]
 45%|████▍     | 16940/37963 [40:41:06<49:26:50,  8.47s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '2.971', 'learning_rate': '1.221e-05', 'epoch': '0.4462'}

 45%|████▍     | 16940/37963 [40:41:06<49:26:50,  8.47s/it]
 45%|████▍     | 16941/37963 [40:41:13<47:44:38,  8.18s/it]
 45%|████▍     | 16942/37963 [40:41:21<46:32:09,  7.97s/it]
 45%|████▍     | 16943/37963 [40:41:28<45:51:45,  7.85s/it]
 45%|████▍     | 16944/37963 [40:41:36<45:14:36,  7.75s/it]
 45%|████▍     | 16945/37963 [40:41:43<44:52:17,  7.69s/it]
 45%|████▍     | 16946/37963 [40:41:51<44:45:45,  7.67s/it]
 45%|████▍     | 16947/37963 [40:41:59<44:30:15,  7.62s/it]
 45%|████▍     | 16948/37963 [40:42:06<44:13:03,  7.57s/it]
 45%|████▍     | 16949/37963 [40:42:14<44:26:10,  7.61s/it]
 45%|████▍     | 16950/37963 [40:42:21<44:15:05,  7.58s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '4.444', 'learning_rate': '1.22e-05', 'epoch': '0.4465'}

 45%|████▍     | 16950/37963 [40:42:21<44:15:05,  7.58s/it]
 45%|████▍     | 16951/37963 [40:42:29<44:12:26,  7.57s/it]
 45%|████▍     | 16952/37963 [40:42:36<44:04:59,  7.55s/it]
 45%|████▍     | 16953/37963 [40:42:44<44:01:02,  7.54s/it]
 45%|████▍     | 16954/37963 [40:43:04<66:35:03, 11.41s/it]
 45%|████▍     | 16955/37963 [40:43:12<59:29:00, 10.19s/it]
 45%|████▍     | 16956/37963 [40:43:19<54:50:50,  9.40s/it]
 45%|████▍     | 16957/37963 [40:43:27<51:54:36,  8.90s/it]
 45%|████▍     | 16958/37963 [40:43:34<49:13:27,  8.44s/it]
 45%|████▍     | 16959/37963 [40:43:42<47:36:10,  8.16s/it]
 45%|████▍     | 16960/37963 [40:43:49<46:43:04,  8.01s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.578', 'learning_rate': '1.219e-05', 'epoch': '0.4468'}

 45%|████▍     | 16960/37963 [40:43:49<46:43:04,  8.01s/it]
 45%|████▍     | 16961/37963 [40:43:57<46:00:28,  7.89s/it]
 45%|████▍     | 16962/37963 [40:44:05<45:19:01,  7.77s/it]
 45%|████▍     | 16963/37963 [40:44:18<55:55:36,  9.59s/it]
 45%|████▍     | 16964/37963 [40:44:26<52:01:40,  8.92s/it]
 45%|████▍     | 16965/37963 [40:44:33<49:19:33,  8.46s/it]
 45%|████▍     | 16966/37963 [40:44:41<47:41:21,  8.18s/it]
 45%|████▍     | 16967/37963 [40:44:55<57:42:09,  9.89s/it]
 45%|████▍     | 16968/37963 [40:45:02<53:39:17,  9.20s/it]
 45%|████▍     | 16969/37963 [40:45:10<50:48:19,  8.71s/it]
 45%|████▍     | 16970/37963 [40:45:17<48:59:48,  8.40s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '1.243', 'learning_rate': '1.219e-05', 'epoch': '0.447'}

 45%|████▍     | 16970/37963 [40:45:17<48:59:48,  8.40s/it]
 45%|████▍     | 16971/37963 [40:45:25<47:19:22,  8.12s/it]
 45%|████▍     | 16972/37963 [40:45:32<46:08:27,  7.91s/it]
 45%|████▍     | 16973/37963 [40:45:40<45:27:44,  7.80s/it]
 45%|████▍     | 16974/37963 [40:45:53<55:21:09,  9.49s/it]
 45%|████▍     | 16975/37963 [40:46:01<51:33:54,  8.84s/it]
 45%|████▍     | 16976/37963 [40:46:08<49:14:57,  8.45s/it]
 45%|████▍     | 16977/37963 [40:46:16<47:44:58,  8.19s/it]
 45%|████▍     | 16978/37963 [40:46:23<46:34:35,  7.99s/it]
 45%|████▍     | 16979/37963 [40:46:31<45:34:18,  7.82s/it]
 45%|████▍     | 16980/37963 [40:46:38<45:18:13,  7.77s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.246', 'learning_rate': '1.218e-05', 'epoch': '0.4473'}

 45%|████▍     | 16980/37963 [40:46:38<45:18:13,  7.77s/it]
 45%|████▍     | 16981/37963 [40:46:46<45:05:07,  7.74s/it]
 45%|████▍     | 16982/37963 [40:47:00<56:02:33,  9.62s/it]
 45%|████▍     | 16983/37963 [40:47:14<63:53:06, 10.96s/it]
 45%|████▍     | 16984/37963 [40:47:28<69:03:19, 11.85s/it]
 45%|████▍     | 16985/37963 [40:47:36<61:40:57, 10.59s/it]
 45%|████▍     | 16986/37963 [40:47:43<56:27:52,  9.69s/it]
 45%|████▍     | 16987/37963 [40:47:51<52:26:37,  9.00s/it]
 45%|████▍     | 16988/37963 [40:47:58<50:05:01,  8.60s/it]
 45%|████▍     | 16989/37963 [40:48:06<48:14:43,  8.28s/it]
 45%|████▍     | 16990/37963 [40:48:13<47:02:00,  8.07s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '2.97', 'learning_rate': '1.217e-05', 'epoch': '0.4475'}

 45%|████▍     | 16990/37963 [40:48:13<47:02:00,  8.07s/it]
 45%|████▍     | 16991/37963 [40:48:21<45:48:44,  7.86s/it]
 45%|████▍     | 16992/37963 [40:48:28<45:14:12,  7.77s/it]
 45%|████▍     | 16993/37963 [40:48:36<44:53:28,  7.71s/it]
 45%|████▍     | 16994/37963 [40:48:43<44:15:01,  7.60s/it]
 45%|████▍     | 16995/37963 [40:48:51<44:08:06,  7.58s/it]
 45%|████▍     | 16996/37963 [40:48:58<44:05:56,  7.57s/it]
 45%|████▍     | 16997/37963 [40:49:06<43:33:40,  7.48s/it]
 45%|████▍     | 16998/37963 [40:49:13<43:51:08,  7.53s/it]
 45%|████▍     | 16999/37963 [40:49:21<44:02:24,  7.56s/it]
 45%|████▍     | 17000/37963 [40:49:28<43:56:09,  7.55s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '0.8408', 'learning_rate': '1.216e-05', 'epoch': '0.4478'}

 45%|████▍     | 17000/37963 [40:49:28<43:56:09,  7.55s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 45%|████▍     | 17001/37963 [40:50:32<142:26:52, 24.46s/it]
 45%|████▍     | 17002/37963 [40:50:46<124:24:42, 21.37s/it]
 45%|████▍     | 17003/37963 [40:50:54<99:56:51, 17.17s/it] 
 45%|████▍     | 17004/37963 [40:51:01<83:09:13, 14.28s/it]
 45%|████▍     | 17005/37963 [40:51:09<71:17:10, 12.24s/it]
 45%|████▍     | 17006/37963 [40:51:16<63:08:05, 10.85s/it]
 45%|████▍     | 17007/37963 [40:51:24<57:16:55,  9.84s/it]
 45%|████▍     | 17008/37963 [40:51:31<53:01:25,  9.11s/it]
 45%|████▍     | 17009/37963 [40:51:39<50:29:49,  8.68s/it]
 45%|████▍     | 17010/37963 [40:51:47<48:32:29,  8.34s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '2.196', 'learning_rate': '1.215e-05', 'epoch': '0.4481'}

 45%|████▍     | 17010/37963 [40:51:47<48:32:29,  8.34s/it]
 45%|████▍     | 17011/37963 [40:51:54<46:57:47,  8.07s/it]
 45%|████▍     | 17012/37963 [40:52:08<57:21:48,  9.86s/it]
 45%|████▍     | 17013/37963 [40:52:16<53:28:28,  9.19s/it]
 45%|████▍     | 17014/37963 [40:52:30<62:15:14, 10.70s/it]
 45%|████▍     | 17015/37963 [40:52:37<56:51:59,  9.77s/it]
 45%|████▍     | 17016/37963 [40:52:45<52:52:00,  9.09s/it]
 45%|████▍     | 17017/37963 [40:52:52<49:59:57,  8.59s/it]
 45%|████▍     | 17018/37963 [40:53:00<48:12:30,  8.29s/it]
 45%|████▍     | 17019/37963 [40:53:07<46:38:22,  8.02s/it]
 45%|████▍     | 17020/37963 [40:53:15<45:41:36,  7.85s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.473', 'learning_rate': '1.214e-05', 'epoch': '0.4483'}

 45%|████▍     | 17020/37963 [40:53:15<45:41:36,  7.85s/it]
 45%|████▍     | 17021/37963 [40:53:22<45:04:36,  7.75s/it]
 45%|████▍     | 17022/37963 [40:53:30<44:49:42,  7.71s/it]
 45%|████▍     | 17023/37963 [40:53:44<55:41:14,  9.57s/it]
 45%|████▍     | 17024/37963 [40:53:51<52:06:45,  8.96s/it]
 45%|████▍     | 17025/37963 [40:53:59<49:19:06,  8.48s/it]
 45%|████▍     | 17026/37963 [40:54:06<47:40:47,  8.20s/it]
 45%|████▍     | 17027/37963 [40:54:14<46:31:31,  8.00s/it]
 45%|████▍     | 17028/37963 [40:54:21<45:37:21,  7.85s/it]
 45%|████▍     | 17029/37963 [40:54:35<56:09:38,  9.66s/it]
 45%|████▍     | 17030/37963 [40:54:43<52:08:38,  8.97s/it]
                                                           
{'loss': '0.158', 'grad_norm': '2.81', 'learning_rate': '1.214e-05', 'epoch': '0.4486'}

 45%|████▍     | 17030/37963 [40:54:43<52:08:38,  8.97s/it]
 45%|████▍     | 17031/37963 [40:54:50<49:36:46,  8.53s/it]
 45%|████▍     | 17032/37963 [40:55:10<69:48:07, 12.01s/it]
 45%|████▍     | 17033/37963 [40:55:18<62:16:05, 10.71s/it]
 45%|████▍     | 17034/37963 [40:55:26<56:50:10,  9.78s/it]
 45%|████▍     | 17035/37963 [40:55:33<52:50:42,  9.09s/it]
 45%|████▍     | 17036/37963 [40:55:40<49:39:15,  8.54s/it]
 45%|████▍     | 17037/37963 [40:55:48<48:04:16,  8.27s/it]
 45%|████▍     | 17038/37963 [40:55:55<46:54:22,  8.07s/it]
 45%|████▍     | 17039/37963 [40:56:03<45:45:15,  7.87s/it]
 45%|████▍     | 17040/37963 [40:56:10<44:57:58,  7.74s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '0.9917', 'learning_rate': '1.213e-05', 'epoch': '0.4489'}

 45%|████▍     | 17040/37963 [40:56:10<44:57:58,  7.74s/it]
 45%|████▍     | 17041/37963 [40:56:18<44:35:04,  7.67s/it]
 45%|████▍     | 17042/37963 [40:56:26<44:37:08,  7.68s/it]
 45%|████▍     | 17043/37963 [40:56:33<43:43:29,  7.52s/it]
 45%|████▍     | 17044/37963 [40:56:40<43:59:30,  7.57s/it]
 45%|████▍     | 17045/37963 [40:56:48<43:49:11,  7.54s/it]
 45%|████▍     | 17046/37963 [40:56:55<43:35:09,  7.50s/it]
 45%|████▍     | 17047/37963 [40:57:03<43:40:11,  7.52s/it]
 45%|████▍     | 17048/37963 [40:57:17<54:55:42,  9.45s/it]
 45%|████▍     | 17049/37963 [40:57:31<62:23:41, 10.74s/it]
 45%|████▍     | 17050/37963 [40:57:38<56:54:16,  9.80s/it]
                                                           
{'loss': '0.1576', 'grad_norm': '1.232', 'learning_rate': '1.212e-05', 'epoch': '0.4491'}

 45%|████▍     | 17050/37963 [40:57:38<56:54:16,  9.80s/it]
 45%|████▍     | 17051/37963 [40:57:46<52:52:45,  9.10s/it]
 45%|████▍     | 17052/37963 [40:57:53<50:08:42,  8.63s/it]
 45%|████▍     | 17053/37963 [40:58:01<48:01:14,  8.27s/it]
 45%|████▍     | 17054/37963 [40:58:08<46:22:02,  7.98s/it]
 45%|████▍     | 17055/37963 [40:58:15<45:07:28,  7.77s/it]
 45%|████▍     | 17056/37963 [40:58:23<44:46:03,  7.71s/it]
 45%|████▍     | 17057/37963 [40:58:30<44:32:43,  7.67s/it]
 45%|████▍     | 17058/37963 [40:58:38<43:59:50,  7.58s/it]
 45%|████▍     | 17059/37963 [40:58:45<43:33:22,  7.50s/it]
 45%|████▍     | 17060/37963 [40:58:53<43:35:05,  7.51s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '4.149', 'learning_rate': '1.211e-05', 'epoch': '0.4494'}

 45%|████▍     | 17060/37963 [40:58:53<43:35:05,  7.51s/it]
 45%|████▍     | 17061/37963 [40:59:00<43:54:41,  7.56s/it]
 45%|████▍     | 17062/37963 [40:59:14<55:00:05,  9.47s/it]
 45%|████▍     | 17063/37963 [40:59:22<51:21:41,  8.85s/it]
 45%|████▍     | 17064/37963 [40:59:29<49:07:42,  8.46s/it]
 45%|████▍     | 17065/37963 [40:59:36<47:13:41,  8.14s/it]
 45%|████▍     | 17066/37963 [40:59:44<46:31:20,  8.01s/it]
 45%|████▍     | 17067/37963 [40:59:58<57:02:34,  9.83s/it]
 45%|████▍     | 17068/37963 [41:00:06<53:04:07,  9.14s/it]
 45%|████▍     | 17069/37963 [41:00:13<50:17:24,  8.66s/it]
 45%|████▍     | 17070/37963 [41:00:21<48:28:35,  8.35s/it]
                                                           
{'loss': '0.147', 'grad_norm': '1.143', 'learning_rate': '1.21e-05', 'epoch': '0.4496'}

 45%|████▍     | 17070/37963 [41:00:21<48:28:35,  8.35s/it]
 45%|████▍     | 17071/37963 [41:00:29<47:08:31,  8.12s/it]
 45%|████▍     | 17072/37963 [41:00:36<46:09:06,  7.95s/it]
 45%|████▍     | 17073/37963 [41:00:44<45:30:45,  7.84s/it]
 45%|████▍     | 17074/37963 [41:00:51<44:57:11,  7.75s/it]
 45%|████▍     | 17075/37963 [41:01:05<55:46:06,  9.61s/it]
 45%|████▍     | 17076/37963 [41:01:19<63:25:39, 10.93s/it]
 45%|████▍     | 17077/37963 [41:01:27<57:31:22,  9.91s/it]
 45%|████▍     | 17078/37963 [41:01:34<53:19:54,  9.19s/it]
 45%|████▍     | 17079/37963 [41:01:48<61:29:15, 10.60s/it]
 45%|████▍     | 17080/37963 [41:02:02<67:12:43, 11.59s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.691', 'learning_rate': '1.209e-05', 'epoch': '0.4499'}

 45%|████▍     | 17080/37963 [41:02:02<67:12:43, 11.59s/it]
 45%|████▍     | 17081/37963 [41:02:10<60:17:22, 10.39s/it]
 45%|████▍     | 17082/37963 [41:02:17<55:38:01,  9.59s/it]
 45%|████▍     | 17083/37963 [41:02:25<52:11:45,  9.00s/it]
 45%|████▌     | 17084/37963 [41:02:32<49:32:06,  8.54s/it]
 45%|████▌     | 17085/37963 [41:02:40<47:29:48,  8.19s/it]
 45%|████▌     | 17086/37963 [41:02:47<46:23:45,  8.00s/it]
 45%|████▌     | 17087/37963 [41:02:55<44:56:59,  7.75s/it]
 45%|████▌     | 17088/37963 [41:03:02<44:40:47,  7.71s/it]
 45%|████▌     | 17089/37963 [41:03:10<44:40:02,  7.70s/it]
 45%|████▌     | 17090/37963 [41:03:17<44:23:20,  7.66s/it]
                                                           
{'loss': '0.1572', 'grad_norm': '4.851', 'learning_rate': '1.209e-05', 'epoch': '0.4502'}

 45%|████▌     | 17090/37963 [41:03:17<44:23:20,  7.66s/it]
 45%|████▌     | 17091/37963 [41:03:25<44:05:26,  7.60s/it]
 45%|████▌     | 17092/37963 [41:03:32<43:55:36,  7.58s/it]
 45%|████▌     | 17093/37963 [41:03:40<44:13:06,  7.63s/it]
 45%|████▌     | 17094/37963 [41:03:48<43:51:29,  7.57s/it]
 45%|████▌     | 17095/37963 [41:03:55<43:44:09,  7.55s/it]
 45%|████▌     | 17096/37963 [41:04:03<43:42:57,  7.54s/it]
 45%|████▌     | 17097/37963 [41:04:10<43:41:09,  7.54s/it]
 45%|████▌     | 17098/37963 [41:04:24<55:09:02,  9.52s/it]
 45%|████▌     | 17099/37963 [41:04:38<63:18:43, 10.92s/it]
 45%|████▌     | 17100/37963 [41:04:46<58:10:24, 10.04s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '2.201', 'learning_rate': '1.208e-05', 'epoch': '0.4504'}

 45%|████▌     | 17100/37963 [41:04:46<58:10:24, 10.04s/it]
 45%|████▌     | 17101/37963 [41:04:54<53:55:57,  9.31s/it]
 45%|████▌     | 17102/37963 [41:05:02<50:53:40,  8.78s/it]
 45%|████▌     | 17103/37963 [41:05:09<48:42:14,  8.41s/it]
 45%|████▌     | 17104/37963 [41:05:16<46:46:42,  8.07s/it]
 45%|████▌     | 17105/37963 [41:05:24<45:41:37,  7.89s/it]
 45%|████▌     | 17106/37963 [41:05:31<44:56:13,  7.76s/it]
 45%|████▌     | 17107/37963 [41:05:39<44:38:54,  7.71s/it]
 45%|████▌     | 17108/37963 [41:05:46<44:19:41,  7.65s/it]
 45%|████▌     | 17109/37963 [41:05:54<43:55:20,  7.58s/it]
 45%|████▌     | 17110/37963 [41:06:08<54:58:10,  9.49s/it]
                                                           
{'loss': '0.166', 'grad_norm': '3.193', 'learning_rate': '1.207e-05', 'epoch': '0.4507'}

 45%|████▌     | 17110/37963 [41:06:08<54:58:10,  9.49s/it]
 45%|████▌     | 17111/37963 [41:06:22<63:05:38, 10.89s/it]
 45%|████▌     | 17112/37963 [41:06:29<56:51:40,  9.82s/it]
 45%|████▌     | 17113/37963 [41:06:37<52:52:46,  9.13s/it]
 45%|████▌     | 17114/37963 [41:06:44<50:02:12,  8.64s/it]
 45%|████▌     | 17115/37963 [41:06:52<48:02:04,  8.29s/it]
 45%|████▌     | 17116/37963 [41:06:59<46:37:21,  8.05s/it]
 45%|████▌     | 17117/37963 [41:07:07<45:42:48,  7.89s/it]
 45%|████▌     | 17118/37963 [41:07:14<45:09:25,  7.80s/it]
 45%|████▌     | 17119/37963 [41:07:22<44:20:39,  7.66s/it]
 45%|████▌     | 17120/37963 [41:07:29<44:03:25,  7.61s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.46', 'learning_rate': '1.206e-05', 'epoch': '0.451'}

 45%|████▌     | 17120/37963 [41:07:29<44:03:25,  7.61s/it]
 45%|████▌     | 17121/37963 [41:07:37<43:52:00,  7.58s/it]
 45%|████▌     | 17122/37963 [41:07:44<43:55:04,  7.59s/it]
 45%|████▌     | 17123/37963 [41:07:52<43:33:45,  7.53s/it]
 45%|████▌     | 17124/37963 [41:08:06<54:31:34,  9.42s/it]
 45%|████▌     | 17125/37963 [41:08:19<62:19:40, 10.77s/it]
 45%|████▌     | 17126/37963 [41:08:33<67:24:45, 11.65s/it]
 45%|████▌     | 17127/37963 [41:08:41<60:35:10, 10.47s/it]
 45%|████▌     | 17128/37963 [41:08:48<55:31:54,  9.60s/it]
 45%|████▌     | 17129/37963 [41:08:56<51:55:08,  8.97s/it]
 45%|████▌     | 17130/37963 [41:09:10<60:28:22, 10.45s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '2.609', 'learning_rate': '1.205e-05', 'epoch': '0.4512'}

 45%|████▌     | 17130/37963 [41:09:10<60:28:22, 10.45s/it]
 45%|████▌     | 17131/37963 [41:09:18<55:42:07,  9.63s/it]
 45%|████▌     | 17132/37963 [41:09:25<52:01:23,  8.99s/it]
 45%|████▌     | 17133/37963 [41:09:33<49:47:28,  8.61s/it]
 45%|████▌     | 17134/37963 [41:09:40<47:58:39,  8.29s/it]
 45%|████▌     | 17135/37963 [41:09:48<46:29:08,  8.03s/it]
 45%|████▌     | 17136/37963 [41:09:55<45:39:46,  7.89s/it]
 45%|████▌     | 17137/37963 [41:10:03<45:09:43,  7.81s/it]
 45%|████▌     | 17138/37963 [41:10:11<45:00:57,  7.78s/it]
 45%|████▌     | 17139/37963 [41:10:18<44:36:05,  7.71s/it]
 45%|████▌     | 17140/37963 [41:10:26<44:02:36,  7.61s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '0.9535', 'learning_rate': '1.204e-05', 'epoch': '0.4515'}

 45%|████▌     | 17140/37963 [41:10:26<44:02:36,  7.61s/it]
 45%|████▌     | 17141/37963 [41:10:33<43:58:11,  7.60s/it]
 45%|████▌     | 17142/37963 [41:10:41<43:36:50,  7.54s/it]
 45%|████▌     | 17143/37963 [41:10:48<43:42:44,  7.56s/it]
 45%|████▌     | 17144/37963 [41:10:56<43:50:53,  7.58s/it]
 45%|████▌     | 17145/37963 [41:11:10<55:06:07,  9.53s/it]
 45%|████▌     | 17146/37963 [41:11:17<51:48:04,  8.96s/it]
 45%|████▌     | 17147/37963 [41:11:25<49:20:44,  8.53s/it]
 45%|████▌     | 17148/37963 [41:11:32<47:24:48,  8.20s/it]
 45%|████▌     | 17149/37963 [41:11:40<46:09:34,  7.98s/it]
 45%|████▌     | 17150/37963 [41:11:48<45:42:37,  7.91s/it]
                                                           
{'loss': '0.1469', 'grad_norm': '1.38', 'learning_rate': '1.203e-05', 'epoch': '0.4518'}

 45%|████▌     | 17150/37963 [41:11:48<45:42:37,  7.91s/it]
 45%|████▌     | 17151/37963 [41:11:55<45:01:47,  7.79s/it]
 45%|████▌     | 17152/37963 [41:12:09<55:47:59,  9.65s/it]
 45%|████▌     | 17153/37963 [41:12:17<52:27:17,  9.07s/it]
 45%|████▌     | 17154/37963 [41:12:24<49:24:42,  8.55s/it]
 45%|████▌     | 17155/37963 [41:12:32<47:48:09,  8.27s/it]
 45%|████▌     | 17156/37963 [41:12:39<46:22:11,  8.02s/it]
 45%|████▌     | 17157/37963 [41:12:47<45:38:58,  7.90s/it]
 45%|████▌     | 17158/37963 [41:12:54<45:09:31,  7.81s/it]
 45%|████▌     | 17159/37963 [41:13:08<55:29:52,  9.60s/it]
 45%|████▌     | 17160/37963 [41:13:22<63:16:12, 10.95s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '2.269', 'learning_rate': '1.203e-05', 'epoch': '0.452'}

 45%|████▌     | 17160/37963 [41:13:22<63:16:12, 10.95s/it]
 45%|████▌     | 17161/37963 [41:13:30<56:57:33,  9.86s/it]
 45%|████▌     | 17162/37963 [41:13:37<53:07:49,  9.20s/it]
 45%|████▌     | 17163/37963 [41:13:45<50:34:02,  8.75s/it]
 45%|████▌     | 17164/37963 [41:13:53<48:21:48,  8.37s/it]
 45%|████▌     | 17165/37963 [41:14:00<47:02:21,  8.14s/it]
 45%|████▌     | 17166/37963 [41:14:07<45:36:07,  7.89s/it]
 45%|████▌     | 17167/37963 [41:14:15<44:54:19,  7.77s/it]
 45%|████▌     | 17168/37963 [41:14:29<55:37:00,  9.63s/it]
 45%|████▌     | 17169/37963 [41:14:36<51:45:04,  8.96s/it]
 45%|████▌     | 17170/37963 [41:14:44<49:29:39,  8.57s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '1.16', 'learning_rate': '1.202e-05', 'epoch': '0.4523'}

 45%|████▌     | 17170/37963 [41:14:44<49:29:39,  8.57s/it]
 45%|████▌     | 17171/37963 [41:14:51<47:14:12,  8.18s/it]
 45%|████▌     | 17172/37963 [41:15:05<57:09:47,  9.90s/it]
 45%|████▌     | 17173/37963 [41:15:13<53:09:40,  9.21s/it]
 45%|████▌     | 17174/37963 [41:15:20<49:48:31,  8.63s/it]
 45%|████▌     | 17175/37963 [41:15:34<58:45:39, 10.18s/it]
 45%|████▌     | 17176/37963 [41:15:41<54:26:15,  9.43s/it]
 45%|████▌     | 17177/37963 [41:15:49<51:11:23,  8.87s/it]
 45%|████▌     | 17178/37963 [41:16:03<59:53:25, 10.37s/it]
 45%|████▌     | 17179/37963 [41:16:10<54:45:46,  9.49s/it]
 45%|████▌     | 17180/37963 [41:16:18<51:22:18,  8.90s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.368', 'learning_rate': '1.201e-05', 'epoch': '0.4525'}

 45%|████▌     | 17180/37963 [41:16:18<51:22:18,  8.90s/it]
 45%|████▌     | 17181/37963 [41:16:25<48:53:14,  8.47s/it]
 45%|████▌     | 17182/37963 [41:16:33<47:17:26,  8.19s/it]
 45%|████▌     | 17183/37963 [41:16:40<46:05:30,  7.99s/it]
 45%|████▌     | 17184/37963 [41:16:48<44:43:19,  7.75s/it]
 45%|████▌     | 17185/37963 [41:16:55<44:02:36,  7.63s/it]
 45%|████▌     | 17186/37963 [41:17:02<43:48:57,  7.59s/it]
 45%|████▌     | 17187/37963 [41:17:10<43:58:33,  7.62s/it]
 45%|████▌     | 17188/37963 [41:17:17<43:26:26,  7.53s/it]
 45%|████▌     | 17189/37963 [41:17:25<43:15:29,  7.50s/it]
 45%|████▌     | 17190/37963 [41:17:32<42:48:19,  7.42s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '3.438', 'learning_rate': '1.2e-05', 'epoch': '0.4528'}

 45%|████▌     | 17190/37963 [41:17:32<42:48:19,  7.42s/it]
 45%|████▌     | 17191/37963 [41:17:40<42:59:57,  7.45s/it]
 45%|████▌     | 17192/37963 [41:17:47<43:03:43,  7.46s/it]
 45%|████▌     | 17193/37963 [41:17:55<43:09:47,  7.48s/it]
 45%|████▌     | 17194/37963 [41:18:02<43:17:11,  7.50s/it]
 45%|████▌     | 17195/37963 [41:18:10<43:15:59,  7.50s/it]
 45%|████▌     | 17196/37963 [41:18:17<42:48:03,  7.42s/it]
 45%|████▌     | 17197/37963 [41:18:24<43:02:31,  7.46s/it]
 45%|████▌     | 17198/37963 [41:18:38<54:10:13,  9.39s/it]
 45%|████▌     | 17199/37963 [41:18:46<51:11:22,  8.88s/it]
 45%|████▌     | 17200/37963 [41:18:54<48:50:23,  8.47s/it]
                                                           
{'loss': '0.1517', 'grad_norm': '0.714', 'learning_rate': '1.199e-05', 'epoch': '0.4531'}

 45%|████▌     | 17200/37963 [41:18:54<48:50:23,  8.47s/it]
 45%|████▌     | 17201/37963 [41:19:01<47:13:48,  8.19s/it]
 45%|████▌     | 17202/37963 [41:19:15<56:42:13,  9.83s/it]
 45%|████▌     | 17203/37963 [41:19:22<52:54:48,  9.18s/it]
 45%|████▌     | 17204/37963 [41:19:36<61:12:50, 10.62s/it]
 45%|████▌     | 17205/37963 [41:19:44<55:28:41,  9.62s/it]
 45%|████▌     | 17206/37963 [41:19:51<51:49:00,  8.99s/it]
 45%|████▌     | 17207/37963 [41:19:59<49:13:45,  8.54s/it]
 45%|████▌     | 17208/37963 [41:20:13<59:17:27, 10.28s/it]
 45%|████▌     | 17209/37963 [41:20:20<54:17:28,  9.42s/it]
 45%|████▌     | 17210/37963 [41:20:28<51:04:13,  8.86s/it]
                                                           
{'loss': '0.151', 'grad_norm': '1.395', 'learning_rate': '1.198e-05', 'epoch': '0.4533'}

 45%|████▌     | 17210/37963 [41:20:28<51:04:13,  8.86s/it]
 45%|████▌     | 17211/37963 [41:20:36<48:51:43,  8.48s/it]
 45%|████▌     | 17212/37963 [41:20:43<47:01:13,  8.16s/it]
 45%|████▌     | 17213/37963 [41:20:50<45:38:42,  7.92s/it]
 45%|████▌     | 17214/37963 [41:20:58<45:06:10,  7.83s/it]
 45%|████▌     | 17215/37963 [41:21:05<44:36:51,  7.74s/it]
 45%|████▌     | 17216/37963 [41:21:13<44:13:41,  7.67s/it]
 45%|████▌     | 17217/37963 [41:21:27<55:10:56,  9.58s/it]
 45%|████▌     | 17218/37963 [41:21:35<51:40:17,  8.97s/it]
 45%|████▌     | 17219/37963 [41:21:42<49:26:04,  8.58s/it]
 45%|████▌     | 17220/37963 [41:21:50<47:34:17,  8.26s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '2.163', 'learning_rate': '1.198e-05', 'epoch': '0.4536'}

 45%|████▌     | 17220/37963 [41:21:50<47:34:17,  8.26s/it]
 45%|████▌     | 17221/37963 [41:22:04<57:29:52,  9.98s/it]
 45%|████▌     | 17222/37963 [41:22:11<53:15:59,  9.25s/it]
 45%|████▌     | 17223/37963 [41:22:19<50:16:57,  8.73s/it]
 45%|████▌     | 17224/37963 [41:22:26<48:25:04,  8.40s/it]
 45%|████▌     | 17225/37963 [41:22:34<46:57:33,  8.15s/it]
 45%|████▌     | 17226/37963 [41:22:48<57:22:53,  9.96s/it]
 45%|████▌     | 17227/37963 [41:22:56<53:06:39,  9.22s/it]
 45%|████▌     | 17228/37963 [41:23:03<50:05:43,  8.70s/it]
 45%|████▌     | 17229/37963 [41:23:10<47:45:54,  8.29s/it]
 45%|████▌     | 17230/37963 [41:23:18<46:23:47,  8.06s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '2.04', 'learning_rate': '1.197e-05', 'epoch': '0.4539'}

 45%|████▌     | 17230/37963 [41:23:18<46:23:47,  8.06s/it]
 45%|████▌     | 17231/37963 [41:23:25<45:23:19,  7.88s/it]
 45%|████▌     | 17232/37963 [41:23:39<55:54:30,  9.71s/it]
 45%|████▌     | 17233/37963 [41:23:47<52:11:26,  9.06s/it]
 45%|████▌     | 17234/37963 [41:23:55<49:30:57,  8.60s/it]
 45%|████▌     | 17235/37963 [41:24:02<47:35:37,  8.27s/it]
 45%|████▌     | 17236/37963 [41:24:09<45:48:39,  7.96s/it]
 45%|████▌     | 17237/37963 [41:24:17<45:16:59,  7.87s/it]
 45%|████▌     | 17238/37963 [41:24:25<44:53:16,  7.80s/it]
 45%|████▌     | 17239/37963 [41:24:32<44:37:06,  7.75s/it]
 45%|████▌     | 17240/37963 [41:24:40<44:29:18,  7.73s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '2.633', 'learning_rate': '1.196e-05', 'epoch': '0.4541'}

 45%|████▌     | 17240/37963 [41:24:40<44:29:18,  7.73s/it]
 45%|████▌     | 17241/37963 [41:24:47<44:08:34,  7.67s/it]
 45%|████▌     | 17242/37963 [41:24:55<43:57:07,  7.64s/it]
 45%|████▌     | 17243/37963 [41:25:03<43:53:14,  7.63s/it]
 45%|████▌     | 17244/37963 [41:25:10<43:09:09,  7.50s/it]
 45%|████▌     | 17245/37963 [41:25:17<43:10:37,  7.50s/it]
 45%|████▌     | 17246/37963 [41:25:31<54:21:08,  9.44s/it]
 45%|████▌     | 17247/37963 [41:25:45<62:11:21, 10.81s/it]
 45%|████▌     | 17248/37963 [41:25:53<56:33:59,  9.83s/it]
 45%|████▌     | 17249/37963 [41:26:00<52:40:55,  9.16s/it]
 45%|████▌     | 17250/37963 [41:26:08<49:32:44,  8.61s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '2.097', 'learning_rate': '1.195e-05', 'epoch': '0.4544'}

 45%|████▌     | 17250/37963 [41:26:08<49:32:44,  8.61s/it]
 45%|████▌     | 17251/37963 [41:26:15<47:26:53,  8.25s/it]
 45%|████▌     | 17252/37963 [41:26:29<57:17:40,  9.96s/it]
 45%|████▌     | 17253/37963 [41:26:36<52:37:33,  9.15s/it]
 45%|████▌     | 17254/37963 [41:26:44<49:54:48,  8.68s/it]
 45%|████▌     | 17255/37963 [41:26:51<47:56:11,  8.33s/it]
 45%|████▌     | 17256/37963 [41:26:59<46:21:45,  8.06s/it]
 45%|████▌     | 17257/37963 [41:27:06<45:33:30,  7.92s/it]
 45%|████▌     | 17258/37963 [41:27:21<56:14:15,  9.78s/it]
 45%|████▌     | 17259/37963 [41:27:28<52:28:30,  9.12s/it]
 45%|████▌     | 17260/37963 [41:27:35<49:03:04,  8.53s/it]
                                                           
{'loss': '0.1523', 'grad_norm': '3.219', 'learning_rate': '1.194e-05', 'epoch': '0.4547'}

 45%|████▌     | 17260/37963 [41:27:35<49:03:04,  8.53s/it]
 45%|████▌     | 17261/37963 [41:27:43<47:07:40,  8.20s/it]
 45%|████▌     | 17262/37963 [41:27:50<45:38:09,  7.94s/it]
 45%|████▌     | 17263/37963 [41:27:58<44:58:16,  7.82s/it]
 45%|████▌     | 17264/37963 [41:28:05<44:27:16,  7.73s/it]
 45%|████▌     | 17265/37963 [41:28:13<44:06:00,  7.67s/it]
 45%|████▌     | 17266/37963 [41:28:20<43:50:29,  7.63s/it]
 45%|████▌     | 17267/37963 [41:28:28<43:23:15,  7.55s/it]
 45%|████▌     | 17268/37963 [41:28:41<54:01:42,  9.40s/it]
 45%|████▌     | 17269/37963 [41:28:55<62:09:56, 10.81s/it]
 45%|████▌     | 17270/37963 [41:29:03<56:27:11,  9.82s/it]
                                                           
{'loss': '0.1493', 'grad_norm': '1.63', 'learning_rate': '1.193e-05', 'epoch': '0.4549'}

 45%|████▌     | 17270/37963 [41:29:03<56:27:11,  9.82s/it]
 45%|████▌     | 17271/37963 [41:29:10<52:31:07,  9.14s/it]
 45%|████▌     | 17272/37963 [41:29:18<49:36:26,  8.63s/it]
 45%|████▌     | 17273/37963 [41:29:25<47:49:30,  8.32s/it]
 46%|████▌     | 17274/37963 [41:29:33<46:24:57,  8.08s/it]
 46%|████▌     | 17275/37963 [41:29:40<45:26:30,  7.91s/it]
 46%|████▌     | 17276/37963 [41:29:48<44:47:58,  7.80s/it]
 46%|████▌     | 17277/37963 [41:30:02<55:31:41,  9.66s/it]
 46%|████▌     | 17278/37963 [41:30:09<51:26:40,  8.95s/it]
 46%|████▌     | 17279/37963 [41:30:17<49:01:14,  8.53s/it]
 46%|████▌     | 17280/37963 [41:30:24<47:17:10,  8.23s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '0.9076', 'learning_rate': '1.193e-05', 'epoch': '0.4552'}

 46%|████▌     | 17280/37963 [41:30:24<47:17:10,  8.23s/it]
 46%|████▌     | 17281/37963 [41:30:32<46:18:18,  8.06s/it]
 46%|████▌     | 17282/37963 [41:30:39<45:06:06,  7.85s/it]
 46%|████▌     | 17283/37963 [41:30:47<44:20:08,  7.72s/it]
 46%|████▌     | 17284/37963 [41:30:54<44:09:45,  7.69s/it]
 46%|████▌     | 17285/37963 [41:31:02<44:01:12,  7.66s/it]
 46%|████▌     | 17286/37963 [41:31:16<55:18:19,  9.63s/it]
 46%|████▌     | 17287/37963 [41:31:24<51:39:46,  9.00s/it]
 46%|████▌     | 17288/37963 [41:31:31<49:03:12,  8.54s/it]
 46%|████▌     | 17289/37963 [41:31:39<46:51:48,  8.16s/it]
 46%|████▌     | 17290/37963 [41:31:46<45:55:58,  8.00s/it]
                                                           
{'loss': '0.1647', 'grad_norm': '2.346', 'learning_rate': '1.192e-05', 'epoch': '0.4554'}

 46%|████▌     | 17290/37963 [41:31:46<45:55:58,  8.00s/it]
 46%|████▌     | 17291/37963 [41:32:00<56:14:04,  9.79s/it]
 46%|████▌     | 17292/37963 [41:32:07<52:02:28,  9.06s/it]
 46%|████▌     | 17293/37963 [41:32:15<49:22:18,  8.60s/it]
 46%|████▌     | 17294/37963 [41:32:23<47:30:14,  8.27s/it]
 46%|████▌     | 17295/37963 [41:32:36<57:04:12,  9.94s/it]
 46%|████▌     | 17296/37963 [41:32:44<52:54:30,  9.22s/it]
 46%|████▌     | 17297/37963 [41:32:51<49:59:16,  8.71s/it]
 46%|████▌     | 17298/37963 [41:33:05<58:47:09, 10.24s/it]
 46%|████▌     | 17299/37963 [41:33:13<54:27:46,  9.49s/it]
 46%|████▌     | 17300/37963 [41:33:20<50:43:16,  8.84s/it]
                                                           
{'loss': '0.1615', 'grad_norm': '1.907', 'learning_rate': '1.191e-05', 'epoch': '0.4557'}

 46%|████▌     | 17300/37963 [41:33:20<50:43:16,  8.84s/it]
 46%|████▌     | 17301/37963 [41:33:28<48:06:34,  8.38s/it]
 46%|████▌     | 17302/37963 [41:33:35<46:37:35,  8.12s/it]
 46%|████▌     | 17303/37963 [41:33:43<45:32:44,  7.94s/it]
 46%|████▌     | 17304/37963 [41:33:50<44:58:39,  7.84s/it]
 46%|████▌     | 17305/37963 [41:33:58<44:29:38,  7.75s/it]
 46%|████▌     | 17306/37963 [41:34:05<43:53:21,  7.65s/it]
 46%|████▌     | 17307/37963 [41:34:13<43:44:42,  7.62s/it]
 46%|████▌     | 17308/37963 [41:34:20<43:32:47,  7.59s/it]
 46%|████▌     | 17309/37963 [41:34:28<43:20:15,  7.55s/it]
 46%|████▌     | 17310/37963 [41:34:35<43:04:45,  7.51s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '4.028', 'learning_rate': '1.19e-05', 'epoch': '0.456'}

 46%|████▌     | 17310/37963 [41:34:35<43:04:45,  7.51s/it]
 46%|████▌     | 17311/37963 [41:34:42<42:31:01,  7.41s/it]
 46%|████▌     | 17312/37963 [41:34:56<53:55:10,  9.40s/it]
 46%|████▌     | 17313/37963 [41:35:04<50:30:05,  8.80s/it]
 46%|████▌     | 17314/37963 [41:35:11<48:30:06,  8.46s/it]
 46%|████▌     | 17315/37963 [41:35:25<57:55:23, 10.10s/it]
 46%|████▌     | 17316/37963 [41:35:39<64:36:19, 11.26s/it]
 46%|████▌     | 17317/37963 [41:35:47<57:57:42, 10.11s/it]
 46%|████▌     | 17318/37963 [41:35:54<53:51:36,  9.39s/it]
 46%|████▌     | 17319/37963 [41:36:02<50:24:06,  8.79s/it]
 46%|████▌     | 17320/37963 [41:36:09<48:03:31,  8.38s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '1.829', 'learning_rate': '1.189e-05', 'epoch': '0.4562'}

 46%|████▌     | 17320/37963 [41:36:09<48:03:31,  8.38s/it]
 46%|████▌     | 17321/37963 [41:36:17<46:37:01,  8.13s/it]
 46%|████▌     | 17322/37963 [41:36:24<45:42:37,  7.97s/it]
 46%|████▌     | 17323/37963 [41:36:32<44:52:21,  7.83s/it]
 46%|████▌     | 17324/37963 [41:36:46<55:56:01,  9.76s/it]
 46%|████▌     | 17325/37963 [41:36:54<52:20:58,  9.13s/it]
 46%|████▌     | 17326/37963 [41:37:01<49:29:40,  8.63s/it]
 46%|████▌     | 17327/37963 [41:37:09<47:43:29,  8.33s/it]
 46%|████▌     | 17328/37963 [41:37:17<46:28:22,  8.11s/it]
 46%|████▌     | 17329/37963 [41:37:24<45:07:00,  7.87s/it]
 46%|████▌     | 17330/37963 [41:37:38<55:25:16,  9.67s/it]
                                                           
{'loss': '0.1428', 'grad_norm': '0.8016', 'learning_rate': '1.188e-05', 'epoch': '0.4565'}

 46%|████▌     | 17330/37963 [41:37:38<55:25:16,  9.67s/it]
 46%|████▌     | 17331/37963 [41:37:45<51:16:32,  8.95s/it]
 46%|████▌     | 17332/37963 [41:37:52<48:47:00,  8.51s/it]
 46%|████▌     | 17333/37963 [41:38:00<47:09:29,  8.23s/it]
 46%|████▌     | 17334/37963 [41:38:08<45:53:11,  8.01s/it]
 46%|████▌     | 17335/37963 [41:38:15<45:01:58,  7.86s/it]
 46%|████▌     | 17336/37963 [41:38:23<44:33:13,  7.78s/it]
 46%|████▌     | 17337/37963 [41:38:30<44:04:51,  7.69s/it]
 46%|████▌     | 17338/37963 [41:38:38<43:45:06,  7.64s/it]
 46%|████▌     | 17339/37963 [41:38:45<43:44:35,  7.64s/it]
 46%|████▌     | 17340/37963 [41:38:59<54:43:37,  9.55s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '1.831', 'learning_rate': '1.188e-05', 'epoch': '0.4568'}

 46%|████▌     | 17340/37963 [41:38:59<54:43:37,  9.55s/it]
 46%|████▌     | 17341/37963 [41:39:07<51:06:40,  8.92s/it]
 46%|████▌     | 17342/37963 [41:39:14<48:56:16,  8.54s/it]
 46%|████▌     | 17343/37963 [41:39:22<47:35:13,  8.31s/it]
 46%|████▌     | 17344/37963 [41:39:36<57:20:28, 10.01s/it]
 46%|████▌     | 17345/37963 [41:39:44<52:54:18,  9.24s/it]
 46%|████▌     | 17346/37963 [41:39:51<50:02:09,  8.74s/it]
 46%|████▌     | 17347/37963 [41:39:59<47:55:47,  8.37s/it]
 46%|████▌     | 17348/37963 [41:40:12<57:16:50, 10.00s/it]
 46%|████▌     | 17349/37963 [41:40:20<53:00:51,  9.26s/it]
 46%|████▌     | 17350/37963 [41:40:27<49:58:57,  8.73s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '4.138', 'learning_rate': '1.187e-05', 'epoch': '0.457'}

 46%|████▌     | 17350/37963 [41:40:27<49:58:57,  8.73s/it]
 46%|████▌     | 17351/37963 [41:40:35<47:38:29,  8.32s/it]
 46%|████▌     | 17352/37963 [41:40:42<46:25:32,  8.11s/it]
 46%|████▌     | 17353/37963 [41:40:50<45:26:38,  7.94s/it]
 46%|████▌     | 17354/37963 [41:40:58<44:41:30,  7.81s/it]
 46%|████▌     | 17355/37963 [41:41:05<43:58:54,  7.68s/it]
 46%|████▌     | 17356/37963 [41:41:12<43:34:02,  7.61s/it]
 46%|████▌     | 17357/37963 [41:41:20<43:24:07,  7.58s/it]
 46%|████▌     | 17358/37963 [41:41:27<43:01:24,  7.52s/it]
 46%|████▌     | 17359/37963 [41:41:34<42:30:03,  7.43s/it]
 46%|████▌     | 17360/37963 [41:41:42<42:51:59,  7.49s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.331', 'learning_rate': '1.186e-05', 'epoch': '0.4573'}

 46%|████▌     | 17360/37963 [41:41:42<42:51:59,  7.49s/it]
 46%|████▌     | 17361/37963 [41:41:56<53:40:22,  9.38s/it]
 46%|████▌     | 17362/37963 [41:42:03<50:34:03,  8.84s/it]
 46%|████▌     | 17363/37963 [41:42:11<48:18:48,  8.44s/it]
 46%|████▌     | 17364/37963 [41:42:25<57:43:28, 10.09s/it]
 46%|████▌     | 17365/37963 [41:42:33<53:42:08,  9.39s/it]
 46%|████▌     | 17366/37963 [41:42:40<50:32:42,  8.83s/it]
 46%|████▌     | 17367/37963 [41:42:48<48:25:48,  8.47s/it]
 46%|████▌     | 17368/37963 [41:42:55<46:47:43,  8.18s/it]
 46%|████▌     | 17369/37963 [41:43:16<67:52:33, 11.87s/it]
 46%|████▌     | 17370/37963 [41:43:23<59:59:17, 10.49s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '5.339', 'learning_rate': '1.185e-05', 'epoch': '0.4576'}

 46%|████▌     | 17370/37963 [41:43:23<59:59:17, 10.49s/it]
 46%|████▌     | 17371/37963 [41:43:31<55:00:10,  9.62s/it]
 46%|████▌     | 17372/37963 [41:43:38<51:20:48,  8.98s/it]
 46%|████▌     | 17373/37963 [41:43:46<48:52:29,  8.55s/it]
 46%|████▌     | 17374/37963 [41:43:53<47:08:22,  8.24s/it]
 46%|████▌     | 17375/37963 [41:44:01<45:46:26,  8.00s/it]
 46%|████▌     | 17376/37963 [41:44:08<44:55:51,  7.86s/it]
 46%|████▌     | 17377/37963 [41:44:16<44:24:07,  7.76s/it]
 46%|████▌     | 17378/37963 [41:44:23<43:58:26,  7.69s/it]
 46%|████▌     | 17379/37963 [41:44:31<43:47:59,  7.66s/it]
 46%|████▌     | 17380/37963 [41:44:38<43:45:58,  7.65s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.387', 'learning_rate': '1.184e-05', 'epoch': '0.4578'}

 46%|████▌     | 17380/37963 [41:44:38<43:45:58,  7.65s/it]
 46%|████▌     | 17381/37963 [41:44:46<43:40:59,  7.64s/it]
 46%|████▌     | 17382/37963 [41:45:00<54:47:09,  9.58s/it]
 46%|████▌     | 17383/37963 [41:45:08<51:22:55,  8.99s/it]
 46%|████▌     | 17384/37963 [41:45:15<48:50:52,  8.55s/it]
 46%|████▌     | 17385/37963 [41:45:23<47:20:48,  8.28s/it]
 46%|████▌     | 17386/37963 [41:45:37<57:05:33,  9.99s/it]
 46%|████▌     | 17387/37963 [41:45:45<53:04:39,  9.29s/it]
 46%|████▌     | 17388/37963 [41:45:52<50:19:58,  8.81s/it]
 46%|████▌     | 17389/37963 [41:46:00<48:11:34,  8.43s/it]
 46%|████▌     | 17390/37963 [41:46:07<46:40:04,  8.17s/it]
                                                           
{'loss': '0.164', 'grad_norm': '2.687', 'learning_rate': '1.183e-05', 'epoch': '0.4581'}

 46%|████▌     | 17390/37963 [41:46:07<46:40:04,  8.17s/it]
 46%|████▌     | 17391/37963 [41:46:15<45:27:39,  7.96s/it]
 46%|████▌     | 17392/37963 [41:46:22<44:39:27,  7.82s/it]
 46%|████▌     | 17393/37963 [41:46:36<55:05:26,  9.64s/it]
 46%|████▌     | 17394/37963 [41:46:44<51:30:02,  9.01s/it]
 46%|████▌     | 17395/37963 [41:46:51<49:03:06,  8.59s/it]
 46%|████▌     | 17396/37963 [41:46:59<46:59:35,  8.23s/it]
 46%|████▌     | 17397/37963 [41:47:06<45:43:10,  8.00s/it]
 46%|████▌     | 17398/37963 [41:47:14<44:52:33,  7.86s/it]
 46%|████▌     | 17399/37963 [41:47:21<44:21:34,  7.77s/it]
 46%|████▌     | 17400/37963 [41:47:29<44:03:42,  7.71s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.703', 'learning_rate': '1.183e-05', 'epoch': '0.4583'}

 46%|████▌     | 17400/37963 [41:47:29<44:03:42,  7.71s/it]
 46%|████▌     | 17401/37963 [41:47:36<43:54:49,  7.69s/it]
 46%|████▌     | 17402/37963 [41:47:50<54:38:26,  9.57s/it]
 46%|████▌     | 17403/37963 [41:47:58<51:18:11,  8.98s/it]
 46%|████▌     | 17404/37963 [41:48:06<48:57:13,  8.57s/it]
 46%|████▌     | 17405/37963 [41:48:20<58:30:20, 10.25s/it]
 46%|████▌     | 17406/37963 [41:48:27<53:47:32,  9.42s/it]
 46%|████▌     | 17407/37963 [41:48:35<50:33:30,  8.85s/it]
 46%|████▌     | 17408/37963 [41:48:42<48:20:47,  8.47s/it]
 46%|████▌     | 17409/37963 [41:48:50<46:23:59,  8.13s/it]
 46%|████▌     | 17410/37963 [41:48:57<45:31:20,  7.97s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '2.489', 'learning_rate': '1.182e-05', 'epoch': '0.4586'}

 46%|████▌     | 17410/37963 [41:48:57<45:31:20,  7.97s/it]
 46%|████▌     | 17411/37963 [41:49:05<44:44:12,  7.84s/it]
 46%|████▌     | 17412/37963 [41:49:19<55:20:07,  9.69s/it]
 46%|████▌     | 17413/37963 [41:49:26<51:32:45,  9.03s/it]
 46%|████▌     | 17414/37963 [41:49:34<49:20:19,  8.64s/it]
 46%|████▌     | 17415/37963 [41:49:42<47:36:00,  8.34s/it]
 46%|████▌     | 17416/37963 [41:49:56<57:05:49, 10.00s/it]
 46%|████▌     | 17417/37963 [41:50:03<52:56:13,  9.28s/it]
 46%|████▌     | 17418/37963 [41:50:11<49:57:27,  8.75s/it]
 46%|████▌     | 17419/37963 [41:50:25<58:54:26, 10.32s/it]
 46%|████▌     | 17420/37963 [41:50:32<53:56:50,  9.45s/it]
                                                           
{'loss': '0.1539', 'grad_norm': '1.013', 'learning_rate': '1.181e-05', 'epoch': '0.4589'}

 46%|████▌     | 17420/37963 [41:50:32<53:56:50,  9.45s/it]
 46%|████▌     | 17421/37963 [41:50:40<50:45:33,  8.90s/it]
 46%|████▌     | 17422/37963 [41:50:47<48:23:11,  8.48s/it]
 46%|████▌     | 17423/37963 [41:50:55<46:48:31,  8.20s/it]
 46%|████▌     | 17424/37963 [41:51:02<45:43:41,  8.02s/it]
 46%|████▌     | 17425/37963 [41:51:10<44:59:38,  7.89s/it]
 46%|████▌     | 17426/37963 [41:51:18<44:22:26,  7.78s/it]
 46%|████▌     | 17427/37963 [41:51:25<43:58:52,  7.71s/it]
 46%|████▌     | 17428/37963 [41:51:33<44:01:49,  7.72s/it]
 46%|████▌     | 17429/37963 [41:51:40<43:40:49,  7.66s/it]
 46%|████▌     | 17430/37963 [41:51:48<43:25:44,  7.61s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '3.572', 'learning_rate': '1.18e-05', 'epoch': '0.4591'}

 46%|████▌     | 17430/37963 [41:51:48<43:25:44,  7.61s/it]
 46%|████▌     | 17431/37963 [41:51:55<43:07:49,  7.56s/it]
 46%|████▌     | 17432/37963 [41:52:03<43:14:03,  7.58s/it]
 46%|████▌     | 17433/37963 [41:52:17<53:41:31,  9.42s/it]
 46%|████▌     | 17434/37963 [41:52:24<50:33:03,  8.86s/it]
 46%|████▌     | 17435/37963 [41:52:32<47:59:47,  8.42s/it]
 46%|████▌     | 17436/37963 [41:52:45<57:22:21, 10.06s/it]
 46%|████▌     | 17437/37963 [41:53:00<64:27:28, 11.31s/it]
 46%|████▌     | 17438/37963 [41:53:07<58:06:28, 10.19s/it]
 46%|████▌     | 17439/37963 [41:53:15<53:31:36,  9.39s/it]
 46%|████▌     | 17440/37963 [41:53:22<50:33:02,  8.87s/it]
                                                           
{'loss': '0.1476', 'grad_norm': '2.909', 'learning_rate': '1.179e-05', 'epoch': '0.4594'}

 46%|████▌     | 17440/37963 [41:53:22<50:33:02,  8.87s/it]
 46%|████▌     | 17441/37963 [41:53:30<48:13:59,  8.46s/it]
 46%|████▌     | 17442/37963 [41:53:37<46:34:20,  8.17s/it]
 46%|████▌     | 17443/37963 [41:53:45<45:24:34,  7.97s/it]
 46%|████▌     | 17444/37963 [41:53:53<44:50:45,  7.87s/it]
 46%|████▌     | 17445/37963 [41:54:00<44:22:58,  7.79s/it]
 46%|████▌     | 17446/37963 [41:54:08<43:57:12,  7.71s/it]
 46%|████▌     | 17447/37963 [41:54:15<43:42:35,  7.67s/it]
 46%|████▌     | 17448/37963 [41:54:23<43:41:08,  7.67s/it]
 46%|████▌     | 17449/37963 [41:54:30<43:08:43,  7.57s/it]
 46%|████▌     | 17450/37963 [41:54:38<42:46:44,  7.51s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '4.055', 'learning_rate': '1.178e-05', 'epoch': '0.4597'}

 46%|████▌     | 17450/37963 [41:54:38<42:46:44,  7.51s/it]
 46%|████▌     | 17451/37963 [41:54:45<43:09:49,  7.58s/it]
 46%|████▌     | 17452/37963 [41:54:53<43:02:36,  7.55s/it]
 46%|████▌     | 17453/37963 [41:55:00<43:04:38,  7.56s/it]
 46%|████▌     | 17454/37963 [41:55:08<43:00:56,  7.55s/it]
 46%|████▌     | 17455/37963 [41:55:16<42:59:42,  7.55s/it]
 46%|████▌     | 17456/37963 [41:55:29<53:42:48,  9.43s/it]
 46%|████▌     | 17457/37963 [41:55:37<49:57:00,  8.77s/it]
 46%|████▌     | 17458/37963 [41:55:44<47:30:04,  8.34s/it]
 46%|████▌     | 17459/37963 [41:55:58<57:03:41, 10.02s/it]
 46%|████▌     | 17460/37963 [41:56:05<52:21:16,  9.19s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2.117', 'learning_rate': '1.178e-05', 'epoch': '0.4599'}

 46%|████▌     | 17460/37963 [41:56:05<52:21:16,  9.19s/it]
 46%|████▌     | 17461/37963 [41:56:13<49:35:37,  8.71s/it]
 46%|████▌     | 17462/37963 [41:56:27<59:07:08, 10.38s/it]
 46%|████▌     | 17463/37963 [41:56:34<54:11:56,  9.52s/it]
 46%|████▌     | 17464/37963 [41:56:48<61:51:12, 10.86s/it]
 46%|████▌     | 17465/37963 [41:56:56<56:09:44,  9.86s/it]
 46%|████▌     | 17466/37963 [41:57:10<63:17:52, 11.12s/it]
 46%|████▌     | 17467/37963 [41:57:17<56:34:51,  9.94s/it]
 46%|████▌     | 17468/37963 [41:57:25<52:22:52,  9.20s/it]
 46%|████▌     | 17469/37963 [41:57:32<49:30:59,  8.70s/it]
 46%|████▌     | 17470/37963 [41:57:40<47:27:58,  8.34s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.547', 'learning_rate': '1.177e-05', 'epoch': '0.4602'}

 46%|████▌     | 17470/37963 [41:57:40<47:27:58,  8.34s/it]
 46%|████▌     | 17471/37963 [41:57:47<46:04:30,  8.09s/it]
 46%|████▌     | 17472/37963 [41:57:55<45:10:18,  7.94s/it]
 46%|████▌     | 17473/37963 [41:58:02<44:26:04,  7.81s/it]
 46%|████▌     | 17474/37963 [41:58:10<44:12:55,  7.77s/it]
 46%|████▌     | 17475/37963 [41:58:17<43:38:46,  7.67s/it]
 46%|████▌     | 17476/37963 [41:58:25<43:27:47,  7.64s/it]
 46%|████▌     | 17477/37963 [41:58:33<43:18:55,  7.61s/it]
 46%|████▌     | 17478/37963 [41:58:40<43:18:12,  7.61s/it]
 46%|████▌     | 17479/37963 [41:58:48<43:02:49,  7.57s/it]
 46%|████▌     | 17480/37963 [41:59:01<53:44:00,  9.44s/it]
                                                           
{'loss': '0.1649', 'grad_norm': '1.17', 'learning_rate': '1.176e-05', 'epoch': '0.4604'}

 46%|████▌     | 17480/37963 [41:59:01<53:44:00,  9.44s/it]
 46%|████▌     | 17481/37963 [41:59:09<50:47:41,  8.93s/it]
 46%|████▌     | 17482/37963 [41:59:17<48:17:51,  8.49s/it]
 46%|████▌     | 17483/37963 [41:59:24<46:36:49,  8.19s/it]
 46%|████▌     | 17484/37963 [41:59:38<56:24:57,  9.92s/it]
 46%|████▌     | 17485/37963 [41:59:45<51:43:51,  9.09s/it]
 46%|████▌     | 17486/37963 [41:59:53<48:41:53,  8.56s/it]
 46%|████▌     | 17487/37963 [42:00:00<46:46:47,  8.22s/it]
 46%|████▌     | 17488/37963 [42:00:07<45:21:48,  7.98s/it]
 46%|████▌     | 17489/37963 [42:00:15<44:05:37,  7.75s/it]
 46%|████▌     | 17490/37963 [42:00:22<43:38:41,  7.67s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.002', 'learning_rate': '1.175e-05', 'epoch': '0.4607'}

 46%|████▌     | 17490/37963 [42:00:22<43:38:41,  7.67s/it]
 46%|████▌     | 17491/37963 [42:00:36<54:25:04,  9.57s/it]
 46%|████▌     | 17492/37963 [42:00:44<50:54:07,  8.95s/it]
 46%|████▌     | 17493/37963 [42:00:51<48:30:59,  8.53s/it]
 46%|████▌     | 17494/37963 [42:00:59<46:45:42,  8.22s/it]
 46%|████▌     | 17495/37963 [42:01:06<45:37:51,  8.03s/it]
 46%|████▌     | 17496/37963 [42:01:14<44:44:48,  7.87s/it]
 46%|████▌     | 17497/37963 [42:01:21<43:25:12,  7.64s/it]
 46%|████▌     | 17498/37963 [42:01:28<43:20:18,  7.62s/it]
 46%|████▌     | 17499/37963 [42:01:36<43:41:25,  7.69s/it]
 46%|████▌     | 17500/37963 [42:01:44<43:22:16,  7.63s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.998', 'learning_rate': '1.174e-05', 'epoch': '0.461'}

 46%|████▌     | 17500/37963 [42:01:44<43:22:16,  7.63s/it]
 46%|████▌     | 17501/37963 [42:01:51<43:12:58,  7.60s/it]
 46%|████▌     | 17502/37963 [42:01:59<43:16:42,  7.61s/it]
 46%|████▌     | 17503/37963 [42:02:07<43:11:22,  7.60s/it]
 46%|████▌     | 17504/37963 [42:02:20<53:22:49,  9.39s/it]
 46%|████▌     | 17505/37963 [42:02:28<50:16:05,  8.85s/it]
 46%|████▌     | 17506/37963 [42:02:35<48:14:15,  8.49s/it]
 46%|████▌     | 17507/37963 [42:02:43<46:46:20,  8.23s/it]
 46%|████▌     | 17508/37963 [42:03:03<67:14:19, 11.83s/it]
 46%|████▌     | 17509/37963 [42:03:11<59:33:43, 10.48s/it]
 46%|████▌     | 17510/37963 [42:03:25<66:20:39, 11.68s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '2.551', 'learning_rate': '1.173e-05', 'epoch': '0.4612'}

 46%|████▌     | 17510/37963 [42:03:25<66:20:39, 11.68s/it]
 46%|████▌     | 17511/37963 [42:03:33<59:18:35, 10.44s/it]
 46%|████▌     | 17512/37963 [42:03:40<54:11:40,  9.54s/it]
 46%|████▌     | 17513/37963 [42:03:47<50:19:30,  8.86s/it]
 46%|████▌     | 17514/37963 [42:03:55<48:01:14,  8.45s/it]
 46%|████▌     | 17515/37963 [42:04:09<57:18:25, 10.09s/it]
 46%|████▌     | 17516/37963 [42:04:16<53:04:52,  9.35s/it]
 46%|████▌     | 17517/37963 [42:04:24<49:49:53,  8.77s/it]
 46%|████▌     | 17518/37963 [42:04:31<47:50:24,  8.42s/it]
 46%|████▌     | 17519/37963 [42:04:39<46:00:40,  8.10s/it]
 46%|████▌     | 17520/37963 [42:04:46<45:08:12,  7.95s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.163', 'learning_rate': '1.172e-05', 'epoch': '0.4615'}

 46%|████▌     | 17520/37963 [42:04:46<45:08:12,  7.95s/it]
 46%|████▌     | 17521/37963 [42:04:54<44:25:15,  7.82s/it]
 46%|████▌     | 17522/37963 [42:05:01<43:33:06,  7.67s/it]
 46%|████▌     | 17523/37963 [42:05:09<43:21:20,  7.64s/it]
 46%|████▌     | 17524/37963 [42:05:16<42:48:02,  7.54s/it]
 46%|████▌     | 17525/37963 [42:05:24<42:58:17,  7.57s/it]
 46%|████▌     | 17526/37963 [42:05:38<54:20:32,  9.57s/it]
 46%|████▌     | 17527/37963 [42:05:45<50:24:27,  8.88s/it]
 46%|████▌     | 17528/37963 [42:05:53<48:23:04,  8.52s/it]
 46%|████▌     | 17529/37963 [42:06:00<46:06:52,  8.12s/it]
 46%|████▌     | 17530/37963 [42:06:07<44:38:48,  7.87s/it]
                                                           
{'loss': '0.162', 'grad_norm': '1.753', 'learning_rate': '1.172e-05', 'epoch': '0.4618'}

 46%|████▌     | 17530/37963 [42:06:07<44:38:48,  7.87s/it]
 46%|████▌     | 17531/37963 [42:06:15<44:06:05,  7.77s/it]
 46%|████▌     | 17532/37963 [42:06:22<43:42:21,  7.70s/it]
 46%|████▌     | 17533/37963 [42:06:30<43:19:53,  7.64s/it]
 46%|████▌     | 17534/37963 [42:06:37<43:07:49,  7.60s/it]
 46%|████▌     | 17535/37963 [42:06:45<42:29:42,  7.49s/it]
 46%|████▌     | 17536/37963 [42:06:59<53:33:19,  9.44s/it]
 46%|████▌     | 17537/37963 [42:07:06<50:20:00,  8.87s/it]
 46%|████▌     | 17538/37963 [42:07:14<48:06:30,  8.48s/it]
 46%|████▌     | 17539/37963 [42:07:21<46:42:26,  8.23s/it]
 46%|████▌     | 17540/37963 [42:07:29<45:35:39,  8.04s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.165', 'learning_rate': '1.171e-05', 'epoch': '0.462'}

 46%|████▌     | 17540/37963 [42:07:29<45:35:39,  8.04s/it]
 46%|████▌     | 17541/37963 [42:07:43<55:13:16,  9.73s/it]
 46%|████▌     | 17542/37963 [42:07:50<51:37:07,  9.10s/it]
 46%|████▌     | 17543/37963 [42:07:58<48:57:30,  8.63s/it]
 46%|████▌     | 17544/37963 [42:08:05<47:05:08,  8.30s/it]
 46%|████▌     | 17545/37963 [42:08:13<45:53:02,  8.09s/it]
 46%|████▌     | 17546/37963 [42:08:20<44:31:43,  7.85s/it]
 46%|████▌     | 17547/37963 [42:08:28<43:59:21,  7.76s/it]
 46%|████▌     | 17548/37963 [42:08:35<43:34:58,  7.69s/it]
 46%|████▌     | 17549/37963 [42:08:43<43:12:17,  7.62s/it]
 46%|████▌     | 17550/37963 [42:08:50<42:48:38,  7.55s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.125', 'learning_rate': '1.17e-05', 'epoch': '0.4623'}

 46%|████▌     | 17550/37963 [42:08:50<42:48:38,  7.55s/it]
 46%|████▌     | 17551/37963 [42:08:58<42:49:01,  7.55s/it]
 46%|████▌     | 17552/37963 [42:09:05<42:48:22,  7.55s/it]
 46%|████▌     | 17553/37963 [42:09:13<42:32:51,  7.50s/it]
 46%|████▌     | 17554/37963 [42:09:27<53:24:19,  9.42s/it]
 46%|████▌     | 17555/37963 [42:09:34<50:07:16,  8.84s/it]
 46%|████▌     | 17556/37963 [42:09:54<69:52:32, 12.33s/it]
 46%|████▌     | 17557/37963 [42:10:02<61:37:40, 10.87s/it]
 46%|████▋     | 17558/37963 [42:10:10<56:02:18,  9.89s/it]
 46%|████▋     | 17559/37963 [42:10:17<51:41:47,  9.12s/it]
 46%|████▋     | 17560/37963 [42:10:24<49:00:20,  8.65s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.589', 'learning_rate': '1.169e-05', 'epoch': '0.4626'}

 46%|████▋     | 17560/37963 [42:10:24<49:00:20,  8.65s/it]
 46%|████▋     | 17561/37963 [42:10:32<47:20:25,  8.35s/it]
 46%|████▋     | 17562/37963 [42:10:40<46:02:34,  8.12s/it]
 46%|████▋     | 17563/37963 [42:10:47<45:05:06,  7.96s/it]
 46%|████▋     | 17564/37963 [42:10:55<44:21:33,  7.83s/it]
 46%|████▋     | 17565/37963 [42:11:02<43:35:12,  7.69s/it]
 46%|████▋     | 17566/37963 [42:11:10<43:16:18,  7.64s/it]
 46%|████▋     | 17567/37963 [42:11:24<53:54:44,  9.52s/it]
 46%|████▋     | 17568/37963 [42:11:31<50:36:44,  8.93s/it]
 46%|████▋     | 17569/37963 [42:11:39<48:24:54,  8.55s/it]
 46%|████▋     | 17570/37963 [42:11:46<46:34:24,  8.22s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '1.174', 'learning_rate': '1.168e-05', 'epoch': '0.4628'}

 46%|████▋     | 17570/37963 [42:11:46<46:34:24,  8.22s/it]
 46%|████▋     | 17571/37963 [42:11:54<45:26:09,  8.02s/it]
 46%|████▋     | 17572/37963 [42:12:01<44:17:14,  7.82s/it]
 46%|████▋     | 17573/37963 [42:12:09<43:47:42,  7.73s/it]
 46%|████▋     | 17574/37963 [42:12:16<43:25:42,  7.67s/it]
 46%|████▋     | 17575/37963 [42:12:30<54:01:03,  9.54s/it]
 46%|████▋     | 17576/37963 [42:12:38<50:34:47,  8.93s/it]
 46%|████▋     | 17577/37963 [42:12:45<48:13:47,  8.52s/it]
 46%|████▋     | 17578/37963 [42:12:53<46:36:01,  8.23s/it]
 46%|████▋     | 17579/37963 [42:13:00<45:19:56,  8.01s/it]
 46%|████▋     | 17580/37963 [42:13:08<44:35:30,  7.88s/it]
                                                           
{'loss': '0.156', 'grad_norm': '2.267', 'learning_rate': '1.167e-05', 'epoch': '0.4631'}

 46%|████▋     | 17580/37963 [42:13:08<44:35:30,  7.88s/it]
 46%|████▋     | 17581/37963 [42:13:15<44:07:05,  7.79s/it]
 46%|████▋     | 17582/37963 [42:13:30<55:01:51,  9.72s/it]
 46%|████▋     | 17583/37963 [42:13:37<50:55:17,  8.99s/it]
 46%|████▋     | 17584/37963 [42:13:44<48:06:15,  8.50s/it]
 46%|████▋     | 17585/37963 [42:13:52<46:22:38,  8.19s/it]
 46%|████▋     | 17586/37963 [42:13:59<45:17:58,  8.00s/it]
 46%|████▋     | 17587/37963 [42:14:07<44:11:01,  7.81s/it]
 46%|████▋     | 17588/37963 [42:14:14<43:31:26,  7.69s/it]
 46%|████▋     | 17589/37963 [42:14:28<54:14:49,  9.59s/it]
 46%|████▋     | 17590/37963 [42:14:36<50:48:54,  8.98s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '3.345', 'learning_rate': '1.167e-05', 'epoch': '0.4633'}

 46%|████▋     | 17590/37963 [42:14:36<50:48:54,  8.98s/it]
 46%|████▋     | 17591/37963 [42:14:43<48:16:20,  8.53s/it]
 46%|████▋     | 17592/37963 [42:14:51<46:40:30,  8.25s/it]
 46%|████▋     | 17593/37963 [42:14:58<45:25:18,  8.03s/it]
 46%|████▋     | 17594/37963 [42:15:06<44:38:40,  7.89s/it]
 46%|████▋     | 17595/37963 [42:15:13<44:04:54,  7.79s/it]
 46%|████▋     | 17596/37963 [42:15:21<43:35:05,  7.70s/it]
 46%|████▋     | 17597/37963 [42:15:28<43:09:46,  7.63s/it]
 46%|████▋     | 17598/37963 [42:15:36<42:35:36,  7.53s/it]
 46%|████▋     | 17599/37963 [42:15:43<42:42:06,  7.55s/it]
 46%|████▋     | 17600/37963 [42:15:50<42:17:32,  7.48s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.267', 'learning_rate': '1.166e-05', 'epoch': '0.4636'}

 46%|████▋     | 17600/37963 [42:15:50<42:17:32,  7.48s/it]
 46%|████▋     | 17601/37963 [42:16:04<53:18:19,  9.42s/it]
 46%|████▋     | 17602/37963 [42:16:12<50:01:20,  8.84s/it]
 46%|████▋     | 17603/37963 [42:16:19<47:50:34,  8.46s/it]
 46%|████▋     | 17604/37963 [42:16:27<46:13:15,  8.17s/it]
 46%|████▋     | 17605/37963 [42:16:35<45:12:54,  8.00s/it]
 46%|████▋     | 17606/37963 [42:16:42<43:57:37,  7.77s/it]
 46%|████▋     | 17607/37963 [42:16:49<43:38:36,  7.72s/it]
 46%|████▋     | 17608/37963 [42:16:57<43:14:42,  7.65s/it]
 46%|████▋     | 17609/37963 [42:17:11<53:54:58,  9.54s/it]
 46%|████▋     | 17610/37963 [42:17:31<72:10:13, 12.77s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.21', 'learning_rate': '1.165e-05', 'epoch': '0.4639'}

 46%|████▋     | 17610/37963 [42:17:31<72:10:13, 12.77s/it]
 46%|████▋     | 17611/37963 [42:17:39<63:35:14, 11.25s/it]
 46%|████▋     | 17612/37963 [42:17:47<57:33:30, 10.18s/it]
 46%|████▋     | 17613/37963 [42:17:54<52:40:29,  9.32s/it]
 46%|████▋     | 17614/37963 [42:18:01<49:34:17,  8.77s/it]
 46%|████▋     | 17615/37963 [42:18:09<47:04:02,  8.33s/it]
 46%|████▋     | 17616/37963 [42:18:16<45:40:36,  8.08s/it]
 46%|████▋     | 17617/37963 [42:18:24<44:53:42,  7.94s/it]
 46%|████▋     | 17618/37963 [42:18:37<54:27:30,  9.64s/it]
 46%|████▋     | 17619/37963 [42:18:45<51:08:21,  9.05s/it]
 46%|████▋     | 17620/37963 [42:18:53<48:33:34,  8.59s/it]
                                                           
{'loss': '0.1455', 'grad_norm': '2.321', 'learning_rate': '1.164e-05', 'epoch': '0.4641'}

 46%|████▋     | 17620/37963 [42:18:53<48:33:34,  8.59s/it]
 46%|████▋     | 17621/37963 [42:19:00<46:08:43,  8.17s/it]
 46%|████▋     | 17622/37963 [42:19:07<45:05:41,  7.98s/it]
 46%|████▋     | 17623/37963 [42:19:15<44:16:32,  7.84s/it]
 46%|████▋     | 17624/37963 [42:19:22<43:46:59,  7.75s/it]
 46%|████▋     | 17625/37963 [42:19:36<54:09:02,  9.59s/it]
 46%|████▋     | 17626/37963 [42:19:43<49:54:54,  8.84s/it]
 46%|████▋     | 17627/37963 [42:19:51<47:32:39,  8.42s/it]
 46%|████▋     | 17628/37963 [42:19:58<46:00:08,  8.14s/it]
 46%|████▋     | 17629/37963 [42:20:06<44:50:00,  7.94s/it]
 46%|████▋     | 17630/37963 [42:20:19<54:45:26,  9.69s/it]
                                                           
{'loss': '0.141', 'grad_norm': '3.397', 'learning_rate': '1.163e-05', 'epoch': '0.4644'}

 46%|████▋     | 17630/37963 [42:20:19<54:45:26,  9.69s/it]
 46%|████▋     | 17631/37963 [42:20:27<50:52:53,  9.01s/it]
 46%|████▋     | 17632/37963 [42:20:35<48:31:56,  8.59s/it]
 46%|████▋     | 17633/37963 [42:20:42<46:29:52,  8.23s/it]
 46%|████▋     | 17634/37963 [42:20:49<44:55:20,  7.96s/it]
 46%|████▋     | 17635/37963 [42:20:57<44:13:59,  7.83s/it]
 46%|████▋     | 17636/37963 [42:21:04<43:55:19,  7.78s/it]
 46%|████▋     | 17637/37963 [42:21:12<43:42:19,  7.74s/it]
 46%|████▋     | 17638/37963 [42:21:26<54:36:27,  9.67s/it]
 46%|████▋     | 17639/37963 [42:21:34<50:37:27,  8.97s/it]
 46%|████▋     | 17640/37963 [42:21:41<48:27:55,  8.59s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.414', 'learning_rate': '1.162e-05', 'epoch': '0.4647'}

 46%|████▋     | 17640/37963 [42:21:41<48:27:55,  8.59s/it]
 46%|████▋     | 17641/37963 [42:21:49<46:47:05,  8.29s/it]
 46%|████▋     | 17642/37963 [42:21:56<45:30:36,  8.06s/it]
 46%|████▋     | 17643/37963 [42:22:04<44:44:28,  7.93s/it]
 46%|████▋     | 17644/37963 [42:22:12<44:16:21,  7.84s/it]
 46%|████▋     | 17645/37963 [42:22:26<54:38:21,  9.68s/it]
 46%|████▋     | 17646/37963 [42:22:33<51:02:58,  9.05s/it]
 46%|████▋     | 17647/37963 [42:22:41<48:29:02,  8.59s/it]
 46%|████▋     | 17648/37963 [42:22:48<46:34:55,  8.25s/it]
 46%|████▋     | 17649/37963 [42:22:56<45:17:43,  8.03s/it]
 46%|████▋     | 17650/37963 [42:23:03<44:39:19,  7.91s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '2.679', 'learning_rate': '1.162e-05', 'epoch': '0.4649'}

 46%|████▋     | 17650/37963 [42:23:03<44:39:19,  7.91s/it]
 46%|████▋     | 17651/37963 [42:23:11<43:39:45,  7.74s/it]
 46%|████▋     | 17652/37963 [42:23:18<43:08:36,  7.65s/it]
 47%|████▋     | 17653/37963 [42:23:26<42:50:10,  7.59s/it]
 47%|████▋     | 17654/37963 [42:23:33<42:49:55,  7.59s/it]
 47%|████▋     | 17655/37963 [42:23:48<54:19:27,  9.63s/it]
 47%|████▋     | 17656/37963 [42:23:55<50:43:15,  8.99s/it]
 47%|████▋     | 17657/37963 [42:24:03<48:16:05,  8.56s/it]
 47%|████▋     | 17658/37963 [42:24:17<57:24:34, 10.18s/it]
 47%|████▋     | 17659/37963 [42:24:31<63:56:04, 11.34s/it]
 47%|████▋     | 17660/37963 [42:24:38<57:13:18, 10.15s/it]
                                                           
{'loss': '0.157', 'grad_norm': '2.381', 'learning_rate': '1.161e-05', 'epoch': '0.4652'}

 47%|████▋     | 17660/37963 [42:24:38<57:13:18, 10.15s/it]
 47%|████▋     | 17661/37963 [42:24:45<52:44:01,  9.35s/it]
 47%|████▋     | 17662/37963 [42:24:53<49:45:25,  8.82s/it]
 47%|████▋     | 17663/37963 [42:25:01<47:36:16,  8.44s/it]
 47%|████▋     | 17664/37963 [42:25:14<56:06:07,  9.95s/it]
 47%|████▋     | 17665/37963 [42:25:21<51:23:54,  9.12s/it]
 47%|████▋     | 17666/37963 [42:25:29<48:45:47,  8.65s/it]
 47%|████▋     | 17667/37963 [42:25:36<46:51:38,  8.31s/it]
 47%|████▋     | 17668/37963 [42:25:44<45:33:43,  8.08s/it]
 47%|████▋     | 17669/37963 [42:25:51<44:12:52,  7.84s/it]
 47%|████▋     | 17670/37963 [42:25:59<43:28:28,  7.71s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.028', 'learning_rate': '1.16e-05', 'epoch': '0.4655'}

 47%|████▋     | 17670/37963 [42:25:59<43:28:28,  7.71s/it]
 47%|████▋     | 17671/37963 [42:26:06<42:52:59,  7.61s/it]
 47%|████▋     | 17672/37963 [42:26:13<42:42:33,  7.58s/it]
 47%|████▋     | 17673/37963 [42:26:21<42:56:06,  7.62s/it]
 47%|████▋     | 17674/37963 [42:26:28<42:18:53,  7.51s/it]
 47%|████▋     | 17675/37963 [42:26:36<42:20:22,  7.51s/it]
 47%|████▋     | 17676/37963 [42:26:43<42:25:05,  7.53s/it]
 47%|████▋     | 17677/37963 [42:26:57<53:19:51,  9.46s/it]
 47%|████▋     | 17678/37963 [42:27:11<60:57:52, 10.82s/it]
 47%|████▋     | 17679/37963 [42:27:19<55:19:13,  9.82s/it]
 47%|████▋     | 17680/37963 [42:27:26<51:24:32,  9.12s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.699', 'learning_rate': '1.159e-05', 'epoch': '0.4657'}

 47%|████▋     | 17680/37963 [42:27:26<51:24:32,  9.12s/it]
 47%|████▋     | 17681/37963 [42:27:34<48:36:08,  8.63s/it]
 47%|████▋     | 17682/37963 [42:27:41<46:36:13,  8.27s/it]
 47%|████▋     | 17683/37963 [42:27:49<45:24:58,  8.06s/it]
 47%|████▋     | 17684/37963 [42:27:56<44:28:27,  7.90s/it]
 47%|████▋     | 17685/37963 [42:28:10<54:24:48,  9.66s/it]
 47%|████▋     | 17686/37963 [42:28:18<51:02:28,  9.06s/it]
 47%|████▋     | 17687/37963 [42:28:25<48:22:46,  8.59s/it]
 47%|████▋     | 17688/37963 [42:28:33<46:51:52,  8.32s/it]
 47%|████▋     | 17689/37963 [42:28:41<45:35:27,  8.10s/it]
 47%|████▋     | 17690/37963 [42:28:48<44:34:20,  7.91s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '1.89', 'learning_rate': '1.158e-05', 'epoch': '0.466'}

 47%|████▋     | 17690/37963 [42:28:48<44:34:20,  7.91s/it]
 47%|████▋     | 17691/37963 [42:28:56<44:01:32,  7.82s/it]
 47%|████▋     | 17692/37963 [42:29:03<43:31:33,  7.73s/it]
 47%|████▋     | 17693/37963 [42:29:11<43:08:39,  7.66s/it]
 47%|████▋     | 17694/37963 [42:29:18<42:39:17,  7.58s/it]
 47%|████▋     | 17695/37963 [42:29:26<42:27:19,  7.54s/it]
 47%|████▋     | 17696/37963 [42:29:33<42:24:30,  7.53s/it]
 47%|████▋     | 17697/37963 [42:29:41<42:24:40,  7.53s/it]
 47%|████▋     | 17698/37963 [42:29:48<42:08:15,  7.49s/it]
 47%|████▋     | 17699/37963 [42:30:02<53:00:58,  9.42s/it]
 47%|████▋     | 17700/37963 [42:30:09<49:40:18,  8.82s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '3.37', 'learning_rate': '1.157e-05', 'epoch': '0.4662'}

 47%|████▋     | 17700/37963 [42:30:09<49:40:18,  8.82s/it]
 47%|████▋     | 17701/37963 [42:30:17<47:02:09,  8.36s/it]
 47%|████▋     | 17702/37963 [42:30:31<56:31:23, 10.04s/it]
 47%|████▋     | 17703/37963 [42:30:38<52:27:27,  9.32s/it]
 47%|████▋     | 17704/37963 [42:30:46<49:47:01,  8.85s/it]
 47%|████▋     | 17705/37963 [42:30:53<46:58:51,  8.35s/it]
 47%|████▋     | 17706/37963 [42:31:01<45:28:55,  8.08s/it]
 47%|████▋     | 17707/37963 [42:31:08<44:34:55,  7.92s/it]
 47%|████▋     | 17708/37963 [42:31:22<54:47:10,  9.74s/it]
 47%|████▋     | 17709/37963 [42:31:30<51:09:08,  9.09s/it]
 47%|████▋     | 17710/37963 [42:31:44<59:48:22, 10.63s/it]
                                                           
{'loss': '0.1504', 'grad_norm': '1.736', 'learning_rate': '1.157e-05', 'epoch': '0.4665'}

 47%|████▋     | 17710/37963 [42:31:44<59:48:22, 10.63s/it]
 47%|████▋     | 17711/37963 [42:31:52<54:44:24,  9.73s/it]
 47%|████▋     | 17712/37963 [42:31:59<51:12:20,  9.10s/it]
 47%|████▋     | 17713/37963 [42:32:13<59:10:41, 10.52s/it]
 47%|████▋     | 17714/37963 [42:32:21<54:06:15,  9.62s/it]
 47%|████▋     | 17715/37963 [42:32:28<49:49:05,  8.86s/it]
 47%|████▋     | 17716/37963 [42:32:35<47:31:10,  8.45s/it]
 47%|████▋     | 17717/37963 [42:32:43<45:57:58,  8.17s/it]
 47%|████▋     | 17718/37963 [42:32:50<44:52:52,  7.98s/it]
 47%|████▋     | 17719/37963 [42:32:58<44:14:41,  7.87s/it]
 47%|████▋     | 17720/37963 [42:33:05<43:33:34,  7.75s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '1.629', 'learning_rate': '1.156e-05', 'epoch': '0.4668'}

 47%|████▋     | 17720/37963 [42:33:05<43:33:34,  7.75s/it]
 47%|████▋     | 17721/37963 [42:33:13<43:07:53,  7.67s/it]
 47%|████▋     | 17722/37963 [42:33:20<42:52:56,  7.63s/it]
 47%|████▋     | 17723/37963 [42:33:28<42:21:23,  7.53s/it]
 47%|████▋     | 17724/37963 [42:33:35<42:07:01,  7.49s/it]
 47%|████▋     | 17725/37963 [42:33:43<42:16:56,  7.52s/it]
 47%|████▋     | 17726/37963 [42:33:57<53:55:10,  9.59s/it]
 47%|████▋     | 17727/37963 [42:34:11<61:38:02, 10.96s/it]
 47%|████▋     | 17728/37963 [42:34:19<55:48:16,  9.93s/it]
 47%|████▋     | 17729/37963 [42:34:26<51:15:41,  9.12s/it]
 47%|████▋     | 17730/37963 [42:34:33<48:28:23,  8.62s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '4.02', 'learning_rate': '1.155e-05', 'epoch': '0.467'}

 47%|████▋     | 17730/37963 [42:34:33<48:28:23,  8.62s/it]
 47%|████▋     | 17731/37963 [42:34:41<46:28:18,  8.27s/it]
 47%|████▋     | 17732/37963 [42:34:55<56:07:34,  9.99s/it]
 47%|████▋     | 17733/37963 [42:35:02<51:57:30,  9.25s/it]
 47%|████▋     | 17734/37963 [42:35:10<49:05:36,  8.74s/it]
 47%|████▋     | 17735/37963 [42:35:17<47:05:17,  8.38s/it]
 47%|████▋     | 17736/37963 [42:35:25<45:57:58,  8.18s/it]
 47%|████▋     | 17737/37963 [42:35:33<44:59:33,  8.01s/it]
 47%|████▋     | 17738/37963 [42:35:40<44:17:23,  7.88s/it]
 47%|████▋     | 17739/37963 [42:35:48<43:41:17,  7.78s/it]
 47%|████▋     | 17740/37963 [42:35:55<42:50:35,  7.63s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.514', 'learning_rate': '1.154e-05', 'epoch': '0.4673'}

 47%|████▋     | 17740/37963 [42:35:55<42:50:35,  7.63s/it]
 47%|████▋     | 17741/37963 [42:36:03<42:24:59,  7.55s/it]
 47%|████▋     | 17742/37963 [42:36:10<42:29:02,  7.56s/it]
 47%|████▋     | 17743/37963 [42:36:18<42:21:26,  7.54s/it]
 47%|████▋     | 17744/37963 [42:36:25<42:17:21,  7.53s/it]
 47%|████▋     | 17745/37963 [42:36:33<42:17:04,  7.53s/it]
 47%|████▋     | 17746/37963 [42:36:47<53:15:01,  9.48s/it]
 47%|████▋     | 17747/37963 [42:36:54<49:51:59,  8.88s/it]
 47%|████▋     | 17748/37963 [42:37:02<47:44:45,  8.50s/it]
 47%|████▋     | 17749/37963 [42:37:16<57:01:29, 10.16s/it]
 47%|████▋     | 17750/37963 [42:37:23<52:31:46,  9.36s/it]
                                                           
{'loss': '0.1406', 'grad_norm': '0.9642', 'learning_rate': '1.153e-05', 'epoch': '0.4676'}

 47%|████▋     | 17750/37963 [42:37:23<52:31:46,  9.36s/it]
 47%|████▋     | 17751/37963 [42:37:31<49:25:51,  8.80s/it]
 47%|████▋     | 17752/37963 [42:37:38<47:16:40,  8.42s/it]
 47%|████▋     | 17753/37963 [42:37:46<45:50:00,  8.16s/it]
 47%|████▋     | 17754/37963 [42:37:53<44:48:53,  7.98s/it]
 47%|████▋     | 17755/37963 [42:38:01<43:42:54,  7.79s/it]
 47%|████▋     | 17756/37963 [42:38:15<54:00:55,  9.62s/it]
 47%|████▋     | 17757/37963 [42:38:22<50:40:43,  9.03s/it]
 47%|████▋     | 17758/37963 [42:38:30<48:18:38,  8.61s/it]
 47%|████▋     | 17759/37963 [42:38:44<57:25:32, 10.23s/it]
 47%|████▋     | 17760/37963 [42:38:52<53:05:40,  9.46s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '2.944', 'learning_rate': '1.152e-05', 'epoch': '0.4678'}

 47%|████▋     | 17760/37963 [42:38:52<53:05:40,  9.46s/it]
 47%|████▋     | 17761/37963 [42:39:05<60:20:15, 10.75s/it]
 47%|████▋     | 17762/37963 [42:39:13<55:05:29,  9.82s/it]
 47%|████▋     | 17763/37963 [42:39:21<51:09:14,  9.12s/it]
 47%|████▋     | 17764/37963 [42:39:28<48:27:25,  8.64s/it]
 47%|████▋     | 17765/37963 [42:39:36<46:55:53,  8.36s/it]
 47%|████▋     | 17766/37963 [42:39:43<45:42:31,  8.15s/it]
 47%|████▋     | 17767/37963 [42:39:51<44:22:16,  7.91s/it]
 47%|████▋     | 17768/37963 [42:39:58<43:42:41,  7.79s/it]
 47%|████▋     | 17769/37963 [42:40:06<43:00:45,  7.67s/it]
 47%|████▋     | 17770/37963 [42:40:13<43:03:41,  7.68s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '1.287', 'learning_rate': '1.151e-05', 'epoch': '0.4681'}

 47%|████▋     | 17770/37963 [42:40:13<43:03:41,  7.68s/it]
 47%|████▋     | 17771/37963 [42:40:21<42:49:00,  7.63s/it]
 47%|████▋     | 17772/37963 [42:40:28<42:41:37,  7.61s/it]
 47%|████▋     | 17773/37963 [42:40:43<53:32:19,  9.55s/it]
 47%|████▋     | 17774/37963 [42:40:57<61:01:01, 10.88s/it]
 47%|████▋     | 17775/37963 [42:41:04<55:20:57,  9.87s/it]
 47%|████▋     | 17776/37963 [42:41:18<61:45:20, 11.01s/it]
 47%|████▋     | 17777/37963 [42:41:25<55:44:43,  9.94s/it]
 47%|████▋     | 17778/37963 [42:41:32<51:17:42,  9.15s/it]
 47%|████▋     | 17779/37963 [42:41:40<48:45:55,  8.70s/it]
 47%|████▋     | 17780/37963 [42:41:47<46:24:29,  8.28s/it]
                                                           
{'loss': '0.148', 'grad_norm': '0.8929', 'learning_rate': '1.151e-05', 'epoch': '0.4684'}

 47%|████▋     | 17780/37963 [42:41:47<46:24:29,  8.28s/it]
 47%|████▋     | 17781/37963 [42:41:55<45:02:52,  8.04s/it]
 47%|████▋     | 17782/37963 [42:42:02<44:01:53,  7.85s/it]
 47%|████▋     | 17783/37963 [42:42:10<43:23:08,  7.74s/it]
 47%|████▋     | 17784/37963 [42:42:17<42:52:39,  7.65s/it]
 47%|████▋     | 17785/37963 [42:42:25<42:48:43,  7.64s/it]
 47%|████▋     | 17786/37963 [42:42:32<42:33:45,  7.59s/it]
 47%|████▋     | 17787/37963 [42:42:39<41:52:48,  7.47s/it]
 47%|████▋     | 17788/37963 [42:42:47<41:53:03,  7.47s/it]
 47%|████▋     | 17789/37963 [42:42:55<42:01:57,  7.50s/it]
 47%|████▋     | 17790/37963 [42:43:02<42:10:14,  7.53s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '4.604', 'learning_rate': '1.15e-05', 'epoch': '0.4686'}

 47%|████▋     | 17790/37963 [42:43:02<42:10:14,  7.53s/it]
 47%|████▋     | 17791/37963 [42:43:10<42:23:33,  7.57s/it]
 47%|████▋     | 17792/37963 [42:43:17<42:20:08,  7.56s/it]
 47%|████▋     | 17793/37963 [42:43:31<53:10:00,  9.49s/it]
 47%|████▋     | 17794/37963 [42:43:39<49:53:58,  8.91s/it]
 47%|████▋     | 17795/37963 [42:43:53<58:53:46, 10.51s/it]
 47%|████▋     | 17796/37963 [42:44:01<54:12:46,  9.68s/it]
 47%|████▋     | 17797/37963 [42:44:08<50:18:44,  8.98s/it]
 47%|████▋     | 17798/37963 [42:44:16<47:54:00,  8.55s/it]
 47%|████▋     | 17799/37963 [42:44:23<46:12:07,  8.25s/it]
 47%|████▋     | 17800/37963 [42:44:31<44:42:48,  7.98s/it]
                                                           
{'loss': '0.1593', 'grad_norm': '3.321', 'learning_rate': '1.149e-05', 'epoch': '0.4689'}

 47%|████▋     | 17800/37963 [42:44:31<44:42:48,  7.98s/it]
 47%|████▋     | 17801/37963 [42:44:45<54:51:06,  9.79s/it]
 47%|████▋     | 17802/37963 [42:44:52<50:56:54,  9.10s/it]
 47%|████▋     | 17803/37963 [42:44:59<47:56:15,  8.56s/it]
 47%|████▋     | 17804/37963 [42:45:07<46:06:37,  8.23s/it]
 47%|████▋     | 17805/37963 [42:45:21<55:56:57,  9.99s/it]
 47%|████▋     | 17806/37963 [42:45:28<51:28:55,  9.19s/it]
 47%|████▋     | 17807/37963 [42:45:36<48:36:02,  8.68s/it]
 47%|████▋     | 17808/37963 [42:45:43<46:18:38,  8.27s/it]
 47%|████▋     | 17809/37963 [42:45:57<55:43:13,  9.95s/it]
 47%|████▋     | 17810/37963 [42:46:05<51:36:11,  9.22s/it]
                                                           
{'loss': '0.1543', 'grad_norm': '1.024', 'learning_rate': '1.148e-05', 'epoch': '0.4691'}

 47%|████▋     | 17810/37963 [42:46:05<51:36:11,  9.22s/it]
 47%|████▋     | 17811/37963 [42:46:12<48:22:02,  8.64s/it]
 47%|████▋     | 17812/37963 [42:46:19<45:57:38,  8.21s/it]
 47%|████▋     | 17813/37963 [42:46:27<44:44:15,  7.99s/it]
 47%|████▋     | 17814/37963 [42:46:34<44:02:01,  7.87s/it]
 47%|████▋     | 17815/37963 [42:46:42<43:28:25,  7.77s/it]
 47%|████▋     | 17816/37963 [42:46:49<43:00:06,  7.68s/it]
 47%|████▋     | 17817/37963 [42:47:03<53:09:17,  9.50s/it]
 47%|████▋     | 17818/37963 [42:47:10<49:50:58,  8.91s/it]
 47%|████▋     | 17819/37963 [42:47:24<58:04:47, 10.38s/it]
 47%|████▋     | 17820/37963 [42:47:32<53:20:33,  9.53s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.609', 'learning_rate': '1.147e-05', 'epoch': '0.4694'}

 47%|████▋     | 17820/37963 [42:47:32<53:20:33,  9.53s/it]
 47%|████▋     | 17821/37963 [42:47:39<50:15:46,  8.98s/it]
 47%|████▋     | 17822/37963 [42:47:47<47:43:27,  8.53s/it]
 47%|████▋     | 17823/37963 [42:47:54<45:51:39,  8.20s/it]
 47%|████▋     | 17824/37963 [42:48:02<44:37:59,  7.98s/it]
 47%|████▋     | 17825/37963 [42:48:16<54:32:31,  9.75s/it]
 47%|████▋     | 17826/37963 [42:48:23<50:27:36,  9.02s/it]
 47%|████▋     | 17827/37963 [42:48:31<47:52:46,  8.56s/it]
 47%|████▋     | 17828/37963 [42:48:38<46:14:46,  8.27s/it]
 47%|████▋     | 17829/37963 [42:48:45<44:46:27,  8.01s/it]
 47%|████▋     | 17830/37963 [42:48:53<44:20:32,  7.93s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.477', 'learning_rate': '1.146e-05', 'epoch': '0.4697'}

 47%|████▋     | 17830/37963 [42:48:53<44:20:32,  7.93s/it]
 47%|████▋     | 17831/37963 [42:49:01<43:43:12,  7.82s/it]
 47%|████▋     | 17832/37963 [42:49:08<43:04:16,  7.70s/it]
 47%|████▋     | 17833/37963 [42:49:16<42:42:23,  7.64s/it]
 47%|████▋     | 17834/37963 [42:49:23<42:39:27,  7.63s/it]
 47%|████▋     | 17835/37963 [42:49:31<42:27:48,  7.59s/it]
 47%|████▋     | 17836/37963 [42:49:38<42:17:10,  7.56s/it]
 47%|████▋     | 17837/37963 [42:49:46<42:09:33,  7.54s/it]
 47%|████▋     | 17838/37963 [42:49:53<41:30:33,  7.43s/it]
 47%|████▋     | 17839/37963 [42:50:07<52:23:04,  9.37s/it]
 47%|████▋     | 17840/37963 [42:50:14<49:12:52,  8.80s/it]
                                                           
{'loss': '0.1484', 'grad_norm': '2.26', 'learning_rate': '1.146e-05', 'epoch': '0.4699'}

 47%|████▋     | 17840/37963 [42:50:14<49:12:52,  8.80s/it]
 47%|████▋     | 17841/37963 [42:50:28<57:34:15, 10.30s/it]
 47%|████▋     | 17842/37963 [42:50:36<52:51:33,  9.46s/it]
 47%|████▋     | 17843/37963 [42:50:43<49:40:53,  8.89s/it]
 47%|████▋     | 17844/37963 [42:50:51<47:20:45,  8.47s/it]
 47%|████▋     | 17845/37963 [42:50:58<45:17:12,  8.10s/it]
 47%|████▋     | 17846/37963 [42:51:05<44:14:54,  7.92s/it]
 47%|████▋     | 17847/37963 [42:51:13<43:35:44,  7.80s/it]
 47%|████▋     | 17848/37963 [42:51:20<42:46:09,  7.65s/it]
 47%|████▋     | 17849/37963 [42:51:28<42:29:42,  7.61s/it]
 47%|████▋     | 17850/37963 [42:51:35<42:19:12,  7.57s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.524', 'learning_rate': '1.145e-05', 'epoch': '0.4702'}

 47%|████▋     | 17850/37963 [42:51:35<42:19:12,  7.57s/it]
 47%|████▋     | 17851/37963 [42:51:49<53:14:52,  9.53s/it]
 47%|████▋     | 17852/37963 [42:51:57<49:57:01,  8.94s/it]
 47%|████▋     | 17853/37963 [42:52:04<47:31:22,  8.51s/it]
 47%|████▋     | 17854/37963 [42:52:12<45:55:26,  8.22s/it]
 47%|████▋     | 17855/37963 [42:52:26<55:16:34,  9.90s/it]
 47%|████▋     | 17856/37963 [42:52:33<51:19:51,  9.19s/it]
 47%|████▋     | 17857/37963 [42:52:41<48:07:44,  8.62s/it]
 47%|████▋     | 17858/37963 [42:52:48<46:18:18,  8.29s/it]
 47%|████▋     | 17859/37963 [42:52:56<44:56:40,  8.05s/it]
 47%|████▋     | 17860/37963 [42:53:03<43:46:25,  7.84s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.138', 'learning_rate': '1.144e-05', 'epoch': '0.4705'}

 47%|████▋     | 17860/37963 [42:53:03<43:46:25,  7.84s/it]
 47%|████▋     | 17861/37963 [42:53:11<43:17:56,  7.75s/it]
 47%|████▋     | 17862/37963 [42:53:18<42:54:25,  7.68s/it]
 47%|████▋     | 17863/37963 [42:53:32<53:12:13,  9.53s/it]
 47%|████▋     | 17864/37963 [42:53:39<49:55:50,  8.94s/it]
 47%|████▋     | 17865/37963 [42:53:53<58:23:19, 10.46s/it]
 47%|████▋     | 17866/37963 [42:54:01<53:51:59,  9.65s/it]
 47%|████▋     | 17867/37963 [42:54:09<50:16:57,  9.01s/it]
 47%|████▋     | 17868/37963 [42:54:16<47:49:29,  8.57s/it]
 47%|████▋     | 17869/37963 [42:54:24<46:23:02,  8.31s/it]
 47%|████▋     | 17870/37963 [42:54:32<45:07:07,  8.08s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '1.695', 'learning_rate': '1.143e-05', 'epoch': '0.4707'}

 47%|████▋     | 17870/37963 [42:54:32<45:07:07,  8.08s/it]
 47%|████▋     | 17871/37963 [42:54:39<44:08:48,  7.91s/it]
 47%|████▋     | 17872/37963 [42:54:47<43:31:10,  7.80s/it]
 47%|████▋     | 17873/37963 [42:55:00<53:31:50,  9.59s/it]
 47%|████▋     | 17874/37963 [42:55:14<60:44:26, 10.88s/it]
 47%|████▋     | 17875/37963 [42:55:22<54:48:59,  9.82s/it]
 47%|████▋     | 17876/37963 [42:55:29<51:08:16,  9.16s/it]
 47%|████▋     | 17877/37963 [42:55:37<48:14:26,  8.65s/it]
 47%|████▋     | 17878/37963 [42:55:44<46:26:01,  8.32s/it]
 47%|████▋     | 17879/37963 [42:55:52<45:20:34,  8.13s/it]
 47%|████▋     | 17880/37963 [42:55:59<43:47:07,  7.85s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '2.375', 'learning_rate': '1.142e-05', 'epoch': '0.471'}

 47%|████▋     | 17880/37963 [42:55:59<43:47:07,  7.85s/it]
 47%|████▋     | 17881/37963 [42:56:07<43:14:39,  7.75s/it]
 47%|████▋     | 17882/37963 [42:56:14<42:56:45,  7.70s/it]
 47%|████▋     | 17883/37963 [42:56:22<42:44:48,  7.66s/it]
 47%|████▋     | 17884/37963 [42:56:29<42:28:44,  7.62s/it]
 47%|████▋     | 17885/37963 [42:56:37<42:30:41,  7.62s/it]
 47%|████▋     | 17886/37963 [42:56:44<42:18:40,  7.59s/it]
 47%|████▋     | 17887/37963 [42:56:52<42:31:08,  7.62s/it]
 47%|████▋     | 17888/37963 [42:57:00<42:32:09,  7.63s/it]
 47%|████▋     | 17889/37963 [42:57:14<53:46:07,  9.64s/it]
 47%|████▋     | 17890/37963 [42:57:22<50:32:27,  9.06s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.291', 'learning_rate': '1.141e-05', 'epoch': '0.4712'}

 47%|████▋     | 17890/37963 [42:57:22<50:32:27,  9.06s/it]
 47%|████▋     | 17891/37963 [42:57:36<58:21:47, 10.47s/it]
 47%|████▋     | 17892/37963 [42:57:43<53:05:46,  9.52s/it]
 47%|████▋     | 17893/37963 [42:57:50<49:39:31,  8.91s/it]
 47%|████▋     | 17894/37963 [42:57:58<47:13:07,  8.47s/it]
 47%|████▋     | 17895/37963 [42:58:06<45:53:36,  8.23s/it]
 47%|████▋     | 17896/37963 [42:58:13<44:43:22,  8.02s/it]
 47%|████▋     | 17897/37963 [42:58:21<44:04:39,  7.91s/it]
 47%|████▋     | 17898/37963 [42:58:28<43:29:32,  7.80s/it]
 47%|████▋     | 17899/37963 [42:58:42<53:39:07,  9.63s/it]
 47%|████▋     | 17900/37963 [42:58:50<50:16:03,  9.02s/it]
                                                           
{'loss': '0.1528', 'grad_norm': '2.148', 'learning_rate': '1.14e-05', 'epoch': '0.4715'}

 47%|████▋     | 17900/37963 [42:58:50<50:16:03,  9.02s/it]
 47%|████▋     | 17901/37963 [42:58:57<47:40:10,  8.55s/it]
 47%|████▋     | 17902/37963 [42:59:05<45:56:16,  8.24s/it]
 47%|████▋     | 17903/37963 [42:59:12<44:56:47,  8.07s/it]
 47%|████▋     | 17904/37963 [42:59:20<43:56:27,  7.89s/it]
 47%|████▋     | 17905/37963 [42:59:27<43:15:13,  7.76s/it]
 47%|████▋     | 17906/37963 [42:59:35<42:46:39,  7.68s/it]
 47%|████▋     | 17907/37963 [42:59:42<42:09:07,  7.57s/it]
 47%|████▋     | 17908/37963 [42:59:56<53:07:24,  9.54s/it]
 47%|████▋     | 17909/37963 [43:00:04<49:53:26,  8.96s/it]
 47%|████▋     | 17910/37963 [43:00:11<47:27:29,  8.52s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '2.423', 'learning_rate': '1.14e-05', 'epoch': '0.4718'}

 47%|████▋     | 17910/37963 [43:00:11<47:27:29,  8.52s/it]
 47%|████▋     | 17911/37963 [43:00:19<45:56:03,  8.25s/it]
 47%|████▋     | 17912/37963 [43:00:26<44:40:55,  8.02s/it]
 47%|████▋     | 17913/37963 [43:00:34<43:48:30,  7.87s/it]
 47%|████▋     | 17914/37963 [43:00:41<43:16:02,  7.77s/it]
 47%|████▋     | 17915/37963 [43:00:49<42:23:15,  7.61s/it]
 47%|████▋     | 17916/37963 [43:01:03<52:56:18,  9.51s/it]
 47%|████▋     | 17917/37963 [43:01:16<59:58:07, 10.77s/it]
 47%|████▋     | 17918/37963 [43:01:30<65:03:24, 11.68s/it]
 47%|████▋     | 17919/37963 [43:01:38<57:51:41, 10.39s/it]
 47%|████▋     | 17920/37963 [43:01:45<53:04:41,  9.53s/it]
                                                           
{'loss': '0.148', 'grad_norm': '1.545', 'learning_rate': '1.139e-05', 'epoch': '0.472'}

 47%|████▋     | 17920/37963 [43:01:45<53:04:41,  9.53s/it]
 47%|████▋     | 17921/37963 [43:01:53<49:42:33,  8.93s/it]
 47%|████▋     | 17922/37963 [43:02:07<58:08:54, 10.45s/it]
 47%|████▋     | 17923/37963 [43:02:14<53:36:36,  9.63s/it]
 47%|████▋     | 17924/37963 [43:02:22<49:51:33,  8.96s/it]
 47%|████▋     | 17925/37963 [43:02:29<47:21:39,  8.51s/it]
 47%|████▋     | 17926/37963 [43:02:37<45:33:25,  8.19s/it]
 47%|████▋     | 17927/37963 [43:02:44<44:08:27,  7.93s/it]
 47%|████▋     | 17928/37963 [43:02:52<43:42:36,  7.85s/it]
 47%|████▋     | 17929/37963 [43:02:59<43:16:18,  7.78s/it]
 47%|████▋     | 17930/37963 [43:03:07<42:38:53,  7.66s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.411', 'learning_rate': '1.138e-05', 'epoch': '0.4723'}

 47%|████▋     | 17930/37963 [43:03:07<42:38:53,  7.66s/it]
 47%|████▋     | 17931/37963 [43:03:14<42:24:58,  7.62s/it]
 47%|████▋     | 17932/37963 [43:03:22<42:11:38,  7.58s/it]
 47%|████▋     | 17933/37963 [43:03:29<42:06:21,  7.57s/it]
 47%|████▋     | 17934/37963 [43:03:37<42:05:44,  7.57s/it]
 47%|████▋     | 17935/37963 [43:03:44<41:47:48,  7.51s/it]
 47%|████▋     | 17936/37963 [43:03:58<52:19:01,  9.40s/it]
 47%|████▋     | 17937/37963 [43:04:06<49:20:57,  8.87s/it]
 47%|████▋     | 17938/37963 [43:04:20<58:04:09, 10.44s/it]
 47%|████▋     | 17939/37963 [43:04:27<52:57:31,  9.52s/it]
 47%|████▋     | 17940/37963 [43:04:35<49:39:52,  8.93s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '0.9712', 'learning_rate': '1.137e-05', 'epoch': '0.4726'}

 47%|████▋     | 17940/37963 [43:04:35<49:39:52,  8.93s/it]
 47%|████▋     | 17941/37963 [43:04:42<47:20:43,  8.51s/it]
 47%|████▋     | 17942/37963 [43:04:50<45:48:04,  8.24s/it]
 47%|████▋     | 17943/37963 [43:04:57<44:23:37,  7.98s/it]
 47%|████▋     | 17944/37963 [43:05:05<43:30:27,  7.82s/it]
 47%|████▋     | 17945/37963 [43:05:12<43:03:27,  7.74s/it]
 47%|████▋     | 17946/37963 [43:05:19<42:18:52,  7.61s/it]
 47%|████▋     | 17947/37963 [43:05:27<42:07:37,  7.58s/it]
 47%|████▋     | 17948/37963 [43:05:41<53:04:26,  9.55s/it]
 47%|████▋     | 17949/37963 [43:05:49<49:52:22,  8.97s/it]
 47%|████▋     | 17950/37963 [43:05:56<47:25:53,  8.53s/it]
                                                           
{'loss': '0.159', 'grad_norm': '3.794', 'learning_rate': '1.136e-05', 'epoch': '0.4728'}

 47%|████▋     | 17950/37963 [43:05:56<47:25:53,  8.53s/it]
 47%|████▋     | 17951/37963 [43:06:04<45:34:32,  8.20s/it]
 47%|████▋     | 17952/37963 [43:06:11<44:32:04,  8.01s/it]
 47%|████▋     | 17953/37963 [43:06:19<43:30:39,  7.83s/it]
 47%|████▋     | 17954/37963 [43:06:26<43:06:31,  7.76s/it]
 47%|████▋     | 17955/37963 [43:06:34<42:44:16,  7.69s/it]
 47%|████▋     | 17956/37963 [43:06:41<42:26:32,  7.64s/it]
 47%|████▋     | 17957/37963 [43:06:49<42:11:53,  7.59s/it]
 47%|████▋     | 17958/37963 [43:06:56<41:51:56,  7.53s/it]
 47%|████▋     | 17959/37963 [43:07:04<41:48:12,  7.52s/it]
 47%|████▋     | 17960/37963 [43:07:17<52:21:36,  9.42s/it]
                                                           
{'loss': '0.1395', 'grad_norm': '1.072', 'learning_rate': '1.135e-05', 'epoch': '0.4731'}

 47%|████▋     | 17960/37963 [43:07:17<52:21:36,  9.42s/it]
 47%|████▋     | 17961/37963 [43:07:32<60:07:44, 10.82s/it]
 47%|████▋     | 17962/37963 [43:07:39<54:37:15,  9.83s/it]
 47%|████▋     | 17963/37963 [43:07:46<50:35:19,  9.11s/it]
 47%|████▋     | 17964/37963 [43:08:00<58:44:09, 10.57s/it]
 47%|████▋     | 17965/37963 [43:08:08<53:46:12,  9.68s/it]
 47%|████▋     | 17966/37963 [43:08:15<49:41:22,  8.95s/it]
 47%|████▋     | 17967/37963 [43:08:23<47:25:27,  8.54s/it]
 47%|████▋     | 17968/37963 [43:08:30<45:33:53,  8.20s/it]
 47%|████▋     | 17969/37963 [43:08:38<44:36:30,  8.03s/it]
 47%|████▋     | 17970/37963 [43:08:46<43:49:18,  7.89s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '1.031', 'learning_rate': '1.135e-05', 'epoch': '0.4734'}

 47%|████▋     | 17970/37963 [43:08:46<43:49:18,  7.89s/it]
 47%|████▋     | 17971/37963 [43:08:53<43:10:55,  7.78s/it]
 47%|████▋     | 17972/37963 [43:09:07<53:38:34,  9.66s/it]
 47%|████▋     | 17973/37963 [43:09:15<49:55:57,  8.99s/it]
 47%|████▋     | 17974/37963 [43:09:22<47:20:01,  8.52s/it]
 47%|████▋     | 17975/37963 [43:09:29<45:42:48,  8.23s/it]
 47%|████▋     | 17976/37963 [43:09:43<55:00:36,  9.91s/it]
 47%|████▋     | 17977/37963 [43:09:51<50:55:57,  9.17s/it]
 47%|████▋     | 17978/37963 [43:09:58<48:09:34,  8.68s/it]
 47%|████▋     | 17979/37963 [43:10:05<45:38:04,  8.22s/it]
 47%|████▋     | 17980/37963 [43:10:13<44:29:40,  8.02s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '3.406', 'learning_rate': '1.134e-05', 'epoch': '0.4736'}

 47%|████▋     | 17980/37963 [43:10:13<44:29:40,  8.02s/it]
 47%|████▋     | 17981/37963 [43:10:21<43:46:06,  7.89s/it]
 47%|████▋     | 17982/37963 [43:10:28<43:09:52,  7.78s/it]
 47%|████▋     | 17983/37963 [43:10:35<42:25:07,  7.64s/it]
 47%|████▋     | 17984/37963 [43:10:43<42:12:23,  7.61s/it]
 47%|████▋     | 17985/37963 [43:10:50<42:02:59,  7.58s/it]
 47%|████▋     | 17986/37963 [43:10:58<41:58:46,  7.57s/it]
 47%|████▋     | 17987/37963 [43:11:06<41:55:12,  7.55s/it]
 47%|████▋     | 17988/37963 [43:11:19<52:02:02,  9.38s/it]
 47%|████▋     | 17989/37963 [43:11:27<49:02:00,  8.84s/it]
 47%|████▋     | 17990/37963 [43:11:34<46:50:07,  8.44s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.242', 'learning_rate': '1.133e-05', 'epoch': '0.4739'}

 47%|████▋     | 17990/37963 [43:11:34<46:50:07,  8.44s/it]
 47%|████▋     | 17991/37963 [43:11:42<45:18:35,  8.17s/it]
 47%|████▋     | 17992/37963 [43:11:56<54:46:10,  9.87s/it]
 47%|████▋     | 17993/37963 [43:12:03<50:54:57,  9.18s/it]
 47%|████▋     | 17994/37963 [43:12:11<48:23:34,  8.72s/it]
 47%|████▋     | 17995/37963 [43:12:25<57:12:33, 10.31s/it]
 47%|████▋     | 17996/37963 [43:12:32<52:27:25,  9.46s/it]
 47%|████▋     | 17997/37963 [43:12:40<49:18:20,  8.89s/it]
 47%|████▋     | 17998/37963 [43:12:47<47:05:19,  8.49s/it]
 47%|████▋     | 17999/37963 [43:12:55<45:37:42,  8.23s/it]
 47%|████▋     | 18000/37963 [43:13:03<44:39:49,  8.05s/it]
                                                           
{'loss': '0.1565', 'grad_norm': '2.739', 'learning_rate': '1.132e-05', 'epoch': '0.4741'}

 47%|████▋     | 18000/37963 [43:13:03<44:39:49,  8.05s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.21s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.21s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 47%|████▋     | 18001/37963 [43:13:59<124:11:05, 22.40s/it]
 47%|████▋     | 18002/37963 [43:14:06<99:26:14, 17.93s/it] 
 47%|████▋     | 18003/37963 [43:14:14<82:09:25, 14.82s/it]
 47%|████▋     | 18004/37963 [43:14:21<69:23:23, 12.52s/it]
 47%|████▋     | 18005/37963 [43:14:28<61:05:28, 11.02s/it]
 47%|████▋     | 18006/37963 [43:14:36<55:19:12,  9.98s/it]
 47%|████▋     | 18007/37963 [43:14:50<61:47:43, 11.15s/it]
 47%|████▋     | 18008/37963 [43:14:57<55:54:15, 10.09s/it]
 47%|████▋     | 18009/37963 [43:15:05<51:15:41,  9.25s/it]
 47%|████▋     | 18010/37963 [43:15:12<48:14:25,  8.70s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '4.38', 'learning_rate': '1.131e-05', 'epoch': '0.4744'}

 47%|████▋     | 18010/37963 [43:15:12<48:14:25,  8.70s/it]
 47%|████▋     | 18011/37963 [43:15:20<46:30:15,  8.39s/it]
 47%|████▋     | 18012/37963 [43:15:27<45:00:49,  8.12s/it]
 47%|████▋     | 18013/37963 [43:15:35<44:03:49,  7.95s/it]
 47%|████▋     | 18014/37963 [43:15:55<64:47:36, 11.69s/it]
 47%|████▋     | 18015/37963 [43:16:03<58:11:53, 10.50s/it]
 47%|████▋     | 18016/37963 [43:16:10<52:48:50,  9.53s/it]
 47%|████▋     | 18017/37963 [43:16:18<49:25:10,  8.92s/it]
 47%|████▋     | 18018/37963 [43:16:25<47:07:40,  8.51s/it]
 47%|████▋     | 18019/37963 [43:16:33<45:32:24,  8.22s/it]
 47%|████▋     | 18020/37963 [43:16:40<44:31:32,  8.04s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '2.959', 'learning_rate': '1.13e-05', 'epoch': '0.4747'}

 47%|████▋     | 18020/37963 [43:16:40<44:31:32,  8.04s/it]
 47%|████▋     | 18021/37963 [43:16:48<43:45:49,  7.90s/it]
 47%|████▋     | 18022/37963 [43:16:56<43:14:33,  7.81s/it]
 47%|████▋     | 18023/37963 [43:17:09<52:59:43,  9.57s/it]
 47%|████▋     | 18024/37963 [43:17:17<49:35:42,  8.95s/it]
 47%|████▋     | 18025/37963 [43:17:24<47:18:28,  8.54s/it]
 47%|████▋     | 18026/37963 [43:17:38<56:13:00, 10.15s/it]
 47%|████▋     | 18027/37963 [43:17:46<52:01:15,  9.39s/it]
 47%|████▋     | 18028/37963 [43:17:53<48:56:49,  8.84s/it]
 47%|████▋     | 18029/37963 [43:18:01<46:56:55,  8.48s/it]
 47%|████▋     | 18030/37963 [43:18:09<45:21:45,  8.19s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '1.749', 'learning_rate': '1.129e-05', 'epoch': '0.4749'}

 47%|████▋     | 18030/37963 [43:18:09<45:21:45,  8.19s/it]
 47%|████▋     | 18031/37963 [43:18:16<44:20:12,  8.01s/it]
 47%|████▋     | 18032/37963 [43:18:24<43:27:29,  7.85s/it]
 48%|████▊     | 18033/37963 [43:18:31<43:00:37,  7.77s/it]
 48%|████▊     | 18034/37963 [43:18:39<42:44:36,  7.72s/it]
 48%|████▊     | 18035/37963 [43:18:46<42:29:35,  7.68s/it]
 48%|████▊     | 18036/37963 [43:18:54<42:20:18,  7.65s/it]
 48%|████▊     | 18037/37963 [43:19:02<42:19:21,  7.65s/it]
 48%|████▊     | 18038/37963 [43:19:16<52:48:34,  9.54s/it]
 48%|████▊     | 18039/37963 [43:19:23<49:12:22,  8.89s/it]
 48%|████▊     | 18040/37963 [43:19:30<46:54:58,  8.48s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '0.7453', 'learning_rate': '1.129e-05', 'epoch': '0.4752'}

 48%|████▊     | 18040/37963 [43:19:30<46:54:58,  8.48s/it]
 48%|████▊     | 18041/37963 [43:19:44<55:52:36, 10.10s/it]
 48%|████▊     | 18042/37963 [43:19:52<51:42:10,  9.34s/it]
 48%|████▊     | 18043/37963 [43:19:59<48:36:21,  8.78s/it]
 48%|████▊     | 18044/37963 [43:20:14<57:34:18, 10.41s/it]
 48%|████▊     | 18045/37963 [43:20:21<53:06:25,  9.60s/it]
 48%|████▊     | 18046/37963 [43:20:29<49:39:28,  8.98s/it]
 48%|████▊     | 18047/37963 [43:20:36<47:19:03,  8.55s/it]
 48%|████▊     | 18048/37963 [43:20:44<45:41:55,  8.26s/it]
 48%|████▊     | 18049/37963 [43:20:51<44:26:49,  8.04s/it]
 48%|████▊     | 18050/37963 [43:20:59<43:23:11,  7.84s/it]
                                                           
{'loss': '0.1562', 'grad_norm': '1.747', 'learning_rate': '1.128e-05', 'epoch': '0.4755'}

 48%|████▊     | 18050/37963 [43:20:59<43:23:11,  7.84s/it]
 48%|████▊     | 18051/37963 [43:21:07<43:04:48,  7.79s/it]
 48%|████▊     | 18052/37963 [43:21:14<42:51:56,  7.75s/it]
 48%|████▊     | 18053/37963 [43:21:22<42:31:57,  7.69s/it]
 48%|████▊     | 18054/37963 [43:21:29<42:15:15,  7.64s/it]
 48%|████▊     | 18055/37963 [43:21:37<42:11:05,  7.63s/it]
 48%|████▊     | 18056/37963 [43:21:51<52:19:39,  9.46s/it]
 48%|████▊     | 18057/37963 [43:21:58<48:51:26,  8.84s/it]
 48%|████▊     | 18058/37963 [43:22:06<46:39:38,  8.44s/it]
 48%|████▊     | 18059/37963 [43:22:20<55:53:01, 10.11s/it]
 48%|████▊     | 18060/37963 [43:22:27<51:48:06,  9.37s/it]
                                                           
{'loss': '0.151', 'grad_norm': '2.855', 'learning_rate': '1.127e-05', 'epoch': '0.4757'}

 48%|████▊     | 18060/37963 [43:22:27<51:48:06,  9.37s/it]
 48%|████▊     | 18061/37963 [43:22:35<48:45:46,  8.82s/it]
 48%|████▊     | 18062/37963 [43:22:49<57:47:12, 10.45s/it]
 48%|████▊     | 18063/37963 [43:22:57<53:04:57,  9.60s/it]
 48%|████▊     | 18064/37963 [43:23:04<49:42:03,  8.99s/it]
 48%|████▊     | 18065/37963 [43:23:12<47:28:11,  8.59s/it]
 48%|████▊     | 18066/37963 [43:23:19<45:41:18,  8.27s/it]
 48%|████▊     | 18067/37963 [43:23:33<55:26:26, 10.03s/it]
 48%|████▊     | 18068/37963 [43:23:41<51:20:54,  9.29s/it]
 48%|████▊     | 18069/37963 [43:23:48<48:15:00,  8.73s/it]
 48%|████▊     | 18070/37963 [43:23:56<46:12:09,  8.36s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.774', 'learning_rate': '1.126e-05', 'epoch': '0.476'}

 48%|████▊     | 18070/37963 [43:23:56<46:12:09,  8.36s/it]
 48%|████▊     | 18071/37963 [43:24:03<44:44:26,  8.10s/it]
 48%|████▊     | 18072/37963 [43:24:11<43:58:44,  7.96s/it]
 48%|████▊     | 18073/37963 [43:24:18<42:48:40,  7.75s/it]
 48%|████▊     | 18074/37963 [43:24:26<42:32:14,  7.70s/it]
 48%|████▊     | 18075/37963 [43:24:33<42:11:07,  7.64s/it]
 48%|████▊     | 18076/37963 [43:24:41<42:07:03,  7.62s/it]
 48%|████▊     | 18077/37963 [43:24:49<42:05:59,  7.62s/it]
 48%|████▊     | 18078/37963 [43:24:56<41:26:34,  7.50s/it]
 48%|████▊     | 18079/37963 [43:25:03<41:27:22,  7.51s/it]
 48%|████▊     | 18080/37963 [43:25:17<51:35:52,  9.34s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '2.307', 'learning_rate': '1.125e-05', 'epoch': '0.4763'}

 48%|████▊     | 18080/37963 [43:25:17<51:35:52,  9.34s/it]
 48%|████▊     | 18081/37963 [43:25:24<48:34:04,  8.79s/it]
 48%|████▊     | 18082/37963 [43:25:32<46:34:21,  8.43s/it]
 48%|████▊     | 18083/37963 [43:25:40<44:59:33,  8.15s/it]
 48%|████▊     | 18084/37963 [43:25:47<44:20:39,  8.03s/it]
 48%|████▊     | 18085/37963 [43:25:55<43:21:26,  7.85s/it]
 48%|████▊     | 18086/37963 [43:26:02<42:50:12,  7.76s/it]
 48%|████▊     | 18087/37963 [43:26:10<42:29:27,  7.70s/it]
 48%|████▊     | 18088/37963 [43:26:17<42:15:41,  7.65s/it]
 48%|████▊     | 18089/37963 [43:26:38<63:30:23, 11.50s/it]
 48%|████▊     | 18090/37963 [43:26:46<57:10:05, 10.36s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.881', 'learning_rate': '1.124e-05', 'epoch': '0.4765'}

 48%|████▊     | 18090/37963 [43:26:46<57:10:05, 10.36s/it]
 48%|████▊     | 18091/37963 [43:26:53<52:30:23,  9.51s/it]
 48%|████▊     | 18092/37963 [43:27:01<49:15:23,  8.92s/it]
 48%|████▊     | 18093/37963 [43:27:08<46:38:57,  8.45s/it]
 48%|████▊     | 18094/37963 [43:27:16<45:18:09,  8.21s/it]
 48%|████▊     | 18095/37963 [43:27:30<54:57:10,  9.96s/it]
 48%|████▊     | 18096/37963 [43:27:37<50:25:27,  9.14s/it]
 48%|████▊     | 18097/37963 [43:27:44<47:26:17,  8.60s/it]
 48%|████▊     | 18098/37963 [43:27:52<45:38:49,  8.27s/it]
 48%|████▊     | 18099/37963 [43:27:59<44:25:41,  8.05s/it]
 48%|████▊     | 18100/37963 [43:28:07<43:29:48,  7.88s/it]
                                                           
{'loss': '0.1559', 'grad_norm': '1.764', 'learning_rate': '1.124e-05', 'epoch': '0.4768'}

 48%|████▊     | 18100/37963 [43:28:07<43:29:48,  7.88s/it]
 48%|████▊     | 18101/37963 [43:28:14<43:03:18,  7.80s/it]
 48%|████▊     | 18102/37963 [43:28:22<41:54:27,  7.60s/it]
 48%|████▊     | 18103/37963 [43:28:29<41:42:19,  7.56s/it]
 48%|████▊     | 18104/37963 [43:28:36<41:35:27,  7.54s/it]
 48%|████▊     | 18105/37963 [43:28:44<41:33:57,  7.54s/it]
 48%|████▊     | 18106/37963 [43:28:58<52:15:50,  9.48s/it]
 48%|████▊     | 18107/37963 [43:29:05<48:43:40,  8.83s/it]
 48%|████▊     | 18108/37963 [43:29:19<57:03:18, 10.34s/it]
 48%|████▊     | 18109/37963 [43:29:27<52:21:16,  9.49s/it]
 48%|████▊     | 18110/37963 [43:29:41<59:38:24, 10.81s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '2.131', 'learning_rate': '1.123e-05', 'epoch': '0.477'}

 48%|████▊     | 18110/37963 [43:29:41<59:38:24, 10.81s/it]
 48%|████▊     | 18111/37963 [43:29:48<54:14:26,  9.84s/it]
 48%|████▊     | 18112/37963 [43:29:56<50:40:00,  9.19s/it]
 48%|████▊     | 18113/37963 [43:30:03<47:40:03,  8.65s/it]
 48%|████▊     | 18114/37963 [43:30:11<45:52:06,  8.32s/it]
 48%|████▊     | 18115/37963 [43:30:18<44:33:20,  8.08s/it]
 48%|████▊     | 18116/37963 [43:30:26<43:49:00,  7.95s/it]
 48%|████▊     | 18117/37963 [43:30:33<43:06:04,  7.82s/it]
 48%|████▊     | 18118/37963 [43:30:41<42:37:25,  7.73s/it]
 48%|████▊     | 18119/37963 [43:30:49<42:15:45,  7.67s/it]
 48%|████▊     | 18120/37963 [43:30:56<42:05:27,  7.64s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '1.144', 'learning_rate': '1.122e-05', 'epoch': '0.4773'}

 48%|████▊     | 18120/37963 [43:30:56<42:05:27,  7.64s/it]
 48%|████▊     | 18121/37963 [43:31:04<42:01:20,  7.62s/it]
 48%|████▊     | 18122/37963 [43:31:18<52:17:58,  9.49s/it]
 48%|████▊     | 18123/37963 [43:31:25<49:03:50,  8.90s/it]
 48%|████▊     | 18124/37963 [43:31:33<46:39:20,  8.47s/it]
 48%|████▊     | 18125/37963 [43:31:47<55:52:05, 10.14s/it]
 48%|████▊     | 18126/37963 [43:31:54<51:32:08,  9.35s/it]
 48%|████▊     | 18127/37963 [43:32:02<48:26:08,  8.79s/it]
 48%|████▊     | 18128/37963 [43:32:09<46:25:38,  8.43s/it]
 48%|████▊     | 18129/37963 [43:32:17<45:18:38,  8.22s/it]
 48%|████▊     | 18130/37963 [43:32:24<44:15:34,  8.03s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.884', 'learning_rate': '1.121e-05', 'epoch': '0.4776'}

 48%|████▊     | 18130/37963 [43:32:24<44:15:34,  8.03s/it]
 48%|████▊     | 18131/37963 [43:32:32<42:45:42,  7.76s/it]
 48%|████▊     | 18132/37963 [43:32:39<42:39:33,  7.74s/it]
 48%|████▊     | 18133/37963 [43:32:47<42:43:46,  7.76s/it]
 48%|████▊     | 18134/37963 [43:32:55<42:23:35,  7.70s/it]
 48%|████▊     | 18135/37963 [43:33:02<42:10:27,  7.66s/it]
 48%|████▊     | 18136/37963 [43:33:10<41:56:21,  7.61s/it]
 48%|████▊     | 18137/37963 [43:33:24<52:23:32,  9.51s/it]
 48%|████▊     | 18138/37963 [43:33:31<49:08:24,  8.92s/it]
 48%|████▊     | 18139/37963 [43:33:39<46:57:46,  8.53s/it]
 48%|████▊     | 18140/37963 [43:33:46<45:32:55,  8.27s/it]
                                                           
{'loss': '0.1579', 'grad_norm': '4.206', 'learning_rate': '1.12e-05', 'epoch': '0.4778'}

 48%|████▊     | 18140/37963 [43:33:46<45:32:55,  8.27s/it]
 48%|████▊     | 18141/37963 [43:34:00<54:09:47,  9.84s/it]
 48%|████▊     | 18142/37963 [43:34:14<61:13:46, 11.12s/it]
 48%|████▊     | 18143/37963 [43:34:22<55:28:04, 10.07s/it]
 48%|████▊     | 18144/37963 [43:34:29<50:51:45,  9.24s/it]
 48%|████▊     | 18145/37963 [43:34:37<47:59:07,  8.72s/it]
 48%|████▊     | 18146/37963 [43:34:44<46:10:48,  8.39s/it]
 48%|████▊     | 18147/37963 [43:34:52<44:45:42,  8.13s/it]
 48%|████▊     | 18148/37963 [43:34:59<43:47:58,  7.96s/it]
 48%|████▊     | 18149/37963 [43:35:07<42:59:48,  7.81s/it]
 48%|████▊     | 18150/37963 [43:35:14<42:33:31,  7.73s/it]
                                                           
{'loss': '0.1522', 'grad_norm': '1.521', 'learning_rate': '1.119e-05', 'epoch': '0.4781'}

 48%|████▊     | 18150/37963 [43:35:14<42:33:31,  7.73s/it]
 48%|████▊     | 18151/37963 [43:35:22<41:49:45,  7.60s/it]
 48%|████▊     | 18152/37963 [43:35:29<41:43:20,  7.58s/it]
 48%|████▊     | 18153/37963 [43:35:36<41:21:35,  7.52s/it]
 48%|████▊     | 18154/37963 [43:35:44<41:22:50,  7.52s/it]
 48%|████▊     | 18155/37963 [43:35:52<41:42:23,  7.58s/it]
 48%|████▊     | 18156/37963 [43:35:59<41:36:28,  7.56s/it]
 48%|████▊     | 18157/37963 [43:36:13<52:31:18,  9.55s/it]
 48%|████▊     | 18158/37963 [43:36:21<49:13:06,  8.95s/it]
 48%|████▊     | 18159/37963 [43:36:29<47:12:52,  8.58s/it]
 48%|████▊     | 18160/37963 [43:36:43<56:11:22, 10.21s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '2.184', 'learning_rate': '1.118e-05', 'epoch': '0.4784'}

 48%|████▊     | 18160/37963 [43:36:43<56:11:22, 10.21s/it]
 48%|████▊     | 18161/37963 [43:36:57<62:31:37, 11.37s/it]
 48%|████▊     | 18162/37963 [43:37:04<56:22:08, 10.25s/it]
 48%|████▊     | 18163/37963 [43:37:12<51:57:39,  9.45s/it]
 48%|████▊     | 18164/37963 [43:37:19<48:40:31,  8.85s/it]
 48%|████▊     | 18165/37963 [43:37:27<46:32:23,  8.46s/it]
 48%|████▊     | 18166/37963 [43:37:41<55:36:33, 10.11s/it]
 48%|████▊     | 18167/37963 [43:37:48<51:22:17,  9.34s/it]
 48%|████▊     | 18168/37963 [43:37:56<48:25:04,  8.81s/it]
 48%|████▊     | 18169/37963 [43:38:04<46:40:19,  8.49s/it]
 48%|████▊     | 18170/37963 [43:38:11<45:10:18,  8.22s/it]
                                                           
{'loss': '0.1578', 'grad_norm': '2.107', 'learning_rate': '1.118e-05', 'epoch': '0.4786'}

 48%|████▊     | 18170/37963 [43:38:11<45:10:18,  8.22s/it]
 48%|████▊     | 18171/37963 [43:38:19<44:07:54,  8.03s/it]
 48%|████▊     | 18172/37963 [43:38:27<43:32:44,  7.92s/it]
 48%|████▊     | 18173/37963 [43:38:34<42:49:42,  7.79s/it]
 48%|████▊     | 18174/37963 [43:38:42<42:33:41,  7.74s/it]
 48%|████▊     | 18175/37963 [43:38:55<52:21:50,  9.53s/it]
 48%|████▊     | 18176/37963 [43:39:03<49:16:34,  8.97s/it]
 48%|████▊     | 18177/37963 [43:39:11<47:01:15,  8.56s/it]
 48%|████▊     | 18178/37963 [43:39:18<45:16:32,  8.24s/it]
 48%|████▊     | 18179/37963 [43:39:26<44:04:53,  8.02s/it]
 48%|████▊     | 18180/37963 [43:39:33<43:04:43,  7.84s/it]
                                                           
{'loss': '0.143', 'grad_norm': '1.537', 'learning_rate': '1.117e-05', 'epoch': '0.4789'}

 48%|████▊     | 18180/37963 [43:39:33<43:04:43,  7.84s/it]
 48%|████▊     | 18181/37963 [43:39:40<42:05:41,  7.66s/it]
 48%|████▊     | 18182/37963 [43:39:48<41:55:07,  7.63s/it]
 48%|████▊     | 18183/37963 [43:39:56<41:53:47,  7.63s/it]
 48%|████▊     | 18184/37963 [43:40:03<41:49:41,  7.61s/it]
 48%|████▊     | 18185/37963 [43:40:11<41:34:47,  7.57s/it]
 48%|████▊     | 18186/37963 [43:40:18<41:27:55,  7.55s/it]
 48%|████▊     | 18187/37963 [43:40:26<41:32:02,  7.56s/it]
 48%|████▊     | 18188/37963 [43:40:33<41:08:39,  7.49s/it]
 48%|████▊     | 18189/37963 [43:40:41<41:13:53,  7.51s/it]
 48%|████▊     | 18190/37963 [43:41:01<62:45:00, 11.42s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.868', 'learning_rate': '1.116e-05', 'epoch': '0.4792'}

 48%|████▊     | 18190/37963 [43:41:01<62:45:00, 11.42s/it]
 48%|████▊     | 18191/37963 [43:41:09<56:19:29, 10.26s/it]
 48%|████▊     | 18192/37963 [43:41:23<62:18:24, 11.35s/it]
 48%|████▊     | 18193/37963 [43:41:30<56:02:18, 10.20s/it]
 48%|████▊     | 18194/37963 [43:41:38<51:48:26,  9.43s/it]
 48%|████▊     | 18195/37963 [43:41:45<48:48:47,  8.89s/it]
 48%|████▊     | 18196/37963 [43:41:53<46:40:56,  8.50s/it]
 48%|████▊     | 18197/37963 [43:42:00<45:01:18,  8.20s/it]
 48%|████▊     | 18198/37963 [43:42:08<43:55:13,  8.00s/it]
 48%|████▊     | 18199/37963 [43:42:15<43:03:53,  7.84s/it]
 48%|████▊     | 18200/37963 [43:42:23<42:28:02,  7.74s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '3.616', 'learning_rate': '1.115e-05', 'epoch': '0.4794'}

 48%|████▊     | 18200/37963 [43:42:23<42:28:02,  7.74s/it]
 48%|████▊     | 18201/37963 [43:42:30<42:02:17,  7.66s/it]
 48%|████▊     | 18202/37963 [43:42:38<41:43:49,  7.60s/it]
 48%|████▊     | 18203/37963 [43:42:45<41:29:05,  7.56s/it]
 48%|████▊     | 18204/37963 [43:42:53<41:25:47,  7.55s/it]
 48%|████▊     | 18205/37963 [43:43:00<41:35:49,  7.58s/it]
 48%|████▊     | 18206/37963 [43:43:14<51:37:44,  9.41s/it]
 48%|████▊     | 18207/37963 [43:43:22<48:30:59,  8.84s/it]
 48%|████▊     | 18208/37963 [43:43:29<46:22:54,  8.45s/it]
 48%|████▊     | 18209/37963 [43:43:37<44:49:34,  8.17s/it]
 48%|████▊     | 18210/37963 [43:43:44<43:20:41,  7.90s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '1.737', 'learning_rate': '1.114e-05', 'epoch': '0.4797'}

 48%|████▊     | 18210/37963 [43:43:44<43:20:41,  7.90s/it]
 48%|████▊     | 18211/37963 [43:43:58<53:15:07,  9.71s/it]
 48%|████▊     | 18212/37963 [43:44:05<49:10:57,  8.96s/it]
 48%|████▊     | 18213/37963 [43:44:13<46:54:38,  8.55s/it]
 48%|████▊     | 18214/37963 [43:44:27<55:41:47, 10.15s/it]
 48%|████▊     | 18215/37963 [43:44:34<51:06:59,  9.32s/it]
 48%|████▊     | 18216/37963 [43:44:41<48:03:59,  8.76s/it]
 48%|████▊     | 18217/37963 [43:44:55<56:22:08, 10.28s/it]
 48%|████▊     | 18218/37963 [43:45:03<51:46:52,  9.44s/it]
 48%|████▊     | 18219/37963 [43:45:10<48:38:35,  8.87s/it]
 48%|████▊     | 18220/37963 [43:45:18<46:22:59,  8.46s/it]
                                                           
{'loss': '0.1629', 'grad_norm': '1.508', 'learning_rate': '1.113e-05', 'epoch': '0.4799'}

 48%|████▊     | 18220/37963 [43:45:18<46:22:59,  8.46s/it]
 48%|████▊     | 18221/37963 [43:45:25<44:35:27,  8.13s/it]
 48%|████▊     | 18222/37963 [43:45:33<43:39:17,  7.96s/it]
 48%|████▊     | 18223/37963 [43:45:40<43:03:08,  7.85s/it]
 48%|████▊     | 18224/37963 [43:45:48<42:00:45,  7.66s/it]
 48%|████▊     | 18225/37963 [43:45:55<41:25:24,  7.56s/it]
 48%|████▊     | 18226/37963 [43:46:02<41:20:53,  7.54s/it]
 48%|████▊     | 18227/37963 [43:46:10<41:10:43,  7.51s/it]
 48%|████▊     | 18228/37963 [43:46:17<41:24:50,  7.55s/it]
 48%|████▊     | 18229/37963 [43:46:31<51:48:24,  9.45s/it]
 48%|████▊     | 18230/37963 [43:46:39<48:15:47,  8.80s/it]
                                                           
{'loss': '0.155', 'grad_norm': '0.9824', 'learning_rate': '1.113e-05', 'epoch': '0.4802'}

 48%|████▊     | 18230/37963 [43:46:39<48:15:47,  8.80s/it]
 48%|████▊     | 18231/37963 [43:46:46<46:10:02,  8.42s/it]
 48%|████▊     | 18232/37963 [43:46:54<44:45:11,  8.17s/it]
 48%|████▊     | 18233/37963 [43:47:01<43:36:34,  7.96s/it]
 48%|████▊     | 18234/37963 [43:47:09<42:51:08,  7.82s/it]
 48%|████▊     | 18235/37963 [43:47:16<41:36:14,  7.59s/it]
 48%|████▊     | 18236/37963 [43:47:36<62:09:38, 11.34s/it]
 48%|████▊     | 18237/37963 [43:47:43<55:43:39, 10.17s/it]
 48%|████▊     | 18238/37963 [43:47:51<51:21:56,  9.37s/it]
 48%|████▊     | 18239/37963 [43:48:05<59:17:33, 10.82s/it]
 48%|████▊     | 18240/37963 [43:48:13<53:48:06,  9.82s/it]
                                                           
{'loss': '0.1555', 'grad_norm': '1.542', 'learning_rate': '1.112e-05', 'epoch': '0.4805'}

 48%|████▊     | 18240/37963 [43:48:13<53:48:06,  9.82s/it]
 48%|████▊     | 18241/37963 [43:48:20<50:07:48,  9.15s/it]
 48%|████▊     | 18242/37963 [43:48:28<47:33:33,  8.68s/it]
 48%|████▊     | 18243/37963 [43:48:35<45:38:11,  8.33s/it]
 48%|████▊     | 18244/37963 [43:48:43<44:15:18,  8.08s/it]
 48%|████▊     | 18245/37963 [43:48:50<43:32:33,  7.95s/it]
 48%|████▊     | 18246/37963 [43:48:58<42:37:50,  7.78s/it]
 48%|████▊     | 18247/37963 [43:49:05<42:14:33,  7.71s/it]
 48%|████▊     | 18248/37963 [43:49:13<41:43:08,  7.62s/it]
 48%|████▊     | 18249/37963 [43:49:20<41:30:18,  7.58s/it]
 48%|████▊     | 18250/37963 [43:49:28<41:34:08,  7.59s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '1.817', 'learning_rate': '1.111e-05', 'epoch': '0.4807'}

 48%|████▊     | 18250/37963 [43:49:28<41:34:08,  7.59s/it]
 48%|████▊     | 18251/37963 [43:49:35<41:31:11,  7.58s/it]
 48%|████▊     | 18252/37963 [43:49:43<41:37:13,  7.60s/it]
 48%|████▊     | 18253/37963 [43:49:50<41:25:48,  7.57s/it]
 48%|████▊     | 18254/37963 [43:49:58<41:01:11,  7.49s/it]
 48%|████▊     | 18255/37963 [43:50:05<40:41:56,  7.43s/it]
 48%|████▊     | 18256/37963 [43:50:13<40:47:41,  7.45s/it]
 48%|████▊     | 18257/37963 [43:50:26<51:06:12,  9.34s/it]
 48%|████▊     | 18258/37963 [43:50:40<58:23:32, 10.67s/it]
 48%|████▊     | 18259/37963 [43:50:48<53:10:35,  9.72s/it]
 48%|████▊     | 18260/37963 [43:51:02<60:13:17, 11.00s/it]
                                                           
{'loss': '0.1506', 'grad_norm': '1.93', 'learning_rate': '1.11e-05', 'epoch': '0.481'}

 48%|████▊     | 18260/37963 [43:51:02<60:13:17, 11.00s/it]
 48%|████▊     | 18261/37963 [43:51:09<54:06:34,  9.89s/it]
 48%|████▊     | 18262/37963 [43:51:16<50:18:07,  9.19s/it]
 48%|████▊     | 18263/37963 [43:51:24<47:44:19,  8.72s/it]
 48%|████▊     | 18264/37963 [43:51:32<45:55:26,  8.39s/it]
 48%|████▊     | 18265/37963 [43:51:46<54:58:23, 10.05s/it]
 48%|████▊     | 18266/37963 [43:51:53<50:56:39,  9.31s/it]
 48%|████▊     | 18267/37963 [43:52:01<48:08:34,  8.80s/it]
 48%|████▊     | 18268/37963 [43:52:08<45:44:40,  8.36s/it]
 48%|████▊     | 18269/37963 [43:52:16<44:29:50,  8.13s/it]
 48%|████▊     | 18270/37963 [43:52:23<43:01:58,  7.87s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '3.76', 'learning_rate': '1.109e-05', 'epoch': '0.4813'}

 48%|████▊     | 18270/37963 [43:52:23<43:01:58,  7.87s/it]
 48%|████▊     | 18271/37963 [43:52:31<42:40:35,  7.80s/it]
 48%|████▊     | 18272/37963 [43:52:38<42:12:59,  7.72s/it]
 48%|████▊     | 18273/37963 [43:52:46<41:43:57,  7.63s/it]
 48%|████▊     | 18274/37963 [43:52:53<41:29:13,  7.59s/it]
 48%|████▊     | 18275/37963 [43:53:01<41:26:21,  7.58s/it]
 48%|████▊     | 18276/37963 [43:53:08<40:54:42,  7.48s/it]
 48%|████▊     | 18277/37963 [43:53:15<40:56:58,  7.49s/it]
 48%|████▊     | 18278/37963 [43:53:29<51:33:35,  9.43s/it]
 48%|████▊     | 18279/37963 [43:53:37<48:02:19,  8.79s/it]
 48%|████▊     | 18280/37963 [43:53:44<45:58:19,  8.41s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.519', 'learning_rate': '1.108e-05', 'epoch': '0.4815'}

 48%|████▊     | 18280/37963 [43:53:44<45:58:19,  8.41s/it]
 48%|████▊     | 18281/37963 [43:53:52<44:42:11,  8.18s/it]
 48%|████▊     | 18282/37963 [43:53:59<43:27:04,  7.95s/it]
 48%|████▊     | 18283/37963 [43:54:07<42:48:57,  7.83s/it]
 48%|████▊     | 18284/37963 [43:54:21<52:56:12,  9.68s/it]
 48%|████▊     | 18285/37963 [43:54:28<49:31:27,  9.06s/it]
 48%|████▊     | 18286/37963 [43:54:36<47:19:58,  8.66s/it]
 48%|████▊     | 18287/37963 [43:54:57<66:54:57, 12.24s/it]
 48%|████▊     | 18288/37963 [43:55:04<59:24:12, 10.87s/it]
 48%|████▊     | 18289/37963 [43:55:12<53:57:52,  9.87s/it]
 48%|████▊     | 18290/37963 [43:55:19<49:57:57,  9.14s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '2.288', 'learning_rate': '1.107e-05', 'epoch': '0.4818'}

 48%|████▊     | 18290/37963 [43:55:19<49:57:57,  9.14s/it]
 48%|████▊     | 18291/37963 [43:55:27<47:31:31,  8.70s/it]
 48%|████▊     | 18292/37963 [43:55:35<45:58:30,  8.41s/it]
 48%|████▊     | 18293/37963 [43:55:42<44:28:53,  8.14s/it]
 48%|████▊     | 18294/37963 [43:55:50<43:27:42,  7.95s/it]
 48%|████▊     | 18295/37963 [43:55:57<42:45:07,  7.83s/it]
 48%|████▊     | 18296/37963 [43:56:04<41:24:46,  7.58s/it]
 48%|████▊     | 18297/37963 [43:56:12<41:19:11,  7.56s/it]
 48%|████▊     | 18298/37963 [43:56:19<40:54:45,  7.49s/it]
 48%|████▊     | 18299/37963 [43:56:27<40:56:34,  7.50s/it]
 48%|████▊     | 18300/37963 [43:56:34<40:55:43,  7.49s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.284', 'learning_rate': '1.107e-05', 'epoch': '0.482'}

 48%|████▊     | 18300/37963 [43:56:34<40:55:43,  7.49s/it]
 48%|████▊     | 18301/37963 [43:56:42<41:03:17,  7.52s/it]
 48%|████▊     | 18302/37963 [43:56:49<40:48:50,  7.47s/it]
 48%|████▊     | 18303/37963 [43:56:57<40:47:12,  7.47s/it]
 48%|████▊     | 18304/37963 [43:57:10<51:06:42,  9.36s/it]
 48%|████▊     | 18305/37963 [43:57:24<58:45:56, 10.76s/it]
 48%|████▊     | 18306/37963 [43:57:32<53:33:48,  9.81s/it]
 48%|████▊     | 18307/37963 [43:57:39<49:46:25,  9.12s/it]
 48%|████▊     | 18308/37963 [43:57:47<47:10:14,  8.64s/it]
 48%|████▊     | 18309/37963 [43:57:54<45:04:05,  8.26s/it]
 48%|████▊     | 18310/37963 [43:58:15<65:33:03, 12.01s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '1.153', 'learning_rate': '1.106e-05', 'epoch': '0.4823'}

 48%|████▊     | 18310/37963 [43:58:15<65:33:03, 12.01s/it]
 48%|████▊     | 18311/37963 [43:58:23<58:31:25, 10.72s/it]
 48%|████▊     | 18312/37963 [43:58:30<53:16:34,  9.76s/it]
 48%|████▊     | 18313/37963 [43:58:38<49:37:23,  9.09s/it]
 48%|████▊     | 18314/37963 [43:58:46<47:22:41,  8.68s/it]
 48%|████▊     | 18315/37963 [43:58:53<45:33:53,  8.35s/it]
 48%|████▊     | 18316/37963 [43:59:00<43:47:22,  8.02s/it]
 48%|████▊     | 18317/37963 [43:59:08<42:47:42,  7.84s/it]
 48%|████▊     | 18318/37963 [43:59:15<41:56:32,  7.69s/it]
 48%|████▊     | 18319/37963 [43:59:23<41:31:21,  7.61s/it]
 48%|████▊     | 18320/37963 [43:59:30<41:25:34,  7.59s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '0.8813', 'learning_rate': '1.105e-05', 'epoch': '0.4826'}

 48%|████▊     | 18320/37963 [43:59:30<41:25:34,  7.59s/it]
 48%|████▊     | 18321/37963 [43:59:38<41:18:19,  7.57s/it]
 48%|████▊     | 18322/37963 [43:59:45<41:16:32,  7.57s/it]
 48%|████▊     | 18323/37963 [43:59:53<41:13:05,  7.56s/it]
 48%|████▊     | 18324/37963 [44:00:00<41:06:30,  7.54s/it]
 48%|████▊     | 18325/37963 [44:00:08<41:09:14,  7.54s/it]
 48%|████▊     | 18326/37963 [44:00:21<51:02:06,  9.36s/it]
 48%|████▊     | 18327/37963 [44:00:29<48:15:12,  8.85s/it]
 48%|████▊     | 18328/37963 [44:00:37<45:59:47,  8.43s/it]
 48%|████▊     | 18329/37963 [44:00:44<44:30:25,  8.16s/it]
 48%|████▊     | 18330/37963 [44:00:52<43:22:40,  7.95s/it]
                                                           
{'loss': '0.1554', 'grad_norm': '1.189', 'learning_rate': '1.104e-05', 'epoch': '0.4828'}

 48%|████▊     | 18330/37963 [44:00:52<43:22:40,  7.95s/it]
 48%|████▊     | 18331/37963 [44:01:06<53:22:01,  9.79s/it]
 48%|████▊     | 18332/37963 [44:01:13<49:49:30,  9.14s/it]
 48%|████▊     | 18333/37963 [44:01:27<58:01:07, 10.64s/it]
 48%|████▊     | 18334/37963 [44:01:35<52:49:54,  9.69s/it]
 48%|████▊     | 18335/37963 [44:01:42<49:21:20,  9.05s/it]
 48%|████▊     | 18336/37963 [44:01:57<57:44:54, 10.59s/it]
 48%|████▊     | 18337/37963 [44:02:04<52:27:21,  9.62s/it]
 48%|████▊     | 18338/37963 [44:02:11<48:15:58,  8.85s/it]
 48%|████▊     | 18339/37963 [44:02:19<46:08:05,  8.46s/it]
 48%|████▊     | 18340/37963 [44:02:26<44:18:26,  8.13s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.049', 'learning_rate': '1.103e-05', 'epoch': '0.4831'}

 48%|████▊     | 18340/37963 [44:02:26<44:18:26,  8.13s/it]
 48%|████▊     | 18341/37963 [44:02:33<43:21:24,  7.95s/it]
 48%|████▊     | 18342/37963 [44:02:41<42:40:02,  7.83s/it]
 48%|████▊     | 18343/37963 [44:02:49<42:19:39,  7.77s/it]
 48%|████▊     | 18344/37963 [44:02:56<42:01:45,  7.71s/it]
 48%|████▊     | 18345/37963 [44:03:03<41:10:51,  7.56s/it]
 48%|████▊     | 18346/37963 [44:03:11<41:23:33,  7.60s/it]
 48%|████▊     | 18347/37963 [44:03:19<41:23:04,  7.60s/it]
 48%|████▊     | 18348/37963 [44:03:26<40:59:36,  7.52s/it]
 48%|████▊     | 18349/37963 [44:03:34<41:07:58,  7.55s/it]
 48%|████▊     | 18350/37963 [44:03:48<52:05:23,  9.56s/it]
                                                           
{'loss': '0.1587', 'grad_norm': '4.211', 'learning_rate': '1.102e-05', 'epoch': '0.4834'}

 48%|████▊     | 18350/37963 [44:03:48<52:05:23,  9.56s/it]
 48%|████▊     | 18351/37963 [44:03:55<48:50:39,  8.97s/it]
 48%|████▊     | 18352/37963 [44:04:03<46:09:30,  8.47s/it]
 48%|████▊     | 18353/37963 [44:04:10<44:41:15,  8.20s/it]
 48%|████▊     | 18354/37963 [44:04:31<64:46:25, 11.89s/it]
 48%|████▊     | 18355/37963 [44:04:38<57:39:15, 10.59s/it]
 48%|████▊     | 18356/37963 [44:04:46<52:35:57,  9.66s/it]
 48%|████▊     | 18357/37963 [44:04:53<48:44:43,  8.95s/it]
 48%|████▊     | 18358/37963 [44:05:01<46:37:13,  8.56s/it]
 48%|████▊     | 18359/37963 [44:05:15<55:31:15, 10.20s/it]
 48%|████▊     | 18360/37963 [44:05:22<51:12:13,  9.40s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '0.8274', 'learning_rate': '1.102e-05', 'epoch': '0.4836'}

 48%|████▊     | 18360/37963 [44:05:22<51:12:13,  9.40s/it]
 48%|████▊     | 18361/37963 [44:05:30<48:19:16,  8.87s/it]
 48%|████▊     | 18362/37963 [44:05:38<46:03:30,  8.46s/it]
 48%|████▊     | 18363/37963 [44:05:45<44:31:19,  8.18s/it]
 48%|████▊     | 18364/37963 [44:05:53<43:30:25,  7.99s/it]
 48%|████▊     | 18365/37963 [44:06:00<42:41:55,  7.84s/it]
 48%|████▊     | 18366/37963 [44:06:08<42:06:33,  7.74s/it]
 48%|████▊     | 18367/37963 [44:06:15<41:48:39,  7.68s/it]
 48%|████▊     | 18368/37963 [44:06:22<41:04:49,  7.55s/it]
 48%|████▊     | 18369/37963 [44:06:30<40:41:59,  7.48s/it]
 48%|████▊     | 18370/37963 [44:06:37<40:36:26,  7.46s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '1.046', 'learning_rate': '1.101e-05', 'epoch': '0.4839'}

 48%|████▊     | 18370/37963 [44:06:37<40:36:26,  7.46s/it]
 48%|████▊     | 18371/37963 [44:06:51<50:36:15,  9.30s/it]
 48%|████▊     | 18372/37963 [44:06:58<47:14:23,  8.68s/it]
 48%|████▊     | 18373/37963 [44:07:06<45:26:58,  8.35s/it]
 48%|████▊     | 18374/37963 [44:07:13<44:04:17,  8.10s/it]
 48%|████▊     | 18375/37963 [44:07:20<42:48:50,  7.87s/it]
 48%|████▊     | 18376/37963 [44:07:28<41:58:32,  7.71s/it]
 48%|████▊     | 18377/37963 [44:07:35<41:34:12,  7.64s/it]
 48%|████▊     | 18378/37963 [44:07:43<41:17:44,  7.59s/it]
 48%|████▊     | 18379/37963 [44:07:56<51:04:21,  9.39s/it]
 48%|████▊     | 18380/37963 [44:08:10<58:31:05, 10.76s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.839', 'learning_rate': '1.1e-05', 'epoch': '0.4842'}

 48%|████▊     | 18380/37963 [44:08:10<58:31:05, 10.76s/it]
 48%|████▊     | 18381/37963 [44:08:18<53:03:52,  9.76s/it]
 48%|████▊     | 18382/37963 [44:08:25<49:08:08,  9.03s/it]
 48%|████▊     | 18383/37963 [44:08:32<46:31:57,  8.56s/it]
 48%|████▊     | 18384/37963 [44:08:40<44:58:57,  8.27s/it]
 48%|████▊     | 18385/37963 [44:08:54<54:11:22,  9.96s/it]
 48%|████▊     | 18386/37963 [44:09:02<50:29:36,  9.29s/it]
 48%|████▊     | 18387/37963 [44:09:09<47:52:18,  8.80s/it]
 48%|████▊     | 18388/37963 [44:09:17<45:24:04,  8.35s/it]
 48%|████▊     | 18389/37963 [44:09:24<43:47:49,  8.06s/it]
 48%|████▊     | 18390/37963 [44:09:32<42:56:30,  7.90s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '2.246', 'learning_rate': '1.099e-05', 'epoch': '0.4844'}

 48%|████▊     | 18390/37963 [44:09:32<42:56:30,  7.90s/it]
 48%|████▊     | 18391/37963 [44:09:39<42:35:05,  7.83s/it]
 48%|████▊     | 18392/37963 [44:09:47<42:03:07,  7.74s/it]
 48%|████▊     | 18393/37963 [44:09:54<41:31:21,  7.64s/it]
 48%|████▊     | 18394/37963 [44:10:02<41:22:45,  7.61s/it]
 48%|████▊     | 18395/37963 [44:10:09<41:13:10,  7.58s/it]
 48%|████▊     | 18396/37963 [44:10:23<51:51:00,  9.54s/it]
 48%|████▊     | 18397/37963 [44:10:31<48:41:51,  8.96s/it]
 48%|████▊     | 18398/37963 [44:10:38<46:25:15,  8.54s/it]
 48%|████▊     | 18399/37963 [44:10:46<44:48:46,  8.25s/it]
 48%|████▊     | 18400/37963 [44:10:54<43:53:23,  8.08s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.47', 'learning_rate': '1.098e-05', 'epoch': '0.4847'}

 48%|████▊     | 18400/37963 [44:10:54<43:53:23,  8.08s/it]
 48%|████▊     | 18401/37963 [44:11:01<43:00:32,  7.91s/it]
 48%|████▊     | 18402/37963 [44:11:09<42:33:08,  7.83s/it]
 48%|████▊     | 18403/37963 [44:11:23<52:31:17,  9.67s/it]
 48%|████▊     | 18404/37963 [44:11:30<49:07:15,  9.04s/it]
 48%|████▊     | 18405/37963 [44:11:44<57:14:49, 10.54s/it]
 48%|████▊     | 18406/37963 [44:11:52<52:32:29,  9.67s/it]
 48%|████▊     | 18407/37963 [44:12:00<49:01:24,  9.02s/it]
 48%|████▊     | 18408/37963 [44:12:14<57:21:25, 10.56s/it]
 48%|████▊     | 18409/37963 [44:12:21<51:46:58,  9.53s/it]
 48%|████▊     | 18410/37963 [44:12:28<48:39:07,  8.96s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.636', 'learning_rate': '1.097e-05', 'epoch': '0.4849'}

 48%|████▊     | 18410/37963 [44:12:28<48:39:07,  8.96s/it]
 48%|████▊     | 18411/37963 [44:12:36<46:25:31,  8.55s/it]
 48%|████▊     | 18412/37963 [44:12:44<44:45:41,  8.24s/it]
 49%|████▊     | 18413/37963 [44:12:51<43:34:34,  8.02s/it]
 49%|████▊     | 18414/37963 [44:12:59<42:43:54,  7.87s/it]
 49%|████▊     | 18415/37963 [44:13:06<41:37:22,  7.67s/it]
 49%|████▊     | 18416/37963 [44:13:20<51:51:18,  9.55s/it]
 49%|████▊     | 18417/37963 [44:13:27<48:18:51,  8.90s/it]
 49%|████▊     | 18418/37963 [44:13:35<46:02:05,  8.48s/it]
 49%|████▊     | 18419/37963 [44:13:42<44:16:16,  8.15s/it]
 49%|████▊     | 18420/37963 [44:13:49<42:43:15,  7.87s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '2.186', 'learning_rate': '1.096e-05', 'epoch': '0.4852'}

 49%|████▊     | 18420/37963 [44:13:49<42:43:15,  7.87s/it]
 49%|████▊     | 18421/37963 [44:13:57<42:19:49,  7.80s/it]
 49%|████▊     | 18422/37963 [44:14:04<41:49:36,  7.71s/it]
 49%|████▊     | 18423/37963 [44:14:12<41:36:51,  7.67s/it]
 49%|████▊     | 18424/37963 [44:14:19<41:25:12,  7.63s/it]
 49%|████▊     | 18425/37963 [44:14:27<40:49:34,  7.52s/it]
 49%|████▊     | 18426/37963 [44:14:34<40:47:59,  7.52s/it]
 49%|████▊     | 18427/37963 [44:14:42<40:58:32,  7.55s/it]
 49%|████▊     | 18428/37963 [44:14:49<40:34:20,  7.48s/it]
 49%|████▊     | 18429/37963 [44:14:57<40:43:40,  7.51s/it]
 49%|████▊     | 18430/37963 [44:15:17<61:44:10, 11.38s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '1.629', 'learning_rate': '1.096e-05', 'epoch': '0.4855'}

 49%|████▊     | 18430/37963 [44:15:17<61:44:10, 11.38s/it]
 49%|████▊     | 18431/37963 [44:15:25<55:31:21, 10.23s/it]
 49%|████▊     | 18432/37963 [44:15:33<51:28:03,  9.49s/it]
 49%|████▊     | 18433/37963 [44:15:46<58:43:08, 10.82s/it]
 49%|████▊     | 18434/37963 [44:15:54<53:21:18,  9.84s/it]
 49%|████▊     | 18435/37963 [44:16:01<49:29:03,  9.12s/it]
 49%|████▊     | 18436/37963 [44:16:09<46:52:16,  8.64s/it]
 49%|████▊     | 18437/37963 [44:16:16<45:02:27,  8.30s/it]
 49%|████▊     | 18438/37963 [44:16:24<43:51:36,  8.09s/it]
 49%|████▊     | 18439/37963 [44:16:32<43:13:02,  7.97s/it]
 49%|████▊     | 18440/37963 [44:16:39<42:27:11,  7.83s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '3.086', 'learning_rate': '1.095e-05', 'epoch': '0.4857'}

 49%|████▊     | 18440/37963 [44:16:39<42:27:11,  7.83s/it]
 49%|████▊     | 18441/37963 [44:16:47<41:56:56,  7.74s/it]
 49%|████▊     | 18442/37963 [44:16:54<41:04:21,  7.57s/it]
 49%|████▊     | 18443/37963 [44:17:02<41:04:06,  7.57s/it]
 49%|████▊     | 18444/37963 [44:17:09<41:11:01,  7.60s/it]
 49%|████▊     | 18445/37963 [44:17:17<41:01:56,  7.57s/it]
 49%|████▊     | 18446/37963 [44:17:24<40:55:30,  7.55s/it]
 49%|████▊     | 18447/37963 [44:17:32<40:52:15,  7.54s/it]
 49%|████▊     | 18448/37963 [44:17:46<51:10:50,  9.44s/it]
 49%|████▊     | 18449/37963 [44:17:53<47:55:58,  8.84s/it]
 49%|████▊     | 18450/37963 [44:18:00<45:04:38,  8.32s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '0.8283', 'learning_rate': '1.094e-05', 'epoch': '0.486'}

 49%|████▊     | 18450/37963 [44:18:00<45:04:38,  8.32s/it]
 49%|████▊     | 18451/37963 [44:18:08<43:45:42,  8.07s/it]
 49%|████▊     | 18452/37963 [44:18:15<42:46:36,  7.89s/it]
 49%|████▊     | 18453/37963 [44:18:29<52:45:20,  9.73s/it]
 49%|████▊     | 18454/37963 [44:18:36<48:47:53,  9.00s/it]
 49%|████▊     | 18455/37963 [44:18:44<46:19:13,  8.55s/it]
 49%|████▊     | 18456/37963 [44:18:51<44:42:17,  8.25s/it]
 49%|████▊     | 18457/37963 [44:19:05<53:20:29,  9.84s/it]
 49%|████▊     | 18458/37963 [44:19:12<48:49:06,  9.01s/it]
 49%|████▊     | 18459/37963 [44:19:19<46:01:00,  8.49s/it]
 49%|████▊     | 18460/37963 [44:19:33<54:31:04, 10.06s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '1.015', 'learning_rate': '1.093e-05', 'epoch': '0.4863'}

 49%|████▊     | 18460/37963 [44:19:33<54:31:04, 10.06s/it]
 49%|████▊     | 18461/37963 [44:19:41<50:34:27,  9.34s/it]
 49%|████▊     | 18462/37963 [44:19:55<57:56:50, 10.70s/it]
 49%|████▊     | 18463/37963 [44:20:02<52:50:21,  9.75s/it]
 49%|████▊     | 18464/37963 [44:20:10<49:12:29,  9.09s/it]
 49%|████▊     | 18465/37963 [44:20:17<46:32:58,  8.59s/it]
 49%|████▊     | 18466/37963 [44:20:25<44:33:18,  8.23s/it]
 49%|████▊     | 18467/37963 [44:20:32<42:44:56,  7.89s/it]
 49%|████▊     | 18468/37963 [44:20:39<42:18:52,  7.81s/it]
 49%|████▊     | 18469/37963 [44:20:47<41:48:24,  7.72s/it]
 49%|████▊     | 18470/37963 [44:20:54<41:26:03,  7.65s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '0.9271', 'learning_rate': '1.092e-05', 'epoch': '0.4865'}

 49%|████▊     | 18470/37963 [44:20:54<41:26:03,  7.65s/it]
 49%|████▊     | 18471/37963 [44:21:02<41:06:42,  7.59s/it]
 49%|████▊     | 18472/37963 [44:21:09<41:15:55,  7.62s/it]
 49%|████▊     | 18473/37963 [44:21:17<40:35:24,  7.50s/it]
 49%|████▊     | 18474/37963 [44:21:24<40:34:41,  7.50s/it]
 49%|████▊     | 18475/37963 [44:21:32<40:35:18,  7.50s/it]
 49%|████▊     | 18476/37963 [44:21:46<51:04:25,  9.44s/it]
 49%|████▊     | 18477/37963 [44:21:59<58:05:28, 10.73s/it]
 49%|████▊     | 18478/37963 [44:22:07<52:44:11,  9.74s/it]
 49%|████▊     | 18479/37963 [44:22:14<49:17:27,  9.11s/it]
 49%|████▊     | 18480/37963 [44:22:22<46:45:49,  8.64s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '2.409', 'learning_rate': '1.091e-05', 'epoch': '0.4868'}

 49%|████▊     | 18480/37963 [44:22:22<46:45:49,  8.64s/it]
 49%|████▊     | 18481/37963 [44:22:29<44:58:00,  8.31s/it]
 49%|████▊     | 18482/37963 [44:22:37<43:47:13,  8.09s/it]
 49%|████▊     | 18483/37963 [44:22:51<52:56:27,  9.78s/it]
 49%|████▊     | 18484/37963 [44:22:58<49:16:10,  9.11s/it]
 49%|████▊     | 18485/37963 [44:23:06<46:23:27,  8.57s/it]
 49%|████▊     | 18486/37963 [44:23:13<44:42:52,  8.26s/it]
 49%|████▊     | 18487/37963 [44:23:20<42:59:31,  7.95s/it]
 49%|████▊     | 18488/37963 [44:23:28<42:05:47,  7.78s/it]
 49%|████▊     | 18489/37963 [44:23:35<41:31:58,  7.68s/it]
 49%|████▊     | 18490/37963 [44:23:43<41:02:10,  7.59s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '2.239', 'learning_rate': '1.09e-05', 'epoch': '0.4871'}

 49%|████▊     | 18490/37963 [44:23:43<41:02:10,  7.59s/it]
 49%|████▊     | 18491/37963 [44:23:50<41:00:34,  7.58s/it]
 49%|████▊     | 18492/37963 [44:23:58<40:53:44,  7.56s/it]
 49%|████▊     | 18493/37963 [44:24:05<40:32:50,  7.50s/it]
 49%|████▊     | 18494/37963 [44:24:13<40:37:09,  7.51s/it]
 49%|████▊     | 18495/37963 [44:24:20<40:38:22,  7.52s/it]
 49%|████▊     | 18496/37963 [44:24:27<40:08:25,  7.42s/it]
 49%|████▊     | 18497/37963 [44:24:35<40:23:50,  7.47s/it]
 49%|████▊     | 18498/37963 [44:24:42<40:37:33,  7.51s/it]
 49%|████▊     | 18499/37963 [44:24:50<40:51:57,  7.56s/it]
 49%|████▊     | 18500/37963 [44:25:04<50:59:18,  9.43s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '3.714', 'learning_rate': '1.09e-05', 'epoch': '0.4873'}

 49%|████▊     | 18500/37963 [44:25:04<50:59:18,  9.43s/it]
 49%|████▊     | 18501/37963 [44:25:18<58:21:29, 10.79s/it]
 49%|████▊     | 18502/37963 [44:25:25<53:06:30,  9.82s/it]
 49%|████▊     | 18503/37963 [44:25:39<59:25:22, 10.99s/it]
 49%|████▊     | 18504/37963 [44:25:47<53:48:46,  9.96s/it]
 49%|████▊     | 18505/37963 [44:25:54<49:59:32,  9.25s/it]
 49%|████▊     | 18506/37963 [44:26:02<47:05:12,  8.71s/it]
 49%|████▉     | 18507/37963 [44:26:16<55:33:10, 10.28s/it]
 49%|████▉     | 18508/37963 [44:26:23<50:37:55,  9.37s/it]
 49%|████▉     | 18509/37963 [44:26:30<47:28:14,  8.78s/it]
 49%|████▉     | 18510/37963 [44:26:44<55:33:21, 10.28s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '1.146', 'learning_rate': '1.089e-05', 'epoch': '0.4876'}

 49%|████▉     | 18510/37963 [44:26:44<55:33:21, 10.28s/it]
 49%|████▉     | 18511/37963 [44:26:52<51:19:40,  9.50s/it]
 49%|████▉     | 18512/37963 [44:26:59<48:07:22,  8.91s/it]
 49%|████▉     | 18513/37963 [44:27:07<45:52:09,  8.49s/it]
 49%|████▉     | 18514/37963 [44:27:14<44:21:49,  8.21s/it]
 49%|████▉     | 18515/37963 [44:27:22<43:15:34,  8.01s/it]
 49%|████▉     | 18516/37963 [44:27:30<42:26:35,  7.86s/it]
 49%|████▉     | 18517/37963 [44:27:37<41:57:34,  7.77s/it]
 49%|████▉     | 18518/37963 [44:27:45<41:39:02,  7.71s/it]
 49%|████▉     | 18519/37963 [44:27:52<41:22:43,  7.66s/it]
 49%|████▉     | 18520/37963 [44:28:00<41:10:32,  7.62s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '0.8773', 'learning_rate': '1.088e-05', 'epoch': '0.4878'}

 49%|████▉     | 18520/37963 [44:28:00<41:10:32,  7.62s/it]
 49%|████▉     | 18521/37963 [44:28:07<41:19:12,  7.65s/it]
 49%|████▉     | 18522/37963 [44:28:15<40:29:02,  7.50s/it]
 49%|████▉     | 18523/37963 [44:28:22<40:30:23,  7.50s/it]
 49%|████▉     | 18524/37963 [44:28:29<40:11:19,  7.44s/it]
 49%|████▉     | 18525/37963 [44:28:37<40:16:36,  7.46s/it]
 49%|████▉     | 18526/37963 [44:28:45<40:37:08,  7.52s/it]
 49%|████▉     | 18527/37963 [44:28:52<40:29:28,  7.50s/it]
 49%|████▉     | 18528/37963 [44:29:06<50:53:39,  9.43s/it]
 49%|████▉     | 18529/37963 [44:29:13<47:48:21,  8.86s/it]
 49%|████▉     | 18530/37963 [44:29:21<45:38:50,  8.46s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '1.409', 'learning_rate': '1.087e-05', 'epoch': '0.4881'}

 49%|████▉     | 18530/37963 [44:29:21<45:38:50,  8.46s/it]
 49%|████▉     | 18531/37963 [44:29:35<54:27:36, 10.09s/it]
 49%|████▉     | 18532/37963 [44:29:42<50:16:14,  9.31s/it]
 49%|████▉     | 18533/37963 [44:29:50<47:15:44,  8.76s/it]
 49%|████▉     | 18534/37963 [44:29:57<45:14:59,  8.38s/it]
 49%|████▉     | 18535/37963 [44:30:11<54:18:57, 10.06s/it]
 49%|████▉     | 18536/37963 [44:30:19<50:12:47,  9.30s/it]
 49%|████▉     | 18537/37963 [44:30:26<47:22:03,  8.78s/it]
 49%|████▉     | 18538/37963 [44:30:34<45:21:41,  8.41s/it]
 49%|████▉     | 18539/37963 [44:30:41<43:54:53,  8.14s/it]
 49%|████▉     | 18540/37963 [44:30:49<42:49:18,  7.94s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.207', 'learning_rate': '1.086e-05', 'epoch': '0.4884'}

 49%|████▉     | 18540/37963 [44:30:49<42:49:18,  7.94s/it]
 49%|████▉     | 18541/37963 [44:30:57<42:23:28,  7.86s/it]
 49%|████▉     | 18542/37963 [44:31:04<41:38:35,  7.72s/it]
 49%|████▉     | 18543/37963 [44:31:12<41:24:51,  7.68s/it]
 49%|████▉     | 18544/37963 [44:31:19<41:07:03,  7.62s/it]
 49%|████▉     | 18545/37963 [44:31:26<40:38:30,  7.53s/it]
 49%|████▉     | 18546/37963 [44:31:34<40:36:06,  7.53s/it]
 49%|████▉     | 18547/37963 [44:31:41<40:26:58,  7.50s/it]
 49%|████▉     | 18548/37963 [44:31:55<50:44:31,  9.41s/it]
 49%|████▉     | 18549/37963 [44:32:03<47:43:48,  8.85s/it]
 49%|████▉     | 18550/37963 [44:32:10<45:53:29,  8.51s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '3.825', 'learning_rate': '1.085e-05', 'epoch': '0.4886'}

 49%|████▉     | 18550/37963 [44:32:10<45:53:29,  8.51s/it]
 49%|████▉     | 18551/37963 [44:32:24<54:34:54, 10.12s/it]
 49%|████▉     | 18552/37963 [44:32:38<60:48:49, 11.28s/it]
 49%|████▉     | 18553/37963 [44:32:46<54:58:58, 10.20s/it]
 49%|████▉     | 18554/37963 [44:33:00<60:42:04, 11.26s/it]
 49%|████▉     | 18555/37963 [44:33:07<54:50:33, 10.17s/it]
 49%|████▉     | 18556/37963 [44:33:15<50:07:21,  9.30s/it]
 49%|████▉     | 18557/37963 [44:33:22<47:11:12,  8.75s/it]
 49%|████▉     | 18558/37963 [44:33:30<45:32:19,  8.45s/it]
 49%|████▉     | 18559/37963 [44:33:44<54:00:12, 10.02s/it]
 49%|████▉     | 18560/37963 [44:33:51<50:03:32,  9.29s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '4.32', 'learning_rate': '1.085e-05', 'epoch': '0.4889'}

 49%|████▉     | 18560/37963 [44:33:51<50:03:32,  9.29s/it]
 49%|████▉     | 18561/37963 [44:33:59<47:08:24,  8.75s/it]
 49%|████▉     | 18562/37963 [44:34:06<45:06:48,  8.37s/it]
 49%|████▉     | 18563/37963 [44:34:13<43:23:01,  8.05s/it]
 49%|████▉     | 18564/37963 [44:34:21<42:36:41,  7.91s/it]
 49%|████▉     | 18565/37963 [44:34:29<41:59:42,  7.79s/it]
 49%|████▉     | 18566/37963 [44:34:36<41:12:25,  7.65s/it]
 49%|████▉     | 18567/37963 [44:34:43<40:59:09,  7.61s/it]
 49%|████▉     | 18568/37963 [44:34:51<41:00:57,  7.61s/it]
 49%|████▉     | 18569/37963 [44:34:59<40:59:27,  7.61s/it]
 49%|████▉     | 18570/37963 [44:35:06<40:36:03,  7.54s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '2.154', 'learning_rate': '1.084e-05', 'epoch': '0.4892'}

 49%|████▉     | 18570/37963 [44:35:06<40:36:03,  7.54s/it]
 49%|████▉     | 18571/37963 [44:35:14<40:39:31,  7.55s/it]
 49%|████▉     | 18572/37963 [44:35:21<40:37:07,  7.54s/it]
 49%|████▉     | 18573/37963 [44:35:28<40:02:46,  7.44s/it]
 49%|████▉     | 18574/37963 [44:35:36<40:09:40,  7.46s/it]
 49%|████▉     | 18575/37963 [44:35:43<39:46:15,  7.38s/it]
 49%|████▉     | 18576/37963 [44:35:50<39:42:15,  7.37s/it]
 49%|████▉     | 18577/37963 [44:36:04<50:34:34,  9.39s/it]
 49%|████▉     | 18578/37963 [44:36:19<58:32:13, 10.87s/it]
 49%|████▉     | 18579/37963 [44:36:26<53:08:45,  9.87s/it]
 49%|████▉     | 18580/37963 [44:36:34<49:21:34,  9.17s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '0.9938', 'learning_rate': '1.083e-05', 'epoch': '0.4894'}

 49%|████▉     | 18580/37963 [44:36:34<49:21:34,  9.17s/it]
 49%|████▉     | 18581/37963 [44:36:41<46:26:45,  8.63s/it]
 49%|████▉     | 18582/37963 [44:36:49<44:30:31,  8.27s/it]
 49%|████▉     | 18583/37963 [44:36:56<43:15:05,  8.03s/it]
 49%|████▉     | 18584/37963 [44:37:10<52:52:41,  9.82s/it]
 49%|████▉     | 18585/37963 [44:37:18<49:13:38,  9.15s/it]
 49%|████▉     | 18586/37963 [44:37:25<46:35:23,  8.66s/it]
 49%|████▉     | 18587/37963 [44:37:33<44:54:52,  8.34s/it]
 49%|████▉     | 18588/37963 [44:37:40<43:40:24,  8.11s/it]
 49%|████▉     | 18589/37963 [44:37:48<42:41:11,  7.93s/it]
 49%|████▉     | 18590/37963 [44:37:55<41:54:52,  7.79s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.534', 'learning_rate': '1.082e-05', 'epoch': '0.4897'}

 49%|████▉     | 18590/37963 [44:37:55<41:54:52,  7.79s/it]
 49%|████▉     | 18591/37963 [44:38:03<41:26:17,  7.70s/it]
 49%|████▉     | 18592/37963 [44:38:10<40:58:00,  7.61s/it]
 49%|████▉     | 18593/37963 [44:38:17<40:26:50,  7.52s/it]
 49%|████▉     | 18594/37963 [44:38:25<40:53:08,  7.60s/it]
 49%|████▉     | 18595/37963 [44:38:33<40:53:05,  7.60s/it]
 49%|████▉     | 18596/37963 [44:38:40<40:49:17,  7.59s/it]
 49%|████▉     | 18597/37963 [44:38:54<50:19:34,  9.36s/it]
 49%|████▉     | 18598/37963 [44:39:15<68:30:08, 12.73s/it]
 49%|████▉     | 18599/37963 [44:39:22<59:50:35, 11.13s/it]
 49%|████▉     | 18600/37963 [44:39:29<53:58:51, 10.04s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.796', 'learning_rate': '1.081e-05', 'epoch': '0.49'}

 49%|████▉     | 18600/37963 [44:39:29<53:58:51, 10.04s/it]
 49%|████▉     | 18601/37963 [44:39:37<50:03:52,  9.31s/it]
 49%|████▉     | 18602/37963 [44:39:45<47:13:15,  8.78s/it]
 49%|████▉     | 18603/37963 [44:39:52<45:06:57,  8.39s/it]
 49%|████▉     | 18604/37963 [44:40:00<43:51:03,  8.15s/it]
 49%|████▉     | 18605/37963 [44:40:07<42:32:10,  7.91s/it]
 49%|████▉     | 18606/37963 [44:40:21<52:02:11,  9.68s/it]
 49%|████▉     | 18607/37963 [44:40:28<48:36:05,  9.04s/it]
 49%|████▉     | 18608/37963 [44:40:36<46:19:43,  8.62s/it]
 49%|████▉     | 18609/37963 [44:40:43<44:15:19,  8.23s/it]
 49%|████▉     | 18610/37963 [44:40:51<43:12:41,  8.04s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.654', 'learning_rate': '1.08e-05', 'epoch': '0.4902'}

 49%|████▉     | 18610/37963 [44:40:51<43:12:41,  8.04s/it]
 49%|████▉     | 18611/37963 [44:40:58<42:24:13,  7.89s/it]
 49%|████▉     | 18612/37963 [44:41:06<41:43:43,  7.76s/it]
 49%|████▉     | 18613/37963 [44:41:20<51:26:47,  9.57s/it]
 49%|████▉     | 18614/37963 [44:41:27<47:56:00,  8.92s/it]
 49%|████▉     | 18615/37963 [44:41:34<45:29:39,  8.46s/it]
 49%|████▉     | 18616/37963 [44:41:42<43:41:05,  8.13s/it]
 49%|████▉     | 18617/37963 [44:41:49<42:44:35,  7.95s/it]
 49%|████▉     | 18618/37963 [44:41:57<42:01:19,  7.82s/it]
 49%|████▉     | 18619/37963 [44:42:04<41:34:08,  7.74s/it]
 49%|████▉     | 18620/37963 [44:42:12<40:49:41,  7.60s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '2.99', 'learning_rate': '1.079e-05', 'epoch': '0.4905'}

 49%|████▉     | 18620/37963 [44:42:12<40:49:41,  7.60s/it]
 49%|████▉     | 18621/37963 [44:42:19<40:54:41,  7.61s/it]
 49%|████▉     | 18622/37963 [44:42:27<41:02:07,  7.64s/it]
 49%|████▉     | 18623/37963 [44:42:41<50:31:21,  9.40s/it]
 49%|████▉     | 18624/37963 [44:42:48<47:41:14,  8.88s/it]
 49%|████▉     | 18625/37963 [44:42:56<45:38:42,  8.50s/it]
 49%|████▉     | 18626/37963 [44:43:10<54:19:54, 10.12s/it]
 49%|████▉     | 18627/37963 [44:43:17<50:09:00,  9.34s/it]
 49%|████▉     | 18628/37963 [44:43:25<46:47:34,  8.71s/it]
 49%|████▉     | 18629/37963 [44:43:32<44:48:23,  8.34s/it]
 49%|████▉     | 18630/37963 [44:43:40<43:32:37,  8.11s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '0.7595', 'learning_rate': '1.079e-05', 'epoch': '0.4907'}

 49%|████▉     | 18630/37963 [44:43:40<43:32:37,  8.11s/it]
 49%|████▉     | 18631/37963 [44:43:47<42:37:19,  7.94s/it]
 49%|████▉     | 18632/37963 [44:43:55<41:49:44,  7.79s/it]
 49%|████▉     | 18633/37963 [44:44:02<41:27:18,  7.72s/it]
 49%|████▉     | 18634/37963 [44:44:10<41:11:11,  7.67s/it]
 49%|████▉     | 18635/37963 [44:44:17<40:57:00,  7.63s/it]
 49%|████▉     | 18636/37963 [44:44:25<40:52:51,  7.61s/it]
 49%|████▉     | 18637/37963 [44:44:39<51:02:12,  9.51s/it]
 49%|████▉     | 18638/37963 [44:44:46<47:48:03,  8.90s/it]
 49%|████▉     | 18639/37963 [44:44:54<45:35:41,  8.49s/it]
 49%|████▉     | 18640/37963 [44:45:01<43:57:18,  8.19s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '0.9935', 'learning_rate': '1.078e-05', 'epoch': '0.491'}

 49%|████▉     | 18640/37963 [44:45:01<43:57:18,  8.19s/it]
 49%|████▉     | 18641/37963 [44:45:09<42:53:09,  7.99s/it]
 49%|████▉     | 18642/37963 [44:45:16<42:10:52,  7.86s/it]
 49%|████▉     | 18643/37963 [44:45:24<41:40:48,  7.77s/it]
 49%|████▉     | 18644/37963 [44:45:31<41:15:34,  7.69s/it]
 49%|████▉     | 18645/37963 [44:45:45<51:29:58,  9.60s/it]
 49%|████▉     | 18646/37963 [44:45:53<48:25:17,  9.02s/it]
 49%|████▉     | 18647/37963 [44:46:00<45:27:38,  8.47s/it]
 49%|████▉     | 18648/37963 [44:46:14<53:55:50, 10.05s/it]
 49%|████▉     | 18649/37963 [44:46:28<60:15:04, 11.23s/it]
 49%|████▉     | 18650/37963 [44:46:36<54:28:49, 10.16s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '2.142', 'learning_rate': '1.077e-05', 'epoch': '0.4913'}

 49%|████▉     | 18650/37963 [44:46:36<54:28:49, 10.16s/it]
 49%|████▉     | 18651/37963 [44:46:43<50:19:44,  9.38s/it]
 49%|████▉     | 18652/37963 [44:46:51<47:10:27,  8.79s/it]
 49%|████▉     | 18653/37963 [44:46:58<44:57:04,  8.38s/it]
 49%|████▉     | 18654/37963 [44:47:05<43:14:13,  8.06s/it]
 49%|████▉     | 18655/37963 [44:47:13<42:23:27,  7.90s/it]
 49%|████▉     | 18656/37963 [44:47:27<52:08:20,  9.72s/it]
 49%|████▉     | 18657/37963 [44:47:34<48:26:03,  9.03s/it]
 49%|████▉     | 18658/37963 [44:47:42<45:52:09,  8.55s/it]
 49%|████▉     | 18659/37963 [44:47:49<44:05:18,  8.22s/it]
 49%|████▉     | 18660/37963 [44:47:57<43:01:18,  8.02s/it]
                                                           
{'loss': '0.1511', 'grad_norm': '0.9916', 'learning_rate': '1.076e-05', 'epoch': '0.4915'}

 49%|████▉     | 18660/37963 [44:47:57<43:01:18,  8.02s/it]
 49%|████▉     | 18661/37963 [44:48:04<42:12:18,  7.87s/it]
 49%|████▉     | 18662/37963 [44:48:12<41:42:24,  7.78s/it]
 49%|████▉     | 18663/37963 [44:48:19<41:16:49,  7.70s/it]
 49%|████▉     | 18664/37963 [44:48:27<41:02:59,  7.66s/it]
 49%|████▉     | 18665/37963 [44:48:34<40:58:55,  7.65s/it]
 49%|████▉     | 18666/37963 [44:48:42<40:47:36,  7.61s/it]
 49%|████▉     | 18667/37963 [44:48:56<51:04:37,  9.53s/it]
 49%|████▉     | 18668/37963 [44:49:04<47:51:06,  8.93s/it]
 49%|████▉     | 18669/37963 [44:49:17<55:53:24, 10.43s/it]
 49%|████▉     | 18670/37963 [44:49:25<51:24:33,  9.59s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '2.151', 'learning_rate': '1.075e-05', 'epoch': '0.4918'}

 49%|████▉     | 18670/37963 [44:49:25<51:24:33,  9.59s/it]
 49%|████▉     | 18671/37963 [44:49:33<48:04:52,  8.97s/it]
 49%|████▉     | 18672/37963 [44:49:40<45:42:33,  8.53s/it]
 49%|████▉     | 18673/37963 [44:49:48<44:00:28,  8.21s/it]
 49%|████▉     | 18674/37963 [44:49:55<42:53:43,  8.01s/it]
 49%|████▉     | 18675/37963 [44:50:09<52:18:44,  9.76s/it]
 49%|████▉     | 18676/37963 [44:50:17<48:49:05,  9.11s/it]
 49%|████▉     | 18677/37963 [44:50:24<46:17:14,  8.64s/it]
 49%|████▉     | 18678/37963 [44:50:32<44:28:46,  8.30s/it]
 49%|████▉     | 18679/37963 [44:50:39<43:05:16,  8.04s/it]
 49%|████▉     | 18680/37963 [44:50:47<42:17:04,  7.89s/it]
                                                           
{'loss': '0.1492', 'grad_norm': '3.126', 'learning_rate': '1.074e-05', 'epoch': '0.4921'}

 49%|████▉     | 18680/37963 [44:50:47<42:17:04,  7.89s/it]
 49%|████▉     | 18681/37963 [44:51:00<51:32:49,  9.62s/it]
 49%|████▉     | 18682/37963 [44:51:08<48:06:42,  8.98s/it]
 49%|████▉     | 18683/37963 [44:51:15<45:49:49,  8.56s/it]
 49%|████▉     | 18684/37963 [44:51:23<44:17:00,  8.27s/it]
 49%|████▉     | 18685/37963 [44:51:31<43:19:27,  8.09s/it]
 49%|████▉     | 18686/37963 [44:51:38<42:31:36,  7.94s/it]
 49%|████▉     | 18687/37963 [44:51:46<41:47:53,  7.81s/it]
 49%|████▉     | 18688/37963 [44:51:53<41:13:58,  7.70s/it]
 49%|████▉     | 18689/37963 [44:52:01<41:07:46,  7.68s/it]
 49%|████▉     | 18690/37963 [44:52:08<40:49:07,  7.62s/it]
                                                           
{'loss': '0.1518', 'grad_norm': '1.356', 'learning_rate': '1.073e-05', 'epoch': '0.4923'}

 49%|████▉     | 18690/37963 [44:52:08<40:49:07,  7.62s/it]
 49%|████▉     | 18691/37963 [44:52:16<40:43:01,  7.61s/it]
 49%|████▉     | 18692/37963 [44:52:23<40:21:41,  7.54s/it]
 49%|████▉     | 18693/37963 [44:52:31<40:21:16,  7.54s/it]
 49%|████▉     | 18694/37963 [44:52:38<40:01:46,  7.48s/it]
 49%|████▉     | 18695/37963 [44:52:46<40:06:23,  7.49s/it]
 49%|████▉     | 18696/37963 [44:52:53<40:01:19,  7.48s/it]
 49%|████▉     | 18697/37963 [44:53:07<50:38:32,  9.46s/it]
 49%|████▉     | 18698/37963 [44:53:15<47:41:27,  8.91s/it]
 49%|████▉     | 18699/37963 [44:53:29<56:01:20, 10.47s/it]
 49%|████▉     | 18700/37963 [44:53:37<51:34:29,  9.64s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '0.8852', 'learning_rate': '1.073e-05', 'epoch': '0.4926'}

 49%|████▉     | 18700/37963 [44:53:37<51:34:29,  9.64s/it]
 49%|████▉     | 18701/37963 [44:53:44<47:48:41,  8.94s/it]
 49%|████▉     | 18702/37963 [44:53:51<45:23:18,  8.48s/it]
 49%|████▉     | 18703/37963 [44:54:12<64:27:52, 12.05s/it]
 49%|████▉     | 18704/37963 [44:54:19<57:13:32, 10.70s/it]
 49%|████▉     | 18705/37963 [44:54:27<52:20:46,  9.79s/it]
 49%|████▉     | 18706/37963 [44:54:34<48:20:12,  9.04s/it]
 49%|████▉     | 18707/37963 [44:54:42<46:03:50,  8.61s/it]
 49%|████▉     | 18708/37963 [44:54:49<44:23:59,  8.30s/it]
 49%|████▉     | 18709/37963 [44:54:57<43:05:41,  8.06s/it]
 49%|████▉     | 18710/37963 [44:55:04<42:11:47,  7.89s/it]
                                                           
{'loss': '0.133', 'grad_norm': '1.754', 'learning_rate': '1.072e-05', 'epoch': '0.4928'}

 49%|████▉     | 18710/37963 [44:55:04<42:11:47,  7.89s/it]
 49%|████▉     | 18711/37963 [44:55:12<41:31:59,  7.77s/it]
 49%|████▉     | 18712/37963 [44:55:19<41:07:05,  7.69s/it]
 49%|████▉     | 18713/37963 [44:55:27<40:48:31,  7.63s/it]
 49%|████▉     | 18714/37963 [44:55:34<40:41:17,  7.61s/it]
 49%|████▉     | 18715/37963 [44:55:42<39:55:14,  7.47s/it]
 49%|████▉     | 18716/37963 [44:55:49<39:39:13,  7.42s/it]
 49%|████▉     | 18717/37963 [44:55:57<40:08:10,  7.51s/it]
 49%|████▉     | 18718/37963 [44:56:04<40:11:54,  7.52s/it]
 49%|████▉     | 18719/37963 [44:56:18<50:24:31,  9.43s/it]
 49%|████▉     | 18720/37963 [44:56:26<47:20:34,  8.86s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '2.093', 'learning_rate': '1.071e-05', 'epoch': '0.4931'}

 49%|████▉     | 18720/37963 [44:56:26<47:20:34,  8.86s/it]
 49%|████▉     | 18721/37963 [44:56:33<45:10:58,  8.45s/it]
 49%|████▉     | 18722/37963 [44:56:47<54:45:00, 10.24s/it]
 49%|████▉     | 18723/37963 [44:56:55<50:19:58,  9.42s/it]
 49%|████▉     | 18724/37963 [44:57:02<47:17:24,  8.85s/it]
 49%|████▉     | 18725/37963 [44:57:16<55:27:21, 10.38s/it]
 49%|████▉     | 18726/37963 [44:57:24<50:56:18,  9.53s/it]
 49%|████▉     | 18727/37963 [44:57:38<58:03:11, 10.86s/it]
 49%|████▉     | 18728/37963 [44:57:45<52:20:03,  9.79s/it]
 49%|████▉     | 18729/37963 [44:57:53<48:31:48,  9.08s/it]
 49%|████▉     | 18730/37963 [44:58:00<45:59:06,  8.61s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '4.131', 'learning_rate': '1.07e-05', 'epoch': '0.4934'}

 49%|████▉     | 18730/37963 [44:58:00<45:59:06,  8.61s/it]
 49%|████▉     | 18731/37963 [44:58:08<43:57:27,  8.23s/it]
 49%|████▉     | 18732/37963 [44:58:15<42:41:00,  7.99s/it]
 49%|████▉     | 18733/37963 [44:58:23<41:59:02,  7.86s/it]
 49%|████▉     | 18734/37963 [44:58:30<41:06:20,  7.70s/it]
 49%|████▉     | 18735/37963 [44:58:37<40:31:09,  7.59s/it]
 49%|████▉     | 18736/37963 [44:58:45<40:34:51,  7.60s/it]
 49%|████▉     | 18737/37963 [44:58:52<39:50:57,  7.46s/it]
 49%|████▉     | 18738/37963 [44:58:59<39:53:38,  7.47s/it]
 49%|████▉     | 18739/37963 [44:59:07<39:38:31,  7.42s/it]
 49%|████▉     | 18740/37963 [44:59:14<40:01:16,  7.50s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '2.362', 'learning_rate': '1.069e-05', 'epoch': '0.4936'}

 49%|████▉     | 18740/37963 [44:59:14<40:01:16,  7.50s/it]
 49%|████▉     | 18741/37963 [44:59:22<40:08:52,  7.52s/it]
 49%|████▉     | 18742/37963 [44:59:29<39:57:43,  7.48s/it]
 49%|████▉     | 18743/37963 [44:59:37<39:59:06,  7.49s/it]
 49%|████▉     | 18744/37963 [44:59:44<40:04:37,  7.51s/it]
 49%|████▉     | 18745/37963 [44:59:52<40:05:54,  7.51s/it]
 49%|████▉     | 18746/37963 [44:59:59<40:05:42,  7.51s/it]
 49%|████▉     | 18747/37963 [45:00:13<50:03:31,  9.38s/it]
 49%|████▉     | 18748/37963 [45:00:21<47:17:58,  8.86s/it]
 49%|████▉     | 18749/37963 [45:00:35<55:09:51, 10.34s/it]
 49%|████▉     | 18750/37963 [45:00:49<61:14:14, 11.47s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '0.8465', 'learning_rate': '1.068e-05', 'epoch': '0.4939'}

 49%|████▉     | 18750/37963 [45:00:49<61:14:14, 11.47s/it]
 49%|████▉     | 18751/37963 [45:00:56<55:05:23, 10.32s/it]
 49%|████▉     | 18752/37963 [45:01:10<60:47:00, 11.39s/it]
 49%|████▉     | 18753/37963 [45:01:18<54:44:35, 10.26s/it]
 49%|████▉     | 18754/37963 [45:01:25<49:45:23,  9.32s/it]
 49%|████▉     | 18755/37963 [45:01:33<47:06:00,  8.83s/it]
 49%|████▉     | 18756/37963 [45:01:40<45:11:50,  8.47s/it]
 49%|████▉     | 18757/37963 [45:01:48<43:37:42,  8.18s/it]
 49%|████▉     | 18758/37963 [45:01:55<42:43:51,  8.01s/it]
 49%|████▉     | 18759/37963 [45:02:03<42:06:00,  7.89s/it]
 49%|████▉     | 18760/37963 [45:02:11<41:32:56,  7.79s/it]
                                                           
{'loss': '0.1477', 'grad_norm': '1.345', 'learning_rate': '1.068e-05', 'epoch': '0.4942'}

 49%|████▉     | 18760/37963 [45:02:11<41:32:56,  7.79s/it]
 49%|████▉     | 18761/37963 [45:02:18<41:04:16,  7.70s/it]
 49%|████▉     | 18762/37963 [45:02:25<40:24:17,  7.58s/it]
 49%|████▉     | 18763/37963 [45:02:33<40:16:58,  7.55s/it]
 49%|████▉     | 18764/37963 [45:02:41<40:26:48,  7.58s/it]
 49%|████▉     | 18765/37963 [45:02:55<50:40:03,  9.50s/it]
 49%|████▉     | 18766/37963 [45:03:02<46:58:32,  8.81s/it]
 49%|████▉     | 18767/37963 [45:03:09<44:59:36,  8.44s/it]
 49%|████▉     | 18768/37963 [45:03:17<43:46:02,  8.21s/it]
 49%|████▉     | 18769/37963 [45:03:31<53:00:58,  9.94s/it]
 49%|████▉     | 18770/37963 [45:03:39<49:23:18,  9.26s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '3.552', 'learning_rate': '1.067e-05', 'epoch': '0.4944'}

 49%|████▉     | 18770/37963 [45:03:39<49:23:18,  9.26s/it]
 49%|████▉     | 18771/37963 [45:03:53<56:55:17, 10.68s/it]
 49%|████▉     | 18772/37963 [45:04:00<51:52:57,  9.73s/it]
 49%|████▉     | 18773/37963 [45:04:08<48:31:49,  9.10s/it]
 49%|████▉     | 18774/37963 [45:04:22<56:36:41, 10.62s/it]
 49%|████▉     | 18775/37963 [45:04:30<51:44:27,  9.71s/it]
 49%|████▉     | 18776/37963 [45:04:37<48:15:26,  9.05s/it]
 49%|████▉     | 18777/37963 [45:04:45<45:46:49,  8.59s/it]
 49%|████▉     | 18778/37963 [45:04:52<44:16:47,  8.31s/it]
 49%|████▉     | 18779/37963 [45:05:00<42:59:10,  8.07s/it]
 49%|████▉     | 18780/37963 [45:05:07<42:16:05,  7.93s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '2.842', 'learning_rate': '1.066e-05', 'epoch': '0.4947'}

 49%|████▉     | 18780/37963 [45:05:07<42:16:05,  7.93s/it]
 49%|████▉     | 18781/37963 [45:05:15<41:34:35,  7.80s/it]
 49%|████▉     | 18782/37963 [45:05:22<41:14:04,  7.74s/it]
 49%|████▉     | 18783/37963 [45:05:30<40:30:21,  7.60s/it]
 49%|████▉     | 18784/37963 [45:05:37<40:19:33,  7.57s/it]
 49%|████▉     | 18785/37963 [45:05:45<40:26:43,  7.59s/it]
 49%|████▉     | 18786/37963 [45:05:52<40:22:03,  7.58s/it]
 49%|████▉     | 18787/37963 [45:06:00<40:10:46,  7.54s/it]
 49%|████▉     | 18788/37963 [45:06:07<40:10:25,  7.54s/it]
 49%|████▉     | 18789/37963 [45:06:15<39:58:51,  7.51s/it]
 49%|████▉     | 18790/37963 [45:06:22<39:51:27,  7.48s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.198', 'learning_rate': '1.065e-05', 'epoch': '0.495'}

 49%|████▉     | 18790/37963 [45:06:22<39:51:27,  7.48s/it]
 49%|████▉     | 18791/37963 [45:06:30<39:52:57,  7.49s/it]
 50%|████▉     | 18792/37963 [45:06:44<49:55:28,  9.38s/it]
 50%|████▉     | 18793/37963 [45:06:51<46:58:24,  8.82s/it]
 50%|████▉     | 18794/37963 [45:06:58<44:20:56,  8.33s/it]
 50%|████▉     | 18795/37963 [45:07:06<43:00:21,  8.08s/it]
 50%|████▉     | 18796/37963 [45:07:20<52:24:31,  9.84s/it]
 50%|████▉     | 18797/37963 [45:07:34<58:58:55, 11.08s/it]
 50%|████▉     | 18798/37963 [45:07:41<53:22:32, 10.03s/it]
 50%|████▉     | 18799/37963 [45:07:49<49:21:09,  9.27s/it]
 50%|████▉     | 18800/37963 [45:07:56<46:31:51,  8.74s/it]
                                                           
{'loss': '0.158', 'grad_norm': '0.7943', 'learning_rate': '1.064e-05', 'epoch': '0.4952'}

 50%|████▉     | 18800/37963 [45:07:56<46:31:51,  8.74s/it]
 50%|████▉     | 18801/37963 [45:08:10<54:43:42, 10.28s/it]
 50%|████▉     | 18802/37963 [45:08:18<50:22:14,  9.46s/it]
 50%|████▉     | 18803/37963 [45:08:25<47:20:02,  8.89s/it]
 50%|████▉     | 18804/37963 [45:08:33<45:10:16,  8.49s/it]
 50%|████▉     | 18805/37963 [45:08:40<43:38:01,  8.20s/it]
 50%|████▉     | 18806/37963 [45:08:48<42:35:57,  8.01s/it]
 50%|████▉     | 18807/37963 [45:08:55<41:50:09,  7.86s/it]
 50%|████▉     | 18808/37963 [45:09:03<41:19:12,  7.77s/it]
 50%|████▉     | 18809/37963 [45:09:11<41:03:41,  7.72s/it]
 50%|████▉     | 18810/37963 [45:09:18<40:26:01,  7.60s/it]
                                                           
{'loss': '0.1608', 'grad_norm': '1.811', 'learning_rate': '1.063e-05', 'epoch': '0.4955'}

 50%|████▉     | 18810/37963 [45:09:18<40:26:01,  7.60s/it]
 50%|████▉     | 18811/37963 [45:09:25<40:19:41,  7.58s/it]
 50%|████▉     | 18812/37963 [45:09:39<49:48:28,  9.36s/it]
 50%|████▉     | 18813/37963 [45:09:46<46:56:54,  8.83s/it]
 50%|████▉     | 18814/37963 [45:09:54<44:57:14,  8.45s/it]
 50%|████▉     | 18815/37963 [45:10:08<54:15:51, 10.20s/it]
 50%|████▉     | 18816/37963 [45:10:16<50:12:56,  9.44s/it]
 50%|████▉     | 18817/37963 [45:10:23<46:55:31,  8.82s/it]
 50%|████▉     | 18818/37963 [45:10:31<44:24:47,  8.35s/it]
 50%|████▉     | 18819/37963 [45:10:38<43:00:07,  8.09s/it]
 50%|████▉     | 18820/37963 [45:10:52<52:20:44,  9.84s/it]
                                                           
{'loss': '0.1668', 'grad_norm': '1.824', 'learning_rate': '1.062e-05', 'epoch': '0.4957'}

 50%|████▉     | 18820/37963 [45:10:52<52:20:44,  9.84s/it]
 50%|████▉     | 18821/37963 [45:11:00<48:46:36,  9.17s/it]
 50%|████▉     | 18822/37963 [45:11:07<46:08:21,  8.68s/it]
 50%|████▉     | 18823/37963 [45:11:15<44:29:34,  8.37s/it]
 50%|████▉     | 18824/37963 [45:11:22<42:45:17,  8.04s/it]
 50%|████▉     | 18825/37963 [45:11:36<52:22:45,  9.85s/it]
 50%|████▉     | 18826/37963 [45:11:44<48:36:22,  9.14s/it]
 50%|████▉     | 18827/37963 [45:11:51<46:15:09,  8.70s/it]
 50%|████▉     | 18828/37963 [45:11:59<44:19:19,  8.34s/it]
 50%|████▉     | 18829/37963 [45:12:06<43:04:49,  8.11s/it]
 50%|████▉     | 18830/37963 [45:12:14<42:04:56,  7.92s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '5.525', 'learning_rate': '1.062e-05', 'epoch': '0.496'}

 50%|████▉     | 18830/37963 [45:12:14<42:04:56,  7.92s/it]
 50%|████▉     | 18831/37963 [45:12:21<41:24:59,  7.79s/it]
 50%|████▉     | 18832/37963 [45:12:29<40:58:52,  7.71s/it]
 50%|████▉     | 18833/37963 [45:12:36<40:36:46,  7.64s/it]
 50%|████▉     | 18834/37963 [45:12:44<40:17:47,  7.58s/it]
 50%|████▉     | 18835/37963 [45:12:51<39:45:42,  7.48s/it]
 50%|████▉     | 18836/37963 [45:12:59<39:48:14,  7.49s/it]
 50%|████▉     | 18837/37963 [45:13:06<39:55:47,  7.52s/it]
 50%|████▉     | 18838/37963 [45:13:14<39:55:22,  7.51s/it]
 50%|████▉     | 18839/37963 [45:13:27<49:31:52,  9.32s/it]
 50%|████▉     | 18840/37963 [45:13:35<46:55:37,  8.83s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.197', 'learning_rate': '1.061e-05', 'epoch': '0.4963'}

 50%|████▉     | 18840/37963 [45:13:35<46:55:37,  8.83s/it]
 50%|████▉     | 18841/37963 [45:13:42<44:45:07,  8.43s/it]
 50%|████▉     | 18842/37963 [45:13:50<43:19:49,  8.16s/it]
 50%|████▉     | 18843/37963 [45:14:04<52:12:01,  9.83s/it]
 50%|████▉     | 18844/37963 [45:14:11<48:29:10,  9.13s/it]
 50%|████▉     | 18845/37963 [45:14:25<56:21:51, 10.61s/it]
 50%|████▉     | 18846/37963 [45:14:33<51:37:44,  9.72s/it]
 50%|████▉     | 18847/37963 [45:14:40<48:18:21,  9.10s/it]
 50%|████▉     | 18848/37963 [45:14:48<45:55:30,  8.65s/it]
 50%|████▉     | 18849/37963 [45:14:56<44:07:58,  8.31s/it]
 50%|████▉     | 18850/37963 [45:15:03<42:42:03,  8.04s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '2.729', 'learning_rate': '1.06e-05', 'epoch': '0.4965'}

 50%|████▉     | 18850/37963 [45:15:03<42:42:03,  8.04s/it]
 50%|████▉     | 18851/37963 [45:15:11<41:58:18,  7.91s/it]
 50%|████▉     | 18852/37963 [45:15:25<51:40:35,  9.73s/it]
 50%|████▉     | 18853/37963 [45:15:32<47:50:36,  9.01s/it]
 50%|████▉     | 18854/37963 [45:15:39<45:27:56,  8.57s/it]
 50%|████▉     | 18855/37963 [45:15:47<43:55:49,  8.28s/it]
 50%|████▉     | 18856/37963 [45:15:55<42:58:30,  8.10s/it]
 50%|████▉     | 18857/37963 [45:16:02<42:01:08,  7.92s/it]
 50%|████▉     | 18858/37963 [45:16:10<41:18:56,  7.79s/it]
 50%|████▉     | 18859/37963 [45:16:24<51:05:37,  9.63s/it]
 50%|████▉     | 18860/37963 [45:16:31<47:54:59,  9.03s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.442', 'learning_rate': '1.059e-05', 'epoch': '0.4968'}

 50%|████▉     | 18860/37963 [45:16:31<47:54:59,  9.03s/it]
 50%|████▉     | 18861/37963 [45:16:39<45:29:48,  8.57s/it]
 50%|████▉     | 18862/37963 [45:16:46<43:43:52,  8.24s/it]
 50%|████▉     | 18863/37963 [45:17:01<53:26:48, 10.07s/it]
 50%|████▉     | 18864/37963 [45:17:08<49:23:35,  9.31s/it]
 50%|████▉     | 18865/37963 [45:17:16<46:31:25,  8.77s/it]
 50%|████▉     | 18866/37963 [45:17:23<44:15:48,  8.34s/it]
 50%|████▉     | 18867/37963 [45:17:30<42:54:46,  8.09s/it]
 50%|████▉     | 18868/37963 [45:17:38<41:58:14,  7.91s/it]
 50%|████▉     | 18869/37963 [45:17:45<41:16:52,  7.78s/it]
 50%|████▉     | 18870/37963 [45:17:53<41:06:52,  7.75s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '3.745', 'learning_rate': '1.058e-05', 'epoch': '0.4971'}

 50%|████▉     | 18870/37963 [45:17:53<41:06:52,  7.75s/it]
 50%|████▉     | 18871/37963 [45:18:01<40:47:30,  7.69s/it]
 50%|████▉     | 18872/37963 [45:18:14<50:24:49,  9.51s/it]
 50%|████▉     | 18873/37963 [45:18:22<47:18:02,  8.92s/it]
 50%|████▉     | 18874/37963 [45:18:36<55:19:01, 10.43s/it]
 50%|████▉     | 18875/37963 [45:18:43<50:41:55,  9.56s/it]
 50%|████▉     | 18876/37963 [45:18:51<47:24:58,  8.94s/it]
 50%|████▉     | 18877/37963 [45:18:59<45:18:04,  8.54s/it]
 50%|████▉     | 18878/37963 [45:19:06<43:43:20,  8.25s/it]
 50%|████▉     | 18879/37963 [45:19:14<42:32:23,  8.02s/it]
 50%|████▉     | 18880/37963 [45:19:21<41:46:06,  7.88s/it]
                                                           
{'loss': '0.158', 'grad_norm': '1.504', 'learning_rate': '1.057e-05', 'epoch': '0.4973'}

 50%|████▉     | 18880/37963 [45:19:21<41:46:06,  7.88s/it]
 50%|████▉     | 18881/37963 [45:19:29<41:19:23,  7.80s/it]
 50%|████▉     | 18882/37963 [45:19:36<41:03:40,  7.75s/it]
 50%|████▉     | 18883/37963 [45:19:44<40:39:39,  7.67s/it]
 50%|████▉     | 18884/37963 [45:19:51<40:24:13,  7.62s/it]
 50%|████▉     | 18885/37963 [45:19:59<40:25:55,  7.63s/it]
 50%|████▉     | 18886/37963 [45:20:07<40:14:15,  7.59s/it]
 50%|████▉     | 18887/37963 [45:20:14<39:52:20,  7.52s/it]
 50%|████▉     | 18888/37963 [45:20:21<39:51:23,  7.52s/it]
 50%|████▉     | 18889/37963 [45:20:36<50:19:55,  9.50s/it]
 50%|████▉     | 18890/37963 [45:20:43<47:21:09,  8.94s/it]
                                                           
{'loss': '0.1485', 'grad_norm': '1.168', 'learning_rate': '1.056e-05', 'epoch': '0.4976'}

 50%|████▉     | 18890/37963 [45:20:43<47:21:09,  8.94s/it]
 50%|████▉     | 18891/37963 [45:20:51<44:47:41,  8.46s/it]
 50%|████▉     | 18892/37963 [45:21:04<53:21:51, 10.07s/it]
 50%|████▉     | 18893/37963 [45:21:12<49:25:21,  9.33s/it]
 50%|████▉     | 18894/37963 [45:21:26<56:37:54, 10.69s/it]
 50%|████▉     | 18895/37963 [45:21:33<51:34:49,  9.74s/it]
 50%|████▉     | 18896/37963 [45:21:41<48:09:55,  9.09s/it]
 50%|████▉     | 18897/37963 [45:21:48<45:38:26,  8.62s/it]
 50%|████▉     | 18898/37963 [45:21:56<43:59:35,  8.31s/it]
 50%|████▉     | 18899/37963 [45:22:04<42:51:49,  8.09s/it]
 50%|████▉     | 18900/37963 [45:22:11<41:55:43,  7.92s/it]
                                                           
{'loss': '0.1468', 'grad_norm': '0.9252', 'learning_rate': '1.056e-05', 'epoch': '0.4979'}

 50%|████▉     | 18900/37963 [45:22:11<41:55:43,  7.92s/it]
 50%|████▉     | 18901/37963 [45:22:19<41:22:59,  7.82s/it]
 50%|████▉     | 18902/37963 [45:22:33<51:02:42,  9.64s/it]
 50%|████▉     | 18903/37963 [45:22:40<48:07:15,  9.09s/it]
 50%|████▉     | 18904/37963 [45:22:48<45:34:23,  8.61s/it]
 50%|████▉     | 18905/37963 [45:23:02<53:57:28, 10.19s/it]
 50%|████▉     | 18906/37963 [45:23:09<49:55:04,  9.43s/it]
 50%|████▉     | 18907/37963 [45:23:17<46:23:40,  8.76s/it]
 50%|████▉     | 18908/37963 [45:23:31<54:54:19, 10.37s/it]
 50%|████▉     | 18909/37963 [45:23:39<50:40:08,  9.57s/it]
 50%|████▉     | 18910/37963 [45:23:46<47:10:20,  8.91s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.356', 'learning_rate': '1.055e-05', 'epoch': '0.4981'}

 50%|████▉     | 18910/37963 [45:23:46<47:10:20,  8.91s/it]
 50%|████▉     | 18911/37963 [45:23:54<45:11:42,  8.54s/it]
 50%|████▉     | 18912/37963 [45:24:01<43:18:26,  8.18s/it]
 50%|████▉     | 18913/37963 [45:24:08<42:06:04,  7.96s/it]
 50%|████▉     | 18914/37963 [45:24:16<41:00:27,  7.75s/it]
 50%|████▉     | 18915/37963 [45:24:23<40:19:04,  7.62s/it]
 50%|████▉     | 18916/37963 [45:24:31<40:16:23,  7.61s/it]
 50%|████▉     | 18917/37963 [45:24:38<40:24:36,  7.64s/it]
 50%|████▉     | 18918/37963 [45:24:52<50:10:19,  9.48s/it]
 50%|████▉     | 18919/37963 [45:24:59<46:52:08,  8.86s/it]
 50%|████▉     | 18920/37963 [45:25:07<44:44:28,  8.46s/it]
                                                           
{'loss': '0.1613', 'grad_norm': '2.711', 'learning_rate': '1.054e-05', 'epoch': '0.4984'}

 50%|████▉     | 18920/37963 [45:25:07<44:44:28,  8.46s/it]
 50%|████▉     | 18921/37963 [45:25:15<43:22:24,  8.20s/it]
 50%|████▉     | 18922/37963 [45:25:22<42:17:29,  8.00s/it]
 50%|████▉     | 18923/37963 [45:25:30<41:28:59,  7.84s/it]
 50%|████▉     | 18924/37963 [45:25:37<41:01:04,  7.76s/it]
 50%|████▉     | 18925/37963 [45:25:51<50:46:48,  9.60s/it]
 50%|████▉     | 18926/37963 [45:25:59<47:47:44,  9.04s/it]
 50%|████▉     | 18927/37963 [45:26:06<45:35:04,  8.62s/it]
 50%|████▉     | 18928/37963 [45:26:14<44:05:39,  8.34s/it]
 50%|████▉     | 18929/37963 [45:26:22<42:57:28,  8.12s/it]
 50%|████▉     | 18930/37963 [45:26:29<42:13:39,  7.99s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '2.691', 'learning_rate': '1.053e-05', 'epoch': '0.4986'}

 50%|████▉     | 18930/37963 [45:26:29<42:13:39,  7.99s/it]
 50%|████▉     | 18931/37963 [45:26:37<41:35:20,  7.87s/it]
 50%|████▉     | 18932/37963 [45:26:44<41:03:26,  7.77s/it]
 50%|████▉     | 18933/37963 [45:26:52<40:22:09,  7.64s/it]
 50%|████▉     | 18934/37963 [45:26:59<40:08:05,  7.59s/it]
 50%|████▉     | 18935/37963 [45:27:07<39:36:41,  7.49s/it]
 50%|████▉     | 18936/37963 [45:27:14<39:34:04,  7.49s/it]
 50%|████▉     | 18937/37963 [45:27:22<39:45:20,  7.52s/it]
 50%|████▉     | 18938/37963 [45:27:36<49:54:37,  9.44s/it]
 50%|████▉     | 18939/37963 [45:27:43<47:05:22,  8.91s/it]
 50%|████▉     | 18940/37963 [45:27:57<55:10:04, 10.44s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '2.541', 'learning_rate': '1.052e-05', 'epoch': '0.4989'}

 50%|████▉     | 18940/37963 [45:27:57<55:10:04, 10.44s/it]
 50%|████▉     | 18941/37963 [45:28:05<50:14:10,  9.51s/it]
 50%|████▉     | 18942/37963 [45:28:12<47:11:55,  8.93s/it]
 50%|████▉     | 18943/37963 [45:28:20<44:53:01,  8.50s/it]
 50%|████▉     | 18944/37963 [45:28:27<42:57:10,  8.13s/it]
 50%|████▉     | 18945/37963 [45:28:34<42:06:43,  7.97s/it]
 50%|████▉     | 18946/37963 [45:28:42<41:26:13,  7.84s/it]
 50%|████▉     | 18947/37963 [45:28:50<40:55:07,  7.75s/it]
 50%|████▉     | 18948/37963 [45:29:04<51:07:52,  9.68s/it]
 50%|████▉     | 18949/37963 [45:29:18<57:45:06, 10.93s/it]
 50%|████▉     | 18950/37963 [45:29:25<52:26:38,  9.93s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.2', 'learning_rate': '1.051e-05', 'epoch': '0.4992'}

 50%|████▉     | 18950/37963 [45:29:25<52:26:38,  9.93s/it]
 50%|████▉     | 18951/37963 [45:29:33<48:46:53,  9.24s/it]
 50%|████▉     | 18952/37963 [45:29:47<56:16:04, 10.66s/it]
 50%|████▉     | 18953/37963 [45:29:54<51:21:07,  9.72s/it]
 50%|████▉     | 18954/37963 [45:30:02<47:38:28,  9.02s/it]
 50%|████▉     | 18955/37963 [45:30:09<45:16:47,  8.58s/it]
 50%|████▉     | 18956/37963 [45:30:23<53:45:52, 10.18s/it]
 50%|████▉     | 18957/37963 [45:30:31<49:42:51,  9.42s/it]
 50%|████▉     | 18958/37963 [45:30:38<46:36:01,  8.83s/it]
 50%|████▉     | 18959/37963 [45:30:46<44:26:33,  8.42s/it]
 50%|████▉     | 18960/37963 [45:30:53<43:21:07,  8.21s/it]
                                                           
{'loss': '0.1552', 'grad_norm': '3.298', 'learning_rate': '1.05e-05', 'epoch': '0.4994'}

 50%|████▉     | 18960/37963 [45:30:53<43:21:07,  8.21s/it]
 50%|████▉     | 18961/37963 [45:31:01<42:22:00,  8.03s/it]
 50%|████▉     | 18962/37963 [45:31:09<41:34:36,  7.88s/it]
 50%|████▉     | 18963/37963 [45:31:16<40:58:48,  7.76s/it]
 50%|████▉     | 18964/37963 [45:31:24<40:30:53,  7.68s/it]
 50%|████▉     | 18965/37963 [45:31:31<40:15:57,  7.63s/it]
 50%|████▉     | 18966/37963 [45:31:39<40:19:32,  7.64s/it]
 50%|████▉     | 18967/37963 [45:31:52<49:57:31,  9.47s/it]
 50%|████▉     | 18968/37963 [45:32:00<46:48:50,  8.87s/it]
 50%|████▉     | 18969/37963 [45:32:07<44:34:45,  8.45s/it]
 50%|████▉     | 18970/37963 [45:32:15<43:09:30,  8.18s/it]
                                                           
{'loss': '0.1472', 'grad_norm': '0.9319', 'learning_rate': '1.05e-05', 'epoch': '0.4997'}

 50%|████▉     | 18970/37963 [45:32:15<43:09:30,  8.18s/it]
 50%|████▉     | 18971/37963 [45:32:22<42:01:44,  7.97s/it]
 50%|████▉     | 18972/37963 [45:32:30<41:08:10,  7.80s/it]
 50%|████▉     | 18973/37963 [45:32:44<51:04:13,  9.68s/it]
 50%|████▉     | 18974/37963 [45:32:52<47:46:29,  9.06s/it]
 50%|████▉     | 18975/37963 [45:32:59<45:23:26,  8.61s/it]
 50%|████▉     | 18976/37963 [45:33:07<43:40:45,  8.28s/it]
 50%|████▉     | 18977/37963 [45:33:14<42:28:07,  8.05s/it]
 50%|████▉     | 18978/37963 [45:33:22<41:40:49,  7.90s/it]
 50%|████▉     | 18979/37963 [45:33:29<41:04:03,  7.79s/it]
 50%|████▉     | 18980/37963 [45:33:37<41:00:46,  7.78s/it]
                                                           
{'loss': '0.1498', 'grad_norm': '2.33', 'learning_rate': '1.049e-05', 'epoch': '0.5'}

 50%|████▉     | 18980/37963 [45:33:37<41:00:46,  7.78s/it]
 50%|████▉     | 18981/37963 [45:33:44<40:31:08,  7.68s/it]
 50%|█████     | 18982/37963 [45:33:58<50:19:36,  9.55s/it]
 50%|█████     | 18983/37963 [45:34:06<47:07:16,  8.94s/it]
 50%|█████     | 18984/37963 [45:34:13<44:39:57,  8.47s/it]
 50%|█████     | 18985/37963 [45:34:21<43:15:38,  8.21s/it]
 50%|█████     | 18986/37963 [45:34:28<42:23:45,  8.04s/it]
 50%|█████     | 18987/37963 [45:34:36<41:33:18,  7.88s/it]
 50%|█████     | 18988/37963 [45:34:44<41:02:03,  7.79s/it]
 50%|█████     | 18989/37963 [45:34:58<50:58:23,  9.67s/it]
 50%|█████     | 18990/37963 [45:35:05<47:35:33,  9.03s/it]
                                                           
{'loss': '0.1503', 'grad_norm': '2.934', 'learning_rate': '1.048e-05', 'epoch': '0.5002'}

 50%|█████     | 18990/37963 [45:35:05<47:35:33,  9.03s/it]
 50%|█████     | 18991/37963 [45:35:13<45:14:47,  8.59s/it]
 50%|█████     | 18992/37963 [45:35:20<43:37:51,  8.28s/it]
 50%|█████     | 18993/37963 [45:35:28<42:24:30,  8.05s/it]
 50%|█████     | 18994/37963 [45:35:35<41:31:01,  7.88s/it]
 50%|█████     | 18995/37963 [45:35:43<41:04:34,  7.80s/it]
 50%|█████     | 18996/37963 [45:35:50<40:37:33,  7.71s/it]
 50%|█████     | 18997/37963 [45:36:04<50:01:56,  9.50s/it]
 50%|█████     | 18998/37963 [45:36:11<46:16:50,  8.79s/it]
 50%|█████     | 18999/37963 [45:36:25<54:53:00, 10.42s/it]
 50%|█████     | 19000/37963 [45:36:33<50:27:05,  9.58s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '2.482', 'learning_rate': '1.047e-05', 'epoch': '0.5005'}

 50%|█████     | 19000/37963 [45:36:33<50:27:05,  9.58s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 50%|█████     | 19001/37963 [45:37:35<133:07:05, 25.27s/it]
 50%|█████     | 19002/37963 [45:37:42<104:59:04, 19.93s/it]
 50%|█████     | 19003/37963 [45:37:50<85:19:11, 16.20s/it] 
 50%|█████     | 19004/37963 [45:38:04<81:44:07, 15.52s/it]
 50%|█████     | 19005/37963 [45:38:11<68:35:36, 13.03s/it]
 50%|█████     | 19006/37963 [45:38:19<59:56:13, 11.38s/it]
 50%|█████     | 19007/37963 [45:38:26<53:51:09, 10.23s/it]
 50%|█████     | 19008/37963 [45:38:34<49:36:23,  9.42s/it]
 50%|█████     | 19009/37963 [45:38:41<46:37:40,  8.86s/it]
 50%|█████     | 19010/37963 [45:38:49<44:36:03,  8.47s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '1.547', 'learning_rate': '1.046e-05', 'epoch': '0.5008'}

 50%|█████     | 19010/37963 [45:38:49<44:36:03,  8.47s/it]
 50%|█████     | 19011/37963 [45:38:56<43:04:04,  8.18s/it]
 50%|█████     | 19012/37963 [45:39:04<41:59:45,  7.98s/it]
 50%|█████     | 19013/37963 [45:39:11<41:22:22,  7.86s/it]
 50%|█████     | 19014/37963 [45:39:19<40:48:31,  7.75s/it]
 50%|█████     | 19015/37963 [45:39:33<50:49:16,  9.66s/it]
 50%|█████     | 19016/37963 [45:39:41<47:37:14,  9.05s/it]
 50%|█████     | 19017/37963 [45:39:48<44:55:33,  8.54s/it]
 50%|█████     | 19018/37963 [45:39:55<43:20:22,  8.24s/it]
 50%|█████     | 19019/37963 [45:40:03<42:10:48,  8.02s/it]
 50%|█████     | 19020/37963 [45:40:11<41:33:22,  7.90s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.407', 'learning_rate': '1.045e-05', 'epoch': '0.501'}

 50%|█████     | 19020/37963 [45:40:11<41:33:22,  7.90s/it]
 50%|█████     | 19021/37963 [45:40:18<40:47:01,  7.75s/it]
 50%|█████     | 19022/37963 [45:40:32<50:36:35,  9.62s/it]
 50%|█████     | 19023/37963 [45:40:40<48:08:17,  9.15s/it]
 50%|█████     | 19024/37963 [45:40:47<45:15:20,  8.60s/it]
 50%|█████     | 19025/37963 [45:40:55<43:45:20,  8.32s/it]
 50%|█████     | 19026/37963 [45:41:02<42:31:40,  8.08s/it]
 50%|█████     | 19027/37963 [45:41:10<41:23:30,  7.87s/it]
 50%|█████     | 19028/37963 [45:41:17<40:49:09,  7.76s/it]
 50%|█████     | 19029/37963 [45:41:25<40:16:23,  7.66s/it]
 50%|█████     | 19030/37963 [45:41:32<39:53:51,  7.59s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.448', 'learning_rate': '1.045e-05', 'epoch': '0.5013'}

 50%|█████     | 19030/37963 [45:41:32<39:53:51,  7.59s/it]
 50%|█████     | 19031/37963 [45:41:40<39:45:45,  7.56s/it]
 50%|█████     | 19032/37963 [45:41:47<39:28:51,  7.51s/it]
 50%|█████     | 19033/37963 [45:42:01<49:40:31,  9.45s/it]
 50%|█████     | 19034/37963 [45:42:09<46:33:02,  8.85s/it]
 50%|█████     | 19035/37963 [45:42:22<54:04:02, 10.28s/it]
 50%|█████     | 19036/37963 [45:42:29<49:15:11,  9.37s/it]
 50%|█████     | 19037/37963 [45:42:37<46:00:28,  8.75s/it]
 50%|█████     | 19038/37963 [45:42:44<43:58:38,  8.37s/it]
 50%|█████     | 19039/37963 [45:42:52<42:43:24,  8.13s/it]
 50%|█████     | 19040/37963 [45:42:59<41:56:04,  7.98s/it]
                                                           
{'loss': '0.1534', 'grad_norm': '2.751', 'learning_rate': '1.044e-05', 'epoch': '0.5015'}

 50%|█████     | 19040/37963 [45:42:59<41:56:04,  7.98s/it]
 50%|█████     | 19041/37963 [45:43:07<41:26:10,  7.88s/it]
 50%|█████     | 19042/37963 [45:43:15<40:52:47,  7.78s/it]
 50%|█████     | 19043/37963 [45:43:22<40:20:47,  7.68s/it]
 50%|█████     | 19044/37963 [45:43:36<49:47:53,  9.48s/it]
 50%|█████     | 19045/37963 [45:43:43<46:43:28,  8.89s/it]
 50%|█████     | 19046/37963 [45:43:51<44:20:01,  8.44s/it]
 50%|█████     | 19047/37963 [45:43:58<43:02:40,  8.19s/it]
 50%|█████     | 19048/37963 [45:44:06<41:59:44,  7.99s/it]
 50%|█████     | 19049/37963 [45:44:13<41:18:03,  7.86s/it]
 50%|█████     | 19050/37963 [45:44:34<61:09:12, 11.64s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.84', 'learning_rate': '1.043e-05', 'epoch': '0.5018'}

 50%|█████     | 19050/37963 [45:44:34<61:09:12, 11.64s/it]
 50%|█████     | 19051/37963 [45:44:41<54:50:57, 10.44s/it]
 50%|█████     | 19052/37963 [45:44:49<50:15:04,  9.57s/it]
 50%|█████     | 19053/37963 [45:45:03<56:58:00, 10.85s/it]
 50%|█████     | 19054/37963 [45:45:10<51:03:49,  9.72s/it]
 50%|█████     | 19055/37963 [45:45:17<47:29:02,  9.04s/it]
 50%|█████     | 19056/37963 [45:45:25<45:01:05,  8.57s/it]
 50%|█████     | 19057/37963 [45:45:32<43:30:01,  8.28s/it]
 50%|█████     | 19058/37963 [45:45:40<42:29:29,  8.09s/it]
 50%|█████     | 19059/37963 [45:45:48<41:31:45,  7.91s/it]
 50%|█████     | 19060/37963 [45:45:55<41:00:57,  7.81s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.196', 'learning_rate': '1.042e-05', 'epoch': '0.5021'}

 50%|█████     | 19060/37963 [45:45:55<41:00:57,  7.81s/it]
 50%|█████     | 19061/37963 [45:46:03<40:38:21,  7.74s/it]
 50%|█████     | 19062/37963 [45:46:17<50:30:49,  9.62s/it]
 50%|█████     | 19063/37963 [45:46:24<46:50:11,  8.92s/it]
 50%|█████     | 19064/37963 [45:46:32<44:41:10,  8.51s/it]
 50%|█████     | 19065/37963 [45:46:39<43:18:22,  8.25s/it]
 50%|█████     | 19066/37963 [45:46:46<41:45:05,  7.95s/it]
 50%|█████     | 19067/37963 [45:46:54<41:18:52,  7.87s/it]
 50%|█████     | 19068/37963 [45:47:02<40:36:22,  7.74s/it]
 50%|█████     | 19069/37963 [45:47:09<40:20:22,  7.69s/it]
 50%|█████     | 19070/37963 [45:47:17<40:04:52,  7.64s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '2.694', 'learning_rate': '1.041e-05', 'epoch': '0.5023'}

 50%|█████     | 19070/37963 [45:47:17<40:04:52,  7.64s/it]
 50%|█████     | 19071/37963 [45:47:24<39:58:33,  7.62s/it]
 50%|█████     | 19072/37963 [45:47:32<39:53:14,  7.60s/it]
 50%|█████     | 19073/37963 [45:47:39<39:20:22,  7.50s/it]
 50%|█████     | 19074/37963 [45:47:47<39:29:19,  7.53s/it]
 50%|█████     | 19075/37963 [45:47:54<39:31:56,  7.53s/it]
 50%|█████     | 19076/37963 [45:48:08<49:06:23,  9.36s/it]
 50%|█████     | 19077/37963 [45:48:15<46:21:30,  8.84s/it]
 50%|█████     | 19078/37963 [45:48:23<44:13:33,  8.43s/it]
 50%|█████     | 19079/37963 [45:48:30<42:47:55,  8.16s/it]
 50%|█████     | 19080/37963 [45:48:38<41:42:24,  7.95s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.325', 'learning_rate': '1.04e-05', 'epoch': '0.5026'}

 50%|█████     | 19080/37963 [45:48:38<41:42:24,  7.95s/it]
 50%|█████     | 19081/37963 [45:48:45<40:58:36,  7.81s/it]
 50%|█████     | 19082/37963 [45:48:53<40:41:34,  7.76s/it]
 50%|█████     | 19083/37963 [45:49:00<40:09:39,  7.66s/it]
 50%|█████     | 19084/37963 [45:49:08<39:59:11,  7.62s/it]
 50%|█████     | 19085/37963 [45:49:28<59:54:23, 11.42s/it]
 50%|█████     | 19086/37963 [45:49:36<53:56:08, 10.29s/it]
 50%|█████     | 19087/37963 [45:49:43<49:18:14,  9.40s/it]
 50%|█████     | 19088/37963 [45:49:51<46:18:09,  8.83s/it]
 50%|█████     | 19089/37963 [45:49:58<44:16:04,  8.44s/it]
 50%|█████     | 19090/37963 [45:50:05<42:20:46,  8.08s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '1.388', 'learning_rate': '1.039e-05', 'epoch': '0.5029'}

 50%|█████     | 19090/37963 [45:50:05<42:20:46,  8.08s/it]
 50%|█████     | 19091/37963 [45:50:13<41:29:19,  7.91s/it]
 50%|█████     | 19092/37963 [45:50:27<51:12:39,  9.77s/it]
 50%|█████     | 19093/37963 [45:50:35<47:37:46,  9.09s/it]
 50%|█████     | 19094/37963 [45:50:42<44:46:15,  8.54s/it]
 50%|█████     | 19095/37963 [45:50:49<42:45:36,  8.16s/it]
 50%|█████     | 19096/37963 [45:50:57<41:50:22,  7.98s/it]
 50%|█████     | 19097/37963 [45:51:04<41:15:05,  7.87s/it]
 50%|█████     | 19098/37963 [45:51:18<50:34:06,  9.65s/it]
 50%|█████     | 19099/37963 [45:51:32<56:51:31, 10.85s/it]
 50%|█████     | 19100/37963 [45:51:39<51:06:30,  9.75s/it]
                                                           
{'loss': '0.139', 'grad_norm': '2.527', 'learning_rate': '1.039e-05', 'epoch': '0.5031'}

 50%|█████     | 19100/37963 [45:51:39<51:06:30,  9.75s/it]
 50%|█████     | 19101/37963 [45:51:47<47:38:54,  9.09s/it]
 50%|█████     | 19102/37963 [45:52:01<55:36:06, 10.61s/it]
 50%|█████     | 19103/37963 [45:52:08<50:52:59,  9.71s/it]
 50%|█████     | 19104/37963 [45:52:16<47:01:09,  8.98s/it]
 50%|█████     | 19105/37963 [45:52:23<44:43:39,  8.54s/it]
 50%|█████     | 19106/37963 [45:52:31<43:16:50,  8.26s/it]
 50%|█████     | 19107/37963 [45:52:38<41:36:30,  7.94s/it]
 50%|█████     | 19108/37963 [45:52:45<40:55:57,  7.82s/it]
 50%|█████     | 19109/37963 [45:52:53<39:56:41,  7.63s/it]
 50%|█████     | 19110/37963 [45:53:00<39:59:50,  7.64s/it]
                                                           
{'loss': '0.1589', 'grad_norm': '0.8601', 'learning_rate': '1.038e-05', 'epoch': '0.5034'}

 50%|█████     | 19110/37963 [45:53:00<39:59:50,  7.64s/it]
 50%|█████     | 19111/37963 [45:53:08<39:38:01,  7.57s/it]
 50%|█████     | 19112/37963 [45:53:22<49:35:33,  9.47s/it]
 50%|█████     | 19113/37963 [45:53:29<46:34:47,  8.90s/it]
 50%|█████     | 19114/37963 [45:53:37<44:19:56,  8.47s/it]
 50%|█████     | 19115/37963 [45:53:44<42:23:45,  8.10s/it]
 50%|█████     | 19116/37963 [45:53:51<41:27:07,  7.92s/it]
 50%|█████     | 19117/37963 [45:53:59<40:36:55,  7.76s/it]
 50%|█████     | 19118/37963 [45:54:06<40:14:02,  7.69s/it]
 50%|█████     | 19119/37963 [45:54:14<39:58:04,  7.64s/it]
 50%|█████     | 19120/37963 [45:54:21<39:21:46,  7.52s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.872', 'learning_rate': '1.037e-05', 'epoch': '0.5036'}

 50%|█████     | 19120/37963 [45:54:21<39:21:46,  7.52s/it]
 50%|█████     | 19121/37963 [45:54:29<39:33:55,  7.56s/it]
 50%|█████     | 19122/37963 [45:54:36<39:30:09,  7.55s/it]
 50%|█████     | 19123/37963 [45:54:44<39:29:38,  7.55s/it]
 50%|█████     | 19124/37963 [45:54:51<39:22:21,  7.52s/it]
 50%|█████     | 19125/37963 [45:54:59<39:25:14,  7.53s/it]
 50%|█████     | 19126/37963 [45:55:06<39:19:00,  7.51s/it]
 50%|█████     | 19127/37963 [45:55:14<39:18:52,  7.51s/it]
 50%|█████     | 19128/37963 [45:55:21<39:11:09,  7.49s/it]
 50%|█████     | 19129/37963 [45:55:29<39:22:10,  7.53s/it]
 50%|█████     | 19130/37963 [45:55:43<49:22:45,  9.44s/it]
                                                           
{'loss': '0.143', 'grad_norm': '5.2', 'learning_rate': '1.036e-05', 'epoch': '0.5039'}

 50%|█████     | 19130/37963 [45:55:43<49:22:45,  9.44s/it]
 50%|█████     | 19131/37963 [45:55:50<46:19:32,  8.86s/it]
 50%|█████     | 19132/37963 [45:55:58<44:16:48,  8.47s/it]
 50%|█████     | 19133/37963 [45:56:05<42:31:22,  8.13s/it]
 50%|█████     | 19134/37963 [45:56:13<41:28:36,  7.93s/it]
 50%|█████     | 19135/37963 [45:56:20<40:58:44,  7.84s/it]
 50%|█████     | 19136/37963 [45:56:40<60:18:02, 11.53s/it]
 50%|█████     | 19137/37963 [45:56:48<54:14:44, 10.37s/it]
 50%|█████     | 19138/37963 [45:56:56<49:56:34,  9.55s/it]
 50%|█████     | 19139/37963 [45:57:03<46:41:49,  8.93s/it]
 50%|█████     | 19140/37963 [45:57:11<44:28:36,  8.51s/it]
                                                           
{'loss': '0.1519', 'grad_norm': '1.426', 'learning_rate': '1.035e-05', 'epoch': '0.5042'}

 50%|█████     | 19140/37963 [45:57:11<44:28:36,  8.51s/it]
 50%|█████     | 19141/37963 [45:57:18<42:52:34,  8.20s/it]
 50%|█████     | 19142/37963 [45:57:25<41:31:52,  7.94s/it]
 50%|█████     | 19143/37963 [45:57:33<40:26:18,  7.74s/it]
 50%|█████     | 19144/37963 [45:57:40<40:05:49,  7.67s/it]
 50%|█████     | 19145/37963 [45:57:48<39:49:08,  7.62s/it]
 50%|█████     | 19146/37963 [45:58:08<59:43:56, 11.43s/it]
 50%|█████     | 19147/37963 [45:58:16<53:41:20, 10.27s/it]
 50%|█████     | 19148/37963 [45:58:23<49:20:20,  9.44s/it]
 50%|█████     | 19149/37963 [45:58:31<46:19:46,  8.86s/it]
 50%|█████     | 19150/37963 [45:58:45<54:37:33, 10.45s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.099', 'learning_rate': '1.034e-05', 'epoch': '0.5044'}

 50%|█████     | 19150/37963 [45:58:45<54:37:33, 10.45s/it]
 50%|█████     | 19151/37963 [45:58:58<59:32:05, 11.39s/it]
 50%|█████     | 19152/37963 [45:59:06<53:49:24, 10.30s/it]
 50%|█████     | 19153/37963 [45:59:14<49:39:25,  9.50s/it]
 50%|█████     | 19154/37963 [45:59:21<46:23:47,  8.88s/it]
 50%|█████     | 19155/37963 [45:59:29<44:25:12,  8.50s/it]
 50%|█████     | 19156/37963 [45:59:36<43:00:32,  8.23s/it]
 50%|█████     | 19157/37963 [45:59:44<41:52:39,  8.02s/it]
 50%|█████     | 19158/37963 [45:59:52<41:17:01,  7.90s/it]
 50%|█████     | 19159/37963 [45:59:59<40:32:19,  7.76s/it]
 50%|█████     | 19160/37963 [46:00:07<40:30:00,  7.75s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '0.9236', 'learning_rate': '1.033e-05', 'epoch': '0.5047'}

 50%|█████     | 19160/37963 [46:00:07<40:30:00,  7.75s/it]
 50%|█████     | 19161/37963 [46:00:14<40:06:40,  7.68s/it]
 50%|█████     | 19162/37963 [46:00:22<39:50:31,  7.63s/it]
 50%|█████     | 19163/37963 [46:00:29<39:43:07,  7.61s/it]
 50%|█████     | 19164/37963 [46:00:43<49:34:59,  9.50s/it]
 50%|█████     | 19165/37963 [46:00:51<46:47:17,  8.96s/it]
 50%|█████     | 19166/37963 [46:00:59<44:51:42,  8.59s/it]
 50%|█████     | 19167/37963 [46:01:06<43:09:12,  8.27s/it]
 50%|█████     | 19168/37963 [46:01:13<41:41:41,  7.99s/it]
 50%|█████     | 19169/37963 [46:01:21<40:47:58,  7.82s/it]
 50%|█████     | 19170/37963 [46:01:29<40:37:47,  7.78s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '0.8368', 'learning_rate': '1.033e-05', 'epoch': '0.505'}

 50%|█████     | 19170/37963 [46:01:29<40:37:47,  7.78s/it]
 50%|█████     | 19171/37963 [46:01:36<40:12:34,  7.70s/it]
 51%|█████     | 19172/37963 [46:01:44<40:16:35,  7.72s/it]
 51%|█████     | 19173/37963 [46:01:51<40:04:31,  7.68s/it]
 51%|█████     | 19174/37963 [46:01:59<39:56:17,  7.65s/it]
 51%|█████     | 19175/37963 [46:02:07<39:43:27,  7.61s/it]
 51%|█████     | 19176/37963 [46:02:14<39:48:02,  7.63s/it]
 51%|█████     | 19177/37963 [46:02:22<39:49:11,  7.63s/it]
 51%|█████     | 19178/37963 [46:02:36<50:04:51,  9.60s/it]
 51%|█████     | 19179/37963 [46:02:44<46:50:59,  8.98s/it]
 51%|█████     | 19180/37963 [46:02:51<44:41:50,  8.57s/it]
                                                           
{'loss': '0.1494', 'grad_norm': '1.577', 'learning_rate': '1.032e-05', 'epoch': '0.5052'}

 51%|█████     | 19180/37963 [46:02:51<44:41:50,  8.57s/it]
 51%|█████     | 19181/37963 [46:02:59<43:11:29,  8.28s/it]
 51%|█████     | 19182/37963 [46:03:06<42:02:37,  8.06s/it]
 51%|█████     | 19183/37963 [46:03:14<41:11:58,  7.90s/it]
 51%|█████     | 19184/37963 [46:03:21<40:38:14,  7.79s/it]
 51%|█████     | 19185/37963 [46:03:29<40:24:45,  7.75s/it]
 51%|█████     | 19186/37963 [46:03:37<40:09:25,  7.70s/it]
 51%|█████     | 19187/37963 [46:03:51<49:50:20,  9.56s/it]
 51%|█████     | 19188/37963 [46:03:58<47:05:11,  9.03s/it]
 51%|█████     | 19189/37963 [46:04:12<55:08:14, 10.57s/it]
 51%|█████     | 19190/37963 [46:04:20<50:25:13,  9.67s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.455', 'learning_rate': '1.031e-05', 'epoch': '0.5055'}

 51%|█████     | 19190/37963 [46:04:20<50:25:13,  9.67s/it]
 51%|█████     | 19191/37963 [46:04:28<47:19:52,  9.08s/it]
 51%|█████     | 19192/37963 [46:04:41<54:25:17, 10.44s/it]
 51%|█████     | 19193/37963 [46:04:49<49:55:45,  9.58s/it]
 51%|█████     | 19194/37963 [46:04:57<46:50:24,  8.98s/it]
 51%|█████     | 19195/37963 [46:05:11<55:06:35, 10.57s/it]
 51%|█████     | 19196/37963 [46:05:18<50:27:56,  9.68s/it]
 51%|█████     | 19197/37963 [46:05:26<47:07:19,  9.04s/it]
 51%|█████     | 19198/37963 [46:05:40<55:01:10, 10.56s/it]
 51%|█████     | 19199/37963 [46:05:48<50:17:45,  9.65s/it]
 51%|█████     | 19200/37963 [46:05:55<47:01:27,  9.02s/it]
                                                           
{'loss': '0.1465', 'grad_norm': '1.635', 'learning_rate': '1.03e-05', 'epoch': '0.5058'}

 51%|█████     | 19200/37963 [46:05:55<47:01:27,  9.02s/it]
 51%|█████     | 19201/37963 [46:06:03<44:39:18,  8.57s/it]
 51%|█████     | 19202/37963 [46:06:10<43:10:17,  8.28s/it]
 51%|█████     | 19203/37963 [46:06:18<41:42:09,  8.00s/it]
 51%|█████     | 19204/37963 [46:06:25<41:05:07,  7.88s/it]
 51%|█████     | 19205/37963 [46:06:40<51:16:03,  9.84s/it]
 51%|█████     | 19206/37963 [46:06:47<47:44:54,  9.16s/it]
 51%|█████     | 19207/37963 [46:06:55<45:17:27,  8.69s/it]
 51%|█████     | 19208/37963 [46:07:02<43:23:54,  8.33s/it]
 51%|█████     | 19209/37963 [46:07:10<41:44:52,  8.01s/it]
 51%|█████     | 19210/37963 [46:07:17<40:46:30,  7.83s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.133', 'learning_rate': '1.029e-05', 'epoch': '0.506'}

 51%|█████     | 19210/37963 [46:07:17<40:46:30,  7.83s/it]
 51%|█████     | 19211/37963 [46:07:24<39:52:35,  7.66s/it]
 51%|█████     | 19212/37963 [46:07:38<50:05:12,  9.62s/it]
 51%|█████     | 19213/37963 [46:07:46<47:08:39,  9.05s/it]
 51%|█████     | 19214/37963 [46:07:54<44:58:43,  8.64s/it]
 51%|█████     | 19215/37963 [46:08:01<43:18:23,  8.32s/it]
 51%|█████     | 19216/37963 [46:08:09<42:05:12,  8.08s/it]
 51%|█████     | 19217/37963 [46:08:17<41:25:19,  7.95s/it]
 51%|█████     | 19218/37963 [46:08:24<40:51:47,  7.85s/it]
 51%|█████     | 19219/37963 [46:08:32<40:14:49,  7.73s/it]
 51%|█████     | 19220/37963 [46:08:39<39:59:26,  7.68s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '1.713', 'learning_rate': '1.028e-05', 'epoch': '0.5063'}

 51%|█████     | 19220/37963 [46:08:39<39:59:26,  7.68s/it]
 51%|█████     | 19221/37963 [46:08:47<39:48:34,  7.65s/it]
 51%|█████     | 19222/37963 [46:09:01<49:36:47,  9.53s/it]
 51%|█████     | 19223/37963 [46:09:08<46:33:50,  8.95s/it]
 51%|█████     | 19224/37963 [46:09:16<44:44:33,  8.60s/it]
 51%|█████     | 19225/37963 [46:09:24<43:02:44,  8.27s/it]
 51%|█████     | 19226/37963 [46:09:31<41:48:20,  8.03s/it]
 51%|█████     | 19227/37963 [46:09:39<41:12:32,  7.92s/it]
 51%|█████     | 19228/37963 [46:09:46<40:40:14,  7.82s/it]
 51%|█████     | 19229/37963 [46:09:54<40:09:44,  7.72s/it]
 51%|█████     | 19230/37963 [46:10:02<40:15:56,  7.74s/it]
                                                           
{'loss': '0.1545', 'grad_norm': '1.513', 'learning_rate': '1.027e-05', 'epoch': '0.5065'}

 51%|█████     | 19230/37963 [46:10:02<40:15:56,  7.74s/it]
 51%|█████     | 19231/37963 [46:10:09<40:11:32,  7.72s/it]
 51%|█████     | 19232/37963 [46:10:17<39:54:07,  7.67s/it]
 51%|█████     | 19233/37963 [46:10:25<40:27:07,  7.78s/it]
 51%|█████     | 19234/37963 [46:10:32<40:09:32,  7.72s/it]
 51%|█████     | 19235/37963 [46:10:40<39:54:01,  7.67s/it]
 51%|█████     | 19236/37963 [46:10:54<49:46:52,  9.57s/it]
 51%|█████     | 19237/37963 [46:11:08<56:08:44, 10.79s/it]
 51%|█████     | 19238/37963 [46:11:15<51:05:37,  9.82s/it]
 51%|█████     | 19239/37963 [46:11:23<47:45:06,  9.18s/it]
 51%|█████     | 19240/37963 [46:11:30<45:13:55,  8.70s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '3.397', 'learning_rate': '1.027e-05', 'epoch': '0.5068'}

 51%|█████     | 19240/37963 [46:11:30<45:13:55,  8.70s/it]
 51%|█████     | 19241/37963 [46:11:45<53:52:44, 10.36s/it]
 51%|█████     | 19242/37963 [46:11:52<49:29:48,  9.52s/it]
 51%|█████     | 19243/37963 [46:12:00<46:20:40,  8.91s/it]
 51%|█████     | 19244/37963 [46:12:07<43:36:14,  8.39s/it]
 51%|█████     | 19245/37963 [46:12:14<42:27:01,  8.16s/it]
 51%|█████     | 19246/37963 [46:12:28<50:49:23,  9.78s/it]
 51%|█████     | 19247/37963 [46:12:42<57:38:51, 11.09s/it]
 51%|█████     | 19248/37963 [46:12:50<52:32:50, 10.11s/it]
 51%|█████     | 19249/37963 [46:12:58<48:40:50,  9.36s/it]
 51%|█████     | 19250/37963 [46:13:05<45:47:12,  8.81s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.879', 'learning_rate': '1.026e-05', 'epoch': '0.5071'}

 51%|█████     | 19250/37963 [46:13:05<45:47:12,  8.81s/it]
 51%|█████     | 19251/37963 [46:13:12<43:25:44,  8.36s/it]
 51%|█████     | 19252/37963 [46:13:20<42:15:41,  8.13s/it]
 51%|█████     | 19253/37963 [46:13:28<41:18:43,  7.95s/it]
 51%|█████     | 19254/37963 [46:13:35<40:22:29,  7.77s/it]
 51%|█████     | 19255/37963 [46:13:49<50:38:26,  9.74s/it]
 51%|█████     | 19256/37963 [46:13:57<47:10:18,  9.08s/it]
 51%|█████     | 19257/37963 [46:14:05<45:06:50,  8.68s/it]
 51%|█████     | 19258/37963 [46:14:12<42:54:39,  8.26s/it]
 51%|█████     | 19259/37963 [46:14:19<41:44:59,  8.04s/it]
 51%|█████     | 19260/37963 [46:14:27<41:01:47,  7.90s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '2.094', 'learning_rate': '1.025e-05', 'epoch': '0.5073'}

 51%|█████     | 19260/37963 [46:14:27<41:01:47,  7.90s/it]
 51%|█████     | 19261/37963 [46:14:34<40:30:41,  7.80s/it]
 51%|█████     | 19262/37963 [46:14:42<40:44:47,  7.84s/it]
 51%|█████     | 19263/37963 [46:14:50<40:02:15,  7.71s/it]
 51%|█████     | 19264/37963 [46:14:57<39:43:47,  7.65s/it]
 51%|█████     | 19265/37963 [46:15:11<49:22:17,  9.51s/it]
 51%|█████     | 19266/37963 [46:15:25<56:29:35, 10.88s/it]
 51%|█████     | 19267/37963 [46:15:33<51:23:38,  9.90s/it]
 51%|█████     | 19268/37963 [46:15:40<47:36:38,  9.17s/it]
 51%|█████     | 19269/37963 [46:15:48<44:32:52,  8.58s/it]
 51%|█████     | 19270/37963 [46:15:55<42:58:08,  8.28s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.407', 'learning_rate': '1.024e-05', 'epoch': '0.5076'}

 51%|█████     | 19270/37963 [46:15:55<42:58:08,  8.28s/it]
 51%|█████     | 19271/37963 [46:16:03<42:12:28,  8.13s/it]
 51%|█████     | 19272/37963 [46:16:10<41:06:25,  7.92s/it]
 51%|█████     | 19273/37963 [46:16:18<40:40:40,  7.84s/it]
 51%|█████     | 19274/37963 [46:16:25<39:49:50,  7.67s/it]
 51%|█████     | 19275/37963 [46:16:33<39:49:48,  7.67s/it]
 51%|█████     | 19276/37963 [46:16:40<39:09:33,  7.54s/it]
 51%|█████     | 19277/37963 [46:16:48<39:20:09,  7.58s/it]
 51%|█████     | 19278/37963 [46:16:55<39:18:20,  7.57s/it]
 51%|█████     | 19279/37963 [46:17:03<39:17:05,  7.57s/it]
 51%|█████     | 19280/37963 [46:17:17<49:43:34,  9.58s/it]
                                                           
{'loss': '0.145', 'grad_norm': '0.7667', 'learning_rate': '1.023e-05', 'epoch': '0.5079'}

 51%|█████     | 19280/37963 [46:17:17<49:43:34,  9.58s/it]
 51%|█████     | 19281/37963 [46:17:25<46:42:22,  9.00s/it]
 51%|█████     | 19282/37963 [46:17:33<44:45:38,  8.63s/it]
 51%|█████     | 19283/37963 [46:17:47<53:10:23, 10.25s/it]
 51%|█████     | 19284/37963 [46:17:54<48:58:30,  9.44s/it]
 51%|█████     | 19285/37963 [46:18:02<46:10:09,  8.90s/it]
 51%|█████     | 19286/37963 [46:18:10<44:24:44,  8.56s/it]
 51%|█████     | 19287/37963 [46:18:17<42:50:35,  8.26s/it]
 51%|█████     | 19288/37963 [46:18:31<51:45:21,  9.98s/it]
 51%|█████     | 19289/37963 [46:18:39<48:21:49,  9.32s/it]
 51%|█████     | 19290/37963 [46:18:47<45:46:37,  8.83s/it]
                                                           
{'loss': '0.143', 'grad_norm': '1.787', 'learning_rate': '1.022e-05', 'epoch': '0.5081'}

 51%|█████     | 19290/37963 [46:18:47<45:46:37,  8.83s/it]
 51%|█████     | 19291/37963 [46:19:01<53:50:02, 10.38s/it]
 51%|█████     | 19292/37963 [46:19:08<49:53:57,  9.62s/it]
 51%|█████     | 19293/37963 [46:19:16<46:51:15,  9.03s/it]
 51%|█████     | 19294/37963 [46:19:24<44:40:06,  8.61s/it]
 51%|█████     | 19295/37963 [46:19:31<42:39:20,  8.23s/it]
 51%|█████     | 19296/37963 [46:19:39<41:35:10,  8.02s/it]
 51%|█████     | 19297/37963 [46:19:46<40:50:50,  7.88s/it]
 51%|█████     | 19298/37963 [46:20:00<50:18:54,  9.70s/it]
 51%|█████     | 19299/37963 [46:20:08<47:02:46,  9.07s/it]
 51%|█████     | 19300/37963 [46:20:15<44:45:39,  8.63s/it]
                                                           
{'loss': '0.1566', 'grad_norm': '1.025', 'learning_rate': '1.021e-05', 'epoch': '0.5084'}

 51%|█████     | 19300/37963 [46:20:15<44:45:39,  8.63s/it]
 51%|█████     | 19301/37963 [46:20:23<43:02:15,  8.30s/it]
 51%|█████     | 19302/37963 [46:20:31<42:01:26,  8.11s/it]
 51%|█████     | 19303/37963 [46:20:38<41:10:40,  7.94s/it]
 51%|█████     | 19304/37963 [46:20:46<40:32:23,  7.82s/it]
 51%|█████     | 19305/37963 [46:20:53<40:04:15,  7.73s/it]
 51%|█████     | 19306/37963 [46:21:01<39:48:20,  7.68s/it]
 51%|█████     | 19307/37963 [46:21:08<39:37:42,  7.65s/it]
 51%|█████     | 19308/37963 [46:21:23<49:57:30,  9.64s/it]
 51%|█████     | 19309/37963 [46:21:30<46:47:31,  9.03s/it]
 51%|█████     | 19310/37963 [46:21:38<44:27:44,  8.58s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '1.247', 'learning_rate': '1.021e-05', 'epoch': '0.5087'}

 51%|█████     | 19310/37963 [46:21:38<44:27:44,  8.58s/it]
 51%|█████     | 19311/37963 [46:21:45<42:57:08,  8.29s/it]
 51%|█████     | 19312/37963 [46:21:53<41:50:47,  8.08s/it]
 51%|█████     | 19313/37963 [46:22:07<51:05:19,  9.86s/it]
 51%|█████     | 19314/37963 [46:22:15<47:32:11,  9.18s/it]
 51%|█████     | 19315/37963 [46:22:22<45:07:44,  8.71s/it]
 51%|█████     | 19316/37963 [46:22:36<53:20:12, 10.30s/it]
 51%|█████     | 19317/37963 [46:22:44<49:09:42,  9.49s/it]
 51%|█████     | 19318/37963 [46:22:51<46:14:56,  8.93s/it]
 51%|█████     | 19319/37963 [46:22:59<43:59:15,  8.49s/it]
 51%|█████     | 19320/37963 [46:23:06<42:15:04,  8.16s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '1.274', 'learning_rate': '1.02e-05', 'epoch': '0.5089'}

 51%|█████     | 19320/37963 [46:23:06<42:15:04,  8.16s/it]
 51%|█████     | 19321/37963 [46:23:14<41:39:23,  8.04s/it]
 51%|█████     | 19322/37963 [46:23:22<41:02:59,  7.93s/it]
 51%|█████     | 19323/37963 [46:23:29<40:24:14,  7.80s/it]
 51%|█████     | 19324/37963 [46:23:37<40:05:36,  7.74s/it]
 51%|█████     | 19325/37963 [46:23:51<49:51:05,  9.63s/it]
 51%|█████     | 19326/37963 [46:23:58<46:28:00,  8.98s/it]
 51%|█████     | 19327/37963 [46:24:06<44:14:00,  8.54s/it]
 51%|█████     | 19328/37963 [46:24:13<42:06:41,  8.14s/it]
 51%|█████     | 19329/37963 [46:24:27<51:31:10,  9.95s/it]
 51%|█████     | 19330/37963 [46:24:35<47:46:27,  9.23s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '2.378', 'learning_rate': '1.019e-05', 'epoch': '0.5092'}

 51%|█████     | 19330/37963 [46:24:35<47:46:27,  9.23s/it]
 51%|█████     | 19331/37963 [46:24:42<45:29:53,  8.79s/it]
 51%|█████     | 19332/37963 [46:24:50<43:24:08,  8.39s/it]
 51%|█████     | 19333/37963 [46:24:58<42:14:15,  8.16s/it]
 51%|█████     | 19334/37963 [46:25:11<50:49:44,  9.82s/it]
 51%|█████     | 19335/37963 [46:25:19<47:45:55,  9.23s/it]
 51%|█████     | 19336/37963 [46:25:27<45:20:05,  8.76s/it]
 51%|█████     | 19337/37963 [46:25:34<43:40:05,  8.44s/it]
 51%|█████     | 19338/37963 [46:25:42<42:34:25,  8.23s/it]
 51%|█████     | 19339/37963 [46:25:56<51:21:01,  9.93s/it]
 51%|█████     | 19340/37963 [46:26:04<47:54:12,  9.26s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '0.992', 'learning_rate': '1.018e-05', 'epoch': '0.5094'}

 51%|█████     | 19340/37963 [46:26:04<47:54:12,  9.26s/it]
 51%|█████     | 19341/37963 [46:26:11<45:20:59,  8.77s/it]
 51%|█████     | 19342/37963 [46:26:19<43:51:06,  8.48s/it]
 51%|█████     | 19343/37963 [46:26:27<42:10:53,  8.16s/it]
 51%|█████     | 19344/37963 [46:26:34<41:12:44,  7.97s/it]
 51%|█████     | 19345/37963 [46:26:42<40:32:07,  7.84s/it]
 51%|█████     | 19346/37963 [46:26:49<40:13:48,  7.78s/it]
 51%|█████     | 19347/37963 [46:26:57<39:48:21,  7.70s/it]
 51%|█████     | 19348/37963 [46:27:04<39:33:06,  7.65s/it]
 51%|█████     | 19349/37963 [46:27:12<39:43:05,  7.68s/it]
 51%|█████     | 19350/37963 [46:27:20<39:34:26,  7.65s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '3.94', 'learning_rate': '1.017e-05', 'epoch': '0.5097'}

 51%|█████     | 19350/37963 [46:27:20<39:34:26,  7.65s/it]
 51%|█████     | 19351/37963 [46:27:27<39:11:01,  7.58s/it]
 51%|█████     | 19352/37963 [46:27:42<49:49:33,  9.64s/it]
 51%|█████     | 19353/37963 [46:27:49<46:47:32,  9.05s/it]
 51%|█████     | 19354/37963 [46:27:57<44:32:02,  8.62s/it]
 51%|█████     | 19355/37963 [46:28:11<52:38:04, 10.18s/it]
 51%|█████     | 19356/37963 [46:28:18<48:50:10,  9.45s/it]
 51%|█████     | 19357/37963 [46:28:26<45:52:18,  8.88s/it]
 51%|█████     | 19358/37963 [46:28:33<43:38:42,  8.45s/it]
 51%|█████     | 19359/37963 [46:28:41<42:18:29,  8.19s/it]
 51%|█████     | 19360/37963 [46:28:49<41:42:34,  8.07s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '1.046', 'learning_rate': '1.016e-05', 'epoch': '0.51'}

 51%|█████     | 19360/37963 [46:28:49<41:42:34,  8.07s/it]
 51%|█████     | 19361/37963 [46:29:03<50:57:37,  9.86s/it]
 51%|█████     | 19362/37963 [46:29:11<48:02:20,  9.30s/it]
 51%|█████     | 19363/37963 [46:29:18<44:43:49,  8.66s/it]
 51%|█████     | 19364/37963 [46:29:32<53:30:21, 10.36s/it]
 51%|█████     | 19365/37963 [46:29:40<49:14:00,  9.53s/it]
 51%|█████     | 19366/37963 [46:29:48<46:18:26,  8.96s/it]
 51%|█████     | 19367/37963 [46:29:55<44:04:21,  8.53s/it]
 51%|█████     | 19368/37963 [46:30:03<42:32:12,  8.24s/it]
 51%|█████     | 19369/37963 [46:30:10<41:36:50,  8.06s/it]
 51%|█████     | 19370/37963 [46:30:18<40:26:28,  7.83s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.629', 'learning_rate': '1.016e-05', 'epoch': '0.5102'}

 51%|█████     | 19370/37963 [46:30:18<40:26:28,  7.83s/it]
 51%|█████     | 19371/37963 [46:30:25<39:46:58,  7.70s/it]
 51%|█████     | 19372/37963 [46:30:39<49:35:59,  9.60s/it]
 51%|█████     | 19373/37963 [46:30:47<46:29:54,  9.00s/it]
 51%|█████     | 19374/37963 [46:30:54<44:22:37,  8.59s/it]
 51%|█████     | 19375/37963 [46:31:09<53:16:57, 10.32s/it]
 51%|█████     | 19376/37963 [46:31:16<49:24:16,  9.57s/it]
 51%|█████     | 19377/37963 [46:31:24<45:56:44,  8.90s/it]
 51%|█████     | 19378/37963 [46:31:31<43:51:19,  8.50s/it]
 51%|█████     | 19379/37963 [46:31:39<42:35:16,  8.25s/it]
 51%|█████     | 19380/37963 [46:31:46<41:15:47,  7.99s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '2.616', 'learning_rate': '1.015e-05', 'epoch': '0.5105'}

 51%|█████     | 19380/37963 [46:31:46<41:15:47,  7.99s/it]
 51%|█████     | 19381/37963 [46:31:54<40:33:04,  7.86s/it]
 51%|█████     | 19382/37963 [46:32:01<39:55:51,  7.74s/it]
 51%|█████     | 19383/37963 [46:32:09<39:40:45,  7.69s/it]
 51%|█████     | 19384/37963 [46:32:16<39:27:40,  7.65s/it]
 51%|█████     | 19385/37963 [46:32:24<39:09:54,  7.59s/it]
 51%|█████     | 19386/37963 [46:32:44<59:10:18, 11.47s/it]
 51%|█████     | 19387/37963 [46:32:52<53:12:24, 10.31s/it]
 51%|█████     | 19388/37963 [46:33:00<49:07:32,  9.52s/it]
 51%|█████     | 19389/37963 [46:33:07<46:14:50,  8.96s/it]
 51%|█████     | 19390/37963 [46:33:15<44:02:18,  8.54s/it]
                                                           
{'loss': '0.1548', 'grad_norm': '1.901', 'learning_rate': '1.014e-05', 'epoch': '0.5108'}

 51%|█████     | 19390/37963 [46:33:15<44:02:18,  8.54s/it]
 51%|█████     | 19391/37963 [46:33:22<42:01:08,  8.14s/it]
 51%|█████     | 19392/37963 [46:33:30<41:17:01,  8.00s/it]
 51%|█████     | 19393/37963 [46:33:37<40:32:34,  7.86s/it]
 51%|█████     | 19394/37963 [46:33:45<40:24:13,  7.83s/it]
 51%|█████     | 19395/37963 [46:33:59<49:50:42,  9.66s/it]
 51%|█████     | 19396/37963 [46:34:07<46:35:46,  9.03s/it]
 51%|█████     | 19397/37963 [46:34:14<44:18:08,  8.59s/it]
 51%|█████     | 19398/37963 [46:34:22<42:38:20,  8.27s/it]
 51%|█████     | 19399/37963 [46:34:29<41:29:42,  8.05s/it]
 51%|█████     | 19400/37963 [46:34:37<40:26:59,  7.84s/it]
                                                           
{'loss': '0.1486', 'grad_norm': '1.425', 'learning_rate': '1.013e-05', 'epoch': '0.511'}

 51%|█████     | 19400/37963 [46:34:37<40:26:59,  7.84s/it]
 51%|█████     | 19401/37963 [46:34:44<40:02:22,  7.77s/it]
 51%|█████     | 19402/37963 [46:34:52<39:55:52,  7.74s/it]
 51%|█████     | 19403/37963 [46:35:06<49:22:21,  9.58s/it]
 51%|█████     | 19404/37963 [46:35:13<46:25:20,  9.00s/it]
 51%|█████     | 19405/37963 [46:35:21<44:16:12,  8.59s/it]
 51%|█████     | 19406/37963 [46:35:29<42:52:30,  8.32s/it]
 51%|█████     | 19407/37963 [46:35:36<41:31:01,  8.05s/it]
 51%|█████     | 19408/37963 [46:35:44<40:37:30,  7.88s/it]
 51%|█████     | 19409/37963 [46:35:51<40:15:00,  7.81s/it]
 51%|█████     | 19410/37963 [46:35:59<39:38:48,  7.69s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '2.118', 'learning_rate': '1.012e-05', 'epoch': '0.5113'}

 51%|█████     | 19410/37963 [46:35:59<39:38:48,  7.69s/it]
 51%|█████     | 19411/37963 [46:36:06<39:22:51,  7.64s/it]
 51%|█████     | 19412/37963 [46:36:14<39:19:54,  7.63s/it]
 51%|█████     | 19413/37963 [46:36:21<39:15:29,  7.62s/it]
 51%|█████     | 19414/37963 [46:36:42<59:48:29, 11.61s/it]
 51%|█████     | 19415/37963 [46:36:50<53:33:31, 10.40s/it]
 51%|█████     | 19416/37963 [46:36:58<49:20:28,  9.58s/it]
 51%|█████     | 19417/37963 [46:37:05<45:44:00,  8.88s/it]
 51%|█████     | 19418/37963 [46:37:12<43:37:55,  8.47s/it]
 51%|█████     | 19419/37963 [46:37:27<52:28:00, 10.19s/it]
 51%|█████     | 19420/37963 [46:37:34<48:59:02,  9.51s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.325', 'learning_rate': '1.011e-05', 'epoch': '0.5116'}

 51%|█████     | 19420/37963 [46:37:34<48:59:02,  9.51s/it]
 51%|█████     | 19421/37963 [46:37:42<45:40:20,  8.87s/it]
 51%|█████     | 19422/37963 [46:37:49<43:36:27,  8.47s/it]
 51%|█████     | 19423/37963 [46:37:57<41:44:41,  8.11s/it]
 51%|█████     | 19424/37963 [46:38:04<41:00:08,  7.96s/it]
 51%|█████     | 19425/37963 [46:38:12<40:42:09,  7.90s/it]
 51%|█████     | 19426/37963 [46:38:20<40:13:44,  7.81s/it]
 51%|█████     | 19427/37963 [46:38:33<49:10:29,  9.55s/it]
 51%|█████     | 19428/37963 [46:38:41<45:47:30,  8.89s/it]
 51%|█████     | 19429/37963 [46:38:48<43:28:20,  8.44s/it]
 51%|█████     | 19430/37963 [46:38:56<42:05:41,  8.18s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '2.281', 'learning_rate': '1.01e-05', 'epoch': '0.5118'}

 51%|█████     | 19430/37963 [46:38:56<42:05:41,  8.18s/it]
 51%|█████     | 19431/37963 [46:39:03<40:56:47,  7.95s/it]
 51%|█████     | 19432/37963 [46:39:10<39:39:25,  7.70s/it]
 51%|█████     | 19433/37963 [46:39:24<49:25:00,  9.60s/it]
 51%|█████     | 19434/37963 [46:39:38<56:09:42, 10.91s/it]
 51%|█████     | 19435/37963 [46:39:46<50:50:38,  9.88s/it]
 51%|█████     | 19436/37963 [46:39:53<47:14:36,  9.18s/it]
 51%|█████     | 19437/37963 [46:40:00<44:14:27,  8.60s/it]
 51%|█████     | 19438/37963 [46:40:08<42:45:32,  8.31s/it]
 51%|█████     | 19439/37963 [46:40:16<41:42:44,  8.11s/it]
 51%|█████     | 19440/37963 [46:40:23<40:49:36,  7.93s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '2.745', 'learning_rate': '1.01e-05', 'epoch': '0.5121'}

 51%|█████     | 19440/37963 [46:40:23<40:49:36,  7.93s/it]
 51%|█████     | 19441/37963 [46:40:31<40:15:28,  7.82s/it]
 51%|█████     | 19442/37963 [46:40:38<39:33:08,  7.69s/it]
 51%|█████     | 19443/37963 [46:40:52<49:14:30,  9.57s/it]
 51%|█████     | 19444/37963 [46:41:00<46:01:10,  8.95s/it]
 51%|█████     | 19445/37963 [46:41:07<43:57:47,  8.55s/it]
 51%|█████     | 19446/37963 [46:41:15<42:31:36,  8.27s/it]
 51%|█████     | 19447/37963 [46:41:22<41:27:01,  8.06s/it]
 51%|█████     | 19448/37963 [46:41:30<40:45:47,  7.93s/it]
 51%|█████     | 19449/37963 [46:41:37<40:04:59,  7.79s/it]
 51%|█████     | 19450/37963 [46:41:45<39:42:26,  7.72s/it]
                                                           
{'loss': '0.1569', 'grad_norm': '2.458', 'learning_rate': '1.009e-05', 'epoch': '0.5123'}

 51%|█████     | 19450/37963 [46:41:45<39:42:26,  7.72s/it]
 51%|█████     | 19451/37963 [46:41:52<39:13:01,  7.63s/it]
 51%|█████     | 19452/37963 [46:42:06<48:36:21,  9.45s/it]
 51%|█████     | 19453/37963 [46:42:14<45:33:07,  8.86s/it]
 51%|█████     | 19454/37963 [46:42:21<43:03:14,  8.37s/it]
 51%|█████     | 19455/37963 [46:42:28<41:48:23,  8.13s/it]
 51%|█████     | 19456/37963 [46:42:36<40:31:43,  7.88s/it]
 51%|█████▏    | 19457/37963 [46:42:50<50:26:52,  9.81s/it]
 51%|█████▏    | 19458/37963 [46:42:58<46:56:13,  9.13s/it]
 51%|█████▏    | 19459/37963 [46:43:05<44:26:57,  8.65s/it]
 51%|█████▏    | 19460/37963 [46:43:13<42:49:03,  8.33s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.992', 'learning_rate': '1.008e-05', 'epoch': '0.5126'}

 51%|█████▏    | 19460/37963 [46:43:13<42:49:03,  8.33s/it]
 51%|█████▏    | 19461/37963 [46:43:20<41:42:25,  8.12s/it]
 51%|█████▏    | 19462/37963 [46:43:28<41:04:56,  7.99s/it]
 51%|█████▏    | 19463/37963 [46:43:42<50:35:46,  9.85s/it]
 51%|█████▏    | 19464/37963 [46:43:50<47:03:58,  9.16s/it]
 51%|█████▏    | 19465/37963 [46:43:57<44:34:06,  8.67s/it]
 51%|█████▏    | 19466/37963 [46:44:05<42:56:22,  8.36s/it]
 51%|█████▏    | 19467/37963 [46:44:12<41:47:56,  8.14s/it]
 51%|█████▏    | 19468/37963 [46:44:27<50:54:27,  9.91s/it]
 51%|█████▏    | 19469/37963 [46:44:34<47:20:31,  9.22s/it]
 51%|█████▏    | 19470/37963 [46:44:42<44:37:45,  8.69s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '1.436', 'learning_rate': '1.007e-05', 'epoch': '0.5129'}

 51%|█████▏    | 19470/37963 [46:44:42<44:37:45,  8.69s/it]
 51%|█████▏    | 19471/37963 [46:44:49<43:02:20,  8.38s/it]
 51%|█████▏    | 19472/37963 [46:44:57<41:44:51,  8.13s/it]
 51%|█████▏    | 19473/37963 [46:45:04<40:31:09,  7.89s/it]
 51%|█████▏    | 19474/37963 [46:45:12<40:11:23,  7.83s/it]
 51%|█████▏    | 19475/37963 [46:45:19<39:32:17,  7.70s/it]
 51%|█████▏    | 19476/37963 [46:45:27<39:15:45,  7.65s/it]
 51%|█████▏    | 19477/37963 [46:45:34<39:15:26,  7.65s/it]
 51%|█████▏    | 19478/37963 [46:45:42<39:22:04,  7.67s/it]
 51%|█████▏    | 19479/37963 [46:45:56<49:11:19,  9.58s/it]
 51%|█████▏    | 19480/37963 [46:46:10<55:58:49, 10.90s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '2.428', 'learning_rate': '1.006e-05', 'epoch': '0.5131'}

 51%|█████▏    | 19480/37963 [46:46:10<55:58:49, 10.90s/it]
 51%|█████▏    | 19481/37963 [46:46:17<50:25:00,  9.82s/it]
 51%|█████▏    | 19482/37963 [46:46:25<46:57:09,  9.15s/it]
 51%|█████▏    | 19483/37963 [46:46:39<54:30:20, 10.62s/it]
 51%|█████▏    | 19484/37963 [46:46:47<49:45:46,  9.69s/it]
 51%|█████▏    | 19485/37963 [46:46:54<46:18:42,  9.02s/it]
 51%|█████▏    | 19486/37963 [46:47:01<43:56:27,  8.56s/it]
 51%|█████▏    | 19487/37963 [46:47:09<41:45:39,  8.14s/it]
 51%|█████▏    | 19488/37963 [46:47:16<40:46:39,  7.95s/it]
 51%|█████▏    | 19489/37963 [46:47:24<40:03:53,  7.81s/it]
 51%|█████▏    | 19490/37963 [46:47:31<39:28:02,  7.69s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '4.321', 'learning_rate': '1.005e-05', 'epoch': '0.5134'}

 51%|█████▏    | 19490/37963 [46:47:31<39:28:02,  7.69s/it]
 51%|█████▏    | 19491/37963 [46:47:39<39:12:51,  7.64s/it]
 51%|█████▏    | 19492/37963 [46:47:46<39:04:43,  7.62s/it]
 51%|█████▏    | 19493/37963 [46:47:54<38:52:24,  7.58s/it]
 51%|█████▏    | 19494/37963 [46:48:08<48:44:18,  9.50s/it]
 51%|█████▏    | 19495/37963 [46:48:15<45:36:43,  8.89s/it]
 51%|█████▏    | 19496/37963 [46:48:23<43:26:22,  8.47s/it]
 51%|█████▏    | 19497/37963 [46:48:30<41:54:15,  8.17s/it]
 51%|█████▏    | 19498/37963 [46:48:44<50:09:42,  9.78s/it]
 51%|█████▏    | 19499/37963 [46:48:51<46:15:51,  9.02s/it]
 51%|█████▏    | 19500/37963 [46:48:58<43:48:41,  8.54s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.267', 'learning_rate': '1.004e-05', 'epoch': '0.5137'}

 51%|█████▏    | 19500/37963 [46:48:58<43:48:41,  8.54s/it]
 51%|█████▏    | 19501/37963 [46:49:06<42:12:56,  8.23s/it]
 51%|█████▏    | 19502/37963 [46:49:13<41:10:35,  8.03s/it]
 51%|█████▏    | 19503/37963 [46:49:21<40:12:39,  7.84s/it]
 51%|█████▏    | 19504/37963 [46:49:28<39:07:50,  7.63s/it]
 51%|█████▏    | 19505/37963 [46:49:35<38:38:07,  7.54s/it]
 51%|█████▏    | 19506/37963 [46:49:49<48:31:21,  9.46s/it]
 51%|█████▏    | 19507/37963 [46:49:57<45:30:49,  8.88s/it]
 51%|█████▏    | 19508/37963 [46:50:04<43:31:07,  8.49s/it]
 51%|█████▏    | 19509/37963 [46:50:12<42:05:30,  8.21s/it]
 51%|█████▏    | 19510/37963 [46:50:19<40:29:02,  7.90s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.301', 'learning_rate': '1.004e-05', 'epoch': '0.5139'}

 51%|█████▏    | 19510/37963 [46:50:19<40:29:02,  7.90s/it]
 51%|█████▏    | 19511/37963 [46:50:33<50:11:20,  9.79s/it]
 51%|█████▏    | 19512/37963 [46:50:41<46:43:13,  9.12s/it]
 51%|█████▏    | 19513/37963 [46:50:48<43:45:36,  8.54s/it]
 51%|█████▏    | 19514/37963 [46:50:55<41:49:23,  8.16s/it]
 51%|█████▏    | 19515/37963 [46:51:03<40:34:03,  7.92s/it]
 51%|█████▏    | 19516/37963 [46:51:10<40:20:05,  7.87s/it]
 51%|█████▏    | 19517/37963 [46:51:18<39:49:51,  7.77s/it]
 51%|█████▏    | 19518/37963 [46:51:25<39:32:39,  7.72s/it]
 51%|█████▏    | 19519/37963 [46:51:33<39:11:26,  7.65s/it]
 51%|█████▏    | 19520/37963 [46:51:40<38:58:45,  7.61s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '1.759', 'learning_rate': '1.003e-05', 'epoch': '0.5142'}

 51%|█████▏    | 19520/37963 [46:51:40<38:58:45,  7.61s/it]
 51%|█████▏    | 19521/37963 [46:51:48<38:42:00,  7.55s/it]
 51%|█████▏    | 19522/37963 [46:52:02<48:52:51,  9.54s/it]
 51%|█████▏    | 19523/37963 [46:52:16<55:41:26, 10.87s/it]
 51%|█████▏    | 19524/37963 [46:52:24<50:38:42,  9.89s/it]
 51%|█████▏    | 19525/37963 [46:52:31<47:06:50,  9.20s/it]
 51%|█████▏    | 19526/37963 [46:52:45<53:57:29, 10.54s/it]
 51%|█████▏    | 19527/37963 [46:52:52<49:31:12,  9.67s/it]
 51%|█████▏    | 19528/37963 [46:53:06<56:01:09, 10.94s/it]
 51%|█████▏    | 19529/37963 [46:53:14<50:52:29,  9.94s/it]
 51%|█████▏    | 19530/37963 [46:53:22<47:12:23,  9.22s/it]
                                                           
{'loss': '0.1583', 'grad_norm': '2.573', 'learning_rate': '1.002e-05', 'epoch': '0.5144'}

 51%|█████▏    | 19530/37963 [46:53:22<47:12:23,  9.22s/it]
 51%|█████▏    | 19531/37963 [46:53:29<44:36:40,  8.71s/it]
 51%|█████▏    | 19532/37963 [46:53:37<42:39:13,  8.33s/it]
 51%|█████▏    | 19533/37963 [46:53:44<41:12:49,  8.05s/it]
 51%|█████▏    | 19534/37963 [46:53:51<40:22:03,  7.89s/it]
 51%|█████▏    | 19535/37963 [46:53:59<39:47:59,  7.78s/it]
 51%|█████▏    | 19536/37963 [46:54:06<39:08:01,  7.65s/it]
 51%|█████▏    | 19537/37963 [46:54:14<38:55:28,  7.60s/it]
 51%|█████▏    | 19538/37963 [46:54:21<38:15:00,  7.47s/it]
 51%|█████▏    | 19539/37963 [46:54:28<38:16:27,  7.48s/it]
 51%|█████▏    | 19540/37963 [46:54:36<38:21:20,  7.50s/it]
                                                           
{'loss': '0.1483', 'grad_norm': '1.201', 'learning_rate': '1.001e-05', 'epoch': '0.5147'}

 51%|█████▏    | 19540/37963 [46:54:36<38:21:20,  7.50s/it]
 51%|█████▏    | 19541/37963 [46:54:43<37:59:28,  7.42s/it]
 51%|█████▏    | 19542/37963 [46:54:57<47:56:04,  9.37s/it]
 51%|█████▏    | 19543/37963 [46:55:05<45:12:27,  8.84s/it]
 51%|█████▏    | 19544/37963 [46:55:12<43:10:17,  8.44s/it]
 51%|█████▏    | 19545/37963 [46:55:20<41:50:57,  8.18s/it]
 51%|█████▏    | 19546/37963 [46:55:34<50:56:49,  9.96s/it]
 51%|█████▏    | 19547/37963 [46:55:41<46:59:37,  9.19s/it]
 51%|█████▏    | 19548/37963 [46:55:49<44:25:42,  8.69s/it]
 51%|█████▏    | 19549/37963 [46:55:56<42:39:53,  8.34s/it]
 51%|█████▏    | 19550/37963 [46:56:04<41:25:13,  8.10s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.379', 'learning_rate': '1e-05', 'epoch': '0.515'}

 51%|█████▏    | 19550/37963 [46:56:04<41:25:13,  8.10s/it]
 52%|█████▏    | 19551/37963 [46:56:12<40:50:01,  7.98s/it]
 52%|█████▏    | 19552/37963 [46:56:19<40:09:21,  7.85s/it]
 52%|█████▏    | 19553/37963 [46:56:26<39:05:41,  7.64s/it]
 52%|█████▏    | 19554/37963 [46:56:34<38:59:12,  7.62s/it]
 52%|█████▏    | 19555/37963 [46:56:41<38:50:48,  7.60s/it]
 52%|█████▏    | 19556/37963 [46:56:49<38:17:11,  7.49s/it]
 52%|█████▏    | 19557/37963 [46:57:02<47:47:21,  9.35s/it]
 52%|█████▏    | 19558/37963 [46:57:10<44:38:36,  8.73s/it]
 52%|█████▏    | 19559/37963 [46:57:17<42:55:23,  8.40s/it]
 52%|█████▏    | 19560/37963 [46:57:31<51:36:03, 10.09s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '2.895', 'learning_rate': '9.993e-06', 'epoch': '0.5152'}

 52%|█████▏    | 19560/37963 [46:57:31<51:36:03, 10.09s/it]
 52%|█████▏    | 19561/37963 [46:57:39<47:42:55,  9.33s/it]
 52%|█████▏    | 19562/37963 [46:57:46<45:00:48,  8.81s/it]
 52%|█████▏    | 19563/37963 [46:57:54<43:03:49,  8.43s/it]
 52%|█████▏    | 19564/37963 [46:58:01<41:21:28,  8.09s/it]
 52%|█████▏    | 19565/37963 [46:58:09<40:29:14,  7.92s/it]
 52%|█████▏    | 19566/37963 [46:58:16<39:51:03,  7.80s/it]
 52%|█████▏    | 19567/37963 [46:58:24<39:24:07,  7.71s/it]
 52%|█████▏    | 19568/37963 [46:58:31<39:04:15,  7.65s/it]
 52%|█████▏    | 19569/37963 [46:58:45<48:15:08,  9.44s/it]
 52%|█████▏    | 19570/37963 [46:58:53<45:28:29,  8.90s/it]
                                                           
{'loss': '0.144', 'grad_norm': '0.9865', 'learning_rate': '9.985e-06', 'epoch': '0.5155'}

 52%|█████▏    | 19570/37963 [46:58:53<45:28:29,  8.90s/it]
 52%|█████▏    | 19571/37963 [46:59:00<43:19:02,  8.48s/it]
 52%|█████▏    | 19572/37963 [46:59:08<41:49:53,  8.19s/it]
 52%|█████▏    | 19573/37963 [46:59:15<40:32:31,  7.94s/it]
 52%|█████▏    | 19574/37963 [46:59:23<40:16:21,  7.88s/it]
 52%|█████▏    | 19575/37963 [46:59:30<39:47:37,  7.79s/it]
 52%|█████▏    | 19576/37963 [46:59:38<39:39:48,  7.77s/it]
 52%|█████▏    | 19577/37963 [47:00:05<68:42:09, 13.45s/it]
 52%|█████▏    | 19578/37963 [47:00:12<59:26:49, 11.64s/it]
 52%|█████▏    | 19579/37963 [47:00:20<53:08:48, 10.41s/it]
 52%|█████▏    | 19580/37963 [47:00:27<48:41:50,  9.54s/it]
                                                           
{'loss': '0.152', 'grad_norm': '2.98', 'learning_rate': '9.976e-06', 'epoch': '0.5158'}

 52%|█████▏    | 19580/37963 [47:00:27<48:41:50,  9.54s/it]
 52%|█████▏    | 19581/37963 [47:00:35<45:32:08,  8.92s/it]
 52%|█████▏    | 19582/37963 [47:00:42<43:06:37,  8.44s/it]
 52%|█████▏    | 19583/37963 [47:00:49<41:24:46,  8.11s/it]
 52%|█████▏    | 19584/37963 [47:00:57<40:19:28,  7.90s/it]
 52%|█████▏    | 19585/37963 [47:01:04<39:58:25,  7.83s/it]
 52%|█████▏    | 19586/37963 [47:01:12<39:32:31,  7.75s/it]
 52%|█████▏    | 19587/37963 [47:01:20<39:18:57,  7.70s/it]
 52%|█████▏    | 19588/37963 [47:01:27<39:05:40,  7.66s/it]
 52%|█████▏    | 19589/37963 [47:01:35<38:57:14,  7.63s/it]
 52%|█████▏    | 19590/37963 [47:01:42<38:51:42,  7.61s/it]
                                                           
{'loss': '0.1561', 'grad_norm': '1.27', 'learning_rate': '9.968e-06', 'epoch': '0.516'}

 52%|█████▏    | 19590/37963 [47:01:42<38:51:42,  7.61s/it]
 52%|█████▏    | 19591/37963 [47:01:50<38:32:38,  7.55s/it]
 52%|█████▏    | 19592/37963 [47:01:57<38:30:44,  7.55s/it]
 52%|█████▏    | 19593/37963 [47:02:18<58:41:26, 11.50s/it]
 52%|█████▏    | 19594/37963 [47:02:25<52:39:26, 10.32s/it]
 52%|█████▏    | 19595/37963 [47:02:33<47:57:04,  9.40s/it]
 52%|█████▏    | 19596/37963 [47:02:40<45:06:53,  8.84s/it]
 52%|█████▏    | 19597/37963 [47:02:48<43:07:18,  8.45s/it]
 52%|█████▏    | 19598/37963 [47:02:55<41:41:48,  8.17s/it]
 52%|█████▏    | 19599/37963 [47:03:03<40:24:14,  7.92s/it]
 52%|█████▏    | 19600/37963 [47:03:10<39:48:41,  7.80s/it]
                                                           
{'loss': '0.153', 'grad_norm': '1.263', 'learning_rate': '9.959e-06', 'epoch': '0.5163'}

 52%|█████▏    | 19600/37963 [47:03:10<39:48:41,  7.80s/it]
 52%|█████▏    | 19601/37963 [47:03:18<39:27:32,  7.74s/it]
 52%|█████▏    | 19602/37963 [47:03:25<39:10:57,  7.68s/it]
 52%|█████▏    | 19603/37963 [47:03:33<39:00:22,  7.65s/it]
 52%|█████▏    | 19604/37963 [47:03:40<38:45:25,  7.60s/it]
 52%|█████▏    | 19605/37963 [47:03:48<38:15:56,  7.50s/it]
 52%|█████▏    | 19606/37963 [47:03:55<38:25:14,  7.53s/it]
 52%|█████▏    | 19607/37963 [47:04:03<38:04:41,  7.47s/it]
 52%|█████▏    | 19608/37963 [47:04:17<48:08:34,  9.44s/it]
 52%|█████▏    | 19609/37963 [47:04:31<54:59:15, 10.79s/it]
 52%|█████▏    | 19610/37963 [47:04:38<49:59:25,  9.81s/it]
                                                           
{'loss': '0.1532', 'grad_norm': '2.084', 'learning_rate': '9.951e-06', 'epoch': '0.5166'}

 52%|█████▏    | 19610/37963 [47:04:38<49:59:25,  9.81s/it]
 52%|█████▏    | 19611/37963 [47:04:45<46:11:26,  9.06s/it]
 52%|█████▏    | 19612/37963 [47:04:53<43:55:26,  8.62s/it]
 52%|█████▏    | 19613/37963 [47:05:00<41:41:25,  8.18s/it]
 52%|█████▏    | 19614/37963 [47:05:08<40:27:55,  7.94s/it]
 52%|█████▏    | 19615/37963 [47:05:15<39:54:21,  7.83s/it]
 52%|█████▏    | 19616/37963 [47:05:29<49:16:29,  9.67s/it]
 52%|█████▏    | 19617/37963 [47:05:37<45:57:32,  9.02s/it]
 52%|█████▏    | 19618/37963 [47:05:44<43:28:36,  8.53s/it]
 52%|█████▏    | 19619/37963 [47:05:52<42:01:16,  8.25s/it]
 52%|█████▏    | 19620/37963 [47:05:59<40:58:50,  8.04s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '0.9875', 'learning_rate': '9.942e-06', 'epoch': '0.5168'}

 52%|█████▏    | 19620/37963 [47:05:59<40:58:50,  8.04s/it]
 52%|█████▏    | 19621/37963 [47:06:07<40:12:42,  7.89s/it]
 52%|█████▏    | 19622/37963 [47:06:14<39:47:28,  7.81s/it]
 52%|█████▏    | 19623/37963 [47:06:22<39:33:56,  7.77s/it]
 52%|█████▏    | 19624/37963 [47:06:29<39:13:25,  7.70s/it]
 52%|█████▏    | 19625/37963 [47:06:37<39:04:29,  7.67s/it]
 52%|█████▏    | 19626/37963 [47:06:45<38:51:31,  7.63s/it]
 52%|█████▏    | 19627/37963 [47:06:52<38:45:58,  7.61s/it]
 52%|█████▏    | 19628/37963 [47:07:13<58:40:55, 11.52s/it]
 52%|█████▏    | 19629/37963 [47:07:27<62:10:04, 12.21s/it]
 52%|█████▏    | 19630/37963 [47:07:34<55:13:24, 10.84s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.357', 'learning_rate': '9.933e-06', 'epoch': '0.5171'}

 52%|█████▏    | 19630/37963 [47:07:34<55:13:24, 10.84s/it]
 52%|█████▏    | 19631/37963 [47:07:42<50:13:19,  9.86s/it]
 52%|█████▏    | 19632/37963 [47:07:49<46:47:30,  9.19s/it]
 52%|█████▏    | 19633/37963 [47:07:57<44:08:02,  8.67s/it]
 52%|█████▏    | 19634/37963 [47:08:04<42:25:34,  8.33s/it]
 52%|█████▏    | 19635/37963 [47:08:12<41:04:50,  8.07s/it]
 52%|█████▏    | 19636/37963 [47:08:20<40:20:37,  7.92s/it]
 52%|█████▏    | 19637/37963 [47:08:27<39:25:29,  7.74s/it]
 52%|█████▏    | 19638/37963 [47:08:34<39:13:25,  7.71s/it]
 52%|█████▏    | 19639/37963 [47:08:42<39:11:06,  7.70s/it]
 52%|█████▏    | 19640/37963 [47:08:50<38:52:12,  7.64s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.724', 'learning_rate': '9.925e-06', 'epoch': '0.5173'}

 52%|█████▏    | 19640/37963 [47:08:50<38:52:12,  7.64s/it]
 52%|█████▏    | 19641/37963 [47:08:57<38:45:24,  7.62s/it]
 52%|█████▏    | 19642/37963 [47:09:05<38:43:07,  7.61s/it]
 52%|█████▏    | 19643/37963 [47:09:19<48:28:27,  9.53s/it]
 52%|█████▏    | 19644/37963 [47:09:26<45:37:28,  8.97s/it]
 52%|█████▏    | 19645/37963 [47:09:34<42:58:20,  8.45s/it]
 52%|█████▏    | 19646/37963 [47:09:48<51:44:32, 10.17s/it]
 52%|█████▏    | 19647/37963 [47:09:56<47:55:34,  9.42s/it]
 52%|█████▏    | 19648/37963 [47:10:03<45:03:30,  8.86s/it]
 52%|█████▏    | 19649/37963 [47:10:10<42:37:40,  8.38s/it]
 52%|█████▏    | 19650/37963 [47:10:18<41:03:52,  8.07s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '1.08', 'learning_rate': '9.916e-06', 'epoch': '0.5176'}

 52%|█████▏    | 19650/37963 [47:10:18<41:03:52,  8.07s/it]
 52%|█████▏    | 19651/37963 [47:10:25<40:19:01,  7.93s/it]
 52%|█████▏    | 19652/37963 [47:10:33<39:57:36,  7.86s/it]
 52%|█████▏    | 19653/37963 [47:10:41<39:27:42,  7.76s/it]
 52%|█████▏    | 19654/37963 [47:10:48<39:13:54,  7.71s/it]
 52%|█████▏    | 19655/37963 [47:10:56<39:02:53,  7.68s/it]
 52%|█████▏    | 19656/37963 [47:11:03<38:50:53,  7.64s/it]
 52%|█████▏    | 19657/37963 [47:11:17<48:51:02,  9.61s/it]
 52%|█████▏    | 19658/37963 [47:11:32<55:37:33, 10.94s/it]
 52%|█████▏    | 19659/37963 [47:11:39<50:22:52,  9.91s/it]
 52%|█████▏    | 19660/37963 [47:11:46<46:34:05,  9.16s/it]
                                                           
{'loss': '0.1508', 'grad_norm': '2.404', 'learning_rate': '9.908e-06', 'epoch': '0.5179'}

 52%|█████▏    | 19660/37963 [47:11:46<46:34:05,  9.16s/it]
 52%|█████▏    | 19661/37963 [47:11:54<44:15:11,  8.70s/it]
 52%|█████▏    | 19662/37963 [47:12:08<52:06:40, 10.25s/it]
 52%|█████▏    | 19663/37963 [47:12:16<48:07:20,  9.47s/it]
 52%|█████▏    | 19664/37963 [47:12:23<45:10:54,  8.89s/it]
 52%|█████▏    | 19665/37963 [47:12:31<42:55:22,  8.44s/it]
 52%|█████▏    | 19666/37963 [47:12:38<41:35:26,  8.18s/it]
 52%|█████▏    | 19667/37963 [47:12:46<40:31:35,  7.97s/it]
 52%|█████▏    | 19668/37963 [47:12:53<39:51:41,  7.84s/it]
 52%|█████▏    | 19669/37963 [47:13:01<39:21:47,  7.75s/it]
 52%|█████▏    | 19670/37963 [47:13:08<38:58:12,  7.67s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.574', 'learning_rate': '9.899e-06', 'epoch': '0.5181'}

 52%|█████▏    | 19670/37963 [47:13:08<38:58:12,  7.67s/it]
 52%|█████▏    | 19671/37963 [47:13:16<38:36:34,  7.60s/it]
 52%|█████▏    | 19672/37963 [47:13:23<38:35:04,  7.59s/it]
 52%|█████▏    | 19673/37963 [47:13:31<38:24:16,  7.56s/it]
 52%|█████▏    | 19674/37963 [47:13:38<38:22:15,  7.55s/it]
 52%|█████▏    | 19675/37963 [47:13:52<48:07:26,  9.47s/it]
 52%|█████▏    | 19676/37963 [47:14:06<54:28:16, 10.72s/it]
 52%|█████▏    | 19677/37963 [47:14:20<59:18:23, 11.68s/it]
 52%|█████▏    | 19678/37963 [47:14:27<53:03:53, 10.45s/it]
 52%|█████▏    | 19679/37963 [47:14:35<48:29:04,  9.55s/it]
 52%|█████▏    | 19680/37963 [47:14:42<45:27:35,  8.95s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.486', 'learning_rate': '9.891e-06', 'epoch': '0.5184'}

 52%|█████▏    | 19680/37963 [47:14:42<45:27:35,  8.95s/it]
 52%|█████▏    | 19681/37963 [47:14:50<43:00:10,  8.47s/it]
 52%|█████▏    | 19682/37963 [47:14:57<41:31:27,  8.18s/it]
 52%|█████▏    | 19683/37963 [47:15:05<40:37:35,  8.00s/it]
 52%|█████▏    | 19684/37963 [47:15:12<39:49:21,  7.84s/it]
 52%|█████▏    | 19685/37963 [47:15:20<39:23:20,  7.76s/it]
 52%|█████▏    | 19686/37963 [47:15:27<39:14:36,  7.73s/it]
 52%|█████▏    | 19687/37963 [47:15:35<38:49:01,  7.65s/it]
 52%|█████▏    | 19688/37963 [47:15:49<48:28:45,  9.55s/it]
 52%|█████▏    | 19689/37963 [47:15:56<45:15:09,  8.91s/it]
 52%|█████▏    | 19690/37963 [47:16:04<43:14:14,  8.52s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '2.886', 'learning_rate': '9.882e-06', 'epoch': '0.5187'}

 52%|█████▏    | 19690/37963 [47:16:04<43:14:14,  8.52s/it]
 52%|█████▏    | 19691/37963 [47:16:11<41:31:52,  8.18s/it]
 52%|█████▏    | 19692/37963 [47:16:25<50:25:25,  9.94s/it]
 52%|█████▏    | 19693/37963 [47:16:33<46:36:35,  9.18s/it]
 52%|█████▏    | 19694/37963 [47:16:40<44:14:44,  8.72s/it]
 52%|█████▏    | 19695/37963 [47:16:48<42:22:10,  8.35s/it]
 52%|█████▏    | 19696/37963 [47:16:55<41:03:33,  8.09s/it]
 52%|█████▏    | 19697/37963 [47:17:03<40:14:36,  7.93s/it]
 52%|█████▏    | 19698/37963 [47:17:10<39:31:23,  7.79s/it]
 52%|█████▏    | 19699/37963 [47:17:18<39:02:07,  7.69s/it]
 52%|█████▏    | 19700/37963 [47:17:25<38:46:35,  7.64s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.433', 'learning_rate': '9.874e-06', 'epoch': '0.5189'}

 52%|█████▏    | 19700/37963 [47:17:25<38:46:35,  7.64s/it]
 52%|█████▏    | 19701/37963 [47:17:33<38:35:38,  7.61s/it]
 52%|█████▏    | 19702/37963 [47:17:41<38:53:11,  7.67s/it]
 52%|█████▏    | 19703/37963 [47:17:55<48:34:14,  9.58s/it]
 52%|█████▏    | 19704/37963 [47:18:02<45:38:53,  9.00s/it]
 52%|█████▏    | 19705/37963 [47:18:16<53:09:20, 10.48s/it]
 52%|█████▏    | 19706/37963 [47:18:24<48:52:46,  9.64s/it]
 52%|█████▏    | 19707/37963 [47:18:31<45:42:20,  9.01s/it]
 52%|█████▏    | 19708/37963 [47:18:39<43:48:10,  8.64s/it]
 52%|█████▏    | 19709/37963 [47:18:47<42:00:19,  8.28s/it]
 52%|█████▏    | 19710/37963 [47:18:54<40:34:01,  8.00s/it]
                                                           
{'loss': '0.1592', 'grad_norm': '1.727', 'learning_rate': '9.865e-06', 'epoch': '0.5192'}

 52%|█████▏    | 19710/37963 [47:18:54<40:34:01,  8.00s/it]
 52%|█████▏    | 19711/37963 [47:19:08<49:54:22,  9.84s/it]
 52%|█████▏    | 19712/37963 [47:19:16<46:18:12,  9.13s/it]
 52%|█████▏    | 19713/37963 [47:19:23<44:03:13,  8.69s/it]
 52%|█████▏    | 19714/37963 [47:19:31<42:26:11,  8.37s/it]
 52%|█████▏    | 19715/37963 [47:19:38<41:06:34,  8.11s/it]
 52%|█████▏    | 19716/37963 [47:19:46<40:09:43,  7.92s/it]
 52%|█████▏    | 19717/37963 [47:19:54<39:39:25,  7.82s/it]
 52%|█████▏    | 19718/37963 [47:20:01<39:18:10,  7.76s/it]
 52%|█████▏    | 19719/37963 [47:20:09<39:04:52,  7.71s/it]
 52%|█████▏    | 19720/37963 [47:20:23<49:03:34,  9.68s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '3.586', 'learning_rate': '9.857e-06', 'epoch': '0.5195'}

 52%|█████▏    | 19720/37963 [47:20:23<49:03:34,  9.68s/it]
 52%|█████▏    | 19721/37963 [47:20:31<45:48:38,  9.04s/it]
 52%|█████▏    | 19722/37963 [47:20:38<43:28:31,  8.58s/it]
 52%|█████▏    | 19723/37963 [47:20:52<51:08:22, 10.09s/it]
 52%|█████▏    | 19724/37963 [47:21:05<56:20:50, 11.12s/it]
 52%|█████▏    | 19725/37963 [47:21:13<51:07:47, 10.09s/it]
 52%|█████▏    | 19726/37963 [47:21:21<47:26:06,  9.36s/it]
 52%|█████▏    | 19727/37963 [47:21:28<44:39:40,  8.82s/it]
 52%|█████▏    | 19728/37963 [47:21:36<42:42:15,  8.43s/it]
 52%|█████▏    | 19729/37963 [47:21:43<41:16:16,  8.15s/it]
 52%|█████▏    | 19730/37963 [47:21:51<40:21:58,  7.97s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '0.9764', 'learning_rate': '9.848e-06', 'epoch': '0.5197'}

 52%|█████▏    | 19730/37963 [47:21:51<40:21:58,  7.97s/it]
 52%|█████▏    | 19731/37963 [47:21:58<39:21:52,  7.77s/it]
 52%|█████▏    | 19732/37963 [47:22:06<38:59:18,  7.70s/it]
 52%|█████▏    | 19733/37963 [47:22:13<38:44:18,  7.65s/it]
 52%|█████▏    | 19734/37963 [47:22:20<38:22:27,  7.58s/it]
 52%|█████▏    | 19735/37963 [47:22:28<38:17:09,  7.56s/it]
 52%|█████▏    | 19736/37963 [47:22:35<37:46:10,  7.46s/it]
 52%|█████▏    | 19737/37963 [47:22:43<38:09:09,  7.54s/it]
 52%|█████▏    | 19738/37963 [47:22:50<38:12:11,  7.55s/it]
 52%|█████▏    | 19739/37963 [47:23:05<48:01:20,  9.49s/it]
 52%|█████▏    | 19740/37963 [47:23:12<44:57:55,  8.88s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '3.105', 'learning_rate': '9.84e-06', 'epoch': '0.52'}

 52%|█████▏    | 19740/37963 [47:23:12<44:57:55,  8.88s/it]
 52%|█████▏    | 19741/37963 [47:23:19<42:51:05,  8.47s/it]
 52%|█████▏    | 19742/37963 [47:23:33<51:10:23, 10.11s/it]
 52%|█████▏    | 19743/37963 [47:23:41<47:24:13,  9.37s/it]
 52%|█████▏    | 19744/37963 [47:23:49<45:01:27,  8.90s/it]
 52%|█████▏    | 19745/37963 [47:23:56<43:02:47,  8.51s/it]
 52%|█████▏    | 19746/37963 [47:24:04<41:38:49,  8.23s/it]
 52%|█████▏    | 19747/37963 [47:24:11<40:25:41,  7.99s/it]
 52%|█████▏    | 19748/37963 [47:24:19<39:50:28,  7.87s/it]
 52%|█████▏    | 19749/37963 [47:24:27<39:20:13,  7.77s/it]
 52%|█████▏    | 19750/37963 [47:24:34<39:02:01,  7.72s/it]
                                                           
{'loss': '0.1594', 'grad_norm': '1.866', 'learning_rate': '9.831e-06', 'epoch': '0.5202'}

 52%|█████▏    | 19750/37963 [47:24:34<39:02:01,  7.72s/it]
 52%|█████▏    | 19751/37963 [47:24:42<38:51:19,  7.68s/it]
 52%|█████▏    | 19752/37963 [47:24:55<47:59:48,  9.49s/it]
 52%|█████▏    | 19753/37963 [47:25:03<45:03:16,  8.91s/it]
 52%|█████▏    | 19754/37963 [47:25:17<52:36:20, 10.40s/it]
 52%|█████▏    | 19755/37963 [47:25:24<48:11:53,  9.53s/it]
 52%|█████▏    | 19756/37963 [47:25:32<45:09:57,  8.93s/it]
 52%|█████▏    | 19757/37963 [47:25:46<52:52:01, 10.45s/it]
 52%|█████▏    | 19758/37963 [47:25:54<48:35:51,  9.61s/it]
 52%|█████▏    | 19759/37963 [47:26:01<45:19:22,  8.96s/it]
 52%|█████▏    | 19760/37963 [47:26:09<43:07:31,  8.53s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '1.963', 'learning_rate': '9.823e-06', 'epoch': '0.5205'}

 52%|█████▏    | 19760/37963 [47:26:09<43:07:31,  8.53s/it]
 52%|█████▏    | 19761/37963 [47:26:16<41:34:27,  8.22s/it]
 52%|█████▏    | 19762/37963 [47:26:24<40:32:14,  8.02s/it]
 52%|█████▏    | 19763/37963 [47:26:31<39:50:31,  7.88s/it]
 52%|█████▏    | 19764/37963 [47:26:39<39:27:09,  7.80s/it]
 52%|█████▏    | 19765/37963 [47:26:46<39:00:50,  7.72s/it]
 52%|█████▏    | 19766/37963 [47:26:54<38:55:14,  7.70s/it]
 52%|█████▏    | 19767/37963 [47:27:01<38:10:57,  7.55s/it]
 52%|█████▏    | 19768/37963 [47:27:09<38:20:00,  7.58s/it]
 52%|█████▏    | 19769/37963 [47:27:16<37:53:08,  7.50s/it]
 52%|█████▏    | 19770/37963 [47:27:24<38:01:44,  7.53s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '3.259', 'learning_rate': '9.814e-06', 'epoch': '0.5208'}

 52%|█████▏    | 19770/37963 [47:27:24<38:01:44,  7.53s/it]
 52%|█████▏    | 19771/37963 [47:27:38<48:08:47,  9.53s/it]
 52%|█████▏    | 19772/37963 [47:27:52<55:06:46, 10.91s/it]
 52%|█████▏    | 19773/37963 [47:28:00<49:54:55,  9.88s/it]
 52%|█████▏    | 19774/37963 [47:28:14<56:17:36, 11.14s/it]
 52%|█████▏    | 19775/37963 [47:28:21<50:44:01, 10.04s/it]
 52%|█████▏    | 19776/37963 [47:28:29<46:59:02,  9.30s/it]
 52%|█████▏    | 19777/37963 [47:28:36<44:13:03,  8.75s/it]
 52%|█████▏    | 19778/37963 [47:28:44<42:15:44,  8.37s/it]
 52%|█████▏    | 19779/37963 [47:28:51<40:47:26,  8.08s/it]
 52%|█████▏    | 19780/37963 [47:28:59<40:01:35,  7.92s/it]
                                                           
{'loss': '0.1408', 'grad_norm': '1.012', 'learning_rate': '9.805e-06', 'epoch': '0.521'}

 52%|█████▏    | 19780/37963 [47:28:59<40:01:35,  7.92s/it]
 52%|█████▏    | 19781/37963 [47:29:06<39:23:52,  7.80s/it]
 52%|█████▏    | 19782/37963 [47:29:14<39:13:38,  7.77s/it]
 52%|█████▏    | 19783/37963 [47:29:21<38:51:22,  7.69s/it]
 52%|█████▏    | 19784/37963 [47:29:29<38:33:31,  7.64s/it]
 52%|█████▏    | 19785/37963 [47:29:36<38:00:54,  7.53s/it]
 52%|█████▏    | 19786/37963 [47:29:44<38:11:43,  7.56s/it]
 52%|█████▏    | 19787/37963 [47:29:51<38:12:04,  7.57s/it]
 52%|█████▏    | 19788/37963 [47:29:59<38:09:23,  7.56s/it]
 52%|█████▏    | 19789/37963 [47:30:06<37:42:00,  7.47s/it]
 52%|█████▏    | 19790/37963 [47:30:13<37:10:48,  7.37s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.329', 'learning_rate': '9.797e-06', 'epoch': '0.5213'}

 52%|█████▏    | 19790/37963 [47:30:13<37:10:48,  7.37s/it]
 52%|█████▏    | 19791/37963 [47:30:21<37:38:04,  7.46s/it]
 52%|█████▏    | 19792/37963 [47:30:35<47:19:21,  9.38s/it]
 52%|█████▏    | 19793/37963 [47:30:49<54:13:41, 10.74s/it]
 52%|█████▏    | 19794/37963 [47:30:56<49:14:21,  9.76s/it]
 52%|█████▏    | 19795/37963 [47:31:04<45:38:36,  9.04s/it]
 52%|█████▏    | 19796/37963 [47:31:11<43:23:11,  8.60s/it]
 52%|█████▏    | 19797/37963 [47:31:19<41:46:44,  8.28s/it]
 52%|█████▏    | 19798/37963 [47:31:33<50:35:39, 10.03s/it]
 52%|█████▏    | 19799/37963 [47:31:40<46:46:30,  9.27s/it]
 52%|█████▏    | 19800/37963 [47:31:48<44:27:26,  8.81s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.759', 'learning_rate': '9.788e-06', 'epoch': '0.5216'}

 52%|█████▏    | 19800/37963 [47:31:48<44:27:26,  8.81s/it]
 52%|█████▏    | 19801/37963 [47:31:55<41:59:17,  8.32s/it]
 52%|█████▏    | 19802/37963 [47:32:03<40:44:29,  8.08s/it]
 52%|█████▏    | 19803/37963 [47:32:10<39:53:14,  7.91s/it]
 52%|█████▏    | 19804/37963 [47:32:18<39:18:27,  7.79s/it]
 52%|█████▏    | 19805/37963 [47:32:32<48:42:50,  9.66s/it]
 52%|█████▏    | 19806/37963 [47:32:39<45:44:19,  9.07s/it]
 52%|█████▏    | 19807/37963 [47:32:47<43:07:03,  8.55s/it]
 52%|█████▏    | 19808/37963 [47:33:01<51:09:57, 10.15s/it]
 52%|█████▏    | 19809/37963 [47:33:08<47:05:53,  9.34s/it]
 52%|█████▏    | 19810/37963 [47:33:16<44:29:06,  8.82s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '2.373', 'learning_rate': '9.78e-06', 'epoch': '0.5218'}

 52%|█████▏    | 19810/37963 [47:33:16<44:29:06,  8.82s/it]
 52%|█████▏    | 19811/37963 [47:33:23<42:32:17,  8.44s/it]
 52%|█████▏    | 19812/37963 [47:33:31<41:09:27,  8.16s/it]
 52%|█████▏    | 19813/37963 [47:33:38<40:11:40,  7.97s/it]
 52%|█████▏    | 19814/37963 [47:33:46<39:44:55,  7.88s/it]
 52%|█████▏    | 19815/37963 [47:33:53<39:13:25,  7.78s/it]
 52%|█████▏    | 19816/37963 [47:34:01<38:54:44,  7.72s/it]
 52%|█████▏    | 19817/37963 [47:34:08<38:19:30,  7.60s/it]
 52%|█████▏    | 19818/37963 [47:34:22<47:53:31,  9.50s/it]
 52%|█████▏    | 19819/37963 [47:34:36<54:32:38, 10.82s/it]
 52%|█████▏    | 19820/37963 [47:34:44<49:48:28,  9.88s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '1.946', 'learning_rate': '9.771e-06', 'epoch': '0.5221'}

 52%|█████▏    | 19820/37963 [47:34:44<49:48:28,  9.88s/it]
 52%|█████▏    | 19821/37963 [47:34:51<46:13:17,  9.17s/it]
 52%|█████▏    | 19822/37963 [47:34:59<43:42:23,  8.67s/it]
 52%|█████▏    | 19823/37963 [47:35:13<51:48:04, 10.28s/it]
 52%|█████▏    | 19824/37963 [47:35:21<47:50:24,  9.49s/it]
 52%|█████▏    | 19825/37963 [47:35:28<44:46:05,  8.89s/it]
 52%|█████▏    | 19826/37963 [47:35:36<42:41:16,  8.47s/it]
 52%|█████▏    | 19827/37963 [47:35:43<41:06:30,  8.16s/it]
 52%|█████▏    | 19828/37963 [47:35:51<40:10:37,  7.98s/it]
 52%|█████▏    | 19829/37963 [47:35:58<39:33:56,  7.85s/it]
 52%|█████▏    | 19830/37963 [47:36:05<38:37:47,  7.67s/it]
                                                           
{'loss': '0.1568', 'grad_norm': '1.748', 'learning_rate': '9.763e-06', 'epoch': '0.5224'}

 52%|█████▏    | 19830/37963 [47:36:05<38:37:47,  7.67s/it]
 52%|█████▏    | 19831/37963 [47:36:13<38:24:06,  7.62s/it]
 52%|█████▏    | 19832/37963 [47:36:20<38:00:55,  7.55s/it]
 52%|█████▏    | 19833/37963 [47:36:28<37:41:55,  7.49s/it]
 52%|█████▏    | 19834/37963 [47:36:35<37:47:48,  7.51s/it]
 52%|█████▏    | 19835/37963 [47:36:43<37:31:51,  7.45s/it]
 52%|█████▏    | 19836/37963 [47:36:50<37:35:34,  7.47s/it]
 52%|█████▏    | 19837/37963 [47:36:58<37:42:37,  7.49s/it]
 52%|█████▏    | 19838/37963 [47:37:05<37:44:21,  7.50s/it]
 52%|█████▏    | 19839/37963 [47:37:13<37:55:38,  7.53s/it]
 52%|█████▏    | 19840/37963 [47:37:20<37:27:50,  7.44s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '2.716', 'learning_rate': '9.754e-06', 'epoch': '0.5226'}

 52%|█████▏    | 19840/37963 [47:37:20<37:27:50,  7.44s/it]
 52%|█████▏    | 19841/37963 [47:37:27<37:36:40,  7.47s/it]
 52%|█████▏    | 19842/37963 [47:37:41<47:12:56,  9.38s/it]
 52%|█████▏    | 19843/37963 [47:37:49<44:21:02,  8.81s/it]
 52%|█████▏    | 19844/37963 [47:37:56<42:07:04,  8.37s/it]
 52%|█████▏    | 19845/37963 [47:38:10<50:35:29, 10.05s/it]
 52%|█████▏    | 19846/37963 [47:38:18<46:55:36,  9.32s/it]
 52%|█████▏    | 19847/37963 [47:38:32<54:18:15, 10.79s/it]
 52%|█████▏    | 19848/37963 [47:38:40<49:27:19,  9.83s/it]
 52%|█████▏    | 19849/37963 [47:38:47<45:56:40,  9.13s/it]
 52%|█████▏    | 19850/37963 [47:38:54<43:08:44,  8.58s/it]
                                                           
{'loss': '0.137', 'grad_norm': '0.9269', 'learning_rate': '9.746e-06', 'epoch': '0.5229'}

 52%|█████▏    | 19850/37963 [47:38:54<43:08:44,  8.58s/it]
 52%|█████▏    | 19851/37963 [47:39:02<41:13:19,  8.19s/it]
 52%|█████▏    | 19852/37963 [47:39:09<39:50:39,  7.92s/it]
 52%|█████▏    | 19853/37963 [47:39:16<39:16:20,  7.81s/it]
 52%|█████▏    | 19854/37963 [47:39:24<38:45:47,  7.71s/it]
 52%|█████▏    | 19855/37963 [47:39:31<38:03:50,  7.57s/it]
 52%|█████▏    | 19856/37963 [47:39:39<38:01:00,  7.56s/it]
 52%|█████▏    | 19857/37963 [47:39:59<57:38:35, 11.46s/it]
 52%|█████▏    | 19858/37963 [47:40:07<51:42:04, 10.28s/it]
 52%|█████▏    | 19859/37963 [47:40:14<47:28:58,  9.44s/it]
 52%|█████▏    | 19860/37963 [47:40:22<44:26:57,  8.84s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '0.9754', 'learning_rate': '9.737e-06', 'epoch': '0.5231'}

 52%|█████▏    | 19860/37963 [47:40:22<44:26:57,  8.84s/it]
 52%|█████▏    | 19861/37963 [47:40:29<42:28:40,  8.45s/it]
 52%|█████▏    | 19862/37963 [47:40:37<41:07:49,  8.18s/it]
 52%|█████▏    | 19863/37963 [47:40:51<50:02:43,  9.95s/it]
 52%|█████▏    | 19864/37963 [47:40:58<45:58:38,  9.15s/it]
 52%|█████▏    | 19865/37963 [47:41:12<53:13:10, 10.59s/it]
 52%|█████▏    | 19866/37963 [47:41:20<48:37:27,  9.67s/it]
 52%|█████▏    | 19867/37963 [47:41:27<45:32:23,  9.06s/it]
 52%|█████▏    | 19868/37963 [47:41:35<43:11:03,  8.59s/it]
 52%|█████▏    | 19869/37963 [47:41:42<41:49:11,  8.32s/it]
 52%|█████▏    | 19870/37963 [47:41:56<50:17:10, 10.01s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '1.636', 'learning_rate': '9.729e-06', 'epoch': '0.5234'}

 52%|█████▏    | 19870/37963 [47:41:56<50:17:10, 10.01s/it]
 52%|█████▏    | 19871/37963 [47:42:04<46:41:07,  9.29s/it]
 52%|█████▏    | 19872/37963 [47:42:11<43:43:07,  8.70s/it]
 52%|█████▏    | 19873/37963 [47:42:19<41:49:03,  8.32s/it]
 52%|█████▏    | 19874/37963 [47:42:26<40:35:05,  8.08s/it]
 52%|█████▏    | 19875/37963 [47:42:33<39:18:02,  7.82s/it]
 52%|█████▏    | 19876/37963 [47:42:41<38:43:20,  7.71s/it]
 52%|█████▏    | 19877/37963 [47:42:48<38:14:31,  7.61s/it]
 52%|█████▏    | 19878/37963 [47:42:56<38:14:15,  7.61s/it]
 52%|█████▏    | 19879/37963 [47:43:03<38:02:12,  7.57s/it]
 52%|█████▏    | 19880/37963 [47:43:11<38:00:46,  7.57s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.888', 'learning_rate': '9.72e-06', 'epoch': '0.5237'}

 52%|█████▏    | 19880/37963 [47:43:11<38:00:46,  7.57s/it]
 52%|█████▏    | 19881/37963 [47:43:18<37:55:49,  7.55s/it]
 52%|█████▏    | 19882/37963 [47:43:26<37:50:45,  7.54s/it]
 52%|█████▏    | 19883/37963 [47:43:33<37:39:09,  7.50s/it]
 52%|█████▏    | 19884/37963 [47:43:41<37:42:56,  7.51s/it]
 52%|█████▏    | 19885/37963 [47:43:48<37:45:33,  7.52s/it]
 52%|█████▏    | 19886/37963 [47:43:56<37:30:39,  7.47s/it]
 52%|█████▏    | 19887/37963 [47:44:10<47:12:23,  9.40s/it]
 52%|█████▏    | 19888/37963 [47:44:17<44:35:22,  8.88s/it]
 52%|█████▏    | 19889/37963 [47:44:25<42:28:21,  8.46s/it]
 52%|█████▏    | 19890/37963 [47:44:32<41:03:54,  8.18s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.812', 'learning_rate': '9.712e-06', 'epoch': '0.5239'}

 52%|█████▏    | 19890/37963 [47:44:32<41:03:54,  8.18s/it]
 52%|█████▏    | 19891/37963 [47:44:40<40:10:13,  8.00s/it]
 52%|█████▏    | 19892/37963 [47:44:47<39:21:49,  7.84s/it]
 52%|█████▏    | 19893/37963 [47:44:55<38:50:26,  7.74s/it]
 52%|█████▏    | 19894/37963 [47:45:03<38:35:05,  7.69s/it]
 52%|█████▏    | 19895/37963 [47:45:17<48:30:26,  9.66s/it]
 52%|█████▏    | 19896/37963 [47:45:24<45:14:57,  9.02s/it]
 52%|█████▏    | 19897/37963 [47:45:32<43:20:10,  8.64s/it]
 52%|█████▏    | 19898/37963 [47:45:40<41:38:53,  8.30s/it]
 52%|█████▏    | 19899/37963 [47:45:47<40:19:18,  8.04s/it]
 52%|█████▏    | 19900/37963 [47:46:01<48:46:55,  9.72s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '1.906', 'learning_rate': '9.703e-06', 'epoch': '0.5242'}

 52%|█████▏    | 19900/37963 [47:46:01<48:46:55,  9.72s/it]
 52%|█████▏    | 19901/37963 [47:46:08<45:10:47,  9.00s/it]
 52%|█████▏    | 19902/37963 [47:46:16<43:03:06,  8.58s/it]
 52%|█████▏    | 19903/37963 [47:46:23<41:24:44,  8.25s/it]
 52%|█████▏    | 19904/37963 [47:46:31<40:27:58,  8.07s/it]
 52%|█████▏    | 19905/37963 [47:46:45<49:41:45,  9.91s/it]
 52%|█████▏    | 19906/37963 [47:46:52<45:37:50,  9.10s/it]
 52%|█████▏    | 19907/37963 [47:47:06<52:51:03, 10.54s/it]
 52%|█████▏    | 19908/37963 [47:47:13<48:04:00,  9.58s/it]
 52%|█████▏    | 19909/37963 [47:47:21<44:45:34,  8.93s/it]
 52%|█████▏    | 19910/37963 [47:47:28<42:18:11,  8.44s/it]
                                                           
{'loss': '0.1496', 'grad_norm': '1.728', 'learning_rate': '9.695e-06', 'epoch': '0.5245'}

 52%|█████▏    | 19910/37963 [47:47:28<42:18:11,  8.44s/it]
 52%|█████▏    | 19911/37963 [47:47:42<50:47:06, 10.13s/it]
 52%|█████▏    | 19912/37963 [47:47:56<56:33:17, 11.28s/it]
 52%|█████▏    | 19913/37963 [47:48:04<50:55:23, 10.16s/it]
 52%|█████▏    | 19914/37963 [47:48:11<47:10:06,  9.41s/it]
 52%|█████▏    | 19915/37963 [47:48:19<44:18:40,  8.84s/it]
 52%|█████▏    | 19916/37963 [47:48:26<42:36:10,  8.50s/it]
 52%|█████▏    | 19917/37963 [47:48:34<41:16:56,  8.24s/it]
 52%|█████▏    | 19918/37963 [47:48:42<40:18:45,  8.04s/it]
 52%|█████▏    | 19919/37963 [47:48:49<39:32:00,  7.89s/it]
 52%|█████▏    | 19920/37963 [47:49:03<48:16:07,  9.63s/it]
                                                           
{'loss': '0.1591', 'grad_norm': '1.427', 'learning_rate': '9.686e-06', 'epoch': '0.5247'}

 52%|█████▏    | 19920/37963 [47:49:03<48:16:07,  9.63s/it]
 52%|█████▏    | 19921/37963 [47:49:10<44:38:42,  8.91s/it]
 52%|█████▏    | 19922/37963 [47:49:18<42:37:17,  8.50s/it]
 52%|█████▏    | 19923/37963 [47:49:25<41:12:39,  8.22s/it]
 52%|█████▏    | 19924/37963 [47:49:33<40:14:03,  8.03s/it]
 52%|█████▏    | 19925/37963 [47:49:40<39:24:48,  7.87s/it]
 52%|█████▏    | 19926/37963 [47:49:48<38:51:48,  7.76s/it]
 52%|█████▏    | 19927/37963 [47:49:55<38:18:05,  7.64s/it]
 52%|█████▏    | 19928/37963 [47:50:03<38:00:24,  7.59s/it]
 52%|█████▏    | 19929/37963 [47:50:10<37:56:57,  7.58s/it]
 52%|█████▏    | 19930/37963 [47:50:18<37:51:13,  7.56s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '2.179', 'learning_rate': '9.678e-06', 'epoch': '0.525'}

 52%|█████▏    | 19930/37963 [47:50:18<37:51:13,  7.56s/it]
 53%|█████▎    | 19931/37963 [47:50:25<37:45:42,  7.54s/it]
 53%|█████▎    | 19932/37963 [47:50:39<47:21:36,  9.46s/it]
 53%|█████▎    | 19933/37963 [47:50:47<44:26:37,  8.87s/it]
 53%|█████▎    | 19934/37963 [47:50:54<42:23:53,  8.47s/it]
 53%|█████▎    | 19935/37963 [47:51:02<40:49:29,  8.15s/it]
 53%|█████▎    | 19936/37963 [47:51:09<39:55:08,  7.97s/it]
 53%|█████▎    | 19937/37963 [47:51:17<39:33:35,  7.90s/it]
 53%|█████▎    | 19938/37963 [47:51:24<38:59:06,  7.79s/it]
 53%|█████▎    | 19939/37963 [47:51:32<38:31:22,  7.69s/it]
 53%|█████▎    | 19940/37963 [47:51:40<38:27:04,  7.68s/it]
                                                           
{'loss': '0.1415', 'grad_norm': '1.877', 'learning_rate': '9.669e-06', 'epoch': '0.5252'}

 53%|█████▎    | 19940/37963 [47:51:40<38:27:04,  7.68s/it]
 53%|█████▎    | 19941/37963 [47:51:47<38:24:15,  7.67s/it]
 53%|█████▎    | 19942/37963 [47:51:55<38:32:48,  7.70s/it]
 53%|█████▎    | 19943/37963 [47:52:09<47:45:09,  9.54s/it]
 53%|█████▎    | 19944/37963 [47:52:16<44:47:44,  8.95s/it]
 53%|█████▎    | 19945/37963 [47:52:24<42:06:58,  8.41s/it]
 53%|█████▎    | 19946/37963 [47:52:31<40:44:29,  8.14s/it]
 53%|█████▎    | 19947/37963 [47:52:38<39:35:46,  7.91s/it]
 53%|█████▎    | 19948/37963 [47:52:46<39:00:17,  7.79s/it]
 53%|█████▎    | 19949/37963 [47:53:00<48:05:39,  9.61s/it]
 53%|█████▎    | 19950/37963 [47:53:07<45:08:27,  9.02s/it]
                                                           
{'loss': '0.1577', 'grad_norm': '1.823', 'learning_rate': '9.661e-06', 'epoch': '0.5255'}

 53%|█████▎    | 19950/37963 [47:53:07<45:08:27,  9.02s/it]
 53%|█████▎    | 19951/37963 [47:53:15<42:50:26,  8.56s/it]
 53%|█████▎    | 19952/37963 [47:53:22<41:13:25,  8.24s/it]
 53%|█████▎    | 19953/37963 [47:53:30<40:14:40,  8.04s/it]
 53%|█████▎    | 19954/37963 [47:53:50<58:38:22, 11.72s/it]
 53%|█████▎    | 19955/37963 [47:53:58<52:40:08, 10.53s/it]
 53%|█████▎    | 19956/37963 [47:54:12<57:22:14, 11.47s/it]
 53%|█████▎    | 19957/37963 [47:54:19<51:25:46, 10.28s/it]
 53%|█████▎    | 19958/37963 [47:54:27<47:12:12,  9.44s/it]
 53%|█████▎    | 19959/37963 [47:54:34<44:24:30,  8.88s/it]
 53%|█████▎    | 19960/37963 [47:54:42<42:26:56,  8.49s/it]
                                                           
{'loss': '0.14', 'grad_norm': '1.089', 'learning_rate': '9.652e-06', 'epoch': '0.5258'}

 53%|█████▎    | 19960/37963 [47:54:42<42:26:56,  8.49s/it]
 53%|█████▎    | 19961/37963 [47:54:56<50:30:24, 10.10s/it]
 53%|█████▎    | 19962/37963 [47:55:03<46:39:46,  9.33s/it]
 53%|█████▎    | 19963/37963 [47:55:11<44:10:37,  8.84s/it]
 53%|█████▎    | 19964/37963 [47:55:18<41:56:57,  8.39s/it]
 53%|█████▎    | 19965/37963 [47:55:26<40:35:41,  8.12s/it]
 53%|█████▎    | 19966/37963 [47:55:33<39:50:42,  7.97s/it]
 53%|█████▎    | 19967/37963 [47:55:47<48:57:32,  9.79s/it]
 53%|█████▎    | 19968/37963 [47:55:55<45:38:13,  9.13s/it]
 53%|█████▎    | 19969/37963 [47:56:03<43:14:38,  8.65s/it]
 53%|█████▎    | 19970/37963 [47:56:10<41:40:10,  8.34s/it]
                                                           
{'loss': '0.143', 'grad_norm': '3.961', 'learning_rate': '9.643e-06', 'epoch': '0.526'}

 53%|█████▎    | 19970/37963 [47:56:10<41:40:10,  8.34s/it]
 53%|█████▎    | 19971/37963 [47:56:18<40:36:18,  8.12s/it]
 53%|█████▎    | 19972/37963 [47:56:25<39:54:01,  7.98s/it]
 53%|█████▎    | 19973/37963 [47:56:33<39:18:23,  7.87s/it]
 53%|█████▎    | 19974/37963 [47:56:41<38:45:17,  7.76s/it]
 53%|█████▎    | 19975/37963 [47:56:48<38:24:59,  7.69s/it]
 53%|█████▎    | 19976/37963 [47:56:56<38:08:19,  7.63s/it]
 53%|█████▎    | 19977/37963 [47:57:03<37:56:46,  7.60s/it]
 53%|█████▎    | 19978/37963 [47:57:11<37:53:10,  7.58s/it]
 53%|█████▎    | 19979/37963 [47:57:18<37:45:51,  7.56s/it]
 53%|█████▎    | 19980/37963 [47:57:26<37:41:42,  7.55s/it]
                                                           
{'loss': '0.1581', 'grad_norm': '2.554', 'learning_rate': '9.635e-06', 'epoch': '0.5263'}

 53%|█████▎    | 19980/37963 [47:57:26<37:41:42,  7.55s/it]
 53%|█████▎    | 19981/37963 [47:57:33<37:40:07,  7.54s/it]
 53%|█████▎    | 19982/37963 [47:57:41<37:51:15,  7.58s/it]
 53%|█████▎    | 19983/37963 [47:57:54<46:51:11,  9.38s/it]
 53%|█████▎    | 19984/37963 [47:58:02<44:06:32,  8.83s/it]
 53%|█████▎    | 19985/37963 [47:58:09<42:04:52,  8.43s/it]
 53%|█████▎    | 19986/37963 [47:58:17<40:39:10,  8.14s/it]
 53%|█████▎    | 19987/37963 [47:58:25<39:50:06,  7.98s/it]
 53%|█████▎    | 19988/37963 [47:58:32<39:01:50,  7.82s/it]
 53%|█████▎    | 19989/37963 [47:58:40<38:42:23,  7.75s/it]
 53%|█████▎    | 19990/37963 [47:58:47<38:18:55,  7.67s/it]
                                                           
{'loss': '0.1585', 'grad_norm': '1.634', 'learning_rate': '9.626e-06', 'epoch': '0.5266'}

 53%|█████▎    | 19990/37963 [47:58:47<38:18:55,  7.67s/it]
 53%|█████▎    | 19991/37963 [47:58:55<38:08:58,  7.64s/it]
 53%|█████▎    | 19992/37963 [47:59:02<37:43:26,  7.56s/it]
 53%|█████▎    | 19993/37963 [47:59:10<37:46:32,  7.57s/it]
 53%|█████▎    | 19994/37963 [47:59:23<47:06:05,  9.44s/it]
 53%|█████▎    | 19995/37963 [47:59:31<44:01:24,  8.82s/it]
 53%|█████▎    | 19996/37963 [47:59:38<41:51:43,  8.39s/it]
 53%|█████▎    | 19997/37963 [47:59:46<40:33:28,  8.13s/it]
 53%|█████▎    | 19998/37963 [47:59:53<39:21:46,  7.89s/it]
 53%|█████▎    | 19999/37963 [48:00:01<38:50:13,  7.78s/it]
 53%|█████▎    | 20000/37963 [48:00:14<48:03:25,  9.63s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '2.266', 'learning_rate': '9.618e-06', 'epoch': '0.5268'}

 53%|█████▎    | 20000/37963 [48:00:14<48:03:25,  9.63s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.48s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.48s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 53%|█████▎    | 20001/37963 [48:01:17<126:29:49, 25.35s/it]
 53%|█████▎    | 20002/37963 [48:01:24<99:40:09, 19.98s/it] 
 53%|█████▎    | 20003/37963 [48:01:32<81:14:58, 16.29s/it]
 53%|█████▎    | 20004/37963 [48:01:45<77:26:18, 15.52s/it]
 53%|█████▎    | 20005/37963 [48:01:53<65:08:26, 13.06s/it]
 53%|█████▎    | 20006/37963 [48:02:00<56:48:36, 11.39s/it]
 53%|█████▎    | 20007/37963 [48:02:14<60:59:48, 12.23s/it]
 53%|█████▎    | 20008/37963 [48:02:28<63:20:01, 12.70s/it]
 53%|█████▎    | 20009/37963 [48:02:36<55:37:50, 11.15s/it]
 53%|█████▎    | 20010/37963 [48:02:43<49:46:20,  9.98s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '2.24', 'learning_rate': '9.609e-06', 'epoch': '0.5271'}

 53%|█████▎    | 20010/37963 [48:02:43<49:46:20,  9.98s/it]
 53%|█████▎    | 20011/37963 [48:02:51<46:24:32,  9.31s/it]
 53%|█████▎    | 20012/37963 [48:02:58<43:48:48,  8.79s/it]
 53%|█████▎    | 20013/37963 [48:03:06<41:57:23,  8.41s/it]
 53%|█████▎    | 20014/37963 [48:03:13<40:41:33,  8.16s/it]
 53%|█████▎    | 20015/37963 [48:03:21<39:54:43,  8.01s/it]
 53%|█████▎    | 20016/37963 [48:03:28<39:06:41,  7.85s/it]
 53%|█████▎    | 20017/37963 [48:03:36<38:35:33,  7.74s/it]
 53%|█████▎    | 20018/37963 [48:03:43<38:03:49,  7.64s/it]
 53%|█████▎    | 20019/37963 [48:03:57<47:23:40,  9.51s/it]
 53%|█████▎    | 20020/37963 [48:04:05<44:41:25,  8.97s/it]
                                                           
{'loss': '0.1487', 'grad_norm': '2.395', 'learning_rate': '9.601e-06', 'epoch': '0.5274'}

 53%|█████▎    | 20020/37963 [48:04:05<44:41:25,  8.97s/it]
 53%|█████▎    | 20021/37963 [48:04:13<42:46:09,  8.58s/it]
 53%|█████▎    | 20022/37963 [48:04:20<41:08:03,  8.25s/it]
 53%|█████▎    | 20023/37963 [48:04:28<40:01:01,  8.03s/it]
 53%|█████▎    | 20024/37963 [48:04:35<39:05:58,  7.85s/it]
 53%|█████▎    | 20025/37963 [48:04:43<38:51:09,  7.80s/it]
 53%|█████▎    | 20026/37963 [48:04:50<38:02:50,  7.64s/it]
 53%|█████▎    | 20027/37963 [48:04:57<37:42:49,  7.57s/it]
 53%|█████▎    | 20028/37963 [48:05:05<37:51:26,  7.60s/it]
 53%|█████▎    | 20029/37963 [48:05:13<37:52:54,  7.60s/it]
 53%|█████▎    | 20030/37963 [48:05:20<37:26:52,  7.52s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '2.464', 'learning_rate': '9.592e-06', 'epoch': '0.5276'}

 53%|█████▎    | 20030/37963 [48:05:20<37:26:52,  7.52s/it]
 53%|█████▎    | 20031/37963 [48:05:28<37:27:41,  7.52s/it]
 53%|█████▎    | 20032/37963 [48:05:35<37:29:09,  7.53s/it]
 53%|█████▎    | 20033/37963 [48:05:43<37:32:30,  7.54s/it]
 53%|█████▎    | 20034/37963 [48:05:50<37:33:27,  7.54s/it]
 53%|█████▎    | 20035/37963 [48:06:04<47:09:11,  9.47s/it]
 53%|█████▎    | 20036/37963 [48:06:12<44:16:03,  8.89s/it]
 53%|█████▎    | 20037/37963 [48:06:19<42:32:30,  8.54s/it]
 53%|█████▎    | 20038/37963 [48:06:27<41:06:50,  8.26s/it]
 53%|█████▎    | 20039/37963 [48:06:35<40:08:54,  8.06s/it]
 53%|█████▎    | 20040/37963 [48:06:49<49:08:41,  9.87s/it]
                                                           
{'loss': '0.16', 'grad_norm': '5.422', 'learning_rate': '9.584e-06', 'epoch': '0.5279'}

 53%|█████▎    | 20040/37963 [48:06:49<49:08:41,  9.87s/it]
 53%|█████▎    | 20041/37963 [48:06:56<45:21:57,  9.11s/it]
 53%|█████▎    | 20042/37963 [48:07:03<42:50:16,  8.61s/it]
 53%|█████▎    | 20043/37963 [48:07:11<41:21:00,  8.31s/it]
 53%|█████▎    | 20044/37963 [48:07:19<40:22:55,  8.11s/it]
 53%|█████▎    | 20045/37963 [48:07:26<39:13:38,  7.88s/it]
 53%|█████▎    | 20046/37963 [48:07:40<48:08:26,  9.67s/it]
 53%|█████▎    | 20047/37963 [48:07:47<44:45:59,  9.00s/it]
 53%|█████▎    | 20048/37963 [48:08:01<52:06:12, 10.47s/it]
 53%|█████▎    | 20049/37963 [48:08:09<47:43:34,  9.59s/it]
 53%|█████▎    | 20050/37963 [48:08:16<44:15:13,  8.89s/it]
                                                           
{'loss': '0.1563', 'grad_norm': '1.535', 'learning_rate': '9.575e-06', 'epoch': '0.5281'}

 53%|█████▎    | 20050/37963 [48:08:16<44:15:13,  8.89s/it]
 53%|█████▎    | 20051/37963 [48:08:24<42:12:44,  8.48s/it]
 53%|█████▎    | 20052/37963 [48:08:31<40:44:01,  8.19s/it]
 53%|█████▎    | 20053/37963 [48:08:45<49:31:17,  9.95s/it]
 53%|█████▎    | 20054/37963 [48:08:53<45:54:42,  9.23s/it]
 53%|█████▎    | 20055/37963 [48:09:07<52:59:52, 10.65s/it]
 53%|█████▎    | 20056/37963 [48:09:14<48:26:05,  9.74s/it]
 53%|█████▎    | 20057/37963 [48:09:22<45:07:19,  9.07s/it]
 53%|█████▎    | 20058/37963 [48:09:29<42:47:43,  8.60s/it]
 53%|█████▎    | 20059/37963 [48:09:37<41:16:27,  8.30s/it]
 53%|█████▎    | 20060/37963 [48:09:44<40:11:20,  8.08s/it]
                                                           
{'loss': '0.1501', 'grad_norm': '1.537', 'learning_rate': '9.567e-06', 'epoch': '0.5284'}

 53%|█████▎    | 20060/37963 [48:09:44<40:11:20,  8.08s/it]
 53%|█████▎    | 20061/37963 [48:09:52<39:22:32,  7.92s/it]
 53%|█████▎    | 20062/37963 [48:10:06<48:16:46,  9.71s/it]
 53%|█████▎    | 20063/37963 [48:10:14<45:20:40,  9.12s/it]
 53%|█████▎    | 20064/37963 [48:10:21<43:13:32,  8.69s/it]
 53%|█████▎    | 20065/37963 [48:10:35<51:14:26, 10.31s/it]
 53%|█████▎    | 20066/37963 [48:10:43<47:10:41,  9.49s/it]
 53%|█████▎    | 20067/37963 [48:10:51<44:14:13,  8.90s/it]
 53%|█████▎    | 20068/37963 [48:10:58<42:18:51,  8.51s/it]
 53%|█████▎    | 20069/37963 [48:11:06<40:56:15,  8.24s/it]
 53%|█████▎    | 20070/37963 [48:11:13<39:54:29,  8.03s/it]
                                                           
{'loss': '0.1529', 'grad_norm': '1.226', 'learning_rate': '9.558e-06', 'epoch': '0.5287'}

 53%|█████▎    | 20070/37963 [48:11:13<39:54:29,  8.03s/it]
 53%|█████▎    | 20071/37963 [48:11:21<39:13:19,  7.89s/it]
 53%|█████▎    | 20072/37963 [48:11:28<38:45:24,  7.80s/it]
 53%|█████▎    | 20073/37963 [48:11:36<38:18:56,  7.71s/it]
 53%|█████▎    | 20074/37963 [48:11:43<37:51:46,  7.62s/it]
 53%|█████▎    | 20075/37963 [48:11:51<37:52:38,  7.62s/it]
 53%|█████▎    | 20076/37963 [48:11:58<37:43:54,  7.59s/it]
 53%|█████▎    | 20077/37963 [48:12:06<37:36:17,  7.57s/it]
 53%|█████▎    | 20078/37963 [48:12:13<37:18:48,  7.51s/it]
 53%|█████▎    | 20079/37963 [48:12:21<37:17:53,  7.51s/it]
 53%|█████▎    | 20080/37963 [48:12:28<37:20:37,  7.52s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '3.858', 'learning_rate': '9.55e-06', 'epoch': '0.5289'}

 53%|█████▎    | 20080/37963 [48:12:28<37:20:37,  7.52s/it]
 53%|█████▎    | 20081/37963 [48:12:36<36:59:41,  7.45s/it]
 53%|█████▎    | 20082/37963 [48:12:43<36:45:21,  7.40s/it]
 53%|█████▎    | 20083/37963 [48:12:57<46:16:57,  9.32s/it]
 53%|█████▎    | 20084/37963 [48:13:04<43:33:58,  8.77s/it]
 53%|█████▎    | 20085/37963 [48:13:12<41:31:50,  8.36s/it]
 53%|█████▎    | 20086/37963 [48:13:26<49:41:55, 10.01s/it]
 53%|█████▎    | 20087/37963 [48:13:33<45:57:01,  9.25s/it]
 53%|█████▎    | 20088/37963 [48:13:41<43:18:23,  8.72s/it]
 53%|█████▎    | 20089/37963 [48:13:48<41:36:34,  8.38s/it]
 53%|█████▎    | 20090/37963 [48:13:56<40:30:17,  8.16s/it]
                                                           
{'loss': '0.1544', 'grad_norm': '1.44', 'learning_rate': '9.541e-06', 'epoch': '0.5292'}

 53%|█████▎    | 20090/37963 [48:13:56<40:30:17,  8.16s/it]
 53%|█████▎    | 20091/37963 [48:14:03<39:40:38,  7.99s/it]
 53%|█████▎    | 20092/37963 [48:14:11<38:54:35,  7.84s/it]
 53%|█████▎    | 20093/37963 [48:14:18<38:05:03,  7.67s/it]
 53%|█████▎    | 20094/37963 [48:14:26<38:11:16,  7.69s/it]
 53%|█████▎    | 20095/37963 [48:14:33<37:54:21,  7.64s/it]
 53%|█████▎    | 20096/37963 [48:14:47<46:58:10,  9.46s/it]
 53%|█████▎    | 20097/37963 [48:15:01<53:41:48, 10.82s/it]
 53%|█████▎    | 20098/37963 [48:15:09<48:57:09,  9.86s/it]
 53%|█████▎    | 20099/37963 [48:15:23<55:19:56, 11.15s/it]
 53%|█████▎    | 20100/37963 [48:15:30<49:55:44, 10.06s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.733', 'learning_rate': '9.533e-06', 'epoch': '0.5295'}

 53%|█████▎    | 20100/37963 [48:15:30<49:55:44, 10.06s/it]
 53%|█████▎    | 20101/37963 [48:15:38<46:15:40,  9.32s/it]
 53%|█████▎    | 20102/37963 [48:15:45<43:24:16,  8.75s/it]
 53%|█████▎    | 20103/37963 [48:15:53<41:08:24,  8.29s/it]
 53%|█████▎    | 20104/37963 [48:16:00<39:50:24,  8.03s/it]
 53%|█████▎    | 20105/37963 [48:16:07<38:42:08,  7.80s/it]
 53%|█████▎    | 20106/37963 [48:16:21<47:51:27,  9.65s/it]
 53%|█████▎    | 20107/37963 [48:16:35<54:16:17, 10.94s/it]
 53%|█████▎    | 20108/37963 [48:16:43<49:09:58,  9.91s/it]
 53%|█████▎    | 20109/37963 [48:16:50<45:36:08,  9.20s/it]
 53%|█████▎    | 20110/37963 [48:16:58<43:09:19,  8.70s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '1.146', 'learning_rate': '9.524e-06', 'epoch': '0.5297'}

 53%|█████▎    | 20110/37963 [48:16:58<43:09:19,  8.70s/it]
 53%|█████▎    | 20111/37963 [48:17:05<41:39:18,  8.40s/it]
 53%|█████▎    | 20112/37963 [48:17:13<40:25:07,  8.15s/it]
 53%|█████▎    | 20113/37963 [48:17:27<49:18:41,  9.95s/it]
 53%|█████▎    | 20114/37963 [48:17:35<45:30:45,  9.18s/it]
 53%|█████▎    | 20115/37963 [48:17:42<43:14:54,  8.72s/it]
 53%|█████▎    | 20116/37963 [48:17:50<41:39:11,  8.40s/it]
 53%|█████▎    | 20117/37963 [48:17:58<40:30:02,  8.17s/it]
 53%|█████▎    | 20118/37963 [48:18:05<39:43:04,  8.01s/it]
 53%|█████▎    | 20119/37963 [48:18:13<39:02:00,  7.87s/it]
 53%|█████▎    | 20120/37963 [48:18:20<38:10:18,  7.70s/it]
                                                           
{'loss': '0.1556', 'grad_norm': '3.349', 'learning_rate': '9.516e-06', 'epoch': '0.53'}

 53%|█████▎    | 20120/37963 [48:18:20<38:10:18,  7.70s/it]
 53%|█████▎    | 20121/37963 [48:18:28<37:54:28,  7.65s/it]
 53%|█████▎    | 20122/37963 [48:18:35<37:35:55,  7.59s/it]
 53%|█████▎    | 20123/37963 [48:18:43<37:29:24,  7.57s/it]
 53%|█████▎    | 20124/37963 [48:18:50<37:27:04,  7.56s/it]
 53%|█████▎    | 20125/37963 [48:18:58<37:22:34,  7.54s/it]
 53%|█████▎    | 20126/37963 [48:19:05<37:25:01,  7.55s/it]
 53%|█████▎    | 20127/37963 [48:19:19<46:49:26,  9.45s/it]
 53%|█████▎    | 20128/37963 [48:19:27<44:16:15,  8.94s/it]
 53%|█████▎    | 20129/37963 [48:19:34<42:12:07,  8.52s/it]
 53%|█████▎    | 20130/37963 [48:19:49<50:51:28, 10.27s/it]
                                                           
{'loss': '0.1674', 'grad_norm': '2.898', 'learning_rate': '9.507e-06', 'epoch': '0.5303'}

 53%|█████▎    | 20130/37963 [48:19:49<50:51:28, 10.27s/it]
 53%|█████▎    | 20131/37963 [48:19:56<46:48:30,  9.45s/it]
 53%|█████▎    | 20132/37963 [48:20:04<43:59:19,  8.88s/it]
 53%|█████▎    | 20133/37963 [48:20:11<42:03:21,  8.49s/it]
 53%|█████▎    | 20134/37963 [48:20:19<40:35:21,  8.20s/it]
 53%|█████▎    | 20135/37963 [48:20:27<39:49:23,  8.04s/it]
 53%|█████▎    | 20136/37963 [48:20:34<38:53:15,  7.85s/it]
 53%|█████▎    | 20137/37963 [48:20:41<38:23:24,  7.75s/it]
 53%|█████▎    | 20138/37963 [48:20:49<37:58:33,  7.67s/it]
 53%|█████▎    | 20139/37963 [48:20:56<37:44:40,  7.62s/it]
 53%|█████▎    | 20140/37963 [48:21:04<37:16:23,  7.53s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '0.9424', 'learning_rate': '9.499e-06', 'epoch': '0.5305'}

 53%|█████▎    | 20140/37963 [48:21:04<37:16:23,  7.53s/it]
 53%|█████▎    | 20141/37963 [48:21:11<37:17:32,  7.53s/it]
 53%|█████▎    | 20142/37963 [48:21:19<37:12:04,  7.51s/it]
 53%|█████▎    | 20143/37963 [48:21:26<37:08:40,  7.50s/it]
 53%|█████▎    | 20144/37963 [48:21:34<37:07:31,  7.50s/it]
 53%|█████▎    | 20145/37963 [48:21:48<46:35:18,  9.41s/it]
 53%|█████▎    | 20146/37963 [48:22:08<62:54:25, 12.71s/it]
 53%|█████▎    | 20147/37963 [48:22:15<55:09:37, 11.15s/it]
 53%|█████▎    | 20148/37963 [48:22:23<49:05:01,  9.92s/it]
 53%|█████▎    | 20149/37963 [48:22:30<45:25:44,  9.18s/it]
 53%|█████▎    | 20150/37963 [48:22:38<43:02:53,  8.70s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.085', 'learning_rate': '9.49e-06', 'epoch': '0.5308'}

 53%|█████▎    | 20150/37963 [48:22:38<43:02:53,  8.70s/it]
 53%|█████▎    | 20151/37963 [48:22:45<40:51:39,  8.26s/it]
 53%|█████▎    | 20152/37963 [48:22:52<39:42:21,  8.03s/it]
 53%|█████▎    | 20153/37963 [48:23:06<48:45:59,  9.86s/it]
 53%|█████▎    | 20154/37963 [48:23:20<54:45:38, 11.07s/it]
 53%|█████▎    | 20155/37963 [48:23:28<49:31:44, 10.01s/it]
 53%|█████▎    | 20156/37963 [48:23:35<45:38:01,  9.23s/it]
 53%|█████▎    | 20157/37963 [48:23:43<42:52:50,  8.67s/it]
 53%|█████▎    | 20158/37963 [48:23:56<50:22:46, 10.19s/it]
 53%|█████▎    | 20159/37963 [48:24:04<46:25:08,  9.39s/it]
 53%|█████▎    | 20160/37963 [48:24:11<43:44:12,  8.84s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '1.042', 'learning_rate': '9.482e-06', 'epoch': '0.531'}

 53%|█████▎    | 20160/37963 [48:24:11<43:44:12,  8.84s/it]
 53%|█████▎    | 20161/37963 [48:24:19<42:00:39,  8.50s/it]
 53%|█████▎    | 20162/37963 [48:24:27<40:34:31,  8.21s/it]
 53%|█████▎    | 20163/37963 [48:24:34<39:25:58,  7.98s/it]
 53%|█████▎    | 20164/37963 [48:24:42<39:02:24,  7.90s/it]
 53%|█████▎    | 20165/37963 [48:24:49<38:30:49,  7.79s/it]
 53%|█████▎    | 20166/37963 [48:24:57<38:14:53,  7.74s/it]
 53%|█████▎    | 20167/37963 [48:25:05<38:17:41,  7.75s/it]
 53%|█████▎    | 20168/37963 [48:25:13<38:42:51,  7.83s/it]
 53%|█████▎    | 20169/37963 [48:25:20<38:22:07,  7.76s/it]
 53%|█████▎    | 20170/37963 [48:25:28<37:59:49,  7.69s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '2.985', 'learning_rate': '9.473e-06', 'epoch': '0.5313'}

 53%|█████▎    | 20170/37963 [48:25:28<37:59:49,  7.69s/it]
 53%|█████▎    | 20171/37963 [48:25:35<37:50:29,  7.66s/it]
 53%|█████▎    | 20172/37963 [48:25:43<37:37:59,  7.62s/it]
 53%|█████▎    | 20173/37963 [48:25:51<37:33:44,  7.60s/it]
 53%|█████▎    | 20174/37963 [48:25:58<37:14:25,  7.54s/it]
 53%|█████▎    | 20175/37963 [48:26:12<47:14:02,  9.56s/it]
 53%|█████▎    | 20176/37963 [48:26:26<53:58:39, 10.92s/it]
 53%|█████▎    | 20177/37963 [48:26:34<49:06:02,  9.94s/it]
 53%|█████▎    | 20178/37963 [48:26:42<45:35:07,  9.23s/it]
 53%|█████▎    | 20179/37963 [48:26:49<43:03:31,  8.72s/it]
 53%|█████▎    | 20180/37963 [48:26:56<40:59:44,  8.30s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.473', 'learning_rate': '9.464e-06', 'epoch': '0.5316'}

 53%|█████▎    | 20180/37963 [48:26:56<40:59:44,  8.30s/it]
 53%|█████▎    | 20181/37963 [48:27:04<39:47:45,  8.06s/it]
 53%|█████▎    | 20182/37963 [48:27:11<38:54:08,  7.88s/it]
 53%|█████▎    | 20183/37963 [48:27:19<38:18:17,  7.76s/it]
 53%|█████▎    | 20184/37963 [48:27:26<38:07:25,  7.72s/it]
 53%|█████▎    | 20185/37963 [48:27:34<37:50:07,  7.66s/it]
 53%|█████▎    | 20186/37963 [48:27:42<37:55:06,  7.68s/it]
 53%|█████▎    | 20187/37963 [48:27:49<37:41:54,  7.63s/it]
 53%|█████▎    | 20188/37963 [48:27:57<37:35:57,  7.62s/it]
 53%|█████▎    | 20189/37963 [48:28:04<37:24:28,  7.58s/it]
 53%|█████▎    | 20190/37963 [48:28:12<37:30:02,  7.60s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '2.109', 'learning_rate': '9.456e-06', 'epoch': '0.5318'}

 53%|█████▎    | 20190/37963 [48:28:12<37:30:02,  7.60s/it]
 53%|█████▎    | 20191/37963 [48:28:19<37:22:06,  7.57s/it]
 53%|█████▎    | 20192/37963 [48:28:27<37:21:30,  7.57s/it]
 53%|█████▎    | 20193/37963 [48:28:41<46:38:14,  9.45s/it]
 53%|█████▎    | 20194/37963 [48:28:48<43:25:39,  8.80s/it]
 53%|█████▎    | 20195/37963 [48:29:02<51:24:25, 10.42s/it]
 53%|█████▎    | 20196/37963 [48:29:16<56:32:57, 11.46s/it]
 53%|█████▎    | 20197/37963 [48:29:24<50:31:00, 10.24s/it]
 53%|█████▎    | 20198/37963 [48:29:31<46:28:40,  9.42s/it]
 53%|█████▎    | 20199/37963 [48:29:39<43:39:00,  8.85s/it]
 53%|█████▎    | 20200/37963 [48:29:46<41:40:32,  8.45s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '3.167', 'learning_rate': '9.447e-06', 'epoch': '0.5321'}

 53%|█████▎    | 20200/37963 [48:29:46<41:40:32,  8.45s/it]
 53%|█████▎    | 20201/37963 [48:29:54<40:32:44,  8.22s/it]
 53%|█████▎    | 20202/37963 [48:30:14<58:46:19, 11.91s/it]
 53%|█████▎    | 20203/37963 [48:30:22<52:18:19, 10.60s/it]
 53%|█████▎    | 20204/37963 [48:30:29<47:41:59,  9.67s/it]
 53%|█████▎    | 20205/37963 [48:30:37<44:48:29,  9.08s/it]
 53%|█████▎    | 20206/37963 [48:30:45<42:44:50,  8.67s/it]
 53%|█████▎    | 20207/37963 [48:30:52<41:03:09,  8.32s/it]
 53%|█████▎    | 20208/37963 [48:31:00<39:56:25,  8.10s/it]
 53%|█████▎    | 20209/37963 [48:31:07<39:11:18,  7.95s/it]
 53%|█████▎    | 20210/37963 [48:31:15<38:37:22,  7.83s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.626', 'learning_rate': '9.439e-06', 'epoch': '0.5324'}

 53%|█████▎    | 20210/37963 [48:31:15<38:37:22,  7.83s/it]
 53%|█████▎    | 20211/37963 [48:31:22<37:55:57,  7.69s/it]
 53%|█████▎    | 20212/37963 [48:31:30<37:37:41,  7.63s/it]
 53%|█████▎    | 20213/37963 [48:31:37<37:23:21,  7.58s/it]
 53%|█████▎    | 20214/37963 [48:31:45<37:35:35,  7.62s/it]
 53%|█████▎    | 20215/37963 [48:31:53<37:28:54,  7.60s/it]
 53%|█████▎    | 20216/37963 [48:32:00<37:13:18,  7.55s/it]
 53%|█████▎    | 20217/37963 [48:32:08<37:30:02,  7.61s/it]
 53%|█████▎    | 20218/37963 [48:32:15<37:09:41,  7.54s/it]
 53%|█████▎    | 20219/37963 [48:32:22<36:39:33,  7.44s/it]
 53%|█████▎    | 20220/37963 [48:32:30<36:43:48,  7.45s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '1.464', 'learning_rate': '9.43e-06', 'epoch': '0.5326'}

 53%|█████▎    | 20220/37963 [48:32:30<36:43:48,  7.45s/it]
 53%|█████▎    | 20221/37963 [48:32:37<36:53:23,  7.49s/it]
 53%|█████▎    | 20222/37963 [48:32:51<46:12:51,  9.38s/it]
 53%|█████▎    | 20223/37963 [48:32:59<43:37:17,  8.85s/it]
 53%|█████▎    | 20224/37963 [48:33:07<41:53:51,  8.50s/it]
 53%|█████▎    | 20225/37963 [48:33:14<40:27:46,  8.21s/it]
 53%|█████▎    | 20226/37963 [48:33:22<39:28:18,  8.01s/it]
 53%|█████▎    | 20227/37963 [48:33:29<38:37:57,  7.84s/it]
 53%|█████▎    | 20228/37963 [48:33:37<38:21:13,  7.79s/it]
 53%|█████▎    | 20229/37963 [48:33:51<47:21:44,  9.61s/it]
 53%|█████▎    | 20230/37963 [48:33:58<44:24:17,  9.01s/it]
                                                           
{'loss': '0.1458', 'grad_norm': '2.042', 'learning_rate': '9.422e-06', 'epoch': '0.5329'}

 53%|█████▎    | 20230/37963 [48:33:58<44:24:17,  9.01s/it]
 53%|█████▎    | 20231/37963 [48:34:06<42:14:02,  8.57s/it]
 53%|█████▎    | 20232/37963 [48:34:13<40:47:53,  8.28s/it]
 53%|█████▎    | 20233/37963 [48:34:21<39:53:23,  8.10s/it]
 53%|█████▎    | 20234/37963 [48:34:28<38:55:03,  7.90s/it]
 53%|█████▎    | 20235/37963 [48:34:36<38:33:51,  7.83s/it]
 53%|█████▎    | 20236/37963 [48:34:44<38:15:58,  7.77s/it]
 53%|█████▎    | 20237/37963 [48:34:51<37:54:57,  7.70s/it]
 53%|█████▎    | 20238/37963 [48:34:59<37:41:24,  7.65s/it]
 53%|█████▎    | 20239/37963 [48:35:07<37:51:55,  7.69s/it]
 53%|█████▎    | 20240/37963 [48:35:21<47:02:14,  9.55s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.781', 'learning_rate': '9.413e-06', 'epoch': '0.5332'}

 53%|█████▎    | 20240/37963 [48:35:21<47:02:14,  9.55s/it]
 53%|█████▎    | 20241/37963 [48:35:28<43:46:47,  8.89s/it]
 53%|█████▎    | 20242/37963 [48:35:35<41:43:51,  8.48s/it]
 53%|█████▎    | 20243/37963 [48:35:43<40:00:24,  8.13s/it]
 53%|█████▎    | 20244/37963 [48:35:50<39:15:56,  7.98s/it]
 53%|█████▎    | 20245/37963 [48:35:58<38:09:30,  7.75s/it]
 53%|█████▎    | 20246/37963 [48:36:11<47:09:20,  9.58s/it]
 53%|█████▎    | 20247/37963 [48:36:26<54:13:18, 11.02s/it]
 53%|█████▎    | 20248/37963 [48:36:39<57:59:58, 11.79s/it]
 53%|█████▎    | 20249/37963 [48:36:47<51:54:49, 10.55s/it]
 53%|█████▎    | 20250/37963 [48:37:01<57:07:22, 11.61s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.492', 'learning_rate': '9.405e-06', 'epoch': '0.5334'}

 53%|█████▎    | 20250/37963 [48:37:01<57:07:22, 11.61s/it]
 53%|█████▎    | 20251/37963 [48:37:09<51:08:21, 10.39s/it]
 53%|█████▎    | 20252/37963 [48:37:16<46:54:57,  9.54s/it]
 53%|█████▎    | 20253/37963 [48:37:24<43:52:10,  8.92s/it]
 53%|█████▎    | 20254/37963 [48:37:31<41:48:26,  8.50s/it]
 53%|█████▎    | 20255/37963 [48:37:39<40:26:35,  8.22s/it]
 53%|█████▎    | 20256/37963 [48:37:46<39:25:30,  8.02s/it]
 53%|█████▎    | 20257/37963 [48:37:54<38:46:44,  7.88s/it]
 53%|█████▎    | 20258/37963 [48:38:01<38:08:14,  7.75s/it]
 53%|█████▎    | 20259/37963 [48:38:09<37:46:40,  7.68s/it]
 53%|█████▎    | 20260/37963 [48:38:16<37:41:33,  7.66s/it]
                                                           
{'loss': '0.1553', 'grad_norm': '2.495', 'learning_rate': '9.396e-06', 'epoch': '0.5337'}

 53%|█████▎    | 20260/37963 [48:38:16<37:41:33,  7.66s/it]
 53%|█████▎    | 20261/37963 [48:38:24<37:27:07,  7.62s/it]
 53%|█████▎    | 20262/37963 [48:38:32<37:21:28,  7.60s/it]
 53%|█████▎    | 20263/37963 [48:38:39<37:24:03,  7.61s/it]
 53%|█████▎    | 20264/37963 [48:38:47<37:22:38,  7.60s/it]
 53%|█████▎    | 20265/37963 [48:38:54<37:01:28,  7.53s/it]
 53%|█████▎    | 20266/37963 [48:39:02<37:01:30,  7.53s/it]
 53%|█████▎    | 20267/37963 [48:39:09<37:08:12,  7.55s/it]
 53%|█████▎    | 20268/37963 [48:39:17<37:03:30,  7.54s/it]
 53%|█████▎    | 20269/37963 [48:39:24<37:02:56,  7.54s/it]
 53%|█████▎    | 20270/37963 [48:39:32<37:15:03,  7.58s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '4.086', 'learning_rate': '9.388e-06', 'epoch': '0.5339'}

 53%|█████▎    | 20270/37963 [48:39:32<37:15:03,  7.58s/it]
 53%|█████▎    | 20271/37963 [48:39:40<37:13:06,  7.57s/it]
 53%|█████▎    | 20272/37963 [48:39:47<37:17:17,  7.59s/it]
 53%|█████▎    | 20273/37963 [48:39:55<37:08:47,  7.56s/it]
 53%|█████▎    | 20274/37963 [48:40:02<36:43:15,  7.47s/it]
 53%|█████▎    | 20275/37963 [48:40:10<36:56:28,  7.52s/it]
 53%|█████▎    | 20276/37963 [48:40:24<46:51:53,  9.54s/it]
 53%|█████▎    | 20277/37963 [48:40:31<43:57:37,  8.95s/it]
 53%|█████▎    | 20278/37963 [48:40:39<42:00:29,  8.55s/it]
 53%|█████▎    | 20279/37963 [48:40:46<40:08:16,  8.17s/it]
 53%|█████▎    | 20280/37963 [48:40:54<39:11:59,  7.98s/it]
                                                           
{'loss': '0.138', 'grad_norm': '5.382', 'learning_rate': '9.379e-06', 'epoch': '0.5342'}

 53%|█████▎    | 20280/37963 [48:40:54<39:11:59,  7.98s/it]
 53%|█████▎    | 20281/37963 [48:41:08<47:48:34,  9.73s/it]
 53%|█████▎    | 20282/37963 [48:41:15<44:03:51,  8.97s/it]
 53%|█████▎    | 20283/37963 [48:41:22<42:00:12,  8.55s/it]
 53%|█████▎    | 20284/37963 [48:41:30<40:39:58,  8.28s/it]
 53%|█████▎    | 20285/37963 [48:41:37<39:21:28,  8.01s/it]
 53%|█████▎    | 20286/37963 [48:41:52<48:15:40,  9.83s/it]
 53%|█████▎    | 20287/37963 [48:41:59<45:00:23,  9.17s/it]
 53%|█████▎    | 20288/37963 [48:42:07<42:30:32,  8.66s/it]
 53%|█████▎    | 20289/37963 [48:42:14<40:22:09,  8.22s/it]
 53%|█████▎    | 20290/37963 [48:42:21<39:31:24,  8.05s/it]
                                                           
{'loss': '0.149', 'grad_norm': '1.776', 'learning_rate': '9.371e-06', 'epoch': '0.5345'}

 53%|█████▎    | 20290/37963 [48:42:21<39:31:24,  8.05s/it]
 53%|█████▎    | 20291/37963 [48:42:29<39:17:32,  8.00s/it]
 53%|█████▎    | 20292/37963 [48:42:37<38:13:45,  7.79s/it]
 53%|█████▎    | 20293/37963 [48:42:44<37:51:36,  7.71s/it]
 53%|█████▎    | 20294/37963 [48:42:59<47:50:19,  9.75s/it]
 53%|█████▎    | 20295/37963 [48:43:19<63:49:42, 13.01s/it]
 53%|█████▎    | 20296/37963 [48:43:33<64:45:39, 13.20s/it]
 53%|█████▎    | 20297/37963 [48:43:41<56:32:24, 11.52s/it]
 53%|█████▎    | 20298/37963 [48:43:54<60:04:18, 12.24s/it]
 53%|█████▎    | 20299/37963 [48:44:02<53:07:11, 10.83s/it]
 53%|█████▎    | 20300/37963 [48:44:09<48:14:26,  9.83s/it]
                                                           
{'loss': '0.146', 'grad_norm': '0.8586', 'learning_rate': '9.362e-06', 'epoch': '0.5347'}

 53%|█████▎    | 20300/37963 [48:44:09<48:14:26,  9.83s/it]
 53%|█████▎    | 20301/37963 [48:44:17<45:01:59,  9.18s/it]
 53%|█████▎    | 20302/37963 [48:44:25<42:40:07,  8.70s/it]
 53%|█████▎    | 20303/37963 [48:44:32<41:17:48,  8.42s/it]
 53%|█████▎    | 20304/37963 [48:44:40<39:58:39,  8.15s/it]
 53%|█████▎    | 20305/37963 [48:44:48<39:05:52,  7.97s/it]
 53%|█████▎    | 20306/37963 [48:44:55<38:30:41,  7.85s/it]
 53%|█████▎    | 20307/37963 [48:45:03<38:03:29,  7.76s/it]
 53%|█████▎    | 20308/37963 [48:45:10<37:50:55,  7.72s/it]
 53%|█████▎    | 20309/37963 [48:45:18<37:36:42,  7.67s/it]
 53%|█████▎    | 20310/37963 [48:45:25<37:26:13,  7.63s/it]
                                                           
{'loss': '0.1437', 'grad_norm': '1.867', 'learning_rate': '9.354e-06', 'epoch': '0.535'}

 53%|█████▎    | 20310/37963 [48:45:25<37:26:13,  7.63s/it]
 54%|█████▎    | 20311/37963 [48:45:33<37:03:57,  7.56s/it]
 54%|█████▎    | 20312/37963 [48:45:40<36:55:47,  7.53s/it]
 54%|█████▎    | 20313/37963 [48:45:48<36:58:36,  7.54s/it]
 54%|█████▎    | 20314/37963 [48:45:55<36:59:14,  7.54s/it]
 54%|█████▎    | 20315/37963 [48:46:03<37:05:16,  7.57s/it]
 54%|█████▎    | 20316/37963 [48:46:10<36:47:08,  7.50s/it]
 54%|█████▎    | 20317/37963 [48:46:18<36:27:18,  7.44s/it]
 54%|█████▎    | 20318/37963 [48:46:25<36:33:59,  7.46s/it]
 54%|█████▎    | 20319/37963 [48:46:33<36:51:38,  7.52s/it]
 54%|█████▎    | 20320/37963 [48:46:40<36:51:35,  7.52s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.949', 'learning_rate': '9.345e-06', 'epoch': '0.5353'}

 54%|█████▎    | 20320/37963 [48:46:40<36:51:35,  7.52s/it]
 54%|█████▎    | 20321/37963 [48:46:48<36:51:25,  7.52s/it]
 54%|█████▎    | 20322/37963 [48:46:55<36:53:12,  7.53s/it]
 54%|█████▎    | 20323/37963 [48:47:09<46:15:40,  9.44s/it]
 54%|█████▎    | 20324/37963 [48:47:23<53:07:59, 10.84s/it]
 54%|█████▎    | 20325/37963 [48:47:31<48:13:43,  9.84s/it]
 54%|█████▎    | 20326/37963 [48:47:38<44:25:30,  9.07s/it]
 54%|█████▎    | 20327/37963 [48:47:45<41:45:05,  8.52s/it]
 54%|█████▎    | 20328/37963 [48:47:53<40:20:15,  8.23s/it]
 54%|█████▎    | 20329/37963 [48:48:01<39:22:00,  8.04s/it]
 54%|█████▎    | 20330/37963 [48:48:08<38:43:47,  7.91s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.65', 'learning_rate': '9.337e-06', 'epoch': '0.5355'}

 54%|█████▎    | 20330/37963 [48:48:08<38:43:47,  7.91s/it]
 54%|█████▎    | 20331/37963 [48:48:22<47:27:10,  9.69s/it]
 54%|█████▎    | 20332/37963 [48:48:30<44:16:27,  9.04s/it]
 54%|█████▎    | 20333/37963 [48:48:37<41:55:25,  8.56s/it]
 54%|█████▎    | 20334/37963 [48:48:45<40:35:57,  8.29s/it]
 54%|█████▎    | 20335/37963 [48:48:52<39:12:19,  8.01s/it]
 54%|█████▎    | 20336/37963 [48:49:00<38:32:49,  7.87s/it]
 54%|█████▎    | 20337/37963 [48:49:07<38:05:04,  7.78s/it]
 54%|█████▎    | 20338/37963 [48:49:14<37:22:46,  7.64s/it]
 54%|█████▎    | 20339/37963 [48:49:22<37:08:21,  7.59s/it]
 54%|█████▎    | 20340/37963 [48:49:36<46:45:16,  9.55s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '0.6159', 'learning_rate': '9.328e-06', 'epoch': '0.5358'}

 54%|█████▎    | 20340/37963 [48:49:36<46:45:16,  9.55s/it]
 54%|█████▎    | 20341/37963 [48:49:43<43:41:07,  8.92s/it]
 54%|█████▎    | 20342/37963 [48:49:58<51:26:08, 10.51s/it]
 54%|█████▎    | 20343/37963 [48:50:12<56:52:45, 11.62s/it]
 54%|█████▎    | 20344/37963 [48:50:19<50:49:03, 10.38s/it]
 54%|█████▎    | 20345/37963 [48:50:27<46:35:22,  9.52s/it]
 54%|█████▎    | 20346/37963 [48:50:35<43:55:08,  8.97s/it]
 54%|█████▎    | 20347/37963 [48:50:49<51:28:04, 10.52s/it]
 54%|█████▎    | 20348/37963 [48:51:03<56:26:24, 11.53s/it]
 54%|█████▎    | 20349/37963 [48:51:10<50:54:34, 10.41s/it]
 54%|█████▎    | 20350/37963 [48:51:18<46:39:39,  9.54s/it]
                                                           
{'loss': '0.1596', 'grad_norm': '0.9772', 'learning_rate': '9.32e-06', 'epoch': '0.5361'}

 54%|█████▎    | 20350/37963 [48:51:18<46:39:39,  9.54s/it]
 54%|█████▎    | 20351/37963 [48:51:25<43:44:54,  8.94s/it]
 54%|█████▎    | 20352/37963 [48:51:33<41:28:02,  8.48s/it]
 54%|█████▎    | 20353/37963 [48:51:40<40:09:50,  8.21s/it]
 54%|█████▎    | 20354/37963 [48:51:48<39:11:30,  8.01s/it]
 54%|█████▎    | 20355/37963 [48:51:56<38:39:41,  7.90s/it]
 54%|█████▎    | 20356/37963 [48:52:03<38:25:35,  7.86s/it]
 54%|█████▎    | 20357/37963 [48:52:11<37:49:20,  7.73s/it]
 54%|█████▎    | 20358/37963 [48:52:18<37:27:59,  7.66s/it]
 54%|█████▎    | 20359/37963 [48:52:26<37:18:12,  7.63s/it]
 54%|█████▎    | 20360/37963 [48:52:34<37:24:24,  7.65s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '5.025', 'learning_rate': '9.311e-06', 'epoch': '0.5363'}

 54%|█████▎    | 20360/37963 [48:52:34<37:24:24,  7.65s/it]
 54%|█████▎    | 20361/37963 [48:52:41<37:08:24,  7.60s/it]
 54%|█████▎    | 20362/37963 [48:52:48<36:49:39,  7.53s/it]
 54%|█████▎    | 20363/37963 [48:52:56<36:51:36,  7.54s/it]
 54%|█████▎    | 20364/37963 [48:53:04<36:55:24,  7.55s/it]
 54%|█████▎    | 20365/37963 [48:53:11<36:51:37,  7.54s/it]
 54%|█████▎    | 20366/37963 [48:53:18<36:26:58,  7.46s/it]
 54%|█████▎    | 20367/37963 [48:53:26<36:22:50,  7.44s/it]
 54%|█████▎    | 20368/37963 [48:53:33<36:28:03,  7.46s/it]
 54%|█████▎    | 20369/37963 [48:53:41<36:39:07,  7.50s/it]
 54%|█████▎    | 20370/37963 [48:53:48<36:39:59,  7.50s/it]
                                                           
{'loss': '0.1427', 'grad_norm': '2.583', 'learning_rate': '9.303e-06', 'epoch': '0.5366'}

 54%|█████▎    | 20370/37963 [48:53:48<36:39:59,  7.50s/it]
 54%|█████▎    | 20371/37963 [48:54:09<56:11:17, 11.50s/it]
 54%|█████▎    | 20372/37963 [48:54:17<50:43:12, 10.38s/it]
 54%|█████▎    | 20373/37963 [48:54:25<46:34:11,  9.53s/it]
 54%|█████▎    | 20374/37963 [48:54:32<43:42:09,  8.94s/it]
 54%|█████▎    | 20375/37963 [48:54:40<41:44:55,  8.55s/it]
 54%|█████▎    | 20376/37963 [48:54:47<40:25:42,  8.28s/it]
 54%|█████▎    | 20377/37963 [48:55:01<48:54:01, 10.01s/it]
 54%|█████▎    | 20378/37963 [48:55:09<45:42:06,  9.36s/it]
 54%|█████▎    | 20379/37963 [48:55:17<43:19:41,  8.87s/it]
 54%|█████▎    | 20380/37963 [48:55:24<41:17:06,  8.45s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '1.684', 'learning_rate': '9.294e-06', 'epoch': '0.5368'}

 54%|█████▎    | 20380/37963 [48:55:24<41:17:06,  8.45s/it]
 54%|█████▎    | 20381/37963 [48:55:32<39:35:05,  8.11s/it]
 54%|█████▎    | 20382/37963 [48:55:39<38:17:35,  7.84s/it]
 54%|█████▎    | 20383/37963 [48:55:47<37:51:56,  7.75s/it]
 54%|█████▎    | 20384/37963 [48:55:54<37:34:57,  7.70s/it]
 54%|█████▎    | 20385/37963 [48:56:02<37:15:05,  7.63s/it]
 54%|█████▎    | 20386/37963 [48:56:09<37:08:03,  7.61s/it]
 54%|█████▎    | 20387/37963 [48:56:23<46:36:54,  9.55s/it]
 54%|█████▎    | 20388/37963 [48:56:37<52:56:04, 10.84s/it]
 54%|█████▎    | 20389/37963 [48:56:45<48:25:30,  9.92s/it]
 54%|█████▎    | 20390/37963 [48:56:53<45:08:48,  9.25s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '1.737', 'learning_rate': '9.286e-06', 'epoch': '0.5371'}

 54%|█████▎    | 20390/37963 [48:56:53<45:08:48,  9.25s/it]
 54%|█████▎    | 20391/37963 [48:57:00<42:45:47,  8.76s/it]
 54%|█████▎    | 20392/37963 [48:57:08<40:54:41,  8.38s/it]
 54%|█████▎    | 20393/37963 [48:57:22<49:21:25, 10.11s/it]
 54%|█████▎    | 20394/37963 [48:57:29<45:36:45,  9.35s/it]
 54%|█████▎    | 20395/37963 [48:57:37<42:58:15,  8.81s/it]
 54%|█████▎    | 20396/37963 [48:57:45<41:19:22,  8.47s/it]
 54%|█████▎    | 20397/37963 [48:57:58<49:07:50, 10.07s/it]
 54%|█████▎    | 20398/37963 [48:58:06<45:46:50,  9.38s/it]
 54%|█████▎    | 20399/37963 [48:58:14<43:05:17,  8.83s/it]
 54%|█████▎    | 20400/37963 [48:58:21<41:00:13,  8.40s/it]
                                                           
{'loss': '0.1514', 'grad_norm': '1.387', 'learning_rate': '9.277e-06', 'epoch': '0.5374'}

 54%|█████▎    | 20400/37963 [48:58:21<41:00:13,  8.40s/it]
 54%|█████▎    | 20401/37963 [48:58:35<48:59:04, 10.04s/it]
 54%|█████▎    | 20402/37963 [48:58:43<45:34:50,  9.34s/it]
 54%|█████▎    | 20403/37963 [48:58:50<42:59:46,  8.81s/it]
 54%|█████▎    | 20404/37963 [48:58:58<41:35:38,  8.53s/it]
 54%|█████▎    | 20405/37963 [48:59:06<40:10:04,  8.24s/it]
 54%|█████▍    | 20406/37963 [48:59:13<38:59:06,  7.99s/it]
 54%|█████▍    | 20407/37963 [48:59:21<38:11:10,  7.83s/it]
 54%|█████▍    | 20408/37963 [48:59:28<37:41:28,  7.73s/it]
 54%|█████▍    | 20409/37963 [48:59:36<37:32:06,  7.70s/it]
 54%|█████▍    | 20410/37963 [48:59:43<36:53:06,  7.56s/it]
                                                           
{'loss': '0.1423', 'grad_norm': '0.8208', 'learning_rate': '9.269e-06', 'epoch': '0.5376'}

 54%|█████▍    | 20410/37963 [48:59:43<36:53:06,  7.56s/it]
 54%|█████▍    | 20411/37963 [48:59:51<36:55:18,  7.57s/it]
 54%|█████▍    | 20412/37963 [48:59:58<36:50:54,  7.56s/it]
 54%|█████▍    | 20413/37963 [49:00:06<36:49:57,  7.56s/it]
 54%|█████▍    | 20414/37963 [49:00:13<36:47:42,  7.55s/it]
 54%|█████▍    | 20415/37963 [49:00:20<36:31:35,  7.49s/it]
 54%|█████▍    | 20416/37963 [49:00:28<36:32:20,  7.50s/it]
 54%|█████▍    | 20417/37963 [49:00:35<36:31:34,  7.49s/it]
 54%|█████▍    | 20418/37963 [49:00:50<46:09:23,  9.47s/it]
 54%|█████▍    | 20419/37963 [49:00:57<43:03:21,  8.83s/it]
 54%|█████▍    | 20420/37963 [49:01:04<40:54:19,  8.39s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.811', 'learning_rate': '9.26e-06', 'epoch': '0.5379'}

 54%|█████▍    | 20420/37963 [49:01:04<40:54:19,  8.39s/it]
 54%|█████▍    | 20421/37963 [49:01:18<49:21:13, 10.13s/it]
 54%|█████▍    | 20422/37963 [49:01:26<45:39:14,  9.37s/it]
 54%|█████▍    | 20423/37963 [49:01:41<53:16:16, 10.93s/it]
 54%|█████▍    | 20424/37963 [49:01:48<48:29:27,  9.95s/it]
 54%|█████▍    | 20425/37963 [49:01:56<45:01:31,  9.24s/it]
 54%|█████▍    | 20426/37963 [49:02:04<42:41:00,  8.76s/it]
 54%|█████▍    | 20427/37963 [49:02:11<41:02:55,  8.43s/it]
 54%|█████▍    | 20428/37963 [49:02:19<39:44:54,  8.16s/it]
 54%|█████▍    | 20429/37963 [49:02:26<38:54:08,  7.99s/it]
 54%|█████▍    | 20430/37963 [49:02:34<38:16:28,  7.86s/it]
                                                           
{'loss': '0.1525', 'grad_norm': '2.375', 'learning_rate': '9.252e-06', 'epoch': '0.5382'}

 54%|█████▍    | 20430/37963 [49:02:34<38:16:28,  7.86s/it]
 54%|█████▍    | 20431/37963 [49:02:48<47:18:23,  9.71s/it]
 54%|█████▍    | 20432/37963 [49:02:56<44:18:10,  9.10s/it]
 54%|█████▍    | 20433/37963 [49:03:03<42:07:08,  8.65s/it]
 54%|█████▍    | 20434/37963 [49:03:11<40:33:28,  8.33s/it]
 54%|█████▍    | 20435/37963 [49:03:18<38:42:38,  7.95s/it]
 54%|█████▍    | 20436/37963 [49:03:32<47:47:20,  9.82s/it]
 54%|█████▍    | 20437/37963 [49:03:40<44:37:15,  9.17s/it]
 54%|█████▍    | 20438/37963 [49:03:47<42:31:14,  8.73s/it]
 54%|█████▍    | 20439/37963 [49:03:55<40:49:32,  8.39s/it]
 54%|█████▍    | 20440/37963 [49:04:02<39:18:40,  8.08s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '2.243', 'learning_rate': '9.243e-06', 'epoch': '0.5384'}

 54%|█████▍    | 20440/37963 [49:04:02<39:18:40,  8.08s/it]
 54%|█████▍    | 20441/37963 [49:04:10<38:29:00,  7.91s/it]
 54%|█████▍    | 20442/37963 [49:04:17<37:55:17,  7.79s/it]
 54%|█████▍    | 20443/37963 [49:04:25<37:45:37,  7.76s/it]
 54%|█████▍    | 20444/37963 [49:04:39<47:06:54,  9.68s/it]
 54%|█████▍    | 20445/37963 [49:04:54<53:59:07, 11.09s/it]
 54%|█████▍    | 20446/37963 [49:05:01<48:59:11, 10.07s/it]
 54%|█████▍    | 20447/37963 [49:05:09<45:32:29,  9.36s/it]
 54%|█████▍    | 20448/37963 [49:05:16<42:47:57,  8.80s/it]
 54%|█████▍    | 20449/37963 [49:05:24<41:08:55,  8.46s/it]
 54%|█████▍    | 20450/37963 [49:05:32<40:03:25,  8.23s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '3.638', 'learning_rate': '9.235e-06', 'epoch': '0.5387'}

 54%|█████▍    | 20450/37963 [49:05:32<40:03:25,  8.23s/it]
 54%|█████▍    | 20451/37963 [49:05:39<38:34:49,  7.93s/it]
 54%|█████▍    | 20452/37963 [49:05:47<37:57:50,  7.80s/it]
 54%|█████▍    | 20453/37963 [49:05:54<37:47:55,  7.77s/it]
 54%|█████▍    | 20454/37963 [49:06:02<37:42:26,  7.75s/it]
 54%|█████▍    | 20455/37963 [49:06:16<46:41:34,  9.60s/it]
 54%|█████▍    | 20456/37963 [49:06:23<43:45:47,  9.00s/it]
 54%|█████▍    | 20457/37963 [49:06:31<41:44:03,  8.58s/it]
 54%|█████▍    | 20458/37963 [49:06:38<40:00:23,  8.23s/it]
 54%|█████▍    | 20459/37963 [49:06:46<39:03:18,  8.03s/it]
 54%|█████▍    | 20460/37963 [49:06:53<37:59:43,  7.81s/it]
                                                           
{'loss': '0.1509', 'grad_norm': '2.322', 'learning_rate': '9.226e-06', 'epoch': '0.5389'}

 54%|█████▍    | 20460/37963 [49:06:53<37:59:43,  7.81s/it]
 54%|█████▍    | 20461/37963 [49:07:01<37:41:46,  7.75s/it]
 54%|█████▍    | 20462/37963 [49:07:09<37:27:44,  7.71s/it]
 54%|█████▍    | 20463/37963 [49:07:16<37:20:54,  7.68s/it]
 54%|█████▍    | 20464/37963 [49:07:23<36:41:49,  7.55s/it]
 54%|█████▍    | 20465/37963 [49:07:31<36:38:00,  7.54s/it]
 54%|█████▍    | 20466/37963 [49:07:45<46:43:40,  9.61s/it]
 54%|█████▍    | 20467/37963 [49:07:53<43:46:53,  9.01s/it]
 54%|█████▍    | 20468/37963 [49:08:07<51:12:52, 10.54s/it]
 54%|█████▍    | 20469/37963 [49:08:15<46:41:39,  9.61s/it]
 54%|█████▍    | 20470/37963 [49:08:29<53:12:52, 10.95s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '1.158', 'learning_rate': '9.218e-06', 'epoch': '0.5392'}

 54%|█████▍    | 20470/37963 [49:08:29<53:12:52, 10.95s/it]
 54%|█████▍    | 20471/37963 [49:08:36<48:01:03,  9.88s/it]
 54%|█████▍    | 20472/37963 [49:08:43<44:29:56,  9.16s/it]
 54%|█████▍    | 20473/37963 [49:08:51<41:56:38,  8.63s/it]
 54%|█████▍    | 20474/37963 [49:08:59<40:29:08,  8.33s/it]
 54%|█████▍    | 20475/37963 [49:09:06<39:26:39,  8.12s/it]
 54%|█████▍    | 20476/37963 [49:09:14<38:42:33,  7.97s/it]
 54%|█████▍    | 20477/37963 [49:09:21<38:07:05,  7.85s/it]
 54%|█████▍    | 20478/37963 [49:09:29<37:40:54,  7.76s/it]
 54%|█████▍    | 20479/37963 [49:09:36<37:30:17,  7.72s/it]
 54%|█████▍    | 20480/37963 [49:09:44<37:14:27,  7.67s/it]
                                                           
{'loss': '0.1418', 'grad_norm': '0.9022', 'learning_rate': '9.209e-06', 'epoch': '0.5395'}

 54%|█████▍    | 20480/37963 [49:09:44<37:14:27,  7.67s/it]
 54%|█████▍    | 20481/37963 [49:09:58<46:21:27,  9.55s/it]
 54%|█████▍    | 20482/37963 [49:10:05<43:18:40,  8.92s/it]
 54%|█████▍    | 20483/37963 [49:10:13<41:43:23,  8.59s/it]
 54%|█████▍    | 20484/37963 [49:10:21<39:55:47,  8.22s/it]
 54%|█████▍    | 20485/37963 [49:10:34<47:49:54,  9.85s/it]
 54%|█████▍    | 20486/37963 [49:10:42<44:33:46,  9.18s/it]
 54%|█████▍    | 20487/37963 [49:10:50<42:25:30,  8.74s/it]
 54%|█████▍    | 20488/37963 [49:10:57<40:43:04,  8.39s/it]
 54%|█████▍    | 20489/37963 [49:11:05<39:20:33,  8.11s/it]
 54%|█████▍    | 20490/37963 [49:11:12<38:45:55,  7.99s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '0.8355', 'learning_rate': '9.201e-06', 'epoch': '0.5397'}

 54%|█████▍    | 20490/37963 [49:11:12<38:45:55,  7.99s/it]
 54%|█████▍    | 20491/37963 [49:11:20<38:09:38,  7.86s/it]
 54%|█████▍    | 20492/37963 [49:11:27<37:18:08,  7.69s/it]
 54%|█████▍    | 20493/37963 [49:11:35<37:06:34,  7.65s/it]
 54%|█████▍    | 20494/37963 [49:11:49<46:34:52,  9.60s/it]
 54%|█████▍    | 20495/37963 [49:11:57<43:54:17,  9.05s/it]
 54%|█████▍    | 20496/37963 [49:12:04<41:42:05,  8.59s/it]
 54%|█████▍    | 20497/37963 [49:12:12<40:14:24,  8.29s/it]
 54%|█████▍    | 20498/37963 [49:12:19<39:08:57,  8.07s/it]
 54%|█████▍    | 20499/37963 [49:12:34<48:14:43,  9.95s/it]
 54%|█████▍    | 20500/37963 [49:12:41<44:24:13,  9.15s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.602', 'learning_rate': '9.192e-06', 'epoch': '0.54'}

 54%|█████▍    | 20500/37963 [49:12:41<44:24:13,  9.15s/it]
 54%|█████▍    | 20501/37963 [49:12:55<51:18:38, 10.58s/it]
 54%|█████▍    | 20502/37963 [49:13:02<46:46:43,  9.64s/it]
 54%|█████▍    | 20503/37963 [49:13:10<43:44:39,  9.02s/it]
 54%|█████▍    | 20504/37963 [49:13:17<41:20:11,  8.52s/it]
 54%|█████▍    | 20505/37963 [49:13:24<39:29:13,  8.14s/it]
 54%|█████▍    | 20506/37963 [49:13:32<38:52:36,  8.02s/it]
 54%|█████▍    | 20507/37963 [49:13:40<38:16:08,  7.89s/it]
 54%|█████▍    | 20508/37963 [49:13:47<37:49:15,  7.80s/it]
 54%|█████▍    | 20509/37963 [49:13:55<37:22:27,  7.71s/it]
 54%|█████▍    | 20510/37963 [49:14:02<36:47:22,  7.59s/it]
                                                           
{'loss': '0.1549', 'grad_norm': '4.43', 'learning_rate': '9.184e-06', 'epoch': '0.5403'}

 54%|█████▍    | 20510/37963 [49:14:02<36:47:22,  7.59s/it]
 54%|█████▍    | 20511/37963 [49:14:10<36:47:25,  7.59s/it]
 54%|█████▍    | 20512/37963 [49:14:17<36:21:18,  7.50s/it]
 54%|█████▍    | 20513/37963 [49:14:25<36:16:29,  7.48s/it]
 54%|█████▍    | 20514/37963 [49:14:32<36:22:15,  7.50s/it]
 54%|█████▍    | 20515/37963 [49:14:46<45:54:27,  9.47s/it]
 54%|█████▍    | 20516/37963 [49:15:00<52:29:17, 10.83s/it]
 54%|█████▍    | 20517/37963 [49:15:08<47:31:23,  9.81s/it]
 54%|█████▍    | 20518/37963 [49:15:15<44:22:55,  9.16s/it]
 54%|█████▍    | 20519/37963 [49:15:23<42:01:30,  8.67s/it]
 54%|█████▍    | 20520/37963 [49:15:30<40:04:49,  8.27s/it]
                                                           
{'loss': '0.1516', 'grad_norm': '1.56', 'learning_rate': '9.175e-06', 'epoch': '0.5405'}

 54%|█████▍    | 20520/37963 [49:15:30<40:04:49,  8.27s/it]
 54%|█████▍    | 20521/37963 [49:15:38<38:55:30,  8.03s/it]
 54%|█████▍    | 20522/37963 [49:15:51<47:02:43,  9.71s/it]
 54%|█████▍    | 20523/37963 [49:15:59<44:11:45,  9.12s/it]
 54%|█████▍    | 20524/37963 [49:16:07<41:58:00,  8.66s/it]
 54%|█████▍    | 20525/37963 [49:16:14<40:28:36,  8.36s/it]
 54%|█████▍    | 20526/37963 [49:16:22<39:25:41,  8.14s/it]
 54%|█████▍    | 20527/37963 [49:16:29<38:25:23,  7.93s/it]
 54%|█████▍    | 20528/37963 [49:16:37<38:04:32,  7.86s/it]
 54%|█████▍    | 20529/37963 [49:16:44<37:28:08,  7.74s/it]
 54%|█████▍    | 20530/37963 [49:16:52<37:12:01,  7.68s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '2.153', 'learning_rate': '9.167e-06', 'epoch': '0.5408'}

 54%|█████▍    | 20530/37963 [49:16:52<37:12:01,  7.68s/it]
 54%|█████▍    | 20531/37963 [49:16:59<36:36:32,  7.56s/it]
 54%|█████▍    | 20532/37963 [49:17:13<46:13:05,  9.55s/it]
 54%|█████▍    | 20533/37963 [49:17:21<43:01:02,  8.88s/it]
 54%|█████▍    | 20534/37963 [49:17:34<49:52:24, 10.30s/it]
 54%|█████▍    | 20535/37963 [49:17:42<45:46:16,  9.45s/it]
 54%|█████▍    | 20536/37963 [49:17:49<43:01:03,  8.89s/it]
 54%|█████▍    | 20537/37963 [49:17:57<41:07:14,  8.50s/it]
 54%|█████▍    | 20538/37963 [49:18:05<40:00:35,  8.27s/it]
 54%|█████▍    | 20539/37963 [49:18:12<39:02:11,  8.07s/it]
 54%|█████▍    | 20540/37963 [49:18:20<38:22:17,  7.93s/it]
                                                           
{'loss': '0.15', 'grad_norm': '2.584', 'learning_rate': '9.158e-06', 'epoch': '0.5411'}

 54%|█████▍    | 20540/37963 [49:18:20<38:22:17,  7.93s/it]
 54%|█████▍    | 20541/37963 [49:18:34<47:14:08,  9.76s/it]
 54%|█████▍    | 20542/37963 [49:18:42<44:01:41,  9.10s/it]
 54%|█████▍    | 20543/37963 [49:18:49<41:39:36,  8.61s/it]
 54%|█████▍    | 20544/37963 [49:19:03<49:36:04, 10.25s/it]
 54%|█████▍    | 20545/37963 [49:19:11<45:51:42,  9.48s/it]
 54%|█████▍    | 20546/37963 [49:19:18<42:57:59,  8.88s/it]
 54%|█████▍    | 20547/37963 [49:19:26<41:11:18,  8.51s/it]
 54%|█████▍    | 20548/37963 [49:19:33<39:42:36,  8.21s/it]
 54%|█████▍    | 20549/37963 [49:19:41<38:42:33,  8.00s/it]
 54%|█████▍    | 20550/37963 [49:19:48<37:49:33,  7.82s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.938', 'learning_rate': '9.15e-06', 'epoch': '0.5413'}

 54%|█████▍    | 20550/37963 [49:19:48<37:49:33,  7.82s/it]
 54%|█████▍    | 20551/37963 [49:19:56<37:25:59,  7.74s/it]
 54%|█████▍    | 20552/37963 [49:20:10<46:32:45,  9.62s/it]
 54%|█████▍    | 20553/37963 [49:20:18<43:51:28,  9.07s/it]
 54%|█████▍    | 20554/37963 [49:20:25<41:30:08,  8.58s/it]
 54%|█████▍    | 20555/37963 [49:20:33<40:08:09,  8.30s/it]
 54%|█████▍    | 20556/37963 [49:20:40<38:59:18,  8.06s/it]
 54%|█████▍    | 20557/37963 [49:20:48<38:03:50,  7.87s/it]
 54%|█████▍    | 20558/37963 [49:20:55<37:30:59,  7.76s/it]
 54%|█████▍    | 20559/37963 [49:21:03<37:31:02,  7.76s/it]
 54%|█████▍    | 20560/37963 [49:21:10<37:06:20,  7.68s/it]
                                                           
{'loss': '0.1471', 'grad_norm': '1.255', 'learning_rate': '9.141e-06', 'epoch': '0.5416'}

 54%|█████▍    | 20560/37963 [49:21:10<37:06:20,  7.68s/it]
 54%|█████▍    | 20561/37963 [49:21:18<36:56:00,  7.64s/it]
 54%|█████▍    | 20562/37963 [49:21:26<36:53:02,  7.63s/it]
 54%|█████▍    | 20563/37963 [49:21:33<36:19:58,  7.52s/it]
 54%|█████▍    | 20564/37963 [49:21:40<36:31:31,  7.56s/it]
 54%|█████▍    | 20565/37963 [49:21:54<45:54:05,  9.50s/it]
 54%|█████▍    | 20566/37963 [49:22:02<43:02:52,  8.91s/it]
 54%|█████▍    | 20567/37963 [49:22:09<40:28:20,  8.38s/it]
 54%|█████▍    | 20568/37963 [49:22:23<48:31:47, 10.04s/it]
 54%|█████▍    | 20569/37963 [49:22:31<44:55:52,  9.30s/it]
 54%|█████▍    | 20570/37963 [49:22:38<42:28:37,  8.79s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '1.966', 'learning_rate': '9.133e-06', 'epoch': '0.5418'}

 54%|█████▍    | 20570/37963 [49:22:38<42:28:37,  8.79s/it]
 54%|█████▍    | 20571/37963 [49:22:52<50:20:15, 10.42s/it]
 54%|█████▍    | 20572/37963 [49:23:00<46:09:06,  9.55s/it]
 54%|█████▍    | 20573/37963 [49:23:08<43:17:29,  8.96s/it]
 54%|█████▍    | 20574/37963 [49:23:15<41:11:25,  8.53s/it]
 54%|█████▍    | 20575/37963 [49:23:23<40:04:57,  8.30s/it]
 54%|█████▍    | 20576/37963 [49:23:31<39:08:23,  8.10s/it]
 54%|█████▍    | 20577/37963 [49:23:38<37:59:22,  7.87s/it]
 54%|█████▍    | 20578/37963 [49:23:45<37:24:08,  7.75s/it]
 54%|█████▍    | 20579/37963 [49:24:00<46:47:27,  9.69s/it]
 54%|█████▍    | 20580/37963 [49:24:07<43:47:33,  9.07s/it]
                                                           
{'loss': '0.1431', 'grad_norm': '2.68', 'learning_rate': '9.124e-06', 'epoch': '0.5421'}

 54%|█████▍    | 20580/37963 [49:24:07<43:47:33,  9.07s/it]
 54%|█████▍    | 20581/37963 [49:24:15<41:20:40,  8.56s/it]
 54%|█████▍    | 20582/37963 [49:24:28<48:31:37, 10.05s/it]
 54%|█████▍    | 20583/37963 [49:24:36<44:54:23,  9.30s/it]
 54%|█████▍    | 20584/37963 [49:24:43<42:24:33,  8.78s/it]
 54%|█████▍    | 20585/37963 [49:24:51<40:33:59,  8.40s/it]
 54%|█████▍    | 20586/37963 [49:24:58<39:25:35,  8.17s/it]
 54%|█████▍    | 20587/37963 [49:25:06<38:27:33,  7.97s/it]
 54%|█████▍    | 20588/37963 [49:25:20<47:19:27,  9.81s/it]
 54%|█████▍    | 20589/37963 [49:25:27<43:57:35,  9.11s/it]
 54%|█████▍    | 20590/37963 [49:25:35<41:27:18,  8.59s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.058', 'learning_rate': '9.116e-06', 'epoch': '0.5424'}

 54%|█████▍    | 20590/37963 [49:25:35<41:27:18,  8.59s/it]
 54%|█████▍    | 20591/37963 [49:25:42<39:55:57,  8.28s/it]
 54%|█████▍    | 20592/37963 [49:25:50<38:36:26,  8.00s/it]
 54%|█████▍    | 20593/37963 [49:26:04<47:11:45,  9.78s/it]
 54%|█████▍    | 20594/37963 [49:26:11<43:59:37,  9.12s/it]
 54%|█████▍    | 20595/37963 [49:26:19<41:46:01,  8.66s/it]
 54%|█████▍    | 20596/37963 [49:26:26<39:59:05,  8.29s/it]
 54%|█████▍    | 20597/37963 [49:26:34<38:40:11,  8.02s/it]
 54%|█████▍    | 20598/37963 [49:26:41<38:05:55,  7.90s/it]
 54%|█████▍    | 20599/37963 [49:26:49<37:22:47,  7.75s/it]
 54%|█████▍    | 20600/37963 [49:26:56<37:01:59,  7.68s/it]
                                                           
{'loss': '0.1478', 'grad_norm': '1.238', 'learning_rate': '9.107e-06', 'epoch': '0.5426'}

 54%|█████▍    | 20600/37963 [49:26:56<37:01:59,  7.68s/it]
 54%|█████▍    | 20601/37963 [49:27:04<36:52:24,  7.65s/it]
 54%|█████▍    | 20602/37963 [49:27:18<46:15:21,  9.59s/it]
 54%|█████▍    | 20603/37963 [49:27:25<43:27:14,  9.01s/it]
 54%|█████▍    | 20604/37963 [49:27:33<41:16:28,  8.56s/it]
 54%|█████▍    | 20605/37963 [49:27:40<39:37:27,  8.22s/it]
 54%|█████▍    | 20606/37963 [49:27:48<38:35:35,  8.00s/it]
 54%|█████▍    | 20607/37963 [49:27:55<37:50:43,  7.85s/it]
 54%|█████▍    | 20608/37963 [49:28:03<37:00:46,  7.68s/it]
 54%|█████▍    | 20609/37963 [49:28:10<36:57:36,  7.67s/it]
 54%|█████▍    | 20610/37963 [49:28:18<36:43:40,  7.62s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.958', 'learning_rate': '9.099e-06', 'epoch': '0.5429'}

 54%|█████▍    | 20610/37963 [49:28:18<36:43:40,  7.62s/it]
 54%|█████▍    | 20611/37963 [49:28:25<36:34:00,  7.59s/it]
 54%|█████▍    | 20612/37963 [49:28:33<36:31:58,  7.58s/it]
 54%|█████▍    | 20613/37963 [49:28:40<36:26:13,  7.56s/it]
 54%|█████▍    | 20614/37963 [49:28:55<46:13:07,  9.59s/it]
 54%|█████▍    | 20615/37963 [49:29:08<52:00:23, 10.79s/it]
 54%|█████▍    | 20616/37963 [49:29:16<47:23:45,  9.84s/it]
 54%|█████▍    | 20617/37963 [49:29:23<44:03:05,  9.14s/it]
 54%|█████▍    | 20618/37963 [49:29:31<41:42:17,  8.66s/it]
 54%|█████▍    | 20619/37963 [49:29:39<40:13:25,  8.35s/it]
 54%|█████▍    | 20620/37963 [49:29:46<39:07:25,  8.12s/it]
                                                           
{'loss': '0.1391', 'grad_norm': '2.281', 'learning_rate': '9.09e-06', 'epoch': '0.5432'}

 54%|█████▍    | 20620/37963 [49:29:46<39:07:25,  8.12s/it]
 54%|█████▍    | 20621/37963 [49:30:00<47:23:05,  9.84s/it]
 54%|█████▍    | 20622/37963 [49:30:07<43:43:12,  9.08s/it]
 54%|█████▍    | 20623/37963 [49:30:15<41:28:19,  8.61s/it]
 54%|█████▍    | 20624/37963 [49:30:29<48:56:06, 10.16s/it]
 54%|█████▍    | 20625/37963 [49:30:36<45:11:59,  9.39s/it]
 54%|█████▍    | 20626/37963 [49:30:44<42:20:26,  8.79s/it]
 54%|█████▍    | 20627/37963 [49:30:51<40:29:34,  8.41s/it]
 54%|█████▍    | 20628/37963 [49:30:59<39:16:47,  8.16s/it]
 54%|█████▍    | 20629/37963 [49:31:06<38:24:32,  7.98s/it]
 54%|█████▍    | 20630/37963 [49:31:14<37:52:13,  7.87s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '3.181', 'learning_rate': '9.082e-06', 'epoch': '0.5434'}

 54%|█████▍    | 20630/37963 [49:31:14<37:52:13,  7.87s/it]
 54%|█████▍    | 20631/37963 [49:31:21<37:16:37,  7.74s/it]
 54%|█████▍    | 20632/37963 [49:31:29<37:03:18,  7.70s/it]
 54%|█████▍    | 20633/37963 [49:31:36<36:17:49,  7.54s/it]
 54%|█████▍    | 20634/37963 [49:31:44<36:17:01,  7.54s/it]
 54%|█████▍    | 20635/37963 [49:31:57<45:24:54,  9.44s/it]
 54%|█████▍    | 20636/37963 [49:32:12<52:10:11, 10.84s/it]
 54%|█████▍    | 20637/37963 [49:32:19<47:08:30,  9.80s/it]
 54%|█████▍    | 20638/37963 [49:32:26<43:26:57,  9.03s/it]
 54%|█████▍    | 20639/37963 [49:32:34<41:20:11,  8.59s/it]
 54%|█████▍    | 20640/37963 [49:32:41<40:00:09,  8.31s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.342', 'learning_rate': '9.073e-06', 'epoch': '0.5437'}

 54%|█████▍    | 20640/37963 [49:32:41<40:00:09,  8.31s/it]
 54%|█████▍    | 20641/37963 [49:32:56<48:29:34, 10.08s/it]
 54%|█████▍    | 20642/37963 [49:33:03<44:47:52,  9.31s/it]
 54%|█████▍    | 20643/37963 [49:33:11<42:18:27,  8.79s/it]
 54%|█████▍    | 20644/37963 [49:33:18<40:24:38,  8.40s/it]
 54%|█████▍    | 20645/37963 [49:33:26<38:59:49,  8.11s/it]
 54%|█████▍    | 20646/37963 [49:33:33<38:07:12,  7.92s/it]
 54%|█████▍    | 20647/37963 [49:33:41<37:43:05,  7.84s/it]
 54%|█████▍    | 20648/37963 [49:33:48<37:18:11,  7.76s/it]
 54%|█████▍    | 20649/37963 [49:33:56<37:00:47,  7.70s/it]
 54%|█████▍    | 20650/37963 [49:34:03<36:46:20,  7.65s/it]
                                                           
{'loss': '0.1319', 'grad_norm': '1.342', 'learning_rate': '9.065e-06', 'epoch': '0.544'}

 54%|█████▍    | 20650/37963 [49:34:03<36:46:20,  7.65s/it]
 54%|█████▍    | 20651/37963 [49:34:17<45:53:00,  9.54s/it]
 54%|█████▍    | 20652/37963 [49:34:25<42:56:04,  8.93s/it]
 54%|█████▍    | 20653/37963 [49:34:32<40:55:07,  8.51s/it]
 54%|█████▍    | 20654/37963 [49:34:40<39:39:38,  8.25s/it]
 54%|█████▍    | 20655/37963 [49:34:48<38:40:35,  8.04s/it]
 54%|█████▍    | 20656/37963 [49:34:55<38:02:53,  7.91s/it]
 54%|█████▍    | 20657/37963 [49:35:03<37:06:18,  7.72s/it]
 54%|█████▍    | 20658/37963 [49:35:10<37:01:57,  7.70s/it]
 54%|█████▍    | 20659/37963 [49:35:18<36:43:23,  7.64s/it]
 54%|█████▍    | 20660/37963 [49:35:25<36:35:57,  7.61s/it]
                                                           
{'loss': '0.1547', 'grad_norm': '1.625', 'learning_rate': '9.056e-06', 'epoch': '0.5442'}

 54%|█████▍    | 20660/37963 [49:35:25<36:35:57,  7.61s/it]
 54%|█████▍    | 20661/37963 [49:35:33<36:13:20,  7.54s/it]
 54%|█████▍    | 20662/37963 [49:35:40<35:43:18,  7.43s/it]
 54%|█████▍    | 20663/37963 [49:35:47<35:48:14,  7.45s/it]
 54%|█████▍    | 20664/37963 [49:36:01<45:05:46,  9.38s/it]
 54%|█████▍    | 20665/37963 [49:36:09<42:22:23,  8.82s/it]
 54%|█████▍    | 20666/37963 [49:36:16<40:27:34,  8.42s/it]
 54%|█████▍    | 20667/37963 [49:36:24<39:08:22,  8.15s/it]
 54%|█████▍    | 20668/37963 [49:36:31<38:24:51,  8.00s/it]
 54%|█████▍    | 20669/37963 [49:36:45<47:00:24,  9.79s/it]
 54%|█████▍    | 20670/37963 [49:36:59<52:53:47, 11.01s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '3.077', 'learning_rate': '9.048e-06', 'epoch': '0.5445'}

 54%|█████▍    | 20670/37963 [49:36:59<52:53:47, 11.01s/it]
 54%|█████▍    | 20671/37963 [49:37:07<47:52:27,  9.97s/it]
 54%|█████▍    | 20672/37963 [49:37:14<44:17:00,  9.22s/it]
 54%|█████▍    | 20673/37963 [49:37:22<41:38:21,  8.67s/it]
 54%|█████▍    | 20674/37963 [49:37:29<40:03:23,  8.34s/it]
 54%|█████▍    | 20675/37963 [49:37:36<38:28:21,  8.01s/it]
 54%|█████▍    | 20676/37963 [49:37:50<46:48:18,  9.75s/it]
 54%|█████▍    | 20677/37963 [49:37:58<43:41:26,  9.10s/it]
 54%|█████▍    | 20678/37963 [49:38:05<41:36:23,  8.67s/it]
 54%|█████▍    | 20679/37963 [49:38:13<40:06:13,  8.35s/it]
 54%|█████▍    | 20680/37963 [49:38:20<38:41:37,  8.06s/it]
                                                           
{'loss': '0.1531', 'grad_norm': '0.9229', 'learning_rate': '9.039e-06', 'epoch': '0.5447'}

 54%|█████▍    | 20680/37963 [49:38:20<38:41:37,  8.06s/it]
 54%|█████▍    | 20681/37963 [49:38:28<37:53:16,  7.89s/it]
 54%|█████▍    | 20682/37963 [49:38:42<46:50:10,  9.76s/it]
 54%|█████▍    | 20683/37963 [49:38:49<43:35:39,  9.08s/it]
 54%|█████▍    | 20684/37963 [49:38:57<41:39:41,  8.68s/it]
 54%|█████▍    | 20685/37963 [49:39:05<39:46:05,  8.29s/it]
 54%|█████▍    | 20686/37963 [49:39:12<38:15:24,  7.97s/it]
 54%|█████▍    | 20687/37963 [49:39:19<37:39:36,  7.85s/it]
 54%|█████▍    | 20688/37963 [49:39:27<37:14:29,  7.76s/it]
 54%|█████▍    | 20689/37963 [49:39:34<36:54:51,  7.69s/it]
 55%|█████▍    | 20690/37963 [49:39:42<36:43:04,  7.65s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '2.293', 'learning_rate': '9.031e-06', 'epoch': '0.545'}

 55%|█████▍    | 20690/37963 [49:39:42<36:43:04,  7.65s/it]
 55%|█████▍    | 20691/37963 [49:39:49<36:21:22,  7.58s/it]
 55%|█████▍    | 20692/37963 [49:39:57<35:55:32,  7.49s/it]
 55%|█████▍    | 20693/37963 [49:40:04<35:56:27,  7.49s/it]
 55%|█████▍    | 20694/37963 [49:40:18<45:22:46,  9.46s/it]
 55%|█████▍    | 20695/37963 [49:40:33<52:21:27, 10.92s/it]
 55%|█████▍    | 20696/37963 [49:40:40<47:37:35,  9.93s/it]
 55%|█████▍    | 20697/37963 [49:40:48<43:56:12,  9.16s/it]
 55%|█████▍    | 20698/37963 [49:40:55<41:27:38,  8.65s/it]
 55%|█████▍    | 20699/37963 [49:41:03<39:50:51,  8.31s/it]
 55%|█████▍    | 20700/37963 [49:41:10<38:25:14,  8.01s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '1.246', 'learning_rate': '9.022e-06', 'epoch': '0.5453'}

 55%|█████▍    | 20700/37963 [49:41:10<38:25:14,  8.01s/it]
 55%|█████▍    | 20701/37963 [49:41:17<37:44:46,  7.87s/it]
 55%|█████▍    | 20702/37963 [49:41:25<36:45:31,  7.67s/it]
 55%|█████▍    | 20703/37963 [49:41:32<36:35:13,  7.63s/it]
 55%|█████▍    | 20704/37963 [49:41:40<36:34:39,  7.63s/it]
 55%|█████▍    | 20705/37963 [49:41:47<36:29:16,  7.61s/it]
 55%|█████▍    | 20706/37963 [49:41:55<36:30:19,  7.62s/it]
 55%|█████▍    | 20707/37963 [49:42:03<36:22:14,  7.59s/it]
 55%|█████▍    | 20708/37963 [49:42:10<36:23:20,  7.59s/it]
 55%|█████▍    | 20709/37963 [49:42:18<36:16:12,  7.57s/it]
 55%|█████▍    | 20710/37963 [49:42:25<36:15:27,  7.57s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '0.898', 'learning_rate': '9.014e-06', 'epoch': '0.5455'}

 55%|█████▍    | 20710/37963 [49:42:25<36:15:27,  7.57s/it]
 55%|█████▍    | 20711/37963 [49:42:33<36:09:41,  7.55s/it]
 55%|█████▍    | 20712/37963 [49:42:46<44:46:11,  9.34s/it]
 55%|█████▍    | 20713/37963 [49:42:54<42:10:18,  8.80s/it]
 55%|█████▍    | 20714/37963 [49:43:01<40:23:10,  8.43s/it]
 55%|█████▍    | 20715/37963 [49:43:09<38:44:39,  8.09s/it]
 55%|█████▍    | 20716/37963 [49:43:16<37:52:59,  7.91s/it]
 55%|█████▍    | 20717/37963 [49:43:24<37:26:29,  7.82s/it]
 55%|█████▍    | 20718/37963 [49:43:37<46:02:14,  9.61s/it]
 55%|█████▍    | 20719/37963 [49:43:45<42:50:03,  8.94s/it]
 55%|█████▍    | 20720/37963 [49:43:59<50:06:21, 10.46s/it]
                                                           
{'loss': '0.1436', 'grad_norm': '2.714', 'learning_rate': '9.005e-06', 'epoch': '0.5458'}

 55%|█████▍    | 20720/37963 [49:43:59<50:06:21, 10.46s/it]
 55%|█████▍    | 20721/37963 [49:44:06<45:23:32,  9.48s/it]
 55%|█████▍    | 20722/37963 [49:44:14<42:48:42,  8.94s/it]
 55%|█████▍    | 20723/37963 [49:44:21<40:36:13,  8.48s/it]
 55%|█████▍    | 20724/37963 [49:44:29<39:15:58,  8.20s/it]
 55%|█████▍    | 20725/37963 [49:44:36<38:17:27,  8.00s/it]
 55%|█████▍    | 20726/37963 [49:44:43<37:10:23,  7.76s/it]
 55%|█████▍    | 20727/37963 [49:44:51<37:08:15,  7.76s/it]
 55%|█████▍    | 20728/37963 [49:45:06<46:36:11,  9.73s/it]
 55%|█████▍    | 20729/37963 [49:45:13<43:09:58,  9.02s/it]
 55%|█████▍    | 20730/37963 [49:45:20<40:54:01,  8.54s/it]
                                                           
{'loss': '0.1439', 'grad_norm': '1.36', 'learning_rate': '8.997e-06', 'epoch': '0.5461'}

 55%|█████▍    | 20730/37963 [49:45:20<40:54:01,  8.54s/it]
 55%|█████▍    | 20731/37963 [49:45:40<57:36:21, 12.03s/it]
 55%|█████▍    | 20732/37963 [49:45:48<51:06:54, 10.68s/it]
 55%|█████▍    | 20733/37963 [49:45:56<46:32:31,  9.72s/it]
 55%|█████▍    | 20734/37963 [49:46:03<43:18:44,  9.05s/it]
 55%|█████▍    | 20735/37963 [49:46:11<41:17:51,  8.63s/it]
 55%|█████▍    | 20736/37963 [49:46:18<39:24:51,  8.24s/it]
 55%|█████▍    | 20737/37963 [49:46:26<38:28:57,  8.04s/it]
 55%|█████▍    | 20738/37963 [49:46:40<47:06:04,  9.84s/it]
 55%|█████▍    | 20739/37963 [49:46:47<43:40:39,  9.13s/it]
 55%|█████▍    | 20740/37963 [49:46:54<40:58:57,  8.57s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.691', 'learning_rate': '8.988e-06', 'epoch': '0.5463'}

 55%|█████▍    | 20740/37963 [49:46:54<40:58:57,  8.57s/it]
 55%|█████▍    | 20741/37963 [49:47:02<39:33:14,  8.27s/it]
 55%|█████▍    | 20742/37963 [49:47:09<38:26:53,  8.04s/it]
 55%|█████▍    | 20743/37963 [49:47:17<37:43:19,  7.89s/it]
 55%|█████▍    | 20744/37963 [49:47:31<46:59:41,  9.83s/it]
 55%|█████▍    | 20745/37963 [49:47:39<43:41:30,  9.14s/it]
 55%|█████▍    | 20746/37963 [49:47:46<41:18:20,  8.64s/it]
 55%|█████▍    | 20747/37963 [49:47:54<40:04:49,  8.38s/it]
 55%|█████▍    | 20748/37963 [49:48:01<38:22:12,  8.02s/it]
 55%|█████▍    | 20749/37963 [49:48:09<37:42:16,  7.89s/it]
 55%|█████▍    | 20750/37963 [49:48:16<37:18:12,  7.80s/it]
                                                           
{'loss': '0.156', 'grad_norm': '1.716', 'learning_rate': '8.98e-06', 'epoch': '0.5466'}

 55%|█████▍    | 20750/37963 [49:48:16<37:18:12,  7.80s/it]
 55%|█████▍    | 20751/37963 [49:48:24<36:51:40,  7.71s/it]
 55%|█████▍    | 20752/37963 [49:48:31<36:32:18,  7.64s/it]
 55%|█████▍    | 20753/37963 [49:48:39<36:12:59,  7.58s/it]
 55%|█████▍    | 20754/37963 [49:48:46<36:15:12,  7.58s/it]
 55%|█████▍    | 20755/37963 [49:48:54<36:04:48,  7.55s/it]
 55%|█████▍    | 20756/37963 [49:49:01<36:11:21,  7.57s/it]
 55%|█████▍    | 20757/37963 [49:49:09<36:02:59,  7.54s/it]
 55%|█████▍    | 20758/37963 [49:49:16<36:00:26,  7.53s/it]
 55%|█████▍    | 20759/37963 [49:49:31<45:27:39,  9.51s/it]
 55%|█████▍    | 20760/37963 [49:49:38<42:39:07,  8.93s/it]
                                                           
{'loss': '0.138', 'grad_norm': '3.059', 'learning_rate': '8.971e-06', 'epoch': '0.5469'}

 55%|█████▍    | 20760/37963 [49:49:38<42:39:07,  8.93s/it]
 55%|█████▍    | 20761/37963 [49:49:46<40:39:42,  8.51s/it]
 55%|█████▍    | 20762/37963 [49:49:53<39:16:00,  8.22s/it]
 55%|█████▍    | 20763/37963 [49:50:01<38:21:54,  8.03s/it]
 55%|█████▍    | 20764/37963 [49:50:08<37:38:38,  7.88s/it]
 55%|█████▍    | 20765/37963 [49:50:16<37:09:30,  7.78s/it]
 55%|█████▍    | 20766/37963 [49:50:23<36:48:25,  7.71s/it]
 55%|█████▍    | 20767/37963 [49:50:31<36:13:42,  7.58s/it]
 55%|█████▍    | 20768/37963 [49:50:44<45:01:41,  9.43s/it]
 55%|█████▍    | 20769/37963 [49:50:52<42:28:17,  8.89s/it]
 55%|█████▍    | 20770/37963 [49:51:06<49:41:15, 10.40s/it]
                                                           
{'loss': '0.1411', 'grad_norm': '1.509', 'learning_rate': '8.963e-06', 'epoch': '0.5471'}

 55%|█████▍    | 20770/37963 [49:51:06<49:41:15, 10.40s/it]
 55%|█████▍    | 20771/37963 [49:51:14<45:45:51,  9.58s/it]
 55%|█████▍    | 20772/37963 [49:51:21<42:30:51,  8.90s/it]
 55%|█████▍    | 20773/37963 [49:51:28<40:15:31,  8.43s/it]
 55%|█████▍    | 20774/37963 [49:51:36<39:01:20,  8.17s/it]
 55%|█████▍    | 20775/37963 [49:51:43<38:03:59,  7.97s/it]
 55%|█████▍    | 20776/37963 [49:51:51<37:23:01,  7.83s/it]
 55%|█████▍    | 20777/37963 [49:51:58<36:57:53,  7.74s/it]
 55%|█████▍    | 20778/37963 [49:52:12<45:49:13,  9.60s/it]
 55%|█████▍    | 20779/37963 [49:52:20<42:46:25,  8.96s/it]
 55%|█████▍    | 20780/37963 [49:52:34<50:11:26, 10.52s/it]
                                                           
{'loss': '0.1537', 'grad_norm': '1.125', 'learning_rate': '8.954e-06', 'epoch': '0.5474'}

 55%|█████▍    | 20780/37963 [49:52:34<50:11:26, 10.52s/it]
 55%|█████▍    | 20781/37963 [49:52:42<46:00:33,  9.64s/it]
 55%|█████▍    | 20782/37963 [49:52:49<42:57:26,  9.00s/it]
 55%|█████▍    | 20783/37963 [49:52:57<40:39:41,  8.52s/it]
 55%|█████▍    | 20784/37963 [49:53:11<48:36:36, 10.19s/it]
 55%|█████▍    | 20785/37963 [49:53:18<45:01:23,  9.44s/it]
 55%|█████▍    | 20786/37963 [49:53:26<42:16:14,  8.86s/it]
 55%|█████▍    | 20787/37963 [49:53:33<40:23:09,  8.46s/it]
 55%|█████▍    | 20788/37963 [49:53:41<39:06:16,  8.20s/it]
 55%|█████▍    | 20789/37963 [49:53:48<38:10:00,  8.00s/it]
 55%|█████▍    | 20790/37963 [49:53:56<37:37:05,  7.89s/it]
                                                           
{'loss': '0.1488', 'grad_norm': '1.437', 'learning_rate': '8.946e-06', 'epoch': '0.5476'}

 55%|█████▍    | 20790/37963 [49:53:56<37:37:05,  7.89s/it]
 55%|█████▍    | 20791/37963 [49:54:10<46:22:20,  9.72s/it]
 55%|█████▍    | 20792/37963 [49:54:18<43:21:47,  9.09s/it]
 55%|█████▍    | 20793/37963 [49:54:32<50:38:11, 10.62s/it]
 55%|█████▍    | 20794/37963 [49:54:40<46:26:43,  9.74s/it]
 55%|█████▍    | 20795/37963 [49:54:47<43:37:54,  9.15s/it]
 55%|█████▍    | 20796/37963 [49:54:55<41:14:24,  8.65s/it]
 55%|█████▍    | 20797/37963 [49:55:02<39:38:34,  8.31s/it]
 55%|█████▍    | 20798/37963 [49:55:10<38:31:38,  8.08s/it]
 55%|█████▍    | 20799/37963 [49:55:17<37:15:14,  7.81s/it]
 55%|█████▍    | 20800/37963 [49:55:25<36:57:41,  7.75s/it]
                                                           
{'loss': '0.1375', 'grad_norm': '3.107', 'learning_rate': '8.937e-06', 'epoch': '0.5479'}

 55%|█████▍    | 20800/37963 [49:55:25<36:57:41,  7.75s/it]
 55%|█████▍    | 20801/37963 [49:55:32<36:18:50,  7.62s/it]
 55%|█████▍    | 20802/37963 [49:55:40<36:09:11,  7.58s/it]
 55%|█████▍    | 20803/37963 [49:55:47<36:04:48,  7.57s/it]
 55%|█████▍    | 20804/37963 [49:56:01<45:30:37,  9.55s/it]
 55%|█████▍    | 20805/37963 [49:56:09<42:43:44,  8.97s/it]
 55%|█████▍    | 20806/37963 [49:56:16<40:45:22,  8.55s/it]
 55%|█████▍    | 20807/37963 [49:56:24<39:14:44,  8.24s/it]
 55%|█████▍    | 20808/37963 [49:56:31<38:18:11,  8.04s/it]
 55%|█████▍    | 20809/37963 [49:56:39<37:30:55,  7.87s/it]
 55%|█████▍    | 20810/37963 [49:56:47<37:11:15,  7.80s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.262', 'learning_rate': '8.929e-06', 'epoch': '0.5482'}

 55%|█████▍    | 20810/37963 [49:56:47<37:11:15,  7.80s/it]
 55%|█████▍    | 20811/37963 [49:56:54<37:00:01,  7.77s/it]
 55%|█████▍    | 20812/37963 [49:57:02<36:43:34,  7.71s/it]
 55%|█████▍    | 20813/37963 [49:57:10<36:39:52,  7.70s/it]
 55%|█████▍    | 20814/37963 [49:57:17<36:35:39,  7.68s/it]
 55%|█████▍    | 20815/37963 [49:57:25<36:17:52,  7.62s/it]
 55%|█████▍    | 20816/37963 [49:57:32<36:09:49,  7.59s/it]
 55%|█████▍    | 20817/37963 [49:57:40<36:19:00,  7.63s/it]
 55%|█████▍    | 20818/37963 [49:57:54<45:03:38,  9.46s/it]
 55%|█████▍    | 20819/37963 [49:58:01<42:45:44,  8.98s/it]
 55%|█████▍    | 20820/37963 [49:58:09<40:14:06,  8.45s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '1.359', 'learning_rate': '8.92e-06', 'epoch': '0.5484'}

 55%|█████▍    | 20820/37963 [49:58:09<40:14:06,  8.45s/it]
 55%|█████▍    | 20821/37963 [49:58:16<38:43:46,  8.13s/it]
 55%|█████▍    | 20822/37963 [49:58:24<37:51:07,  7.95s/it]
 55%|█████▍    | 20823/37963 [49:58:31<37:14:00,  7.82s/it]
 55%|█████▍    | 20824/37963 [49:58:39<36:48:43,  7.73s/it]
 55%|█████▍    | 20825/37963 [49:58:46<36:26:23,  7.65s/it]
 55%|█████▍    | 20826/37963 [49:59:00<45:10:39,  9.49s/it]
 55%|█████▍    | 20827/37963 [49:59:14<52:22:07, 11.00s/it]
 55%|█████▍    | 20828/37963 [49:59:22<47:27:19,  9.97s/it]
 55%|█████▍    | 20829/37963 [49:59:30<44:01:32,  9.25s/it]
 55%|█████▍    | 20830/37963 [49:59:37<41:33:34,  8.73s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '1.439', 'learning_rate': '8.912e-06', 'epoch': '0.5487'}

 55%|█████▍    | 20830/37963 [49:59:37<41:33:34,  8.73s/it]
 55%|█████▍    | 20831/37963 [49:59:44<39:32:05,  8.31s/it]
 55%|█████▍    | 20832/37963 [49:59:52<38:27:34,  8.08s/it]
 55%|█████▍    | 20833/37963 [50:00:00<37:41:28,  7.92s/it]
 55%|█████▍    | 20834/37963 [50:00:07<37:05:20,  7.79s/it]
 55%|█████▍    | 20835/37963 [50:00:21<46:00:00,  9.67s/it]
 55%|█████▍    | 20836/37963 [50:00:29<43:04:45,  9.06s/it]
 55%|█████▍    | 20837/37963 [50:00:36<40:31:12,  8.52s/it]
 55%|█████▍    | 20838/37963 [50:00:50<48:39:23, 10.23s/it]
 55%|█████▍    | 20839/37963 [50:00:58<44:58:48,  9.46s/it]
 55%|█████▍    | 20840/37963 [50:01:05<42:19:18,  8.90s/it]
                                                           
{'loss': '0.146', 'grad_norm': '1.127', 'learning_rate': '8.903e-06', 'epoch': '0.549'}

 55%|█████▍    | 20840/37963 [50:01:05<42:19:18,  8.90s/it]
 55%|█████▍    | 20841/37963 [50:01:13<40:11:21,  8.45s/it]
 55%|█████▍    | 20842/37963 [50:01:20<38:54:12,  8.18s/it]
 55%|█████▍    | 20843/37963 [50:01:28<38:04:43,  8.01s/it]
 55%|█████▍    | 20844/37963 [50:01:36<37:38:36,  7.92s/it]
 55%|█████▍    | 20845/37963 [50:01:43<37:13:37,  7.83s/it]
 55%|█████▍    | 20846/37963 [50:01:57<45:54:41,  9.66s/it]
 55%|█████▍    | 20847/37963 [50:02:05<42:57:37,  9.04s/it]
 55%|█████▍    | 20848/37963 [50:02:12<40:51:26,  8.59s/it]
 55%|█████▍    | 20849/37963 [50:02:20<39:29:05,  8.31s/it]
 55%|█████▍    | 20850/37963 [50:02:34<47:22:59,  9.97s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.27', 'learning_rate': '8.895e-06', 'epoch': '0.5492'}

 55%|█████▍    | 20850/37963 [50:02:34<47:22:59,  9.97s/it]
 55%|█████▍    | 20851/37963 [50:02:42<44:07:50,  9.28s/it]
 55%|█████▍    | 20852/37963 [50:02:49<41:37:14,  8.76s/it]
 55%|█████▍    | 20853/37963 [50:02:57<39:55:43,  8.40s/it]
 55%|█████▍    | 20854/37963 [50:03:04<38:21:57,  8.07s/it]
 55%|█████▍    | 20855/37963 [50:03:11<37:34:41,  7.91s/it]
 55%|█████▍    | 20856/37963 [50:03:19<37:04:28,  7.80s/it]
 55%|█████▍    | 20857/37963 [50:03:26<36:05:33,  7.60s/it]
 55%|█████▍    | 20858/37963 [50:03:34<36:04:16,  7.59s/it]
 55%|█████▍    | 20859/37963 [50:03:41<35:51:15,  7.55s/it]
 55%|█████▍    | 20860/37963 [50:03:49<35:49:30,  7.54s/it]
                                                           
{'loss': '0.1567', 'grad_norm': '3.414', 'learning_rate': '8.886e-06', 'epoch': '0.5495'}

 55%|█████▍    | 20860/37963 [50:03:49<35:49:30,  7.54s/it]
 55%|█████▍    | 20861/37963 [50:03:56<36:04:24,  7.59s/it]
 55%|█████▍    | 20862/37963 [50:04:04<35:53:38,  7.56s/it]
 55%|█████▍    | 20863/37963 [50:04:11<35:41:47,  7.52s/it]
 55%|█████▍    | 20864/37963 [50:04:19<35:24:35,  7.46s/it]
 55%|█████▍    | 20865/37963 [50:04:26<35:30:41,  7.48s/it]
 55%|█████▍    | 20866/37963 [50:04:34<35:35:17,  7.49s/it]
 55%|█████▍    | 20867/37963 [50:04:41<35:48:52,  7.54s/it]
 55%|█████▍    | 20868/37963 [50:04:49<35:40:31,  7.51s/it]
 55%|█████▍    | 20869/37963 [50:05:03<45:01:18,  9.48s/it]
 55%|█████▍    | 20870/37963 [50:05:10<41:55:19,  8.83s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '1.652', 'learning_rate': '8.878e-06', 'epoch': '0.5497'}

 55%|█████▍    | 20870/37963 [50:05:10<41:55:19,  8.83s/it]
 55%|█████▍    | 20871/37963 [50:05:24<49:10:42, 10.36s/it]
 55%|█████▍    | 20872/37963 [50:05:38<54:12:35, 11.42s/it]
 55%|█████▍    | 20873/37963 [50:05:46<48:50:10, 10.29s/it]
 55%|█████▍    | 20874/37963 [50:05:53<44:55:45,  9.46s/it]
 55%|█████▍    | 20875/37963 [50:06:01<42:17:14,  8.91s/it]
 55%|█████▍    | 20876/37963 [50:06:15<49:34:54, 10.45s/it]
 55%|█████▍    | 20877/37963 [50:06:22<45:25:09,  9.57s/it]
 55%|█████▍    | 20878/37963 [50:06:30<42:42:06,  9.00s/it]
 55%|█████▍    | 20879/37963 [50:06:44<49:31:58, 10.44s/it]
 55%|█████▌    | 20880/37963 [50:06:51<45:20:27,  9.55s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.094', 'learning_rate': '8.869e-06', 'epoch': '0.55'}

 55%|█████▌    | 20880/37963 [50:06:51<45:20:27,  9.55s/it]
 55%|█████▌    | 20881/37963 [50:06:59<42:42:25,  9.00s/it]
 55%|█████▌    | 20882/37963 [50:07:07<40:36:21,  8.56s/it]
 55%|█████▌    | 20883/37963 [50:07:14<38:51:16,  8.19s/it]
 55%|█████▌    | 20884/37963 [50:07:21<37:54:26,  7.99s/it]
 55%|█████▌    | 20885/37963 [50:07:35<46:12:32,  9.74s/it]
 55%|█████▌    | 20886/37963 [50:07:43<43:03:53,  9.08s/it]
 55%|█████▌    | 20887/37963 [50:07:50<40:52:07,  8.62s/it]
 55%|█████▌    | 20888/37963 [50:07:58<39:17:55,  8.29s/it]
 55%|█████▌    | 20889/37963 [50:08:05<38:04:24,  8.03s/it]
 55%|█████▌    | 20890/37963 [50:08:13<37:21:23,  7.88s/it]
                                                           
{'loss': '0.1312', 'grad_norm': '2.373', 'learning_rate': '8.861e-06', 'epoch': '0.5503'}

 55%|█████▌    | 20890/37963 [50:08:13<37:21:23,  7.88s/it]
 55%|█████▌    | 20891/37963 [50:08:20<36:46:27,  7.75s/it]
 55%|█████▌    | 20892/37963 [50:08:28<36:21:45,  7.67s/it]
 55%|█████▌    | 20893/37963 [50:08:35<36:09:26,  7.63s/it]
 55%|█████▌    | 20894/37963 [50:08:43<36:12:20,  7.64s/it]
 55%|█████▌    | 20895/37963 [50:08:50<35:41:06,  7.53s/it]
 55%|█████▌    | 20896/37963 [50:08:58<35:41:19,  7.53s/it]
 55%|█████▌    | 20897/37963 [50:09:05<35:40:23,  7.53s/it]
 55%|█████▌    | 20898/37963 [50:09:13<35:44:44,  7.54s/it]
 55%|█████▌    | 20899/37963 [50:09:27<44:51:35,  9.46s/it]
 55%|█████▌    | 20900/37963 [50:09:41<51:13:10, 10.81s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '2.383', 'learning_rate': '8.853e-06', 'epoch': '0.5505'}

 55%|█████▌    | 20900/37963 [50:09:41<51:13:10, 10.81s/it]
 55%|█████▌    | 20901/37963 [50:09:48<46:31:47,  9.82s/it]
 55%|█████▌    | 20902/37963 [50:09:56<43:22:52,  9.15s/it]
 55%|█████▌    | 20903/37963 [50:10:03<41:00:51,  8.65s/it]
 55%|█████▌    | 20904/37963 [50:10:11<39:21:20,  8.31s/it]
 55%|█████▌    | 20905/37963 [50:10:18<37:59:56,  8.02s/it]
 55%|█████▌    | 20906/37963 [50:10:26<37:20:46,  7.88s/it]
 55%|█████▌    | 20907/37963 [50:10:33<36:51:26,  7.78s/it]
 55%|█████▌    | 20908/37963 [50:10:41<36:31:39,  7.71s/it]
 55%|█████▌    | 20909/37963 [50:10:48<36:25:29,  7.69s/it]
 55%|█████▌    | 20910/37963 [50:10:56<35:54:15,  7.58s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '2.362', 'learning_rate': '8.844e-06', 'epoch': '0.5508'}

 55%|█████▌    | 20910/37963 [50:10:56<35:54:15,  7.58s/it]
 55%|█████▌    | 20911/37963 [50:11:03<35:46:31,  7.55s/it]
 55%|█████▌    | 20912/37963 [50:11:11<35:40:29,  7.53s/it]
 55%|█████▌    | 20913/37963 [50:11:18<35:23:10,  7.47s/it]
 55%|█████▌    | 20914/37963 [50:11:26<35:27:39,  7.49s/it]
 55%|█████▌    | 20915/37963 [50:11:39<44:33:29,  9.41s/it]
 55%|█████▌    | 20916/37963 [50:11:47<42:10:57,  8.91s/it]
 55%|█████▌    | 20917/37963 [50:11:55<40:33:15,  8.56s/it]
 55%|█████▌    | 20918/37963 [50:12:02<39:03:52,  8.25s/it]
 55%|█████▌    | 20919/37963 [50:12:23<56:39:57, 11.97s/it]
 55%|█████▌    | 20920/37963 [50:12:30<49:59:49, 10.56s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '1.725', 'learning_rate': '8.836e-06', 'epoch': '0.5511'}

 55%|█████▌    | 20920/37963 [50:12:30<49:59:49, 10.56s/it]
 55%|█████▌    | 20921/37963 [50:12:38<45:51:24,  9.69s/it]
 55%|█████▌    | 20922/37963 [50:12:46<42:47:53,  9.04s/it]
 55%|█████▌    | 20923/37963 [50:12:53<40:35:56,  8.58s/it]
 55%|█████▌    | 20924/37963 [50:13:00<38:55:10,  8.22s/it]
 55%|█████▌    | 20925/37963 [50:13:08<37:57:30,  8.02s/it]
 55%|█████▌    | 20926/37963 [50:13:29<55:44:10, 11.78s/it]
 55%|█████▌    | 20927/37963 [50:13:36<49:43:44, 10.51s/it]
 55%|█████▌    | 20928/37963 [50:13:43<45:05:32,  9.53s/it]
 55%|█████▌    | 20929/37963 [50:13:51<41:50:44,  8.84s/it]
 55%|█████▌    | 20930/37963 [50:13:58<39:45:06,  8.40s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '1.378', 'learning_rate': '8.827e-06', 'epoch': '0.5513'}

 55%|█████▌    | 20930/37963 [50:13:58<39:45:06,  8.40s/it]
 55%|█████▌    | 20931/37963 [50:14:05<38:29:15,  8.13s/it]
 55%|█████▌    | 20932/37963 [50:14:13<37:50:25,  8.00s/it]
 55%|█████▌    | 20933/37963 [50:14:21<37:13:43,  7.87s/it]
 55%|█████▌    | 20934/37963 [50:14:28<36:41:44,  7.76s/it]
 55%|█████▌    | 20935/37963 [50:14:36<36:16:45,  7.67s/it]
 55%|█████▌    | 20936/37963 [50:14:43<36:02:03,  7.62s/it]
 55%|█████▌    | 20937/37963 [50:14:51<35:48:29,  7.57s/it]
 55%|█████▌    | 20938/37963 [50:15:04<44:26:26,  9.40s/it]
 55%|█████▌    | 20939/37963 [50:15:12<41:50:35,  8.85s/it]
 55%|█████▌    | 20940/37963 [50:15:19<39:57:55,  8.45s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.001', 'learning_rate': '8.819e-06', 'epoch': '0.5516'}

 55%|█████▌    | 20940/37963 [50:15:19<39:57:55,  8.45s/it]
 55%|█████▌    | 20941/37963 [50:15:27<39:03:36,  8.26s/it]
 55%|█████▌    | 20942/37963 [50:15:35<37:57:05,  8.03s/it]
 55%|█████▌    | 20943/37963 [50:15:42<37:11:44,  7.87s/it]
 55%|█████▌    | 20944/37963 [50:15:50<36:45:04,  7.77s/it]
 55%|█████▌    | 20945/37963 [50:15:57<36:13:38,  7.66s/it]
 55%|█████▌    | 20946/37963 [50:16:05<36:13:40,  7.66s/it]
 55%|█████▌    | 20947/37963 [50:16:12<36:11:54,  7.66s/it]
 55%|█████▌    | 20948/37963 [50:16:26<45:00:19,  9.52s/it]
 55%|█████▌    | 20949/37963 [50:16:34<42:08:48,  8.92s/it]
 55%|█████▌    | 20950/37963 [50:16:41<40:14:11,  8.51s/it]
                                                           
{'loss': '0.1352', 'grad_norm': '2.217', 'learning_rate': '8.81e-06', 'epoch': '0.5519'}

 55%|█████▌    | 20950/37963 [50:16:41<40:14:11,  8.51s/it]
 55%|█████▌    | 20951/37963 [50:16:49<38:48:40,  8.21s/it]
 55%|█████▌    | 20952/37963 [50:16:56<37:51:22,  8.01s/it]
 55%|█████▌    | 20953/37963 [50:17:04<37:09:42,  7.86s/it]
 55%|█████▌    | 20954/37963 [50:17:11<36:38:56,  7.76s/it]
 55%|█████▌    | 20955/37963 [50:17:25<45:23:49,  9.61s/it]
 55%|█████▌    | 20956/37963 [50:17:33<42:28:03,  8.99s/it]
 55%|█████▌    | 20957/37963 [50:17:40<40:21:45,  8.54s/it]
 55%|█████▌    | 20958/37963 [50:17:48<39:06:16,  8.28s/it]
 55%|█████▌    | 20959/37963 [50:17:56<38:06:04,  8.07s/it]
 55%|█████▌    | 20960/37963 [50:18:10<46:57:16,  9.94s/it]
                                                           
{'loss': '0.1424', 'grad_norm': '1.724', 'learning_rate': '8.802e-06', 'epoch': '0.5521'}

 55%|█████▌    | 20960/37963 [50:18:10<46:57:16,  9.94s/it]
 55%|█████▌    | 20961/37963 [50:18:18<43:36:49,  9.23s/it]
 55%|█████▌    | 20962/37963 [50:18:25<41:09:47,  8.72s/it]
 55%|█████▌    | 20963/37963 [50:18:33<39:25:06,  8.35s/it]
 55%|█████▌    | 20964/37963 [50:18:46<47:19:22, 10.02s/it]
 55%|█████▌    | 20965/37963 [50:18:54<43:47:19,  9.27s/it]
 55%|█████▌    | 20966/37963 [50:19:02<41:23:12,  8.77s/it]
 55%|█████▌    | 20967/37963 [50:19:09<39:40:15,  8.40s/it]
 55%|█████▌    | 20968/37963 [50:19:16<38:00:58,  8.05s/it]
 55%|█████▌    | 20969/37963 [50:19:30<46:30:37,  9.85s/it]
 55%|█████▌    | 20970/37963 [50:19:38<42:50:07,  9.07s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.147', 'learning_rate': '8.793e-06', 'epoch': '0.5524'}

 55%|█████▌    | 20970/37963 [50:19:38<42:50:07,  9.07s/it]
 55%|█████▌    | 20971/37963 [50:19:45<40:47:19,  8.64s/it]
 55%|█████▌    | 20972/37963 [50:19:59<48:12:07, 10.21s/it]
 55%|█████▌    | 20973/37963 [50:20:07<44:27:28,  9.42s/it]
 55%|█████▌    | 20974/37963 [50:20:14<41:45:27,  8.85s/it]
 55%|█████▌    | 20975/37963 [50:20:28<48:53:59, 10.36s/it]
 55%|█████▌    | 20976/37963 [50:20:36<45:11:02,  9.58s/it]
 55%|█████▌    | 20977/37963 [50:20:44<42:23:35,  8.98s/it]
 55%|█████▌    | 20978/37963 [50:20:51<40:18:53,  8.54s/it]
 55%|█████▌    | 20979/37963 [50:20:59<39:01:52,  8.27s/it]
 55%|█████▌    | 20980/37963 [50:21:06<37:53:07,  8.03s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '2.893', 'learning_rate': '8.785e-06', 'epoch': '0.5526'}

 55%|█████▌    | 20980/37963 [50:21:06<37:53:07,  8.03s/it]
 55%|█████▌    | 20981/37963 [50:21:14<37:03:43,  7.86s/it]
 55%|█████▌    | 20982/37963 [50:21:21<36:39:39,  7.77s/it]
 55%|█████▌    | 20983/37963 [50:21:29<36:03:17,  7.64s/it]
 55%|█████▌    | 20984/37963 [50:21:42<44:54:29,  9.52s/it]
 55%|█████▌    | 20985/37963 [50:21:50<42:33:15,  9.02s/it]
 55%|█████▌    | 20986/37963 [50:21:58<40:12:33,  8.53s/it]
 55%|█████▌    | 20987/37963 [50:22:05<38:51:37,  8.24s/it]
 55%|█████▌    | 20988/37963 [50:22:13<37:55:02,  8.04s/it]
 55%|█████▌    | 20989/37963 [50:22:20<36:50:57,  7.82s/it]
 55%|█████▌    | 20990/37963 [50:22:27<36:05:23,  7.65s/it]
                                                           
{'loss': '0.131', 'grad_norm': '1.017', 'learning_rate': '8.776e-06', 'epoch': '0.5529'}

 55%|█████▌    | 20990/37963 [50:22:27<36:05:23,  7.65s/it]
 55%|█████▌    | 20991/37963 [50:22:35<35:49:06,  7.60s/it]
 55%|█████▌    | 20992/37963 [50:22:42<35:34:25,  7.55s/it]
 55%|█████▌    | 20993/37963 [50:22:50<35:46:26,  7.59s/it]
 55%|█████▌    | 20994/37963 [50:22:58<35:57:26,  7.63s/it]
 55%|█████▌    | 20995/37963 [50:23:05<35:41:16,  7.57s/it]
 55%|█████▌    | 20996/37963 [50:23:13<35:39:58,  7.57s/it]
 55%|█████▌    | 20997/37963 [50:23:20<35:25:20,  7.52s/it]
 55%|█████▌    | 20998/37963 [50:23:27<34:55:50,  7.41s/it]
 55%|█████▌    | 20999/37963 [50:23:48<53:46:42, 11.41s/it]
 55%|█████▌    | 21000/37963 [50:23:56<48:24:03, 10.27s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.993', 'learning_rate': '8.768e-06', 'epoch': '0.5532'}

 55%|█████▌    | 21000/37963 [50:23:56<48:24:03, 10.27s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.98s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.98s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 55%|█████▌    | 21001/37963 [50:24:54<116:06:13, 24.64s/it]
 55%|█████▌    | 21002/37963 [50:25:02<93:31:42, 19.85s/it] 
 55%|█████▌    | 21003/37963 [50:25:10<76:13:53, 16.18s/it]
 55%|█████▌    | 21004/37963 [50:25:18<64:01:52, 13.59s/it]
 55%|█████▌    | 21005/37963 [50:25:25<55:34:59, 11.80s/it]
 55%|█████▌    | 21006/37963 [50:25:33<49:40:06, 10.54s/it]
 55%|█████▌    | 21007/37963 [50:25:47<55:13:08, 11.72s/it]
 55%|█████▌    | 21008/37963 [50:25:55<49:20:48, 10.48s/it]
 55%|█████▌    | 21009/37963 [50:26:02<45:12:20,  9.60s/it]
 55%|█████▌    | 21010/37963 [50:26:10<42:02:49,  8.93s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.657', 'learning_rate': '8.759e-06', 'epoch': '0.5534'}

 55%|█████▌    | 21010/37963 [50:26:10<42:02:49,  8.93s/it]
 55%|█████▌    | 21011/37963 [50:26:17<40:09:29,  8.53s/it]
 55%|█████▌    | 21012/37963 [50:26:25<38:43:46,  8.23s/it]
 55%|█████▌    | 21013/37963 [50:26:32<37:45:27,  8.02s/it]
 55%|█████▌    | 21014/37963 [50:26:40<37:17:59,  7.92s/it]
 55%|█████▌    | 21015/37963 [50:26:54<46:20:06,  9.84s/it]
 55%|█████▌    | 21016/37963 [50:27:09<52:46:28, 11.21s/it]
 55%|█████▌    | 21017/37963 [50:27:17<47:51:28, 10.17s/it]
 55%|█████▌    | 21018/37963 [50:27:24<44:23:14,  9.43s/it]
 55%|█████▌    | 21019/37963 [50:27:32<41:43:40,  8.87s/it]
 55%|█████▌    | 21020/37963 [50:27:40<40:02:16,  8.51s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.124', 'learning_rate': '8.751e-06', 'epoch': '0.5537'}

 55%|█████▌    | 21020/37963 [50:27:40<40:02:16,  8.51s/it]
 55%|█████▌    | 21021/37963 [50:27:47<38:39:04,  8.21s/it]
 55%|█████▌    | 21022/37963 [50:28:01<46:52:59,  9.96s/it]
 55%|█████▌    | 21023/37963 [50:28:08<43:10:53,  9.18s/it]
 55%|█████▌    | 21024/37963 [50:28:16<40:52:46,  8.69s/it]
 55%|█████▌    | 21025/37963 [50:28:23<38:50:39,  8.26s/it]
 55%|█████▌    | 21026/37963 [50:28:31<37:27:51,  7.96s/it]
 55%|█████▌    | 21027/37963 [50:28:38<36:56:49,  7.85s/it]
 55%|█████▌    | 21028/37963 [50:28:46<36:37:24,  7.79s/it]
 55%|█████▌    | 21029/37963 [50:29:06<54:30:14, 11.59s/it]
 55%|█████▌    | 21030/37963 [50:29:14<49:00:39, 10.42s/it]
                                                           
{'loss': '0.1414', 'grad_norm': '1.425', 'learning_rate': '8.742e-06', 'epoch': '0.554'}

 55%|█████▌    | 21030/37963 [50:29:14<49:00:39, 10.42s/it]
 55%|█████▌    | 21031/37963 [50:29:22<45:12:40,  9.61s/it]
 55%|█████▌    | 21032/37963 [50:29:29<42:30:01,  9.04s/it]
 55%|█████▌    | 21033/37963 [50:29:37<40:27:41,  8.60s/it]
 55%|█████▌    | 21034/37963 [50:29:44<38:59:51,  8.29s/it]
 55%|█████▌    | 21035/37963 [50:29:52<37:24:20,  7.95s/it]
 55%|█████▌    | 21036/37963 [50:29:59<37:02:10,  7.88s/it]
 55%|█████▌    | 21037/37963 [50:30:07<36:13:22,  7.70s/it]
 55%|█████▌    | 21038/37963 [50:30:14<36:07:08,  7.68s/it]
 55%|█████▌    | 21039/37963 [50:30:22<35:33:27,  7.56s/it]
 55%|█████▌    | 21040/37963 [50:30:29<35:41:58,  7.59s/it]
                                                           
{'loss': '0.1425', 'grad_norm': '1.846', 'learning_rate': '8.734e-06', 'epoch': '0.5542'}

 55%|█████▌    | 21040/37963 [50:30:29<35:41:58,  7.59s/it]
 55%|█████▌    | 21041/37963 [50:30:37<35:35:52,  7.57s/it]
 55%|█████▌    | 21042/37963 [50:30:44<35:40:20,  7.59s/it]
 55%|█████▌    | 21043/37963 [50:30:52<35:30:29,  7.55s/it]
 55%|█████▌    | 21044/37963 [50:30:59<35:26:58,  7.54s/it]
 55%|█████▌    | 21045/37963 [50:31:07<35:30:40,  7.56s/it]
 55%|█████▌    | 21046/37963 [50:31:14<35:27:15,  7.54s/it]
 55%|█████▌    | 21047/37963 [50:31:22<35:35:29,  7.57s/it]
 55%|█████▌    | 21048/37963 [50:31:29<35:04:07,  7.46s/it]
 55%|█████▌    | 21049/37963 [50:31:37<35:09:46,  7.48s/it]
 55%|█████▌    | 21050/37963 [50:31:51<44:45:34,  9.53s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.131', 'learning_rate': '8.725e-06', 'epoch': '0.5545'}

 55%|█████▌    | 21050/37963 [50:31:51<44:45:34,  9.53s/it]
 55%|█████▌    | 21051/37963 [50:31:59<42:08:03,  8.97s/it]
 55%|█████▌    | 21052/37963 [50:32:07<40:28:56,  8.62s/it]
 55%|█████▌    | 21053/37963 [50:32:20<47:30:14, 10.11s/it]
 55%|█████▌    | 21054/37963 [50:32:28<43:58:35,  9.36s/it]
 55%|█████▌    | 21055/37963 [50:32:36<41:40:14,  8.87s/it]
 55%|█████▌    | 21056/37963 [50:32:43<39:42:25,  8.45s/it]
 55%|█████▌    | 21057/37963 [50:32:57<47:21:43, 10.09s/it]
 55%|█████▌    | 21058/37963 [50:33:05<43:57:45,  9.36s/it]
 55%|█████▌    | 21059/37963 [50:33:12<41:19:28,  8.80s/it]
 55%|█████▌    | 21060/37963 [50:33:20<39:35:51,  8.43s/it]
                                                           
{'loss': '0.1512', 'grad_norm': '3.332', 'learning_rate': '8.717e-06', 'epoch': '0.5548'}

 55%|█████▌    | 21060/37963 [50:33:20<39:35:51,  8.43s/it]
 55%|█████▌    | 21061/37963 [50:33:27<38:16:29,  8.15s/it]
 55%|█████▌    | 21062/37963 [50:33:41<46:22:46,  9.88s/it]
 55%|█████▌    | 21063/37963 [50:33:49<43:13:08,  9.21s/it]
 55%|█████▌    | 21064/37963 [50:34:03<49:58:00, 10.64s/it]
 55%|█████▌    | 21065/37963 [50:34:10<45:40:05,  9.73s/it]
 55%|█████▌    | 21066/37963 [50:34:18<42:33:52,  9.07s/it]
 55%|█████▌    | 21067/37963 [50:34:25<40:11:51,  8.56s/it]
 55%|█████▌    | 21068/37963 [50:34:32<38:20:36,  8.17s/it]
 55%|█████▌    | 21069/37963 [50:34:40<37:32:20,  8.00s/it]
 56%|█████▌    | 21070/37963 [50:34:54<46:03:56,  9.82s/it]
                                                           
{'loss': '0.139', 'grad_norm': '1.094', 'learning_rate': '8.709e-06', 'epoch': '0.555'}

 56%|█████▌    | 21070/37963 [50:34:54<46:03:56,  9.82s/it]
 56%|█████▌    | 21071/37963 [50:35:02<42:53:21,  9.14s/it]
 56%|█████▌    | 21072/37963 [50:35:09<40:30:11,  8.63s/it]
 56%|█████▌    | 21073/37963 [50:35:17<38:54:49,  8.29s/it]
 56%|█████▌    | 21074/37963 [50:35:24<37:48:37,  8.06s/it]
 56%|█████▌    | 21075/37963 [50:35:31<36:46:17,  7.84s/it]
 56%|█████▌    | 21076/37963 [50:35:45<44:53:28,  9.57s/it]
 56%|█████▌    | 21077/37963 [50:35:53<42:13:10,  9.00s/it]
 56%|█████▌    | 21078/37963 [50:36:00<40:07:28,  8.55s/it]
 56%|█████▌    | 21079/37963 [50:36:08<38:32:27,  8.22s/it]
 56%|█████▌    | 21080/37963 [50:36:15<37:30:36,  8.00s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '2.192', 'learning_rate': '8.7e-06', 'epoch': '0.5553'}

 56%|█████▌    | 21080/37963 [50:36:15<37:30:36,  8.00s/it]
 56%|█████▌    | 21081/37963 [50:36:23<36:50:45,  7.86s/it]
 56%|█████▌    | 21082/37963 [50:36:30<36:21:39,  7.75s/it]
 56%|█████▌    | 21083/37963 [50:36:45<45:35:27,  9.72s/it]
 56%|█████▌    | 21084/37963 [50:36:52<42:34:22,  9.08s/it]
 56%|█████▌    | 21085/37963 [50:37:00<40:25:56,  8.62s/it]
 56%|█████▌    | 21086/37963 [50:37:07<38:41:48,  8.25s/it]
 56%|█████▌    | 21087/37963 [50:37:14<37:27:24,  7.99s/it]
 56%|█████▌    | 21088/37963 [50:37:22<36:55:41,  7.88s/it]
 56%|█████▌    | 21089/37963 [50:37:30<36:33:28,  7.80s/it]
 56%|█████▌    | 21090/37963 [50:37:37<36:11:42,  7.72s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.319', 'learning_rate': '8.692e-06', 'epoch': '0.5555'}

 56%|█████▌    | 21090/37963 [50:37:37<36:11:42,  7.72s/it]
 56%|█████▌    | 21091/37963 [50:37:45<35:48:09,  7.64s/it]
 56%|█████▌    | 21092/37963 [50:37:52<35:40:19,  7.61s/it]
 56%|█████▌    | 21093/37963 [50:38:00<35:42:08,  7.62s/it]
 56%|█████▌    | 21094/37963 [50:38:07<35:37:17,  7.60s/it]
 56%|█████▌    | 21095/37963 [50:38:15<35:28:32,  7.57s/it]
 56%|█████▌    | 21096/37963 [50:38:23<35:35:27,  7.60s/it]
 56%|█████▌    | 21097/37963 [50:38:37<44:44:44,  9.55s/it]
 56%|█████▌    | 21098/37963 [50:38:44<41:52:57,  8.94s/it]
 56%|█████▌    | 21099/37963 [50:38:58<49:17:39, 10.52s/it]
 56%|█████▌    | 21100/37963 [50:39:06<45:19:10,  9.68s/it]
                                                           
{'loss': '0.144', 'grad_norm': '1.739', 'learning_rate': '8.683e-06', 'epoch': '0.5558'}

 56%|█████▌    | 21100/37963 [50:39:06<45:19:10,  9.68s/it]
 56%|█████▌    | 21101/37963 [50:39:14<42:22:24,  9.05s/it]
 56%|█████▌    | 21102/37963 [50:39:21<40:15:06,  8.59s/it]
 56%|█████▌    | 21103/37963 [50:39:29<38:52:47,  8.30s/it]
 56%|█████▌    | 21104/37963 [50:39:36<37:54:29,  8.09s/it]
 56%|█████▌    | 21105/37963 [50:39:51<46:21:50,  9.90s/it]
 56%|█████▌    | 21106/37963 [50:39:58<43:15:23,  9.24s/it]
 56%|█████▌    | 21107/37963 [50:40:06<41:07:04,  8.78s/it]
 56%|█████▌    | 21108/37963 [50:40:14<39:26:43,  8.43s/it]
 56%|█████▌    | 21109/37963 [50:40:21<38:20:16,  8.19s/it]
 56%|█████▌    | 21110/37963 [50:40:42<56:17:49, 12.03s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.791', 'learning_rate': '8.675e-06', 'epoch': '0.5561'}

 56%|█████▌    | 21110/37963 [50:40:42<56:17:49, 12.03s/it]
 56%|█████▌    | 21111/37963 [50:40:50<49:51:57, 10.65s/it]
 56%|█████▌    | 21112/37963 [50:40:57<45:29:18,  9.72s/it]
 56%|█████▌    | 21113/37963 [50:41:05<42:24:20,  9.06s/it]
 56%|█████▌    | 21114/37963 [50:41:12<40:11:16,  8.59s/it]
 56%|█████▌    | 21115/37963 [50:41:20<38:46:00,  8.28s/it]
 56%|█████▌    | 21116/37963 [50:41:27<37:34:43,  8.03s/it]
 56%|█████▌    | 21117/37963 [50:41:35<36:39:40,  7.83s/it]
 56%|█████▌    | 21118/37963 [50:41:49<45:39:21,  9.76s/it]
 56%|█████▌    | 21119/37963 [50:41:56<42:18:00,  9.04s/it]
 56%|█████▌    | 21120/37963 [50:42:04<40:23:12,  8.63s/it]
                                                           
{'loss': '0.1452', 'grad_norm': '2.837', 'learning_rate': '8.666e-06', 'epoch': '0.5563'}

 56%|█████▌    | 21120/37963 [50:42:04<40:23:12,  8.63s/it]
 56%|█████▌    | 21121/37963 [50:42:12<39:12:16,  8.38s/it]
 56%|█████▌    | 21122/37963 [50:42:19<38:08:33,  8.15s/it]
 56%|█████▌    | 21123/37963 [50:42:27<37:22:22,  7.99s/it]
 56%|█████▌    | 21124/37963 [50:42:34<36:46:13,  7.86s/it]
 56%|█████▌    | 21125/37963 [50:42:42<36:29:40,  7.80s/it]
 56%|█████▌    | 21126/37963 [50:42:56<45:36:17,  9.75s/it]
 56%|█████▌    | 21127/37963 [50:43:10<51:13:54, 10.95s/it]
 56%|█████▌    | 21128/37963 [50:43:17<46:03:10,  9.85s/it]
 56%|█████▌    | 21129/37963 [50:43:25<42:23:02,  9.06s/it]
 56%|█████▌    | 21130/37963 [50:43:32<40:12:12,  8.60s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '2.182', 'learning_rate': '8.658e-06', 'epoch': '0.5566'}

 56%|█████▌    | 21130/37963 [50:43:32<40:12:12,  8.60s/it]
 56%|█████▌    | 21131/37963 [50:43:40<38:43:41,  8.28s/it]
 56%|█████▌    | 21132/37963 [50:43:47<37:21:25,  7.99s/it]
 56%|█████▌    | 21133/37963 [50:43:55<36:42:57,  7.85s/it]
 56%|█████▌    | 21134/37963 [50:44:02<36:05:20,  7.72s/it]
 56%|█████▌    | 21135/37963 [50:44:10<35:51:48,  7.67s/it]
 56%|█████▌    | 21136/37963 [50:44:17<35:39:06,  7.63s/it]
 56%|█████▌    | 21137/37963 [50:44:24<35:14:59,  7.54s/it]
 56%|█████▌    | 21138/37963 [50:44:32<35:14:12,  7.54s/it]
 56%|█████▌    | 21139/37963 [50:44:40<35:25:11,  7.58s/it]
 56%|█████▌    | 21140/37963 [50:44:47<35:07:00,  7.51s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '2.406', 'learning_rate': '8.649e-06', 'epoch': '0.5569'}

 56%|█████▌    | 21140/37963 [50:44:47<35:07:00,  7.51s/it]
 56%|█████▌    | 21141/37963 [50:44:55<35:26:54,  7.59s/it]
 56%|█████▌    | 21142/37963 [50:45:02<35:32:17,  7.61s/it]
 56%|█████▌    | 21143/37963 [50:45:10<35:13:31,  7.54s/it]
 56%|█████▌    | 21144/37963 [50:45:24<44:11:04,  9.46s/it]
 56%|█████▌    | 21145/37963 [50:45:31<41:24:49,  8.86s/it]
 56%|█████▌    | 21146/37963 [50:45:39<39:46:34,  8.51s/it]
 56%|█████▌    | 21147/37963 [50:45:46<38:27:27,  8.23s/it]
 56%|█████▌    | 21148/37963 [50:45:54<37:38:12,  8.06s/it]
 56%|█████▌    | 21149/37963 [50:46:08<45:58:27,  9.84s/it]
 56%|█████▌    | 21150/37963 [50:46:16<42:49:43,  9.17s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '0.9949', 'learning_rate': '8.641e-06', 'epoch': '0.5571'}

 56%|█████▌    | 21150/37963 [50:46:16<42:49:43,  9.17s/it]
 56%|█████▌    | 21151/37963 [50:46:23<40:38:01,  8.70s/it]
 56%|█████▌    | 21152/37963 [50:46:31<39:13:13,  8.40s/it]
 56%|█████▌    | 21153/37963 [50:46:39<37:57:24,  8.13s/it]
 56%|█████▌    | 21154/37963 [50:46:53<46:11:21,  9.89s/it]
 56%|█████▌    | 21155/37963 [50:47:07<51:55:19, 11.12s/it]
 56%|█████▌    | 21156/37963 [50:47:14<46:58:05, 10.06s/it]
 56%|█████▌    | 21157/37963 [50:47:22<43:24:44,  9.30s/it]
 56%|█████▌    | 21158/37963 [50:47:35<49:41:09, 10.64s/it]
 56%|█████▌    | 21159/37963 [50:47:43<45:32:08,  9.76s/it]
 56%|█████▌    | 21160/37963 [50:47:51<42:17:33,  9.06s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.012', 'learning_rate': '8.632e-06', 'epoch': '0.5574'}

 56%|█████▌    | 21160/37963 [50:47:51<42:17:33,  9.06s/it]
 56%|█████▌    | 21161/37963 [50:47:58<39:48:57,  8.53s/it]
 56%|█████▌    | 21162/37963 [50:48:05<38:24:29,  8.23s/it]
 56%|█████▌    | 21163/37963 [50:48:13<37:27:47,  8.03s/it]
 56%|█████▌    | 21164/37963 [50:48:20<36:44:31,  7.87s/it]
 56%|█████▌    | 21165/37963 [50:48:28<36:23:28,  7.80s/it]
 56%|█████▌    | 21166/37963 [50:48:43<45:50:20,  9.82s/it]
 56%|█████▌    | 21167/37963 [50:48:50<42:41:21,  9.15s/it]
 56%|█████▌    | 21168/37963 [50:48:58<40:22:33,  8.65s/it]
 56%|█████▌    | 21169/37963 [50:49:05<38:51:05,  8.33s/it]
 56%|█████▌    | 21170/37963 [50:49:19<46:23:43,  9.95s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.531', 'learning_rate': '8.624e-06', 'epoch': '0.5577'}

 56%|█████▌    | 21170/37963 [50:49:19<46:23:43,  9.95s/it]
 56%|█████▌    | 21171/37963 [50:49:27<43:00:33,  9.22s/it]
 56%|█████▌    | 21172/37963 [50:49:34<40:14:44,  8.63s/it]
 56%|█████▌    | 21173/37963 [50:49:41<38:42:16,  8.30s/it]
 56%|█████▌    | 21174/37963 [50:49:55<46:30:12,  9.97s/it]
 56%|█████▌    | 21175/37963 [50:50:03<43:06:39,  9.24s/it]
 56%|█████▌    | 21176/37963 [50:50:10<40:53:28,  8.77s/it]
 56%|█████▌    | 21177/37963 [50:50:18<38:59:23,  8.36s/it]
 56%|█████▌    | 21178/37963 [50:50:25<37:55:14,  8.13s/it]
 56%|█████▌    | 21179/37963 [50:50:33<36:31:59,  7.84s/it]
 56%|█████▌    | 21180/37963 [50:50:40<36:14:23,  7.77s/it]
                                                           
{'loss': '0.129', 'grad_norm': '4.114', 'learning_rate': '8.616e-06', 'epoch': '0.5579'}

 56%|█████▌    | 21180/37963 [50:50:40<36:14:23,  7.77s/it]
 56%|█████▌    | 21181/37963 [50:50:48<35:55:13,  7.71s/it]
 56%|█████▌    | 21182/37963 [50:50:55<35:31:12,  7.62s/it]
 56%|█████▌    | 21183/37963 [50:51:03<35:27:51,  7.61s/it]
 56%|█████▌    | 21184/37963 [50:51:10<35:24:28,  7.60s/it]
 56%|█████▌    | 21185/37963 [50:51:18<35:22:54,  7.59s/it]
 56%|█████▌    | 21186/37963 [50:51:25<35:23:49,  7.60s/it]
 56%|█████▌    | 21187/37963 [50:51:33<35:11:06,  7.55s/it]
 56%|█████▌    | 21188/37963 [50:51:40<34:56:07,  7.50s/it]
 56%|█████▌    | 21189/37963 [50:51:48<35:02:44,  7.52s/it]
 56%|█████▌    | 21190/37963 [50:51:55<34:43:59,  7.45s/it]
                                                           
{'loss': '0.1542', 'grad_norm': '1.547', 'learning_rate': '8.607e-06', 'epoch': '0.5582'}

 56%|█████▌    | 21190/37963 [50:51:55<34:43:59,  7.45s/it]
 56%|█████▌    | 21191/37963 [50:52:03<34:52:57,  7.49s/it]
 56%|█████▌    | 21192/37963 [50:52:17<43:51:41,  9.42s/it]
 56%|█████▌    | 21193/37963 [50:52:24<41:18:01,  8.87s/it]
 56%|█████▌    | 21194/37963 [50:52:32<39:46:04,  8.54s/it]
 56%|█████▌    | 21195/37963 [50:52:40<38:31:30,  8.27s/it]
 56%|█████▌    | 21196/37963 [50:52:47<37:44:59,  8.11s/it]
 56%|█████▌    | 21197/37963 [50:52:55<36:56:01,  7.93s/it]
 56%|█████▌    | 21198/37963 [50:53:02<36:30:02,  7.84s/it]
 56%|█████▌    | 21199/37963 [50:53:16<44:47:07,  9.62s/it]
 56%|█████▌    | 21200/37963 [50:53:24<41:43:05,  8.96s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '1.689', 'learning_rate': '8.599e-06', 'epoch': '0.5584'}

 56%|█████▌    | 21200/37963 [50:53:24<41:43:05,  8.96s/it]
 56%|█████▌    | 21201/37963 [50:53:31<39:39:47,  8.52s/it]
 56%|█████▌    | 21202/37963 [50:53:39<38:21:11,  8.24s/it]
 56%|█████▌    | 21203/37963 [50:53:53<46:19:16,  9.95s/it]
 56%|█████▌    | 21204/37963 [50:54:07<52:02:19, 11.18s/it]
 56%|█████▌    | 21205/37963 [50:54:15<47:18:52, 10.16s/it]
 56%|█████▌    | 21206/37963 [50:54:28<52:07:11, 11.20s/it]
 56%|█████▌    | 21207/37963 [50:54:36<47:10:30, 10.14s/it]
 56%|█████▌    | 21208/37963 [50:54:43<43:23:59,  9.32s/it]
 56%|█████▌    | 21209/37963 [50:54:51<40:53:34,  8.79s/it]
 56%|█████▌    | 21210/37963 [50:54:58<39:14:08,  8.43s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '1.188', 'learning_rate': '8.59e-06', 'epoch': '0.5587'}

 56%|█████▌    | 21210/37963 [50:54:58<39:14:08,  8.43s/it]
 56%|█████▌    | 21211/37963 [50:55:06<37:41:19,  8.10s/it]
 56%|█████▌    | 21212/37963 [50:55:19<45:26:53,  9.77s/it]
 56%|█████▌    | 21213/37963 [50:55:27<42:27:26,  9.13s/it]
 56%|█████▌    | 21214/37963 [50:55:41<49:03:23, 10.54s/it]
 56%|█████▌    | 21215/37963 [50:55:48<44:53:45,  9.65s/it]
 56%|█████▌    | 21216/37963 [50:55:56<42:02:37,  9.04s/it]
 56%|█████▌    | 21217/37963 [50:56:04<40:07:15,  8.63s/it]
 56%|█████▌    | 21218/37963 [50:56:11<38:13:20,  8.22s/it]
 56%|█████▌    | 21219/37963 [50:56:19<37:18:59,  8.02s/it]
 56%|█████▌    | 21220/37963 [50:56:26<36:34:45,  7.87s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '2.277', 'learning_rate': '8.582e-06', 'epoch': '0.559'}

 56%|█████▌    | 21220/37963 [50:56:26<36:34:45,  7.87s/it]
 56%|█████▌    | 21221/37963 [50:56:34<36:07:37,  7.77s/it]
 56%|█████▌    | 21222/37963 [50:56:41<35:32:45,  7.64s/it]
 56%|█████▌    | 21223/37963 [50:56:48<35:24:26,  7.61s/it]
 56%|█████▌    | 21224/37963 [50:56:56<35:22:39,  7.61s/it]
 56%|█████▌    | 21225/37963 [50:57:04<35:20:45,  7.60s/it]
 56%|█████▌    | 21226/37963 [50:57:11<34:51:08,  7.50s/it]
 56%|█████▌    | 21227/37963 [50:57:18<34:55:14,  7.51s/it]
 56%|█████▌    | 21228/37963 [50:57:32<43:55:28,  9.45s/it]
 56%|█████▌    | 21229/37963 [50:57:40<41:16:12,  8.88s/it]
 56%|█████▌    | 21230/37963 [50:57:47<39:12:40,  8.44s/it]
                                                           
{'loss': '0.141', 'grad_norm': '1.627', 'learning_rate': '8.573e-06', 'epoch': '0.5592'}

 56%|█████▌    | 21230/37963 [50:57:47<39:12:40,  8.44s/it]
 56%|█████▌    | 21231/37963 [50:57:55<38:11:44,  8.22s/it]
 56%|█████▌    | 21232/37963 [50:58:03<37:18:14,  8.03s/it]
 56%|█████▌    | 21233/37963 [50:58:10<36:34:13,  7.87s/it]
 56%|█████▌    | 21234/37963 [50:58:18<36:18:42,  7.81s/it]
 56%|█████▌    | 21235/37963 [50:58:25<35:54:53,  7.73s/it]
 56%|█████▌    | 21236/37963 [50:58:33<35:36:28,  7.66s/it]
 56%|█████▌    | 21237/37963 [50:58:47<44:32:05,  9.59s/it]
 56%|█████▌    | 21238/37963 [50:58:54<41:35:13,  8.95s/it]
 56%|█████▌    | 21239/37963 [50:59:02<39:48:12,  8.57s/it]
 56%|█████▌    | 21240/37963 [50:59:10<38:22:03,  8.26s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '1.167', 'learning_rate': '8.565e-06', 'epoch': '0.5595'}

 56%|█████▌    | 21240/37963 [50:59:10<38:22:03,  8.26s/it]
 56%|█████▌    | 21241/37963 [50:59:17<37:05:32,  7.99s/it]
 56%|█████▌    | 21242/37963 [50:59:31<45:34:37,  9.81s/it]
 56%|█████▌    | 21243/37963 [50:59:39<42:25:28,  9.13s/it]
 56%|█████▌    | 21244/37963 [50:59:46<40:21:00,  8.69s/it]
 56%|█████▌    | 21245/37963 [50:59:54<38:27:38,  8.28s/it]
 56%|█████▌    | 21246/37963 [51:00:01<37:27:03,  8.07s/it]
 56%|█████▌    | 21247/37963 [51:00:09<36:39:24,  7.89s/it]
 56%|█████▌    | 21248/37963 [51:00:16<36:11:10,  7.79s/it]
 56%|█████▌    | 21249/37963 [51:00:24<35:39:03,  7.68s/it]
 56%|█████▌    | 21250/37963 [51:00:31<35:35:45,  7.67s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.639', 'learning_rate': '8.556e-06', 'epoch': '0.5598'}

 56%|█████▌    | 21250/37963 [51:00:31<35:35:45,  7.67s/it]
 56%|█████▌    | 21251/37963 [51:00:45<44:34:00,  9.60s/it]
 56%|█████▌    | 21252/37963 [51:00:59<50:35:55, 10.90s/it]
 56%|█████▌    | 21253/37963 [51:01:07<46:10:05,  9.95s/it]
 56%|█████▌    | 21254/37963 [51:01:15<42:51:40,  9.23s/it]
 56%|█████▌    | 21255/37963 [51:01:28<49:21:59, 10.64s/it]
 56%|█████▌    | 21256/37963 [51:01:36<45:06:44,  9.72s/it]
 56%|█████▌    | 21257/37963 [51:01:44<42:03:55,  9.06s/it]
 56%|█████▌    | 21258/37963 [51:01:51<39:54:53,  8.60s/it]
 56%|█████▌    | 21259/37963 [51:01:59<38:22:14,  8.27s/it]
 56%|█████▌    | 21260/37963 [51:02:06<36:46:21,  7.93s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '3.615', 'learning_rate': '8.548e-06', 'epoch': '0.56'}

 56%|█████▌    | 21260/37963 [51:02:06<36:46:21,  7.93s/it]
 56%|█████▌    | 21261/37963 [51:02:26<54:19:29, 11.71s/it]
 56%|█████▌    | 21262/37963 [51:02:34<48:56:23, 10.55s/it]
 56%|█████▌    | 21263/37963 [51:02:41<44:19:02,  9.55s/it]
 56%|█████▌    | 21264/37963 [51:02:49<41:27:37,  8.94s/it]
 56%|█████▌    | 21265/37963 [51:02:56<39:29:18,  8.51s/it]
 56%|█████▌    | 21266/37963 [51:03:04<38:20:23,  8.27s/it]
 56%|█████▌    | 21267/37963 [51:03:12<37:25:09,  8.07s/it]
 56%|█████▌    | 21268/37963 [51:03:19<36:39:51,  7.91s/it]
 56%|█████▌    | 21269/37963 [51:03:27<36:16:35,  7.82s/it]
 56%|█████▌    | 21270/37963 [51:03:34<35:46:33,  7.72s/it]
                                                           
{'loss': '0.1453', 'grad_norm': '1.508', 'learning_rate': '8.54e-06', 'epoch': '0.5603'}

 56%|█████▌    | 21270/37963 [51:03:34<35:46:33,  7.72s/it]
 56%|█████▌    | 21271/37963 [51:03:48<44:16:29,  9.55s/it]
 56%|█████▌    | 21272/37963 [51:03:56<41:42:53,  9.00s/it]
 56%|█████▌    | 21273/37963 [51:04:03<39:42:41,  8.57s/it]
 56%|█████▌    | 21274/37963 [51:04:11<38:21:10,  8.27s/it]
 56%|█████▌    | 21275/37963 [51:04:19<37:26:08,  8.08s/it]
 56%|█████▌    | 21276/37963 [51:04:26<36:35:53,  7.90s/it]
 56%|█████▌    | 21277/37963 [51:04:34<36:19:01,  7.84s/it]
 56%|█████▌    | 21278/37963 [51:04:41<35:53:59,  7.75s/it]
 56%|█████▌    | 21279/37963 [51:04:49<35:39:37,  7.69s/it]
 56%|█████▌    | 21280/37963 [51:04:56<35:28:28,  7.66s/it]
                                                           
{'loss': '0.1438', 'grad_norm': '1.639', 'learning_rate': '8.531e-06', 'epoch': '0.5605'}

 56%|█████▌    | 21280/37963 [51:04:56<35:28:28,  7.66s/it]
 56%|█████▌    | 21281/37963 [51:05:04<35:12:18,  7.60s/it]
 56%|█████▌    | 21282/37963 [51:05:18<43:34:37,  9.40s/it]
 56%|█████▌    | 21283/37963 [51:05:25<41:05:58,  8.87s/it]
 56%|█████▌    | 21284/37963 [51:05:32<38:51:49,  8.39s/it]
 56%|█████▌    | 21285/37963 [51:05:40<37:30:54,  8.10s/it]
 56%|█████▌    | 21286/37963 [51:05:47<36:43:32,  7.93s/it]
 56%|█████▌    | 21287/37963 [51:05:55<36:10:01,  7.81s/it]
 56%|█████▌    | 21288/37963 [51:06:02<35:30:41,  7.67s/it]
 56%|█████▌    | 21289/37963 [51:06:09<34:55:58,  7.54s/it]
 56%|█████▌    | 21290/37963 [51:06:17<35:02:24,  7.57s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '0.842', 'learning_rate': '8.523e-06', 'epoch': '0.5608'}

 56%|█████▌    | 21290/37963 [51:06:17<35:02:24,  7.57s/it]
 56%|█████▌    | 21291/37963 [51:06:25<35:09:52,  7.59s/it]
 56%|█████▌    | 21292/37963 [51:06:32<35:10:50,  7.60s/it]
 56%|█████▌    | 21293/37963 [51:06:40<35:10:24,  7.60s/it]
 56%|█████▌    | 21294/37963 [51:06:48<35:14:17,  7.61s/it]
 56%|█████▌    | 21295/37963 [51:06:55<35:02:52,  7.57s/it]
 56%|█████▌    | 21296/37963 [51:07:03<34:53:11,  7.54s/it]
 56%|█████▌    | 21297/37963 [51:07:17<43:52:21,  9.48s/it]
 56%|█████▌    | 21298/37963 [51:07:24<41:29:58,  8.96s/it]
 56%|█████▌    | 21299/37963 [51:07:32<39:26:01,  8.52s/it]
 56%|█████▌    | 21300/37963 [51:07:46<47:27:52, 10.25s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.48', 'learning_rate': '8.514e-06', 'epoch': '0.5611'}

 56%|█████▌    | 21300/37963 [51:07:46<47:27:52, 10.25s/it]
 56%|█████▌    | 21301/37963 [51:07:54<43:52:03,  9.48s/it]
 56%|█████▌    | 21302/37963 [51:08:01<41:09:14,  8.89s/it]
 56%|█████▌    | 21303/37963 [51:08:09<39:22:50,  8.51s/it]
 56%|█████▌    | 21304/37963 [51:08:23<47:16:19, 10.22s/it]
 56%|█████▌    | 21305/37963 [51:08:37<52:42:23, 11.39s/it]
 56%|█████▌    | 21306/37963 [51:08:45<47:08:58, 10.19s/it]
 56%|█████▌    | 21307/37963 [51:08:58<52:12:48, 11.29s/it]
 56%|█████▌    | 21308/37963 [51:09:06<47:04:30, 10.18s/it]
 56%|█████▌    | 21309/37963 [51:09:20<52:18:17, 11.31s/it]
 56%|█████▌    | 21310/37963 [51:09:28<47:07:29, 10.19s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '0.928', 'learning_rate': '8.506e-06', 'epoch': '0.5613'}

 56%|█████▌    | 21310/37963 [51:09:28<47:07:29, 10.19s/it]
 56%|█████▌    | 21311/37963 [51:09:35<43:01:29,  9.30s/it]
 56%|█████▌    | 21312/37963 [51:09:42<40:35:04,  8.77s/it]
 56%|█████▌    | 21313/37963 [51:09:50<38:55:59,  8.42s/it]
 56%|█████▌    | 21314/37963 [51:09:57<37:43:30,  8.16s/it]
 56%|█████▌    | 21315/37963 [51:10:05<37:04:31,  8.02s/it]
 56%|█████▌    | 21316/37963 [51:10:13<36:25:45,  7.88s/it]
 56%|█████▌    | 21317/37963 [51:10:20<35:55:59,  7.77s/it]
 56%|█████▌    | 21318/37963 [51:10:28<35:37:04,  7.70s/it]
 56%|█████▌    | 21319/37963 [51:10:35<34:55:48,  7.56s/it]
 56%|█████▌    | 21320/37963 [51:10:43<34:57:22,  7.56s/it]
                                                           
{'loss': '0.143', 'grad_norm': '2.205', 'learning_rate': '8.497e-06', 'epoch': '0.5616'}

 56%|█████▌    | 21320/37963 [51:10:43<34:57:22,  7.56s/it]
 56%|█████▌    | 21321/37963 [51:10:50<35:00:11,  7.57s/it]
 56%|█████▌    | 21322/37963 [51:10:58<35:13:57,  7.62s/it]
 56%|█████▌    | 21323/37963 [51:11:12<44:27:08,  9.62s/it]
 56%|█████▌    | 21324/37963 [51:11:20<41:50:06,  9.05s/it]
 56%|█████▌    | 21325/37963 [51:11:28<39:52:21,  8.63s/it]
 56%|█████▌    | 21326/37963 [51:11:35<37:59:05,  8.22s/it]
 56%|█████▌    | 21327/37963 [51:11:42<37:09:36,  8.04s/it]
 56%|█████▌    | 21328/37963 [51:11:50<36:07:09,  7.82s/it]
 56%|█████▌    | 21329/37963 [51:11:57<35:50:32,  7.76s/it]
 56%|█████▌    | 21330/37963 [51:12:05<35:40:22,  7.72s/it]
                                                           
{'loss': '0.1429', 'grad_norm': '0.8172', 'learning_rate': '8.489e-06', 'epoch': '0.5619'}

 56%|█████▌    | 21330/37963 [51:12:05<35:40:22,  7.72s/it]
 56%|█████▌    | 21331/37963 [51:12:13<35:31:58,  7.69s/it]
 56%|█████▌    | 21332/37963 [51:12:20<35:35:38,  7.70s/it]
 56%|█████▌    | 21333/37963 [51:12:28<35:17:44,  7.64s/it]
 56%|█████▌    | 21334/37963 [51:12:35<35:03:39,  7.59s/it]
 56%|█████▌    | 21335/37963 [51:12:43<35:08:25,  7.61s/it]
 56%|█████▌    | 21336/37963 [51:12:57<44:05:29,  9.55s/it]
 56%|█████▌    | 21337/37963 [51:13:05<41:24:51,  8.97s/it]
 56%|█████▌    | 21338/37963 [51:13:12<39:29:12,  8.55s/it]
 56%|█████▌    | 21339/37963 [51:13:20<37:52:53,  8.20s/it]
 56%|█████▌    | 21340/37963 [51:13:27<37:11:11,  8.05s/it]
                                                           
{'loss': '0.134', 'grad_norm': '0.7899', 'learning_rate': '8.48e-06', 'epoch': '0.5621'}

 56%|█████▌    | 21340/37963 [51:13:27<37:11:11,  8.05s/it]
 56%|█████▌    | 21341/37963 [51:13:42<45:38:57,  9.89s/it]
 56%|█████▌    | 21342/37963 [51:13:49<42:11:46,  9.14s/it]
 56%|█████▌    | 21343/37963 [51:13:56<39:33:17,  8.57s/it]
 56%|█████▌    | 21344/37963 [51:14:04<38:01:27,  8.24s/it]
 56%|█████▌    | 21345/37963 [51:14:11<36:57:52,  8.01s/it]
 56%|█████▌    | 21346/37963 [51:14:19<36:19:43,  7.87s/it]
 56%|█████▌    | 21347/37963 [51:14:26<35:52:06,  7.77s/it]
 56%|█████▌    | 21348/37963 [51:14:40<44:15:22,  9.59s/it]
 56%|█████▌    | 21349/37963 [51:14:54<50:14:42, 10.89s/it]
 56%|█████▌    | 21350/37963 [51:15:02<45:54:51,  9.95s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '2.8', 'learning_rate': '8.472e-06', 'epoch': '0.5624'}

 56%|█████▌    | 21350/37963 [51:15:02<45:54:51,  9.95s/it]
 56%|█████▌    | 21351/37963 [51:15:09<42:32:14,  9.22s/it]
 56%|█████▌    | 21352/37963 [51:15:17<40:17:56,  8.73s/it]
 56%|█████▌    | 21353/37963 [51:15:37<56:48:05, 12.31s/it]
 56%|█████▌    | 21354/37963 [51:15:45<50:11:41, 10.88s/it]
 56%|█████▋    | 21355/37963 [51:15:53<45:35:36,  9.88s/it]
 56%|█████▋    | 21356/37963 [51:16:00<42:17:29,  9.17s/it]
 56%|█████▋    | 21357/37963 [51:16:08<40:06:48,  8.70s/it]
 56%|█████▋    | 21358/37963 [51:16:15<38:49:15,  8.42s/it]
 56%|█████▋    | 21359/37963 [51:16:23<37:34:13,  8.15s/it]
 56%|█████▋    | 21360/37963 [51:16:30<36:42:57,  7.96s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.83', 'learning_rate': '8.464e-06', 'epoch': '0.5627'}

 56%|█████▋    | 21360/37963 [51:16:30<36:42:57,  7.96s/it]
 56%|█████▋    | 21361/37963 [51:16:45<45:37:41,  9.89s/it]
 56%|█████▋    | 21362/37963 [51:16:52<42:17:08,  9.17s/it]
 56%|█████▋    | 21363/37963 [51:17:00<40:08:41,  8.71s/it]
 56%|█████▋    | 21364/37963 [51:17:07<38:30:36,  8.35s/it]
 56%|█████▋    | 21365/37963 [51:17:15<37:22:55,  8.11s/it]
 56%|█████▋    | 21366/37963 [51:17:23<36:34:15,  7.93s/it]
 56%|█████▋    | 21367/37963 [51:17:30<35:59:46,  7.81s/it]
 56%|█████▋    | 21368/37963 [51:17:37<35:20:19,  7.67s/it]
 56%|█████▋    | 21369/37963 [51:17:45<35:26:19,  7.69s/it]
 56%|█████▋    | 21370/37963 [51:17:53<35:21:15,  7.67s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.829', 'learning_rate': '8.455e-06', 'epoch': '0.5629'}

 56%|█████▋    | 21370/37963 [51:17:53<35:21:15,  7.67s/it]
 56%|█████▋    | 21371/37963 [51:18:07<44:26:14,  9.64s/it]
 56%|█████▋    | 21372/37963 [51:18:15<41:34:22,  9.02s/it]
 56%|█████▋    | 21373/37963 [51:18:22<39:23:33,  8.55s/it]
 56%|█████▋    | 21374/37963 [51:18:30<38:03:22,  8.26s/it]
 56%|█████▋    | 21375/37963 [51:18:37<36:45:47,  7.98s/it]
 56%|█████▋    | 21376/37963 [51:18:44<36:05:43,  7.83s/it]
 56%|█████▋    | 21377/37963 [51:18:52<35:42:33,  7.75s/it]
 56%|█████▋    | 21378/37963 [51:18:59<35:20:28,  7.67s/it]
 56%|█████▋    | 21379/37963 [51:19:07<35:02:15,  7.61s/it]
 56%|█████▋    | 21380/37963 [51:19:14<34:38:54,  7.52s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '5.118', 'learning_rate': '8.447e-06', 'epoch': '0.5632'}

 56%|█████▋    | 21380/37963 [51:19:14<34:38:54,  7.52s/it]
 56%|█████▋    | 21381/37963 [51:19:22<34:42:16,  7.53s/it]
 56%|█████▋    | 21382/37963 [51:19:29<34:27:37,  7.48s/it]
 56%|█████▋    | 21383/37963 [51:19:37<34:33:37,  7.50s/it]
 56%|█████▋    | 21384/37963 [51:19:44<34:04:39,  7.40s/it]
 56%|█████▋    | 21385/37963 [51:19:58<43:10:52,  9.38s/it]
 56%|█████▋    | 21386/37963 [51:20:06<40:50:48,  8.87s/it]
 56%|█████▋    | 21387/37963 [51:20:13<38:58:27,  8.46s/it]
 56%|█████▋    | 21388/37963 [51:20:20<37:25:23,  8.13s/it]
 56%|█████▋    | 21389/37963 [51:20:28<36:30:53,  7.93s/it]
 56%|█████▋    | 21390/37963 [51:20:42<45:15:28,  9.83s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '2.191', 'learning_rate': '8.438e-06', 'epoch': '0.5634'}

 56%|█████▋    | 21390/37963 [51:20:42<45:15:28,  9.83s/it]
 56%|█████▋    | 21391/37963 [51:20:50<42:31:52,  9.24s/it]
 56%|█████▋    | 21392/37963 [51:20:58<40:11:28,  8.73s/it]
 56%|█████▋    | 21393/37963 [51:21:05<38:43:44,  8.41s/it]
 56%|█████▋    | 21394/37963 [51:21:13<37:09:34,  8.07s/it]
 56%|█████▋    | 21395/37963 [51:21:20<36:22:21,  7.90s/it]
 56%|█████▋    | 21396/37963 [51:21:28<35:54:39,  7.80s/it]
 56%|█████▋    | 21397/37963 [51:21:42<44:28:01,  9.66s/it]
 56%|█████▋    | 21398/37963 [51:21:49<41:38:30,  9.05s/it]
 56%|█████▋    | 21399/37963 [51:21:57<39:33:29,  8.60s/it]
 56%|█████▋    | 21400/37963 [51:22:04<38:13:23,  8.31s/it]
                                                           
{'loss': '0.1497', 'grad_norm': '1.367', 'learning_rate': '8.43e-06', 'epoch': '0.5637'}

 56%|█████▋    | 21400/37963 [51:22:04<38:13:23,  8.31s/it]
 56%|█████▋    | 21401/37963 [51:22:12<37:13:14,  8.09s/it]
 56%|█████▋    | 21402/37963 [51:22:26<45:33:00,  9.90s/it]
 56%|█████▋    | 21403/37963 [51:22:40<51:20:57, 11.16s/it]
 56%|█████▋    | 21404/37963 [51:22:48<46:27:14, 10.10s/it]
 56%|█████▋    | 21405/37963 [51:22:55<42:52:16,  9.32s/it]
 56%|█████▋    | 21406/37963 [51:23:03<40:02:23,  8.71s/it]
 56%|█████▋    | 21407/37963 [51:23:10<38:22:11,  8.34s/it]
 56%|█████▋    | 21408/37963 [51:23:18<37:13:00,  8.09s/it]
 56%|█████▋    | 21409/37963 [51:23:31<45:06:40,  9.81s/it]
 56%|█████▋    | 21410/37963 [51:23:39<42:11:00,  9.17s/it]
                                                           
{'loss': '0.144', 'grad_norm': '2.263', 'learning_rate': '8.422e-06', 'epoch': '0.564'}

 56%|█████▋    | 21410/37963 [51:23:39<42:11:00,  9.17s/it]
 56%|█████▋    | 21411/37963 [51:23:47<39:55:23,  8.68s/it]
 56%|█████▋    | 21412/37963 [51:23:54<38:36:56,  8.40s/it]
 56%|█████▋    | 21413/37963 [51:24:02<37:30:39,  8.16s/it]
 56%|█████▋    | 21414/37963 [51:24:10<37:01:56,  8.06s/it]
 56%|█████▋    | 21415/37963 [51:24:17<36:16:45,  7.89s/it]
 56%|█████▋    | 21416/37963 [51:24:25<35:37:18,  7.75s/it]
 56%|█████▋    | 21417/37963 [51:24:32<35:14:09,  7.67s/it]
 56%|█████▋    | 21418/37963 [51:24:46<44:18:45,  9.64s/it]
 56%|█████▋    | 21419/37963 [51:24:54<41:25:38,  9.01s/it]
 56%|█████▋    | 21420/37963 [51:25:01<39:19:07,  8.56s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.407', 'learning_rate': '8.413e-06', 'epoch': '0.5642'}

 56%|█████▋    | 21420/37963 [51:25:01<39:19:07,  8.56s/it]
 56%|█████▋    | 21421/37963 [51:25:09<37:54:22,  8.25s/it]
 56%|█████▋    | 21422/37963 [51:25:17<37:02:27,  8.06s/it]
 56%|█████▋    | 21423/37963 [51:25:24<36:19:26,  7.91s/it]
 56%|█████▋    | 21424/37963 [51:25:32<35:44:36,  7.78s/it]
 56%|█████▋    | 21425/37963 [51:25:39<35:25:59,  7.71s/it]
 56%|█████▋    | 21426/37963 [51:25:47<34:54:09,  7.60s/it]
 56%|█████▋    | 21427/37963 [51:25:54<34:45:27,  7.57s/it]
 56%|█████▋    | 21428/37963 [51:26:02<34:49:32,  7.58s/it]
 56%|█████▋    | 21429/37963 [51:26:10<35:13:37,  7.67s/it]
 56%|█████▋    | 21430/37963 [51:26:17<35:09:23,  7.66s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '1.003', 'learning_rate': '8.405e-06', 'epoch': '0.5645'}

 56%|█████▋    | 21430/37963 [51:26:17<35:09:23,  7.66s/it]
 56%|█████▋    | 21431/37963 [51:26:25<35:14:51,  7.68s/it]
 56%|█████▋    | 21432/37963 [51:26:33<35:12:20,  7.67s/it]
 56%|█████▋    | 21433/37963 [51:26:40<35:13:36,  7.67s/it]
 56%|█████▋    | 21434/37963 [51:27:01<52:46:39, 11.49s/it]
 56%|█████▋    | 21435/37963 [51:27:08<47:00:21, 10.24s/it]
 56%|█████▋    | 21436/37963 [51:27:15<43:16:20,  9.43s/it]
 56%|█████▋    | 21437/37963 [51:27:23<40:39:38,  8.86s/it]
 56%|█████▋    | 21438/37963 [51:27:31<38:49:32,  8.46s/it]
 56%|█████▋    | 21439/37963 [51:27:38<37:31:41,  8.18s/it]
 56%|█████▋    | 21440/37963 [51:27:46<36:37:50,  7.98s/it]
                                                           
{'loss': '0.1571', 'grad_norm': '1.047', 'learning_rate': '8.396e-06', 'epoch': '0.5648'}

 56%|█████▋    | 21440/37963 [51:27:46<36:37:50,  7.98s/it]
 56%|█████▋    | 21441/37963 [51:27:53<35:59:18,  7.84s/it]
 56%|█████▋    | 21442/37963 [51:28:01<35:27:00,  7.72s/it]
 56%|█████▋    | 21443/37963 [51:28:08<35:17:51,  7.69s/it]
 56%|█████▋    | 21444/37963 [51:28:22<44:09:35,  9.62s/it]
 56%|█████▋    | 21445/37963 [51:28:30<41:20:53,  9.01s/it]
 56%|█████▋    | 21446/37963 [51:28:37<38:59:23,  8.50s/it]
 56%|█████▋    | 21447/37963 [51:28:45<37:46:06,  8.23s/it]
 56%|█████▋    | 21448/37963 [51:28:52<36:51:56,  8.04s/it]
 56%|█████▋    | 21449/37963 [51:29:06<44:33:09,  9.71s/it]
 57%|█████▋    | 21450/37963 [51:29:20<50:40:19, 11.05s/it]
                                                           
{'loss': '0.12', 'grad_norm': '0.8871', 'learning_rate': '8.388e-06', 'epoch': '0.565'}

 57%|█████▋    | 21450/37963 [51:29:20<50:40:19, 11.05s/it]
 57%|█████▋    | 21451/37963 [51:29:27<45:34:19,  9.94s/it]
 57%|█████▋    | 21452/37963 [51:29:42<51:37:47, 11.26s/it]
 57%|█████▋    | 21453/37963 [51:29:50<46:43:11, 10.19s/it]
 57%|█████▋    | 21454/37963 [51:29:57<43:06:52,  9.40s/it]
 57%|█████▋    | 21455/37963 [51:30:05<40:28:07,  8.83s/it]
 57%|█████▋    | 21456/37963 [51:30:12<38:30:50,  8.40s/it]
 57%|█████▋    | 21457/37963 [51:30:20<37:23:25,  8.15s/it]
 57%|█████▋    | 21458/37963 [51:30:27<36:38:25,  7.99s/it]
 57%|█████▋    | 21459/37963 [51:30:35<35:47:27,  7.81s/it]
 57%|█████▋    | 21460/37963 [51:30:42<35:28:06,  7.74s/it]
                                                           
{'loss': '0.1619', 'grad_norm': '1.449', 'learning_rate': '8.379e-06', 'epoch': '0.5653'}

 57%|█████▋    | 21460/37963 [51:30:42<35:28:06,  7.74s/it]
 57%|█████▋    | 21461/37963 [51:30:50<35:19:58,  7.71s/it]
 57%|█████▋    | 21462/37963 [51:31:04<43:52:48,  9.57s/it]
 57%|█████▋    | 21463/37963 [51:31:18<50:10:14, 10.95s/it]
 57%|█████▋    | 21464/37963 [51:31:25<45:28:03,  9.92s/it]
 57%|█████▋    | 21465/37963 [51:31:33<42:18:18,  9.23s/it]
 57%|█████▋    | 21466/37963 [51:31:41<40:01:46,  8.74s/it]
 57%|█████▋    | 21467/37963 [51:31:48<38:19:10,  8.36s/it]
 57%|█████▋    | 21468/37963 [51:31:56<37:18:31,  8.14s/it]
 57%|█████▋    | 21469/37963 [51:32:03<36:09:54,  7.89s/it]
 57%|█████▋    | 21470/37963 [51:32:11<35:57:28,  7.85s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.047', 'learning_rate': '8.371e-06', 'epoch': '0.5656'}

 57%|█████▋    | 21470/37963 [51:32:11<35:57:28,  7.85s/it]
 57%|█████▋    | 21471/37963 [51:32:18<35:35:23,  7.77s/it]
 57%|█████▋    | 21472/37963 [51:32:26<35:26:45,  7.74s/it]
 57%|█████▋    | 21473/37963 [51:32:34<35:08:23,  7.67s/it]
 57%|█████▋    | 21474/37963 [51:32:41<34:54:31,  7.62s/it]
 57%|█████▋    | 21475/37963 [51:32:49<34:46:33,  7.59s/it]
 57%|█████▋    | 21476/37963 [51:32:56<34:40:30,  7.57s/it]
 57%|█████▋    | 21477/37963 [51:33:04<34:31:15,  7.54s/it]
 57%|█████▋    | 21478/37963 [51:33:11<34:31:36,  7.54s/it]
 57%|█████▋    | 21479/37963 [51:33:19<34:41:44,  7.58s/it]
 57%|█████▋    | 21480/37963 [51:33:33<43:38:00,  9.53s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '3.836', 'learning_rate': '8.363e-06', 'epoch': '0.5658'}

 57%|█████▋    | 21480/37963 [51:33:33<43:38:00,  9.53s/it]
 57%|█████▋    | 21481/37963 [51:33:40<40:42:33,  8.89s/it]
 57%|█████▋    | 21482/37963 [51:33:54<47:52:42, 10.46s/it]
 57%|█████▋    | 21483/37963 [51:34:02<43:55:45,  9.60s/it]
 57%|█████▋    | 21484/37963 [51:34:09<40:54:14,  8.94s/it]
 57%|█████▋    | 21485/37963 [51:34:17<39:06:39,  8.54s/it]
 57%|█████▋    | 21486/37963 [51:34:24<37:31:01,  8.20s/it]
 57%|█████▋    | 21487/37963 [51:34:32<36:33:28,  7.99s/it]
 57%|█████▋    | 21488/37963 [51:34:39<36:05:48,  7.89s/it]
 57%|█████▋    | 21489/37963 [51:34:47<35:43:02,  7.81s/it]
 57%|█████▋    | 21490/37963 [51:34:54<35:03:09,  7.66s/it]
                                                           
{'loss': '0.1464', 'grad_norm': '3.779', 'learning_rate': '8.354e-06', 'epoch': '0.5661'}

 57%|█████▋    | 21490/37963 [51:34:54<35:03:09,  7.66s/it]
 57%|█████▋    | 21491/37963 [51:35:08<43:49:02,  9.58s/it]
 57%|█████▋    | 21492/37963 [51:35:16<40:36:32,  8.88s/it]
 57%|█████▋    | 21493/37963 [51:35:23<38:45:23,  8.47s/it]
 57%|█████▋    | 21494/37963 [51:35:31<37:29:43,  8.20s/it]
 57%|█████▋    | 21495/37963 [51:35:45<45:22:04,  9.92s/it]
 57%|█████▋    | 21496/37963 [51:35:58<50:35:13, 11.06s/it]
 57%|█████▋    | 21497/37963 [51:36:06<45:51:23, 10.03s/it]
 57%|█████▋    | 21498/37963 [51:36:20<51:07:18, 11.18s/it]
 57%|█████▋    | 21499/37963 [51:36:27<46:08:28, 10.09s/it]
 57%|█████▋    | 21500/37963 [51:36:35<42:36:38,  9.32s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '0.958', 'learning_rate': '8.346e-06', 'epoch': '0.5663'}

 57%|█████▋    | 21500/37963 [51:36:35<42:36:38,  9.32s/it]
 57%|█████▋    | 21501/37963 [51:36:42<40:06:10,  8.77s/it]
 57%|█████▋    | 21502/37963 [51:36:50<38:32:58,  8.43s/it]
 57%|█████▋    | 21503/37963 [51:36:58<37:25:57,  8.19s/it]
 57%|█████▋    | 21504/37963 [51:37:05<36:04:49,  7.89s/it]
 57%|█████▋    | 21505/37963 [51:37:12<35:33:07,  7.78s/it]
 57%|█████▋    | 21506/37963 [51:37:20<35:26:34,  7.75s/it]
 57%|█████▋    | 21507/37963 [51:37:34<44:15:39,  9.68s/it]
 57%|█████▋    | 21508/37963 [51:37:42<41:24:56,  9.06s/it]
 57%|█████▋    | 21509/37963 [51:37:50<39:21:36,  8.61s/it]
 57%|█████▋    | 21510/37963 [51:37:57<37:52:37,  8.29s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '1.705', 'learning_rate': '8.337e-06', 'epoch': '0.5666'}

 57%|█████▋    | 21510/37963 [51:37:57<37:52:37,  8.29s/it]
 57%|█████▋    | 21511/37963 [51:38:05<36:56:15,  8.08s/it]
 57%|█████▋    | 21512/37963 [51:38:12<36:13:48,  7.93s/it]
 57%|█████▋    | 21513/37963 [51:38:20<35:27:43,  7.76s/it]
 57%|█████▋    | 21514/37963 [51:38:27<35:10:12,  7.70s/it]
 57%|█████▋    | 21515/37963 [51:38:35<34:59:49,  7.66s/it]
 57%|█████▋    | 21516/37963 [51:38:49<43:48:12,  9.59s/it]
 57%|█████▋    | 21517/37963 [51:38:57<41:16:52,  9.04s/it]
 57%|█████▋    | 21518/37963 [51:39:04<38:46:01,  8.49s/it]
 57%|█████▋    | 21519/37963 [51:39:11<37:15:44,  8.16s/it]
 57%|█████▋    | 21520/37963 [51:39:19<36:17:23,  7.95s/it]
                                                           
{'loss': '0.1631', 'grad_norm': '2.76', 'learning_rate': '8.329e-06', 'epoch': '0.5669'}

 57%|█████▋    | 21520/37963 [51:39:19<36:17:23,  7.95s/it]
 57%|█████▋    | 21521/37963 [51:39:26<35:27:11,  7.76s/it]
 57%|█████▋    | 21522/37963 [51:39:33<35:04:15,  7.68s/it]
 57%|█████▋    | 21523/37963 [51:39:41<35:05:38,  7.68s/it]
 57%|█████▋    | 21524/37963 [51:39:49<34:47:02,  7.62s/it]
 57%|█████▋    | 21525/37963 [51:39:56<34:41:52,  7.60s/it]
 57%|█████▋    | 21526/37963 [51:40:04<34:42:48,  7.60s/it]
 57%|█████▋    | 21527/37963 [51:40:11<34:38:55,  7.59s/it]
 57%|█████▋    | 21528/37963 [51:40:25<43:21:52,  9.50s/it]
 57%|█████▋    | 21529/37963 [51:40:33<40:45:37,  8.93s/it]
 57%|█████▋    | 21530/37963 [51:40:41<39:08:08,  8.57s/it]
                                                           
{'loss': '0.1394', 'grad_norm': '2.109', 'learning_rate': '8.32e-06', 'epoch': '0.5671'}

 57%|█████▋    | 21530/37963 [51:40:41<39:08:08,  8.57s/it]
 57%|█████▋    | 21531/37963 [51:40:48<37:44:11,  8.27s/it]
 57%|█████▋    | 21532/37963 [51:40:56<36:52:46,  8.08s/it]
 57%|█████▋    | 21533/37963 [51:41:03<36:21:22,  7.97s/it]
 57%|█████▋    | 21534/37963 [51:41:11<35:41:13,  7.82s/it]
 57%|█████▋    | 21535/37963 [51:41:18<35:00:15,  7.67s/it]
 57%|█████▋    | 21536/37963 [51:41:39<52:47:20, 11.57s/it]
 57%|█████▋    | 21537/37963 [51:41:47<47:19:47, 10.37s/it]
 57%|█████▋    | 21538/37963 [51:41:54<43:28:13,  9.53s/it]
 57%|█████▋    | 21539/37963 [51:42:02<40:40:59,  8.92s/it]
 57%|█████▋    | 21540/37963 [51:42:09<38:47:35,  8.50s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '3.086', 'learning_rate': '8.312e-06', 'epoch': '0.5674'}

 57%|█████▋    | 21540/37963 [51:42:09<38:47:35,  8.50s/it]
 57%|█████▋    | 21541/37963 [51:42:17<37:17:22,  8.17s/it]
 57%|█████▋    | 21542/37963 [51:42:24<36:17:39,  7.96s/it]
 57%|█████▋    | 21543/37963 [51:42:32<35:45:46,  7.84s/it]
 57%|█████▋    | 21544/37963 [51:42:45<43:32:34,  9.55s/it]
 57%|█████▋    | 21545/37963 [51:42:59<49:38:13, 10.88s/it]
 57%|█████▋    | 21546/37963 [51:43:07<45:10:42,  9.91s/it]
 57%|█████▋    | 21547/37963 [51:43:14<41:49:08,  9.17s/it]
 57%|█████▋    | 21548/37963 [51:43:22<39:34:15,  8.68s/it]
 57%|█████▋    | 21549/37963 [51:43:36<46:48:19, 10.27s/it]
 57%|█████▋    | 21550/37963 [51:43:43<43:14:36,  9.48s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.632', 'learning_rate': '8.304e-06', 'epoch': '0.5677'}

 57%|█████▋    | 21550/37963 [51:43:43<43:14:36,  9.48s/it]
 57%|█████▋    | 21551/37963 [51:43:51<40:56:52,  8.98s/it]
 57%|█████▋    | 21552/37963 [51:43:59<38:44:41,  8.50s/it]
 57%|█████▋    | 21553/37963 [51:44:13<46:21:51, 10.17s/it]
 57%|█████▋    | 21554/37963 [51:44:20<42:36:00,  9.35s/it]
 57%|█████▋    | 21555/37963 [51:44:27<40:00:04,  8.78s/it]
 57%|█████▋    | 21556/37963 [51:44:35<38:15:50,  8.40s/it]
 57%|█████▋    | 21557/37963 [51:44:43<37:11:46,  8.16s/it]
 57%|█████▋    | 21558/37963 [51:44:50<36:39:20,  8.04s/it]
 57%|█████▋    | 21559/37963 [51:44:58<35:47:11,  7.85s/it]
 57%|█████▋    | 21560/37963 [51:45:05<34:55:29,  7.67s/it]
                                                           
{'loss': '0.1421', 'grad_norm': '1.789', 'learning_rate': '8.295e-06', 'epoch': '0.5679'}

 57%|█████▋    | 21560/37963 [51:45:05<34:55:29,  7.67s/it]
 57%|█████▋    | 21561/37963 [51:45:12<34:30:45,  7.58s/it]
 57%|█████▋    | 21562/37963 [51:45:20<34:26:17,  7.56s/it]
 57%|█████▋    | 21563/37963 [51:45:34<43:44:56,  9.60s/it]
 57%|█████▋    | 21564/37963 [51:45:42<40:50:08,  8.96s/it]
 57%|█████▋    | 21565/37963 [51:45:49<38:45:30,  8.51s/it]
 57%|█████▋    | 21566/37963 [51:45:57<37:28:54,  8.23s/it]
 57%|█████▋    | 21567/37963 [51:46:04<36:29:45,  8.01s/it]
 57%|█████▋    | 21568/37963 [51:46:12<35:49:53,  7.87s/it]
 57%|█████▋    | 21569/37963 [51:46:19<35:15:21,  7.74s/it]
 57%|█████▋    | 21570/37963 [51:46:27<35:00:43,  7.69s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '1.835', 'learning_rate': '8.287e-06', 'epoch': '0.5682'}

 57%|█████▋    | 21570/37963 [51:46:27<35:00:43,  7.69s/it]
 57%|█████▋    | 21571/37963 [51:46:34<34:46:19,  7.64s/it]
 57%|█████▋    | 21572/37963 [51:46:42<34:41:52,  7.62s/it]
 57%|█████▋    | 21573/37963 [51:46:50<34:45:09,  7.63s/it]
 57%|█████▋    | 21574/37963 [51:46:57<34:42:22,  7.62s/it]
 57%|█████▋    | 21575/37963 [51:47:05<34:34:30,  7.60s/it]
 57%|█████▋    | 21576/37963 [51:47:12<34:26:56,  7.57s/it]
 57%|█████▋    | 21577/37963 [51:47:20<34:26:59,  7.57s/it]
 57%|█████▋    | 21578/37963 [51:47:27<34:34:40,  7.60s/it]
 57%|█████▋    | 21579/37963 [51:47:35<34:17:45,  7.54s/it]
 57%|█████▋    | 21580/37963 [51:47:49<43:09:20,  9.48s/it]
                                                           
{'loss': '0.1376', 'grad_norm': '1.026', 'learning_rate': '8.278e-06', 'epoch': '0.5685'}

 57%|█████▋    | 21580/37963 [51:47:49<43:09:20,  9.48s/it]
 57%|█████▋    | 21581/37963 [51:47:56<40:28:48,  8.90s/it]
 57%|█████▋    | 21582/37963 [51:48:10<47:17:53, 10.39s/it]
 57%|█████▋    | 21583/37963 [51:48:18<43:50:51,  9.64s/it]
 57%|█████▋    | 21584/37963 [51:48:32<50:02:11, 11.00s/it]
 57%|█████▋    | 21585/37963 [51:48:40<45:17:17,  9.95s/it]
 57%|█████▋    | 21586/37963 [51:48:47<41:38:05,  9.15s/it]
 57%|█████▋    | 21587/37963 [51:48:55<39:25:01,  8.67s/it]
 57%|█████▋    | 21588/37963 [51:49:02<37:56:09,  8.34s/it]
 57%|█████▋    | 21589/37963 [51:49:16<45:28:12, 10.00s/it]
 57%|█████▋    | 21590/37963 [51:49:24<42:08:34,  9.27s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '1.391', 'learning_rate': '8.27e-06', 'epoch': '0.5687'}

 57%|█████▋    | 21590/37963 [51:49:24<42:08:34,  9.27s/it]
 57%|█████▋    | 21591/37963 [51:49:31<39:46:08,  8.74s/it]
 57%|█████▋    | 21592/37963 [51:49:39<38:19:32,  8.43s/it]
 57%|█████▋    | 21593/37963 [51:49:46<37:02:46,  8.15s/it]
 57%|█████▋    | 21594/37963 [51:49:54<36:24:13,  8.01s/it]
 57%|█████▋    | 21595/37963 [51:50:02<36:02:36,  7.93s/it]
 57%|█████▋    | 21596/37963 [51:50:09<35:28:39,  7.80s/it]
 57%|█████▋    | 21597/37963 [51:50:17<35:04:25,  7.72s/it]
 57%|█████▋    | 21598/37963 [51:50:31<44:28:06,  9.78s/it]
 57%|█████▋    | 21599/37963 [51:50:46<50:23:12, 11.08s/it]
 57%|█████▋    | 21600/37963 [51:50:53<45:32:58, 10.02s/it]
                                                           
{'loss': '0.1318', 'grad_norm': '1.618', 'learning_rate': '8.262e-06', 'epoch': '0.569'}

 57%|█████▋    | 21600/37963 [51:50:53<45:32:58, 10.02s/it]
 57%|█████▋    | 21601/37963 [51:51:07<50:54:35, 11.20s/it]
 57%|█████▋    | 21602/37963 [51:51:15<46:13:23, 10.17s/it]
 57%|█████▋    | 21603/37963 [51:51:22<42:44:56,  9.41s/it]
 57%|█████▋    | 21604/37963 [51:51:30<39:55:13,  8.78s/it]
 57%|█████▋    | 21605/37963 [51:51:37<38:16:41,  8.42s/it]
 57%|█████▋    | 21606/37963 [51:51:45<37:07:44,  8.17s/it]
 57%|█████▋    | 21607/37963 [51:51:52<36:09:23,  7.96s/it]
 57%|█████▋    | 21608/37963 [51:52:00<35:41:51,  7.86s/it]
 57%|█████▋    | 21609/37963 [51:52:08<35:21:09,  7.78s/it]
 57%|█████▋    | 21610/37963 [51:52:15<35:06:21,  7.73s/it]
                                                           
{'loss': '0.1441', 'grad_norm': '2.141', 'learning_rate': '8.253e-06', 'epoch': '0.5692'}

 57%|█████▋    | 21610/37963 [51:52:15<35:06:21,  7.73s/it]
 57%|█████▋    | 21611/37963 [51:52:23<35:01:45,  7.71s/it]
 57%|█████▋    | 21612/37963 [51:52:30<34:43:13,  7.64s/it]
 57%|█████▋    | 21613/37963 [51:52:38<34:40:39,  7.64s/it]
 57%|█████▋    | 21614/37963 [51:52:52<43:41:10,  9.62s/it]
 57%|█████▋    | 21615/37963 [51:53:00<40:34:31,  8.94s/it]
 57%|█████▋    | 21616/37963 [51:53:07<38:22:54,  8.45s/it]
 57%|█████▋    | 21617/37963 [51:53:14<37:05:48,  8.17s/it]
 57%|█████▋    | 21618/37963 [51:53:22<36:16:30,  7.99s/it]
 57%|█████▋    | 21619/37963 [51:53:29<35:12:53,  7.76s/it]
 57%|█████▋    | 21620/37963 [51:53:37<34:40:20,  7.64s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.486', 'learning_rate': '8.245e-06', 'epoch': '0.5695'}

 57%|█████▋    | 21620/37963 [51:53:37<34:40:20,  7.64s/it]
 57%|█████▋    | 21621/37963 [51:53:44<34:30:42,  7.60s/it]
 57%|█████▋    | 21622/37963 [51:53:52<34:23:55,  7.58s/it]
 57%|█████▋    | 21623/37963 [51:53:59<33:51:03,  7.46s/it]
 57%|█████▋    | 21624/37963 [51:54:06<33:57:12,  7.48s/it]
 57%|█████▋    | 21625/37963 [51:54:14<33:52:41,  7.46s/it]
 57%|█████▋    | 21626/37963 [51:54:21<34:00:31,  7.49s/it]
 57%|█████▋    | 21627/37963 [51:54:35<42:33:37,  9.38s/it]
 57%|█████▋    | 21628/37963 [51:54:42<39:46:55,  8.77s/it]
 57%|█████▋    | 21629/37963 [51:54:50<37:56:14,  8.36s/it]
 57%|█████▋    | 21630/37963 [51:54:57<36:46:24,  8.11s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '1.152', 'learning_rate': '8.236e-06', 'epoch': '0.5698'}

 57%|█████▋    | 21630/37963 [51:54:57<36:46:24,  8.11s/it]
 57%|█████▋    | 21631/37963 [51:55:12<45:04:40,  9.94s/it]
 57%|█████▋    | 21632/37963 [51:55:19<42:14:45,  9.31s/it]
 57%|█████▋    | 21633/37963 [51:55:27<39:49:09,  8.78s/it]
 57%|█████▋    | 21634/37963 [51:55:41<47:25:54, 10.46s/it]
 57%|█████▋    | 21635/37963 [51:55:49<43:50:02,  9.66s/it]
 57%|█████▋    | 21636/37963 [51:55:57<40:55:44,  9.02s/it]
 57%|█████▋    | 21637/37963 [51:56:04<38:54:16,  8.58s/it]
 57%|█████▋    | 21638/37963 [51:56:12<37:30:04,  8.27s/it]
 57%|█████▋    | 21639/37963 [51:56:25<44:47:56,  9.88s/it]
 57%|█████▋    | 21640/37963 [51:56:33<41:40:31,  9.19s/it]
                                                           
{'loss': '0.145', 'grad_norm': '1.73', 'learning_rate': '8.228e-06', 'epoch': '0.57'}

 57%|█████▋    | 21640/37963 [51:56:33<41:40:31,  9.19s/it]
 57%|█████▋    | 21641/37963 [51:56:41<39:29:24,  8.71s/it]
 57%|█████▋    | 21642/37963 [51:56:48<37:56:48,  8.37s/it]
 57%|█████▋    | 21643/37963 [51:56:56<36:48:05,  8.12s/it]
 57%|█████▋    | 21644/37963 [51:57:03<36:04:37,  7.96s/it]
 57%|█████▋    | 21645/37963 [51:57:11<35:39:21,  7.87s/it]
 57%|█████▋    | 21646/37963 [51:57:25<44:04:15,  9.72s/it]
 57%|█████▋    | 21647/37963 [51:57:33<41:13:09,  9.09s/it]
 57%|█████▋    | 21648/37963 [51:57:40<39:11:07,  8.65s/it]
 57%|█████▋    | 21649/37963 [51:57:48<37:52:11,  8.36s/it]
 57%|█████▋    | 21650/37963 [51:58:02<45:48:53, 10.11s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '2.426', 'learning_rate': '8.22e-06', 'epoch': '0.5703'}

 57%|█████▋    | 21650/37963 [51:58:02<45:48:53, 10.11s/it]
 57%|█████▋    | 21651/37963 [51:58:10<42:19:23,  9.34s/it]
 57%|█████▋    | 21652/37963 [51:58:17<39:50:36,  8.79s/it]
 57%|█████▋    | 21653/37963 [51:58:25<38:10:34,  8.43s/it]
 57%|█████▋    | 21654/37963 [51:58:32<36:24:14,  8.04s/it]
 57%|█████▋    | 21655/37963 [51:58:39<35:43:19,  7.89s/it]
 57%|█████▋    | 21656/37963 [51:58:47<35:12:46,  7.77s/it]
 57%|█████▋    | 21657/37963 [51:58:55<35:11:43,  7.77s/it]
 57%|█████▋    | 21658/37963 [51:59:02<34:58:25,  7.72s/it]
 57%|█████▋    | 21659/37963 [51:59:10<34:48:26,  7.69s/it]
 57%|█████▋    | 21660/37963 [51:59:17<34:36:33,  7.64s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '2.205', 'learning_rate': '8.211e-06', 'epoch': '0.5706'}

 57%|█████▋    | 21660/37963 [51:59:17<34:36:33,  7.64s/it]
 57%|█████▋    | 21661/37963 [51:59:31<43:19:58,  9.57s/it]
 57%|█████▋    | 21662/37963 [51:59:39<40:35:30,  8.96s/it]
 57%|█████▋    | 21663/37963 [51:59:46<38:20:39,  8.47s/it]
 57%|█████▋    | 21664/37963 [51:59:54<37:07:22,  8.20s/it]
 57%|█████▋    | 21665/37963 [52:00:01<36:10:06,  7.99s/it]
 57%|█████▋    | 21666/37963 [52:00:09<35:40:02,  7.88s/it]
 57%|█████▋    | 21667/37963 [52:00:17<35:11:52,  7.78s/it]
 57%|█████▋    | 21668/37963 [52:00:24<34:57:39,  7.72s/it]
 57%|█████▋    | 21669/37963 [52:00:32<34:43:35,  7.67s/it]
 57%|█████▋    | 21670/37963 [52:00:39<34:39:30,  7.66s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '2.631', 'learning_rate': '8.203e-06', 'epoch': '0.5708'}

 57%|█████▋    | 21670/37963 [52:00:39<34:39:30,  7.66s/it]
 57%|█████▋    | 21671/37963 [52:00:47<34:28:34,  7.62s/it]
 57%|█████▋    | 21672/37963 [52:00:54<34:21:20,  7.59s/it]
 57%|█████▋    | 21673/37963 [52:01:02<34:21:34,  7.59s/it]
 57%|█████▋    | 21674/37963 [52:01:09<34:16:02,  7.57s/it]
 57%|█████▋    | 21675/37963 [52:01:24<43:03:12,  9.52s/it]
 57%|█████▋    | 21676/37963 [52:01:31<40:24:53,  8.93s/it]
 57%|█████▋    | 21677/37963 [52:01:39<38:31:31,  8.52s/it]
 57%|█████▋    | 21678/37963 [52:01:46<37:06:55,  8.20s/it]
 57%|█████▋    | 21679/37963 [52:01:54<36:17:16,  8.02s/it]
 57%|█████▋    | 21680/37963 [52:02:01<35:38:23,  7.88s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '5.63', 'learning_rate': '8.194e-06', 'epoch': '0.5711'}

 57%|█████▋    | 21680/37963 [52:02:01<35:38:23,  7.88s/it]
 57%|█████▋    | 21681/37963 [52:02:22<52:42:49, 11.66s/it]
 57%|█████▋    | 21682/37963 [52:02:29<47:18:33, 10.46s/it]
 57%|█████▋    | 21683/37963 [52:02:37<43:17:18,  9.57s/it]
 57%|█████▋    | 21684/37963 [52:02:45<40:39:58,  8.99s/it]
 57%|█████▋    | 21685/37963 [52:02:58<47:21:57, 10.48s/it]
 57%|█████▋    | 21686/37963 [52:03:06<43:33:04,  9.63s/it]
 57%|█████▋    | 21687/37963 [52:03:14<40:41:08,  9.00s/it]
 57%|█████▋    | 21688/37963 [52:03:21<38:41:01,  8.56s/it]
 57%|█████▋    | 21689/37963 [52:03:29<37:13:27,  8.23s/it]
 57%|█████▋    | 21690/37963 [52:03:36<36:01:03,  7.97s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.009', 'learning_rate': '8.186e-06', 'epoch': '0.5713'}

 57%|█████▋    | 21690/37963 [52:03:36<36:01:03,  7.97s/it]
 57%|█████▋    | 21691/37963 [52:03:43<35:04:18,  7.76s/it]
 57%|█████▋    | 21692/37963 [52:03:58<43:53:17,  9.71s/it]
 57%|█████▋    | 21693/37963 [52:04:05<40:57:01,  9.06s/it]
 57%|█████▋    | 21694/37963 [52:04:13<38:59:57,  8.63s/it]
 57%|█████▋    | 21695/37963 [52:04:20<37:29:59,  8.30s/it]
 57%|█████▋    | 21696/37963 [52:04:28<36:23:42,  8.05s/it]
 57%|█████▋    | 21697/37963 [52:04:41<44:01:20,  9.74s/it]
 57%|█████▋    | 21698/37963 [52:04:56<50:00:09, 11.07s/it]
 57%|█████▋    | 21699/37963 [52:05:03<45:19:43, 10.03s/it]
 57%|█████▋    | 21700/37963 [52:05:11<41:50:43,  9.26s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '4.828', 'learning_rate': '8.178e-06', 'epoch': '0.5716'}

 57%|█████▋    | 21700/37963 [52:05:11<41:50:43,  9.26s/it]
 57%|█████▋    | 21701/37963 [52:05:18<39:26:10,  8.73s/it]
 57%|█████▋    | 21702/37963 [52:05:26<37:51:30,  8.38s/it]
 57%|█████▋    | 21703/37963 [52:05:33<36:41:01,  8.12s/it]
 57%|█████▋    | 21704/37963 [52:05:41<35:38:02,  7.89s/it]
 57%|█████▋    | 21705/37963 [52:05:48<34:44:05,  7.69s/it]
 57%|█████▋    | 21706/37963 [52:05:55<34:14:53,  7.58s/it]
 57%|█████▋    | 21707/37963 [52:06:02<33:55:31,  7.51s/it]
 57%|█████▋    | 21708/37963 [52:06:10<34:06:19,  7.55s/it]
 57%|█████▋    | 21709/37963 [52:06:24<42:29:15,  9.41s/it]
 57%|█████▋    | 21710/37963 [52:06:31<40:01:23,  8.87s/it]
                                                           
{'loss': '0.1432', 'grad_norm': '1.092', 'learning_rate': '8.169e-06', 'epoch': '0.5719'}

 57%|█████▋    | 21710/37963 [52:06:31<40:01:23,  8.87s/it]
 57%|█████▋    | 21711/37963 [52:06:39<38:05:43,  8.44s/it]
 57%|█████▋    | 21712/37963 [52:06:46<36:54:13,  8.18s/it]
 57%|█████▋    | 21713/37963 [52:06:54<35:49:03,  7.93s/it]
 57%|█████▋    | 21714/37963 [52:07:01<35:16:17,  7.81s/it]
 57%|█████▋    | 21715/37963 [52:07:09<35:02:46,  7.77s/it]
 57%|█████▋    | 21716/37963 [52:07:17<34:48:46,  7.71s/it]
 57%|█████▋    | 21717/37963 [52:07:24<34:23:40,  7.62s/it]
 57%|█████▋    | 21718/37963 [52:07:31<34:08:37,  7.57s/it]
 57%|█████▋    | 21719/37963 [52:07:39<34:08:29,  7.57s/it]
 57%|█████▋    | 21720/37963 [52:07:46<33:40:00,  7.46s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.66', 'learning_rate': '8.161e-06', 'epoch': '0.5721'}

 57%|█████▋    | 21720/37963 [52:07:46<33:40:00,  7.46s/it]
 57%|█████▋    | 21721/37963 [52:07:54<33:29:16,  7.42s/it]
 57%|█████▋    | 21722/37963 [52:08:01<33:45:38,  7.48s/it]
 57%|█████▋    | 21723/37963 [52:08:09<33:40:05,  7.46s/it]
 57%|█████▋    | 21724/37963 [52:08:16<33:51:51,  7.51s/it]
 57%|█████▋    | 21725/37963 [52:08:24<33:41:48,  7.47s/it]
 57%|█████▋    | 21726/37963 [52:08:31<33:38:05,  7.46s/it]
 57%|█████▋    | 21727/37963 [52:08:38<33:31:13,  7.43s/it]
 57%|█████▋    | 21728/37963 [52:08:52<42:08:00,  9.34s/it]
 57%|█████▋    | 21729/37963 [52:09:06<48:22:39, 10.73s/it]
 57%|█████▋    | 21730/37963 [52:09:14<43:57:11,  9.75s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '2.551', 'learning_rate': '8.153e-06', 'epoch': '0.5724'}

 57%|█████▋    | 21730/37963 [52:09:14<43:57:11,  9.75s/it]
 57%|█████▋    | 21731/37963 [52:09:28<49:34:32, 11.00s/it]
 57%|█████▋    | 21732/37963 [52:09:35<44:59:49,  9.98s/it]
 57%|█████▋    | 21733/37963 [52:09:43<41:51:29,  9.28s/it]
 57%|█████▋    | 21734/37963 [52:09:56<47:28:49, 10.53s/it]
 57%|█████▋    | 21735/37963 [52:10:04<43:26:28,  9.64s/it]
 57%|█████▋    | 21736/37963 [52:10:11<40:29:13,  8.98s/it]
 57%|█████▋    | 21737/37963 [52:10:19<38:21:55,  8.51s/it]
 57%|█████▋    | 21738/37963 [52:10:26<36:59:50,  8.21s/it]
 57%|█████▋    | 21739/37963 [52:10:34<36:03:06,  8.00s/it]
 57%|█████▋    | 21740/37963 [52:10:41<35:30:05,  7.88s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.695', 'learning_rate': '8.144e-06', 'epoch': '0.5727'}

 57%|█████▋    | 21740/37963 [52:10:41<35:30:05,  7.88s/it]
 57%|█████▋    | 21741/37963 [52:10:55<43:27:08,  9.64s/it]
 57%|█████▋    | 21742/37963 [52:11:02<40:27:27,  8.98s/it]
 57%|█████▋    | 21743/37963 [52:11:10<38:42:42,  8.59s/it]
 57%|█████▋    | 21744/37963 [52:11:18<37:14:29,  8.27s/it]
 57%|█████▋    | 21745/37963 [52:11:32<45:09:39, 10.02s/it]
 57%|█████▋    | 21746/37963 [52:11:39<41:58:18,  9.32s/it]
 57%|█████▋    | 21747/37963 [52:11:53<48:10:38, 10.70s/it]
 57%|█████▋    | 21748/37963 [52:12:01<43:51:50,  9.74s/it]
 57%|█████▋    | 21749/37963 [52:12:08<40:55:53,  9.09s/it]
 57%|█████▋    | 21750/37963 [52:12:16<38:59:35,  8.66s/it]
                                                           
{'loss': '0.1466', 'grad_norm': '1.47', 'learning_rate': '8.136e-06', 'epoch': '0.5729'}

 57%|█████▋    | 21750/37963 [52:12:16<38:59:35,  8.66s/it]
 57%|█████▋    | 21751/37963 [52:12:23<36:59:27,  8.21s/it]
 57%|█████▋    | 21752/37963 [52:12:31<36:15:40,  8.05s/it]
 57%|█████▋    | 21753/37963 [52:12:39<35:36:27,  7.91s/it]
 57%|█████▋    | 21754/37963 [52:12:46<35:10:21,  7.81s/it]
 57%|█████▋    | 21755/37963 [52:12:54<34:49:14,  7.73s/it]
 57%|█████▋    | 21756/37963 [52:13:08<43:08:48,  9.58s/it]
 57%|█████▋    | 21757/37963 [52:13:15<40:22:33,  8.97s/it]
 57%|█████▋    | 21758/37963 [52:13:23<38:33:21,  8.57s/it]
 57%|█████▋    | 21759/37963 [52:13:30<37:08:40,  8.25s/it]
 57%|█████▋    | 21760/37963 [52:13:38<36:13:13,  8.05s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '1.112', 'learning_rate': '8.127e-06', 'epoch': '0.5732'}

 57%|█████▋    | 21760/37963 [52:13:38<36:13:13,  8.05s/it]
 57%|█████▋    | 21761/37963 [52:13:45<35:26:42,  7.88s/it]
 57%|█████▋    | 21762/37963 [52:13:53<34:58:17,  7.77s/it]
 57%|█████▋    | 21763/37963 [52:14:00<34:30:54,  7.67s/it]
 57%|█████▋    | 21764/37963 [52:14:08<34:02:37,  7.57s/it]
 57%|█████▋    | 21765/37963 [52:14:15<33:51:12,  7.52s/it]
 57%|█████▋    | 21766/37963 [52:14:23<33:50:28,  7.52s/it]
 57%|█████▋    | 21767/37963 [52:14:30<33:49:13,  7.52s/it]
 57%|█████▋    | 21768/37963 [52:14:38<33:47:59,  7.51s/it]
 57%|█████▋    | 21769/37963 [52:14:45<33:52:55,  7.53s/it]
 57%|█████▋    | 21770/37963 [52:14:53<34:00:45,  7.56s/it]
                                                           
{'loss': '0.142', 'grad_norm': '1.521', 'learning_rate': '8.119e-06', 'epoch': '0.5735'}

 57%|█████▋    | 21770/37963 [52:14:53<34:00:45,  7.56s/it]
 57%|█████▋    | 21771/37963 [52:15:00<34:04:04,  7.57s/it]
 57%|█████▋    | 21772/37963 [52:15:08<33:49:36,  7.52s/it]
 57%|█████▋    | 21773/37963 [52:15:15<33:47:30,  7.51s/it]
 57%|█████▋    | 21774/37963 [52:15:23<33:54:53,  7.54s/it]
 57%|█████▋    | 21775/37963 [52:15:30<33:58:53,  7.56s/it]
 57%|█████▋    | 21776/37963 [52:15:38<34:02:04,  7.57s/it]
 57%|█████▋    | 21777/37963 [52:15:52<42:57:56,  9.56s/it]
 57%|█████▋    | 21778/37963 [52:16:00<40:06:24,  8.92s/it]
 57%|█████▋    | 21779/37963 [52:16:07<38:06:40,  8.48s/it]
 57%|█████▋    | 21780/37963 [52:16:15<36:49:20,  8.19s/it]
                                                           
{'loss': '0.1454', 'grad_norm': '1.211', 'learning_rate': '8.111e-06', 'epoch': '0.5737'}

 57%|█████▋    | 21780/37963 [52:16:15<36:49:20,  8.19s/it]
 57%|█████▋    | 21781/37963 [52:16:22<35:58:32,  8.00s/it]
 57%|█████▋    | 21782/37963 [52:16:36<43:55:45,  9.77s/it]
 57%|█████▋    | 21783/37963 [52:16:44<40:53:57,  9.10s/it]
 57%|█████▋    | 21784/37963 [52:16:51<38:56:09,  8.66s/it]
 57%|█████▋    | 21785/37963 [52:16:59<37:10:58,  8.27s/it]
 57%|█████▋    | 21786/37963 [52:17:13<45:12:21, 10.06s/it]
 57%|█████▋    | 21787/37963 [52:17:20<41:56:14,  9.33s/it]
 57%|█████▋    | 21788/37963 [52:17:35<48:37:31, 10.82s/it]
 57%|█████▋    | 21789/37963 [52:17:42<44:19:05,  9.86s/it]
 57%|█████▋    | 21790/37963 [52:17:50<41:06:47,  9.15s/it]
                                                           
{'loss': '0.1401', 'grad_norm': '1.356', 'learning_rate': '8.102e-06', 'epoch': '0.574'}

 57%|█████▋    | 21790/37963 [52:17:50<41:06:47,  9.15s/it]
 57%|█████▋    | 21791/37963 [52:17:57<38:56:46,  8.67s/it]
 57%|█████▋    | 21792/37963 [52:18:05<37:31:52,  8.36s/it]
 57%|█████▋    | 21793/37963 [52:18:19<45:18:40, 10.09s/it]
 57%|█████▋    | 21794/37963 [52:18:33<50:22:17, 11.22s/it]
 57%|█████▋    | 21795/37963 [52:18:41<45:37:23, 10.16s/it]
 57%|█████▋    | 21796/37963 [52:18:48<42:01:33,  9.36s/it]
 57%|█████▋    | 21797/37963 [52:18:56<39:37:20,  8.82s/it]
 57%|█████▋    | 21798/37963 [52:19:03<37:41:41,  8.39s/it]
 57%|█████▋    | 21799/37963 [52:19:11<36:27:11,  8.12s/it]
 57%|█████▋    | 21800/37963 [52:19:18<35:35:36,  7.93s/it]
                                                           
{'loss': '0.1564', 'grad_norm': '1.379', 'learning_rate': '8.094e-06', 'epoch': '0.5742'}

 57%|█████▋    | 21800/37963 [52:19:18<35:35:36,  7.93s/it]
 57%|█████▋    | 21801/37963 [52:19:25<34:42:26,  7.73s/it]
 57%|█████▋    | 21802/37963 [52:19:33<34:29:51,  7.68s/it]
 57%|█████▋    | 21803/37963 [52:19:40<33:55:00,  7.56s/it]
 57%|█████▋    | 21804/37963 [52:19:54<42:26:50,  9.46s/it]
 57%|█████▋    | 21805/37963 [52:20:02<40:01:27,  8.92s/it]
 57%|█████▋    | 21806/37963 [52:20:09<38:12:24,  8.51s/it]
 57%|█████▋    | 21807/37963 [52:20:17<36:45:26,  8.19s/it]
 57%|█████▋    | 21808/37963 [52:20:24<35:54:12,  8.00s/it]
 57%|█████▋    | 21809/37963 [52:20:32<35:24:03,  7.89s/it]
 57%|█████▋    | 21810/37963 [52:20:40<35:05:30,  7.82s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '1.933', 'learning_rate': '8.086e-06', 'epoch': '0.5745'}

 57%|█████▋    | 21810/37963 [52:20:40<35:05:30,  7.82s/it]
 57%|█████▋    | 21811/37963 [52:20:47<34:39:08,  7.72s/it]
 57%|█████▋    | 21812/37963 [52:20:55<34:22:35,  7.66s/it]
 57%|█████▋    | 21813/37963 [52:21:02<33:59:32,  7.58s/it]
 57%|█████▋    | 21814/37963 [52:21:10<33:56:24,  7.57s/it]
 57%|█████▋    | 21815/37963 [52:21:17<33:43:59,  7.52s/it]
 57%|█████▋    | 21816/37963 [52:21:24<33:22:57,  7.44s/it]
 57%|█████▋    | 21817/37963 [52:21:32<33:26:03,  7.45s/it]
 57%|█████▋    | 21818/37963 [52:21:39<33:25:07,  7.45s/it]
 57%|█████▋    | 21819/37963 [52:21:47<33:28:16,  7.46s/it]
 57%|█████▋    | 21820/37963 [52:21:54<33:32:17,  7.48s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '1.762', 'learning_rate': '8.077e-06', 'epoch': '0.5748'}

 57%|█████▋    | 21820/37963 [52:21:54<33:32:17,  7.48s/it]
 57%|█████▋    | 21821/37963 [52:22:02<33:25:16,  7.45s/it]
 57%|█████▋    | 21822/37963 [52:22:09<33:34:36,  7.49s/it]
 57%|█████▋    | 21823/37963 [52:22:17<33:43:58,  7.52s/it]
 57%|█████▋    | 21824/37963 [52:22:24<33:40:39,  7.51s/it]
 57%|█████▋    | 21825/37963 [52:22:32<33:34:23,  7.49s/it]
 57%|█████▋    | 21826/37963 [52:22:45<41:56:28,  9.36s/it]
 57%|█████▋    | 21827/37963 [52:22:53<39:33:49,  8.83s/it]
 57%|█████▋    | 21828/37963 [52:23:00<37:28:38,  8.36s/it]
 58%|█████▊    | 21829/37963 [52:23:15<45:23:34, 10.13s/it]
 58%|█████▊    | 21830/37963 [52:23:35<59:25:37, 13.26s/it]
                                                           
{'loss': '0.1502', 'grad_norm': '2.964', 'learning_rate': '8.069e-06', 'epoch': '0.575'}

 58%|█████▊    | 21830/37963 [52:23:35<59:25:37, 13.26s/it]
 58%|█████▊    | 21831/37963 [52:23:43<51:43:15, 11.54s/it]
 58%|█████▊    | 21832/37963 [52:23:50<46:15:38, 10.32s/it]
 58%|█████▊    | 21833/37963 [52:23:58<42:25:08,  9.47s/it]
 58%|█████▊    | 21834/37963 [52:24:05<39:48:21,  8.88s/it]
 58%|█████▊    | 21835/37963 [52:24:12<37:38:59,  8.40s/it]
 58%|█████▊    | 21836/37963 [52:24:26<44:38:10,  9.96s/it]
 58%|█████▊    | 21837/37963 [52:24:34<41:33:49,  9.28s/it]
 58%|█████▊    | 21838/37963 [52:24:41<39:15:27,  8.76s/it]
 58%|█████▊    | 21839/37963 [52:24:49<37:18:45,  8.33s/it]
 58%|█████▊    | 21840/37963 [52:25:03<45:21:45, 10.13s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '1.656', 'learning_rate': '8.06e-06', 'epoch': '0.5753'}

 58%|█████▊    | 21840/37963 [52:25:03<45:21:45, 10.13s/it]
 58%|█████▊    | 21841/37963 [52:25:10<41:51:49,  9.35s/it]
 58%|█████▊    | 21842/37963 [52:25:18<39:15:57,  8.77s/it]
 58%|█████▊    | 21843/37963 [52:25:25<37:39:29,  8.41s/it]
 58%|█████▊    | 21844/37963 [52:25:33<36:32:50,  8.16s/it]
 58%|█████▊    | 21845/37963 [52:25:41<35:39:44,  7.97s/it]
 58%|█████▊    | 21846/37963 [52:25:48<35:11:51,  7.86s/it]
 58%|█████▊    | 21847/37963 [52:26:02<43:33:25,  9.73s/it]
 58%|█████▊    | 21848/37963 [52:26:10<40:35:01,  9.07s/it]
 58%|█████▊    | 21849/37963 [52:26:17<38:29:30,  8.60s/it]
 58%|█████▊    | 21850/37963 [52:26:25<37:14:38,  8.32s/it]
                                                           
{'loss': '0.1345', 'grad_norm': '1.242', 'learning_rate': '8.052e-06', 'epoch': '0.5756'}

 58%|█████▊    | 21850/37963 [52:26:25<37:14:38,  8.32s/it]
 58%|█████▊    | 21851/37963 [52:26:32<36:04:49,  8.06s/it]
 58%|█████▊    | 21852/37963 [52:26:40<35:26:35,  7.92s/it]
 58%|█████▊    | 21853/37963 [52:26:47<34:52:44,  7.79s/it]
 58%|█████▊    | 21854/37963 [52:26:55<34:27:05,  7.70s/it]
 58%|█████▊    | 21855/37963 [52:27:02<34:11:18,  7.64s/it]
 58%|█████▊    | 21856/37963 [52:27:17<42:49:28,  9.57s/it]
 58%|█████▊    | 21857/37963 [52:27:24<40:09:13,  8.98s/it]
 58%|█████▊    | 21858/37963 [52:27:32<38:27:21,  8.60s/it]
 58%|█████▊    | 21859/37963 [52:27:39<37:04:09,  8.29s/it]
 58%|█████▊    | 21860/37963 [52:27:47<36:05:22,  8.07s/it]
                                                           
{'loss': '0.1407', 'grad_norm': '1.123', 'learning_rate': '8.044e-06', 'epoch': '0.5758'}

 58%|█████▊    | 21860/37963 [52:27:47<36:05:22,  8.07s/it]
 58%|█████▊    | 21861/37963 [52:27:55<35:25:50,  7.92s/it]
 58%|█████▊    | 21862/37963 [52:28:02<34:42:50,  7.76s/it]
 58%|█████▊    | 21863/37963 [52:28:10<34:37:30,  7.74s/it]
 58%|█████▊    | 21864/37963 [52:28:17<34:37:27,  7.74s/it]
 58%|█████▊    | 21865/37963 [52:28:25<34:28:04,  7.71s/it]
 58%|█████▊    | 21866/37963 [52:28:33<34:19:10,  7.68s/it]
 58%|█████▊    | 21867/37963 [52:28:40<34:07:47,  7.63s/it]
 58%|█████▊    | 21868/37963 [52:28:48<33:58:32,  7.60s/it]
 58%|█████▊    | 21869/37963 [52:28:55<33:53:21,  7.58s/it]
 58%|█████▊    | 21870/37963 [52:29:03<33:47:28,  7.56s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.48', 'learning_rate': '8.035e-06', 'epoch': '0.5761'}

 58%|█████▊    | 21870/37963 [52:29:03<33:47:28,  7.56s/it]
 58%|█████▊    | 21871/37963 [52:29:10<33:53:09,  7.58s/it]
 58%|█████▊    | 21872/37963 [52:29:18<33:45:07,  7.55s/it]
 58%|█████▊    | 21873/37963 [52:29:25<33:41:33,  7.54s/it]
 58%|█████▊    | 21874/37963 [52:29:32<33:13:14,  7.43s/it]
 58%|█████▊    | 21875/37963 [52:29:46<41:54:45,  9.38s/it]
 58%|█████▊    | 21876/37963 [52:30:00<47:50:54, 10.71s/it]
 58%|█████▊    | 21877/37963 [52:30:14<52:16:58, 11.70s/it]
 58%|█████▊    | 21878/37963 [52:30:22<46:48:39, 10.48s/it]
 58%|█████▊    | 21879/37963 [52:30:29<42:48:45,  9.58s/it]
 58%|█████▊    | 21880/37963 [52:30:37<39:59:10,  8.95s/it]
                                                           
{'loss': '0.1359', 'grad_norm': '1.527', 'learning_rate': '8.027e-06', 'epoch': '0.5764'}

 58%|█████▊    | 21880/37963 [52:30:37<39:59:10,  8.95s/it]
 58%|█████▊    | 21881/37963 [52:30:51<46:56:51, 10.51s/it]
 58%|█████▊    | 21882/37963 [52:30:59<42:58:36,  9.62s/it]
 58%|█████▊    | 21883/37963 [52:31:06<39:55:57,  8.94s/it]
 58%|█████▊    | 21884/37963 [52:31:13<37:58:15,  8.50s/it]
 58%|█████▊    | 21885/37963 [52:31:21<36:43:24,  8.22s/it]
 58%|█████▊    | 21886/37963 [52:31:29<35:55:25,  8.04s/it]
 58%|█████▊    | 21887/37963 [52:31:42<43:09:10,  9.66s/it]
 58%|█████▊    | 21888/37963 [52:31:56<48:50:11, 10.94s/it]
 58%|█████▊    | 21889/37963 [52:32:03<44:13:54,  9.91s/it]
 58%|█████▊    | 21890/37963 [52:32:11<41:02:27,  9.19s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.081', 'learning_rate': '8.019e-06', 'epoch': '0.5766'}

 58%|█████▊    | 21890/37963 [52:32:11<41:02:27,  9.19s/it]
 58%|█████▊    | 21891/37963 [52:32:19<38:52:51,  8.71s/it]
 58%|█████▊    | 21892/37963 [52:32:26<37:15:29,  8.35s/it]
 58%|█████▊    | 21893/37963 [52:32:34<36:07:28,  8.09s/it]
 58%|█████▊    | 21894/37963 [52:32:41<35:23:05,  7.93s/it]
 58%|█████▊    | 21895/37963 [52:32:55<43:39:35,  9.78s/it]
 58%|█████▊    | 21896/37963 [52:33:03<40:37:32,  9.10s/it]
 58%|█████▊    | 21897/37963 [52:33:10<38:41:56,  8.67s/it]
 58%|█████▊    | 21898/37963 [52:33:18<37:09:01,  8.33s/it]
 58%|█████▊    | 21899/37963 [52:33:25<36:07:24,  8.10s/it]
 58%|█████▊    | 21900/37963 [52:33:33<35:22:53,  7.93s/it]
                                                           
{'loss': '0.1372', 'grad_norm': '1.179', 'learning_rate': '8.01e-06', 'epoch': '0.5769'}

 58%|█████▊    | 21900/37963 [52:33:33<35:22:53,  7.93s/it]
 58%|█████▊    | 21901/37963 [52:33:40<34:49:01,  7.80s/it]
 58%|█████▊    | 21902/37963 [52:33:48<34:32:37,  7.74s/it]
 58%|█████▊    | 21903/37963 [52:33:56<34:34:10,  7.75s/it]
 58%|█████▊    | 21904/37963 [52:34:03<34:23:44,  7.71s/it]
 58%|█████▊    | 21905/37963 [52:34:11<34:07:24,  7.65s/it]
 58%|█████▊    | 21906/37963 [52:34:18<33:55:11,  7.60s/it]
 58%|█████▊    | 21907/37963 [52:34:26<33:52:20,  7.59s/it]
 58%|█████▊    | 21908/37963 [52:34:34<33:45:24,  7.57s/it]
 58%|█████▊    | 21909/37963 [52:34:41<33:39:21,  7.55s/it]
 58%|█████▊    | 21910/37963 [52:34:55<42:11:31,  9.46s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '2.921', 'learning_rate': '8.002e-06', 'epoch': '0.5771'}

 58%|█████▊    | 21910/37963 [52:34:55<42:11:31,  9.46s/it]
 58%|█████▊    | 21911/37963 [52:35:03<39:40:35,  8.90s/it]
 58%|█████▊    | 21912/37963 [52:35:10<37:49:08,  8.48s/it]
 58%|█████▊    | 21913/37963 [52:35:18<36:45:58,  8.25s/it]
 58%|█████▊    | 21914/37963 [52:35:25<35:45:51,  8.02s/it]
 58%|█████▊    | 21915/37963 [52:35:33<35:09:04,  7.89s/it]
 58%|█████▊    | 21916/37963 [52:35:40<34:43:30,  7.79s/it]
 58%|█████▊    | 21917/37963 [52:35:48<34:26:33,  7.73s/it]
 58%|█████▊    | 21918/37963 [52:35:55<34:10:40,  7.67s/it]
 58%|█████▊    | 21919/37963 [52:36:03<33:43:34,  7.57s/it]
 58%|█████▊    | 21920/37963 [52:36:10<33:40:38,  7.56s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '2.569', 'learning_rate': '7.993e-06', 'epoch': '0.5774'}

 58%|█████▊    | 21920/37963 [52:36:10<33:40:38,  7.56s/it]
 58%|█████▊    | 21921/37963 [52:36:18<33:35:04,  7.54s/it]
 58%|█████▊    | 21922/37963 [52:36:32<42:04:43,  9.44s/it]
 58%|█████▊    | 21923/37963 [52:36:39<39:48:04,  8.93s/it]
 58%|█████▊    | 21924/37963 [52:36:53<46:31:01, 10.44s/it]
 58%|█████▊    | 21925/37963 [52:37:07<51:15:27, 11.51s/it]
 58%|█████▊    | 21926/37963 [52:37:15<45:43:01, 10.26s/it]
 58%|█████▊    | 21927/37963 [52:37:22<42:09:54,  9.47s/it]
 58%|█████▊    | 21928/37963 [52:37:30<39:38:10,  8.90s/it]
 58%|█████▊    | 21929/37963 [52:37:43<45:46:34, 10.28s/it]
 58%|█████▊    | 21930/37963 [52:37:51<41:46:57,  9.38s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '2.421', 'learning_rate': '7.985e-06', 'epoch': '0.5777'}

 58%|█████▊    | 21930/37963 [52:37:51<41:46:57,  9.38s/it]
 58%|█████▊    | 21931/37963 [52:37:58<39:04:39,  8.77s/it]
 58%|█████▊    | 21932/37963 [52:38:05<36:57:22,  8.30s/it]
 58%|█████▊    | 21933/37963 [52:38:13<36:08:22,  8.12s/it]
 58%|█████▊    | 21934/37963 [52:38:21<35:25:14,  7.96s/it]
 58%|█████▊    | 21935/37963 [52:38:28<34:47:49,  7.82s/it]
 58%|█████▊    | 21936/37963 [52:38:48<51:21:12, 11.54s/it]
 58%|█████▊    | 21937/37963 [52:38:56<45:54:15, 10.31s/it]
 58%|█████▊    | 21938/37963 [52:39:03<42:19:24,  9.51s/it]
 58%|█████▊    | 21939/37963 [52:39:11<39:49:08,  8.95s/it]
 58%|█████▊    | 21940/37963 [52:39:18<37:37:43,  8.45s/it]
                                                           
{'loss': '0.154', 'grad_norm': '1.335', 'learning_rate': '7.977e-06', 'epoch': '0.5779'}

 58%|█████▊    | 21940/37963 [52:39:18<37:37:43,  8.45s/it]
 58%|█████▊    | 21941/37963 [52:39:26<36:21:19,  8.17s/it]
 58%|█████▊    | 21942/37963 [52:39:33<35:26:07,  7.96s/it]
 58%|█████▊    | 21943/37963 [52:39:41<34:57:03,  7.85s/it]
 58%|█████▊    | 21944/37963 [52:39:48<34:30:25,  7.75s/it]
 58%|█████▊    | 21945/37963 [52:39:56<33:58:49,  7.64s/it]
 58%|█████▊    | 21946/37963 [52:40:03<33:51:22,  7.61s/it]
 58%|█████▊    | 21947/37963 [52:40:11<33:41:24,  7.57s/it]
 58%|█████▊    | 21948/37963 [52:40:18<33:43:53,  7.58s/it]
 58%|█████▊    | 21949/37963 [52:40:32<42:12:59,  9.49s/it]
 58%|█████▊    | 21950/37963 [52:40:40<39:11:08,  8.81s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '1.539', 'learning_rate': '7.968e-06', 'epoch': '0.5782'}

 58%|█████▊    | 21950/37963 [52:40:40<39:11:08,  8.81s/it]
 58%|█████▊    | 21951/37963 [52:40:47<37:24:37,  8.41s/it]
 58%|█████▊    | 21952/37963 [52:40:55<36:21:35,  8.18s/it]
 58%|█████▊    | 21953/37963 [52:41:02<35:23:53,  7.96s/it]
 58%|█████▊    | 21954/37963 [52:41:16<43:15:39,  9.73s/it]
 58%|█████▊    | 21955/37963 [52:41:24<40:26:36,  9.10s/it]
 58%|█████▊    | 21956/37963 [52:41:31<38:26:46,  8.65s/it]
 58%|█████▊    | 21957/37963 [52:41:39<37:00:16,  8.32s/it]
 58%|█████▊    | 21958/37963 [52:41:46<35:56:42,  8.09s/it]
 58%|█████▊    | 21959/37963 [52:41:54<35:16:47,  7.94s/it]
 58%|█████▊    | 21960/37963 [52:42:01<34:31:21,  7.77s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '3.42', 'learning_rate': '7.96e-06', 'epoch': '0.5785'}

 58%|█████▊    | 21960/37963 [52:42:01<34:31:21,  7.77s/it]
 58%|█████▊    | 21961/37963 [52:42:09<34:18:08,  7.72s/it]
 58%|█████▊    | 21962/37963 [52:42:17<34:26:48,  7.75s/it]
 58%|█████▊    | 21963/37963 [52:42:24<34:13:12,  7.70s/it]
 58%|█████▊    | 21964/37963 [52:42:32<33:59:00,  7.65s/it]
 58%|█████▊    | 21965/37963 [52:42:39<33:50:03,  7.61s/it]
 58%|█████▊    | 21966/37963 [52:42:47<33:40:32,  7.58s/it]
 58%|█████▊    | 21967/37963 [52:42:54<33:08:14,  7.46s/it]
 58%|█████▊    | 21968/37963 [52:43:02<33:11:42,  7.47s/it]
 58%|█████▊    | 21969/37963 [52:43:09<33:27:43,  7.53s/it]
 58%|█████▊    | 21970/37963 [52:43:17<33:29:25,  7.54s/it]
                                                           
{'loss': '0.1474', 'grad_norm': '1.137', 'learning_rate': '7.952e-06', 'epoch': '0.5787'}

 58%|█████▊    | 21970/37963 [52:43:17<33:29:25,  7.54s/it]
 58%|█████▊    | 21971/37963 [52:43:31<41:56:34,  9.44s/it]
 58%|█████▊    | 21972/37963 [52:43:38<39:21:07,  8.86s/it]
 58%|█████▊    | 21973/37963 [52:43:52<46:16:41, 10.42s/it]
 58%|█████▊    | 21974/37963 [52:44:00<42:32:53,  9.58s/it]
 58%|█████▊    | 21975/37963 [52:44:07<39:53:25,  8.98s/it]
 58%|█████▊    | 21976/37963 [52:44:15<37:58:23,  8.55s/it]
 58%|█████▊    | 21977/37963 [52:44:22<36:32:38,  8.23s/it]
 58%|█████▊    | 21978/37963 [52:44:36<43:43:21,  9.85s/it]
 58%|█████▊    | 21979/37963 [52:44:44<40:36:48,  9.15s/it]
 58%|█████▊    | 21980/37963 [52:44:51<38:30:43,  8.67s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.903', 'learning_rate': '7.943e-06', 'epoch': '0.579'}

 58%|█████▊    | 21980/37963 [52:44:51<38:30:43,  8.67s/it]
 58%|█████▊    | 21981/37963 [52:44:59<36:47:23,  8.29s/it]
 58%|█████▊    | 21982/37963 [52:45:13<44:31:08, 10.03s/it]
 58%|█████▊    | 21983/37963 [52:45:20<41:04:25,  9.25s/it]
 58%|█████▊    | 21984/37963 [52:45:34<46:55:53, 10.57s/it]
 58%|█████▊    | 21985/37963 [52:45:41<42:50:23,  9.65s/it]
 58%|█████▊    | 21986/37963 [52:45:49<40:04:55,  9.03s/it]
 58%|█████▊    | 21987/37963 [52:45:56<38:03:27,  8.58s/it]
 58%|█████▊    | 21988/37963 [52:46:04<36:38:31,  8.26s/it]
 58%|█████▊    | 21989/37963 [52:46:11<35:43:28,  8.05s/it]
 58%|█████▊    | 21990/37963 [52:46:19<35:03:29,  7.90s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '1.555', 'learning_rate': '7.935e-06', 'epoch': '0.5793'}

 58%|█████▊    | 21990/37963 [52:46:19<35:03:29,  7.90s/it]
 58%|█████▊    | 21991/37963 [52:46:27<34:43:34,  7.83s/it]
 58%|█████▊    | 21992/37963 [52:46:34<34:21:32,  7.74s/it]
 58%|█████▊    | 21993/37963 [52:46:42<34:10:25,  7.70s/it]
 58%|█████▊    | 21994/37963 [52:46:49<33:55:05,  7.65s/it]
 58%|█████▊    | 21995/37963 [52:46:57<33:52:16,  7.64s/it]
 58%|█████▊    | 21996/37963 [52:47:05<33:53:04,  7.64s/it]
 58%|█████▊    | 21997/37963 [52:47:12<33:46:23,  7.62s/it]
 58%|█████▊    | 21998/37963 [52:47:20<33:39:54,  7.59s/it]
 58%|█████▊    | 21999/37963 [52:47:27<33:44:13,  7.61s/it]
 58%|█████▊    | 22000/37963 [52:47:35<33:36:35,  7.58s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '1.593', 'learning_rate': '7.927e-06', 'epoch': '0.5795'}

 58%|█████▊    | 22000/37963 [52:47:35<33:36:35,  7.58s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.13s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.13s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 58%|█████▊    | 22001/37963 [52:48:37<105:48:03, 23.86s/it]
 58%|█████▊    | 22002/37963 [52:48:51<93:03:56, 20.99s/it] 
 58%|█████▊    | 22003/37963 [52:48:59<76:02:07, 17.15s/it]
 58%|█████▊    | 22004/37963 [52:49:08<64:26:46, 14.54s/it]
 58%|█████▊    | 22005/37963 [52:49:15<54:49:12, 12.37s/it]
 58%|█████▊    | 22006/37963 [52:49:22<48:27:27, 10.93s/it]
 58%|█████▊    | 22007/37963 [52:49:30<44:05:05,  9.95s/it]
 58%|█████▊    | 22008/37963 [52:49:38<40:58:06,  9.24s/it]
 58%|█████▊    | 22009/37963 [52:49:45<38:44:11,  8.74s/it]
 58%|█████▊    | 22010/37963 [52:49:53<37:09:53,  8.39s/it]
                                                           
{'loss': '0.1558', 'grad_norm': '1.673', 'learning_rate': '7.918e-06', 'epoch': '0.5798'}

 58%|█████▊    | 22010/37963 [52:49:53<37:09:53,  8.39s/it]
 58%|█████▊    | 22011/37963 [52:50:00<36:04:07,  8.14s/it]
 58%|█████▊    | 22012/37963 [52:50:08<35:11:19,  7.94s/it]
 58%|█████▊    | 22013/37963 [52:50:15<34:36:16,  7.81s/it]
 58%|█████▊    | 22014/37963 [52:50:23<34:23:49,  7.76s/it]
 58%|█████▊    | 22015/37963 [52:50:30<33:47:45,  7.63s/it]
 58%|█████▊    | 22016/37963 [52:50:38<33:38:50,  7.60s/it]
 58%|█████▊    | 22017/37963 [52:50:52<42:11:34,  9.53s/it]
 58%|█████▊    | 22018/37963 [52:50:59<39:34:01,  8.93s/it]
 58%|█████▊    | 22019/37963 [52:51:14<46:32:02, 10.51s/it]
 58%|█████▊    | 22020/37963 [52:51:21<42:19:46,  9.56s/it]
                                                           
{'loss': '0.139', 'grad_norm': '2.727', 'learning_rate': '7.91e-06', 'epoch': '0.58'}

 58%|█████▊    | 22020/37963 [52:51:21<42:19:46,  9.56s/it]
 58%|█████▊    | 22021/37963 [52:51:29<39:45:58,  8.98s/it]
 58%|█████▊    | 22022/37963 [52:51:36<37:59:38,  8.58s/it]
 58%|█████▊    | 22023/37963 [52:51:44<36:35:34,  8.26s/it]
 58%|█████▊    | 22024/37963 [52:51:58<44:22:25, 10.02s/it]
 58%|█████▊    | 22025/37963 [52:52:05<40:59:56,  9.26s/it]
 58%|█████▊    | 22026/37963 [52:52:19<47:10:51, 10.66s/it]
 58%|█████▊    | 22027/37963 [52:52:27<42:55:39,  9.70s/it]
 58%|█████▊    | 22028/37963 [52:52:34<40:12:03,  9.08s/it]
 58%|█████▊    | 22029/37963 [52:52:49<46:56:05, 10.60s/it]
 58%|█████▊    | 22030/37963 [52:52:56<43:07:48,  9.75s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '1.565', 'learning_rate': '7.902e-06', 'epoch': '0.5803'}

 58%|█████▊    | 22030/37963 [52:52:56<43:07:48,  9.75s/it]
 58%|█████▊    | 22031/37963 [52:53:04<40:15:29,  9.10s/it]
 58%|█████▊    | 22032/37963 [52:53:11<38:16:42,  8.65s/it]
 58%|█████▊    | 22033/37963 [52:53:19<36:50:35,  8.33s/it]
 58%|█████▊    | 22034/37963 [52:53:27<35:49:28,  8.10s/it]
 58%|█████▊    | 22035/37963 [52:53:41<43:47:44,  9.90s/it]
 58%|█████▊    | 22036/37963 [52:53:48<40:42:10,  9.20s/it]
 58%|█████▊    | 22037/37963 [52:53:56<38:29:28,  8.70s/it]
 58%|█████▊    | 22038/37963 [52:54:03<36:49:01,  8.32s/it]
 58%|█████▊    | 22039/37963 [52:54:11<35:45:30,  8.08s/it]
 58%|█████▊    | 22040/37963 [52:54:18<35:14:05,  7.97s/it]
                                                           
{'loss': '0.1442', 'grad_norm': '1.7', 'learning_rate': '7.893e-06', 'epoch': '0.5806'}

 58%|█████▊    | 22040/37963 [52:54:18<35:14:05,  7.97s/it]
 58%|█████▊    | 22041/37963 [52:54:26<34:54:21,  7.89s/it]
 58%|█████▊    | 22042/37963 [52:54:34<34:43:28,  7.85s/it]
 58%|█████▊    | 22043/37963 [52:54:42<34:34:10,  7.82s/it]
 58%|█████▊    | 22044/37963 [52:54:49<34:11:13,  7.73s/it]
 58%|█████▊    | 22045/37963 [52:55:03<42:29:30,  9.61s/it]
 58%|█████▊    | 22046/37963 [52:55:11<39:46:13,  9.00s/it]
 58%|█████▊    | 22047/37963 [52:55:18<37:52:18,  8.57s/it]
 58%|█████▊    | 22048/37963 [52:55:26<36:19:37,  8.22s/it]
 58%|█████▊    | 22049/37963 [52:55:33<35:14:28,  7.97s/it]
 58%|█████▊    | 22050/37963 [52:55:47<43:11:16,  9.77s/it]
                                                           
{'loss': '0.1475', 'grad_norm': '2.781', 'learning_rate': '7.885e-06', 'epoch': '0.5808'}

 58%|█████▊    | 22050/37963 [52:55:47<43:11:16,  9.77s/it]
 58%|█████▊    | 22051/37963 [52:55:54<39:50:18,  9.01s/it]
 58%|█████▊    | 22052/37963 [52:56:02<37:50:28,  8.56s/it]
 58%|█████▊    | 22053/37963 [52:56:10<36:36:41,  8.28s/it]
 58%|█████▊    | 22054/37963 [52:56:17<35:46:50,  8.10s/it]
 58%|█████▊    | 22055/37963 [52:56:25<35:04:11,  7.94s/it]
 58%|█████▊    | 22056/37963 [52:56:32<34:24:14,  7.79s/it]
 58%|█████▊    | 22057/37963 [52:56:40<34:08:07,  7.73s/it]
 58%|█████▊    | 22058/37963 [52:56:47<34:04:33,  7.71s/it]
 58%|█████▊    | 22059/37963 [52:56:55<33:47:52,  7.65s/it]
 58%|█████▊    | 22060/37963 [52:57:03<33:44:22,  7.64s/it]
                                                           
{'loss': '0.1584', 'grad_norm': '2.206', 'learning_rate': '7.877e-06', 'epoch': '0.5811'}

 58%|█████▊    | 22060/37963 [52:57:03<33:44:22,  7.64s/it]
 58%|█████▊    | 22061/37963 [52:57:10<33:38:52,  7.62s/it]
 58%|█████▊    | 22062/37963 [52:57:18<33:34:19,  7.60s/it]
 58%|█████▊    | 22063/37963 [52:57:25<33:31:59,  7.59s/it]
 58%|█████▊    | 22064/37963 [52:57:33<33:21:59,  7.56s/it]
 58%|█████▊    | 22065/37963 [52:57:47<42:10:57,  9.55s/it]
 58%|█████▊    | 22066/37963 [52:57:54<39:06:39,  8.86s/it]
 58%|█████▊    | 22067/37963 [52:58:02<37:21:18,  8.46s/it]
 58%|█████▊    | 22068/37963 [52:58:09<35:47:39,  8.11s/it]
 58%|█████▊    | 22069/37963 [52:58:16<34:54:33,  7.91s/it]
 58%|█████▊    | 22070/37963 [52:58:24<34:20:27,  7.78s/it]
                                                           
{'loss': '0.1463', 'grad_norm': '1.637', 'learning_rate': '7.868e-06', 'epoch': '0.5814'}

 58%|█████▊    | 22070/37963 [52:58:24<34:20:27,  7.78s/it]
 58%|█████▊    | 22071/37963 [52:58:38<42:20:25,  9.59s/it]
 58%|█████▊    | 22072/37963 [52:58:52<48:45:30, 11.05s/it]
 58%|█████▊    | 22073/37963 [52:59:06<52:32:57, 11.91s/it]
 58%|█████▊    | 22074/37963 [52:59:14<46:46:19, 10.60s/it]
 58%|█████▊    | 22075/37963 [52:59:21<42:55:12,  9.73s/it]
 58%|█████▊    | 22076/37963 [52:59:29<40:19:14,  9.14s/it]
 58%|█████▊    | 22077/37963 [52:59:37<38:09:32,  8.65s/it]
 58%|█████▊    | 22078/37963 [52:59:51<45:46:55, 10.38s/it]
 58%|█████▊    | 22079/37963 [52:59:59<42:03:34,  9.53s/it]
 58%|█████▊    | 22080/37963 [53:00:06<39:31:50,  8.96s/it]
                                                           
{'loss': '0.1451', 'grad_norm': '0.9506', 'learning_rate': '7.86e-06', 'epoch': '0.5816'}

 58%|█████▊    | 22080/37963 [53:00:06<39:31:50,  8.96s/it]
 58%|█████▊    | 22081/37963 [53:00:20<46:07:30, 10.46s/it]
 58%|█████▊    | 22082/37963 [53:00:28<42:12:47,  9.57s/it]
 58%|█████▊    | 22083/37963 [53:00:35<39:37:30,  8.98s/it]
 58%|█████▊    | 22084/37963 [53:00:43<37:40:18,  8.54s/it]
 58%|█████▊    | 22085/37963 [53:00:50<36:16:11,  8.22s/it]
 58%|█████▊    | 22086/37963 [53:00:58<35:23:19,  8.02s/it]
 58%|█████▊    | 22087/37963 [53:01:05<34:44:05,  7.88s/it]
 58%|█████▊    | 22088/37963 [53:01:13<34:18:46,  7.78s/it]
 58%|█████▊    | 22089/37963 [53:01:20<33:46:59,  7.66s/it]
 58%|█████▊    | 22090/37963 [53:01:28<33:34:02,  7.61s/it]
                                                           
{'loss': '0.1449', 'grad_norm': '1.296', 'learning_rate': '7.852e-06', 'epoch': '0.5819'}

 58%|█████▊    | 22090/37963 [53:01:28<33:34:02,  7.61s/it]
 58%|█████▊    | 22091/37963 [53:01:35<33:32:20,  7.61s/it]
 58%|█████▊    | 22092/37963 [53:01:43<33:26:33,  7.59s/it]
 58%|█████▊    | 22093/37963 [53:01:50<33:14:31,  7.54s/it]
 58%|█████▊    | 22094/37963 [53:01:58<33:13:07,  7.54s/it]
 58%|█████▊    | 22095/37963 [53:02:05<33:06:08,  7.51s/it]
 58%|█████▊    | 22096/37963 [53:02:13<33:17:04,  7.55s/it]
 58%|█████▊    | 22097/37963 [53:02:21<33:20:44,  7.57s/it]
 58%|█████▊    | 22098/37963 [53:02:28<33:27:12,  7.59s/it]
 58%|█████▊    | 22099/37963 [53:02:49<50:26:10, 11.45s/it]
 58%|█████▊    | 22100/37963 [53:02:56<45:09:40, 10.25s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '2.649', 'learning_rate': '7.843e-06', 'epoch': '0.5821'}

 58%|█████▊    | 22100/37963 [53:02:56<45:09:40, 10.25s/it]
 58%|█████▊    | 22101/37963 [53:03:04<41:31:29,  9.42s/it]
 58%|█████▊    | 22102/37963 [53:03:11<39:10:10,  8.89s/it]
 58%|█████▊    | 22103/37963 [53:03:19<37:22:40,  8.48s/it]
 58%|█████▊    | 22104/37963 [53:03:26<36:13:41,  8.22s/it]
 58%|█████▊    | 22105/37963 [53:03:34<35:18:11,  8.01s/it]
 58%|█████▊    | 22106/37963 [53:03:42<34:44:46,  7.89s/it]
 58%|█████▊    | 22107/37963 [53:03:49<34:04:31,  7.74s/it]
 58%|█████▊    | 22108/37963 [53:03:56<33:51:27,  7.69s/it]
 58%|█████▊    | 22109/37963 [53:04:04<33:46:09,  7.67s/it]
 58%|█████▊    | 22110/37963 [53:04:11<33:20:31,  7.57s/it]
                                                           
{'loss': '0.1385', 'grad_norm': '1.312', 'learning_rate': '7.835e-06', 'epoch': '0.5824'}

 58%|█████▊    | 22110/37963 [53:04:11<33:20:31,  7.57s/it]
 58%|█████▊    | 22111/37963 [53:04:19<33:00:00,  7.49s/it]
 58%|█████▊    | 22112/37963 [53:04:26<33:07:11,  7.52s/it]
 58%|█████▊    | 22113/37963 [53:04:34<32:38:50,  7.42s/it]
 58%|█████▊    | 22114/37963 [53:04:41<32:45:50,  7.44s/it]
 58%|█████▊    | 22115/37963 [53:04:49<32:49:35,  7.46s/it]
 58%|█████▊    | 22116/37963 [53:05:02<41:19:19,  9.39s/it]
 58%|█████▊    | 22117/37963 [53:05:10<39:08:07,  8.89s/it]
 58%|█████▊    | 22118/37963 [53:05:24<45:39:15, 10.37s/it]
 58%|█████▊    | 22119/37963 [53:05:38<50:42:29, 11.52s/it]
 58%|█████▊    | 22120/37963 [53:05:52<54:19:15, 12.34s/it]
                                                           
{'loss': '0.143', 'grad_norm': '1.901', 'learning_rate': '7.827e-06', 'epoch': '0.5827'}

 58%|█████▊    | 22120/37963 [53:05:52<54:19:15, 12.34s/it]
 58%|█████▊    | 22121/37963 [53:06:00<48:15:39, 10.97s/it]
 58%|█████▊    | 22122/37963 [53:06:08<43:49:16,  9.96s/it]
 58%|█████▊    | 22123/37963 [53:06:22<49:11:36, 11.18s/it]
 58%|█████▊    | 22124/37963 [53:06:30<44:42:10, 10.16s/it]
 58%|█████▊    | 22125/37963 [53:06:37<41:30:38,  9.44s/it]
 58%|█████▊    | 22126/37963 [53:06:45<39:02:44,  8.88s/it]
 58%|█████▊    | 22127/37963 [53:06:52<37:11:56,  8.46s/it]
 58%|█████▊    | 22128/37963 [53:07:00<35:41:59,  8.12s/it]
 58%|█████▊    | 22129/37963 [53:07:13<43:04:58,  9.80s/it]
 58%|█████▊    | 22130/37963 [53:07:21<40:05:34,  9.12s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.671', 'learning_rate': '7.818e-06', 'epoch': '0.5829'}

 58%|█████▊    | 22130/37963 [53:07:21<40:05:34,  9.12s/it]
 58%|█████▊    | 22131/37963 [53:07:29<38:09:50,  8.68s/it]
 58%|█████▊    | 22132/37963 [53:07:36<36:16:23,  8.25s/it]
 58%|█████▊    | 22133/37963 [53:07:43<34:53:39,  7.94s/it]
 58%|█████▊    | 22134/37963 [53:07:51<34:29:55,  7.85s/it]
 58%|█████▊    | 22135/37963 [53:07:58<33:46:34,  7.68s/it]
 58%|█████▊    | 22136/37963 [53:08:06<33:37:10,  7.65s/it]
 58%|█████▊    | 22137/37963 [53:08:13<33:37:26,  7.65s/it]
 58%|█████▊    | 22138/37963 [53:08:21<33:42:02,  7.67s/it]
 58%|█████▊    | 22139/37963 [53:08:28<33:32:10,  7.63s/it]
 58%|█████▊    | 22140/37963 [53:08:36<33:28:57,  7.62s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.192', 'learning_rate': '7.81e-06', 'epoch': '0.5832'}

 58%|█████▊    | 22140/37963 [53:08:36<33:28:57,  7.62s/it]
 58%|█████▊    | 22141/37963 [53:08:44<33:45:25,  7.68s/it]
 58%|█████▊    | 22142/37963 [53:08:51<33:37:13,  7.65s/it]
 58%|█████▊    | 22143/37963 [53:08:59<33:24:33,  7.60s/it]
 58%|█████▊    | 22144/37963 [53:09:06<33:12:33,  7.56s/it]
 58%|█████▊    | 22145/37963 [53:09:14<33:09:55,  7.55s/it]
 58%|█████▊    | 22146/37963 [53:09:21<32:47:36,  7.46s/it]
 58%|█████▊    | 22147/37963 [53:09:28<32:28:27,  7.39s/it]
 58%|█████▊    | 22148/37963 [53:09:36<32:36:40,  7.42s/it]
 58%|█████▊    | 22149/37963 [53:09:56<49:44:23, 11.32s/it]
 58%|█████▊    | 22150/37963 [53:10:04<44:50:25, 10.21s/it]
                                                           
{'loss': '0.1479', 'grad_norm': '2.149', 'learning_rate': '7.802e-06', 'epoch': '0.5835'}

 58%|█████▊    | 22150/37963 [53:10:04<44:50:25, 10.21s/it]
 58%|█████▊    | 22151/37963 [53:10:11<41:18:36,  9.41s/it]
 58%|█████▊    | 22152/37963 [53:10:19<38:48:18,  8.84s/it]
 58%|█████▊    | 22153/37963 [53:10:27<37:08:16,  8.46s/it]
 58%|█████▊    | 22154/37963 [53:10:34<36:04:11,  8.21s/it]
 58%|█████▊    | 22155/37963 [53:10:42<35:20:44,  8.05s/it]
 58%|█████▊    | 22156/37963 [53:10:50<34:47:35,  7.92s/it]
 58%|█████▊    | 22157/37963 [53:10:57<34:30:01,  7.86s/it]
 58%|█████▊    | 22158/37963 [53:11:05<34:11:41,  7.79s/it]
 58%|█████▊    | 22159/37963 [53:11:12<33:50:21,  7.71s/it]
 58%|█████▊    | 22160/37963 [53:11:20<33:33:24,  7.64s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '1.726', 'learning_rate': '7.793e-06', 'epoch': '0.5837'}

 58%|█████▊    | 22160/37963 [53:11:20<33:33:24,  7.64s/it]
 58%|█████▊    | 22161/37963 [53:11:27<33:11:57,  7.56s/it]
 58%|█████▊    | 22162/37963 [53:11:41<41:49:23,  9.53s/it]
 58%|█████▊    | 22163/37963 [53:11:49<39:28:18,  8.99s/it]
 58%|█████▊    | 22164/37963 [53:11:57<37:29:04,  8.54s/it]
 58%|█████▊    | 22165/37963 [53:12:04<36:17:19,  8.27s/it]
 58%|█████▊    | 22166/37963 [53:12:12<35:23:27,  8.07s/it]
 58%|█████▊    | 22167/37963 [53:12:19<34:34:12,  7.88s/it]
 58%|█████▊    | 22168/37963 [53:12:40<51:24:40, 11.72s/it]
 58%|█████▊    | 22169/37963 [53:12:47<45:56:12, 10.47s/it]
 58%|█████▊    | 22170/37963 [53:13:01<50:24:53, 11.49s/it]
                                                           
{'loss': '0.1377', 'grad_norm': '1.791', 'learning_rate': '7.785e-06', 'epoch': '0.584'}

 58%|█████▊    | 22170/37963 [53:13:01<50:24:53, 11.49s/it]
 58%|█████▊    | 22171/37963 [53:13:09<45:05:26, 10.28s/it]
 58%|█████▊    | 22172/37963 [53:13:16<41:23:05,  9.43s/it]
 58%|█████▊    | 22173/37963 [53:13:24<38:51:36,  8.86s/it]
 58%|█████▊    | 22174/37963 [53:13:31<36:54:43,  8.42s/it]
 58%|█████▊    | 22175/37963 [53:13:45<44:09:33, 10.07s/it]
 58%|█████▊    | 22176/37963 [53:13:53<40:56:31,  9.34s/it]
 58%|█████▊    | 22177/37963 [53:14:00<38:27:56,  8.77s/it]
 58%|█████▊    | 22178/37963 [53:14:08<36:52:22,  8.41s/it]
 58%|█████▊    | 22179/37963 [53:14:15<35:39:42,  8.13s/it]
 58%|█████▊    | 22180/37963 [53:14:23<34:50:29,  7.95s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '3.87', 'learning_rate': '7.777e-06', 'epoch': '0.5843'}

 58%|█████▊    | 22180/37963 [53:14:23<34:50:29,  7.95s/it]
 58%|█████▊    | 22181/37963 [53:14:30<34:15:30,  7.81s/it]
 58%|█████▊    | 22182/37963 [53:14:38<33:55:01,  7.74s/it]
 58%|█████▊    | 22183/37963 [53:14:45<33:37:50,  7.67s/it]
 58%|█████▊    | 22184/37963 [53:14:53<33:32:50,  7.65s/it]
 58%|█████▊    | 22185/37963 [53:15:01<33:31:07,  7.65s/it]
 58%|█████▊    | 22186/37963 [53:15:08<32:50:02,  7.49s/it]
 58%|█████▊    | 22187/37963 [53:15:15<33:02:42,  7.54s/it]
 58%|█████▊    | 22188/37963 [53:15:23<32:57:45,  7.52s/it]
 58%|█████▊    | 22189/37963 [53:15:30<32:57:55,  7.52s/it]
 58%|█████▊    | 22190/37963 [53:15:38<32:57:28,  7.52s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '1.497', 'learning_rate': '7.768e-06', 'epoch': '0.5845'}

 58%|█████▊    | 22190/37963 [53:15:38<32:57:28,  7.52s/it]
 58%|█████▊    | 22191/37963 [53:15:45<32:57:45,  7.52s/it]
 58%|█████▊    | 22192/37963 [53:15:53<33:00:44,  7.54s/it]
 58%|█████▊    | 22193/37963 [53:16:07<41:09:13,  9.39s/it]
 58%|█████▊    | 22194/37963 [53:16:14<38:54:00,  8.88s/it]
 58%|█████▊    | 22195/37963 [53:16:22<37:12:46,  8.50s/it]
 58%|█████▊    | 22196/37963 [53:16:30<35:59:22,  8.22s/it]
 58%|█████▊    | 22197/37963 [53:16:43<43:27:14,  9.92s/it]
 58%|█████▊    | 22198/37963 [53:16:51<40:18:18,  9.20s/it]
 58%|█████▊    | 22199/37963 [53:16:58<37:55:27,  8.66s/it]
 58%|█████▊    | 22200/37963 [53:17:06<36:21:47,  8.30s/it]
                                                           
{'loss': '0.132', 'grad_norm': '3.405', 'learning_rate': '7.76e-06', 'epoch': '0.5848'}

 58%|█████▊    | 22200/37963 [53:17:06<36:21:47,  8.30s/it]
 58%|█████▊    | 22201/37963 [53:17:13<35:23:32,  8.08s/it]
 58%|█████▊    | 22202/37963 [53:17:21<34:48:45,  7.95s/it]
 58%|█████▊    | 22203/37963 [53:17:29<34:29:04,  7.88s/it]
 58%|█████▊    | 22204/37963 [53:17:37<34:22:56,  7.85s/it]
 58%|█████▊    | 22205/37963 [53:17:44<33:29:09,  7.65s/it]
 58%|█████▊    | 22206/37963 [53:17:51<33:26:05,  7.64s/it]
 58%|█████▊    | 22207/37963 [53:17:59<33:24:38,  7.63s/it]
 58%|█████▊    | 22208/37963 [53:18:13<41:30:26,  9.48s/it]
 59%|█████▊    | 22209/37963 [53:18:20<39:01:03,  8.92s/it]
 59%|█████▊    | 22210/37963 [53:18:28<37:09:23,  8.49s/it]
                                                           
{'loss': '0.1389', 'grad_norm': '2.498', 'learning_rate': '7.752e-06', 'epoch': '0.585'}

 59%|█████▊    | 22210/37963 [53:18:28<37:09:23,  8.49s/it]
 59%|█████▊    | 22211/37963 [53:18:35<35:41:28,  8.16s/it]
 59%|█████▊    | 22212/37963 [53:18:43<35:00:44,  8.00s/it]
 59%|█████▊    | 22213/37963 [53:18:57<42:32:52,  9.73s/it]
 59%|█████▊    | 22214/37963 [53:19:10<47:59:46, 10.97s/it]
 59%|█████▊    | 22215/37963 [53:19:18<43:41:10,  9.99s/it]
 59%|█████▊    | 22216/37963 [53:19:26<40:41:10,  9.30s/it]
 59%|█████▊    | 22217/37963 [53:19:33<38:24:23,  8.78s/it]
 59%|█████▊    | 22218/37963 [53:19:41<36:59:53,  8.46s/it]
 59%|█████▊    | 22219/37963 [53:19:49<36:04:00,  8.25s/it]
 59%|█████▊    | 22220/37963 [53:20:03<43:29:29,  9.95s/it]
                                                           
{'loss': '0.1371', 'grad_norm': '1.348', 'learning_rate': '7.743e-06', 'epoch': '0.5853'}

 59%|█████▊    | 22220/37963 [53:20:03<43:29:29,  9.95s/it]
 59%|█████▊    | 22221/37963 [53:20:10<40:24:44,  9.24s/it]
 59%|█████▊    | 22222/37963 [53:20:24<46:22:38, 10.61s/it]
 59%|█████▊    | 22223/37963 [53:20:32<42:09:41,  9.64s/it]
 59%|█████▊    | 22224/37963 [53:20:46<48:03:08, 10.99s/it]
 59%|█████▊    | 22225/37963 [53:20:53<43:29:10,  9.95s/it]
 59%|█████▊    | 22226/37963 [53:21:01<40:15:29,  9.21s/it]
 59%|█████▊    | 22227/37963 [53:21:08<38:09:43,  8.73s/it]
 59%|█████▊    | 22228/37963 [53:21:16<36:31:04,  8.35s/it]
 59%|█████▊    | 22229/37963 [53:21:23<35:10:28,  8.05s/it]
 59%|█████▊    | 22230/37963 [53:21:31<34:27:52,  7.89s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '3.34', 'learning_rate': '7.735e-06', 'epoch': '0.5856'}

 59%|█████▊    | 22230/37963 [53:21:31<34:27:52,  7.89s/it]
 59%|█████▊    | 22231/37963 [53:21:38<34:15:43,  7.84s/it]
 59%|█████▊    | 22232/37963 [53:21:46<33:55:11,  7.76s/it]
 59%|█████▊    | 22233/37963 [53:21:54<33:38:16,  7.70s/it]
 59%|█████▊    | 22234/37963 [53:22:01<33:27:43,  7.66s/it]
 59%|█████▊    | 22235/37963 [53:22:09<33:21:20,  7.63s/it]
 59%|█████▊    | 22236/37963 [53:22:16<32:52:50,  7.53s/it]
 59%|█████▊    | 22237/37963 [53:22:30<41:15:11,  9.44s/it]
 59%|█████▊    | 22238/37963 [53:22:37<38:51:02,  8.89s/it]
 59%|█████▊    | 22239/37963 [53:22:45<37:05:18,  8.49s/it]
 59%|█████▊    | 22240/37963 [53:22:53<35:52:19,  8.21s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '1.298', 'learning_rate': '7.727e-06', 'epoch': '0.5858'}

 59%|█████▊    | 22240/37963 [53:22:53<35:52:19,  8.21s/it]
 59%|█████▊    | 22241/37963 [53:23:00<34:47:31,  7.97s/it]
 59%|█████▊    | 22242/37963 [53:23:08<34:16:56,  7.85s/it]
 59%|█████▊    | 22243/37963 [53:23:15<33:37:46,  7.70s/it]
 59%|█████▊    | 22244/37963 [53:23:22<33:25:23,  7.65s/it]
 59%|█████▊    | 22245/37963 [53:23:30<33:25:01,  7.65s/it]
 59%|█████▊    | 22246/37963 [53:23:38<33:27:44,  7.66s/it]
 59%|█████▊    | 22247/37963 [53:23:45<33:11:50,  7.60s/it]
 59%|█████▊    | 22248/37963 [53:23:53<33:05:27,  7.58s/it]
 59%|█████▊    | 22249/37963 [53:24:00<33:10:39,  7.60s/it]
 59%|█████▊    | 22250/37963 [53:24:14<41:25:16,  9.49s/it]
                                                           
{'loss': '0.1383', 'grad_norm': '3.081', 'learning_rate': '7.719e-06', 'epoch': '0.5861'}

 59%|█████▊    | 22250/37963 [53:24:14<41:25:16,  9.49s/it]
 59%|█████▊    | 22251/37963 [53:24:22<39:08:38,  8.97s/it]
 59%|█████▊    | 22252/37963 [53:24:30<37:16:59,  8.54s/it]
 59%|█████▊    | 22253/37963 [53:24:37<36:05:05,  8.27s/it]
 59%|█████▊    | 22254/37963 [53:24:45<34:57:51,  8.01s/it]
 59%|█████▊    | 22255/37963 [53:24:52<34:36:55,  7.93s/it]
 59%|█████▊    | 22256/37963 [53:25:06<42:12:15,  9.67s/it]
 59%|█████▊    | 22257/37963 [53:25:14<39:15:26,  9.00s/it]
 59%|█████▊    | 22258/37963 [53:25:27<45:11:55, 10.36s/it]
 59%|█████▊    | 22259/37963 [53:25:34<41:15:10,  9.46s/it]
 59%|█████▊    | 22260/37963 [53:25:42<38:52:07,  8.91s/it]
                                                           
{'loss': '0.1296', 'grad_norm': '1.75', 'learning_rate': '7.71e-06', 'epoch': '0.5864'}

 59%|█████▊    | 22260/37963 [53:25:42<38:52:07,  8.91s/it]
 59%|█████▊    | 22261/37963 [53:25:50<37:09:29,  8.52s/it]
 59%|█████▊    | 22262/37963 [53:26:04<44:07:44, 10.12s/it]
 59%|█████▊    | 22263/37963 [53:26:11<40:39:05,  9.32s/it]
 59%|█████▊    | 22264/37963 [53:26:18<37:50:37,  8.68s/it]
 59%|█████▊    | 22265/37963 [53:26:26<36:27:23,  8.36s/it]
 59%|█████▊    | 22266/37963 [53:26:33<35:11:53,  8.07s/it]
 59%|█████▊    | 22267/37963 [53:26:41<34:23:38,  7.89s/it]
 59%|█████▊    | 22268/37963 [53:26:48<33:31:05,  7.69s/it]
 59%|█████▊    | 22269/37963 [53:27:02<41:27:18,  9.51s/it]
 59%|█████▊    | 22270/37963 [53:27:16<47:17:09, 10.85s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.377', 'learning_rate': '7.702e-06', 'epoch': '0.5866'}

 59%|█████▊    | 22270/37963 [53:27:16<47:17:09, 10.85s/it]
 59%|█████▊    | 22271/37963 [53:27:23<42:59:39,  9.86s/it]
 59%|█████▊    | 22272/37963 [53:27:31<39:47:03,  9.13s/it]
 59%|█████▊    | 22273/37963 [53:27:38<37:27:39,  8.60s/it]
 59%|█████▊    | 22274/37963 [53:27:46<36:06:58,  8.29s/it]
 59%|█████▊    | 22275/37963 [53:27:53<35:15:29,  8.09s/it]
 59%|█████▊    | 22276/37963 [53:28:07<42:52:42,  9.84s/it]
 59%|█████▊    | 22277/37963 [53:28:15<39:55:38,  9.16s/it]
 59%|█████▊    | 22278/37963 [53:28:22<37:51:57,  8.69s/it]
 59%|█████▊    | 22279/37963 [53:28:30<36:13:41,  8.32s/it]
 59%|█████▊    | 22280/37963 [53:28:37<35:06:47,  8.06s/it]
                                                           
{'loss': '0.137', 'grad_norm': '1.682', 'learning_rate': '7.694e-06', 'epoch': '0.5869'}

 59%|█████▊    | 22280/37963 [53:28:37<35:06:47,  8.06s/it]
 59%|█████▊    | 22281/37963 [53:28:45<34:26:55,  7.91s/it]
 59%|█████▊    | 22282/37963 [53:28:52<34:12:33,  7.85s/it]
 59%|█████▊    | 22283/37963 [53:29:06<41:50:34,  9.61s/it]
 59%|█████▊    | 22284/37963 [53:29:14<39:12:41,  9.00s/it]
 59%|█████▊    | 22285/37963 [53:29:21<37:22:46,  8.58s/it]
 59%|█████▊    | 22286/37963 [53:29:29<35:56:17,  8.25s/it]
 59%|█████▊    | 22287/37963 [53:29:36<34:39:36,  7.96s/it]
 59%|█████▊    | 22288/37963 [53:29:44<34:07:38,  7.84s/it]
 59%|█████▊    | 22289/37963 [53:29:51<33:49:58,  7.77s/it]
 59%|█████▊    | 22290/37963 [53:29:59<33:31:00,  7.70s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '1.019', 'learning_rate': '7.685e-06', 'epoch': '0.5872'}

 59%|█████▊    | 22290/37963 [53:29:59<33:31:00,  7.70s/it]
 59%|█████▊    | 22291/37963 [53:30:06<33:07:17,  7.61s/it]
 59%|█████▊    | 22292/37963 [53:30:14<32:48:33,  7.54s/it]
 59%|█████▊    | 22293/37963 [53:30:21<32:52:15,  7.55s/it]
 59%|█████▊    | 22294/37963 [53:30:29<32:38:42,  7.50s/it]
 59%|█████▊    | 22295/37963 [53:30:36<32:30:16,  7.47s/it]
 59%|█████▊    | 22296/37963 [53:30:43<32:35:17,  7.49s/it]
 59%|█████▊    | 22297/37963 [53:30:51<32:39:48,  7.51s/it]
 59%|█████▊    | 22298/37963 [53:30:58<32:21:28,  7.44s/it]
 59%|█████▊    | 22299/37963 [53:31:06<32:33:56,  7.48s/it]
 59%|█████▊    | 22300/37963 [53:31:13<32:23:52,  7.45s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '2.25', 'learning_rate': '7.677e-06', 'epoch': '0.5874'}

 59%|█████▊    | 22300/37963 [53:31:13<32:23:52,  7.45s/it]
 59%|█████▊    | 22301/37963 [53:31:27<40:45:34,  9.37s/it]
 59%|█████▊    | 22302/37963 [53:31:34<38:01:20,  8.74s/it]
 59%|█████▊    | 22303/37963 [53:31:42<36:27:07,  8.38s/it]
 59%|█████▉    | 22304/37963 [53:31:49<35:20:02,  8.12s/it]
 59%|█████▉    | 22305/37963 [53:32:03<42:53:35,  9.86s/it]
 59%|█████▉    | 22306/37963 [53:32:18<48:37:08, 11.18s/it]
 59%|█████▉    | 22307/37963 [53:32:25<43:51:32, 10.09s/it]
 59%|█████▉    | 22308/37963 [53:32:33<40:27:09,  9.30s/it]
 59%|█████▉    | 22309/37963 [53:32:46<46:16:08, 10.64s/it]
 59%|█████▉    | 22310/37963 [53:32:54<42:01:41,  9.67s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '2.074', 'learning_rate': '7.669e-06', 'epoch': '0.5877'}

 59%|█████▉    | 22310/37963 [53:32:54<42:01:41,  9.67s/it]
 59%|█████▉    | 22311/37963 [53:33:01<39:09:03,  9.00s/it]
 59%|█████▉    | 22312/37963 [53:33:09<37:14:52,  8.57s/it]
 59%|█████▉    | 22313/37963 [53:33:16<35:52:26,  8.25s/it]
 59%|█████▉    | 22314/37963 [53:33:30<43:27:47, 10.00s/it]
 59%|█████▉    | 22315/37963 [53:33:38<40:38:28,  9.35s/it]
 59%|█████▉    | 22316/37963 [53:33:46<38:24:24,  8.84s/it]
 59%|█████▉    | 22317/37963 [53:33:54<36:52:44,  8.49s/it]
 59%|█████▉    | 22318/37963 [53:34:07<43:49:03, 10.08s/it]
 59%|█████▉    | 22319/37963 [53:34:15<40:10:55,  9.25s/it]
 59%|█████▉    | 22320/37963 [53:34:22<38:07:14,  8.77s/it]
                                                           
{'loss': '0.1499', 'grad_norm': '1.597', 'learning_rate': '7.66e-06', 'epoch': '0.5879'}

 59%|█████▉    | 22320/37963 [53:34:22<38:07:14,  8.77s/it]
 59%|█████▉    | 22321/37963 [53:34:30<36:42:21,  8.45s/it]
 59%|█████▉    | 22322/37963 [53:34:37<35:28:35,  8.17s/it]
 59%|█████▉    | 22323/37963 [53:34:45<34:14:22,  7.88s/it]
 59%|█████▉    | 22324/37963 [53:34:53<34:11:09,  7.87s/it]
 59%|█████▉    | 22325/37963 [53:35:00<33:54:13,  7.80s/it]
 59%|█████▉    | 22326/37963 [53:35:14<41:39:46,  9.59s/it]
 59%|█████▉    | 22327/37963 [53:35:22<39:12:48,  9.03s/it]
 59%|█████▉    | 22328/37963 [53:35:29<37:13:05,  8.57s/it]
 59%|█████▉    | 22329/37963 [53:35:37<36:06:06,  8.31s/it]
 59%|█████▉    | 22330/37963 [53:35:45<35:21:51,  8.14s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '1.061', 'learning_rate': '7.652e-06', 'epoch': '0.5882'}

 59%|█████▉    | 22330/37963 [53:35:45<35:21:51,  8.14s/it]
 59%|█████▉    | 22331/37963 [53:35:52<34:35:34,  7.97s/it]
 59%|█████▉    | 22332/37963 [53:36:00<34:05:26,  7.85s/it]
 59%|█████▉    | 22333/37963 [53:36:14<42:17:39,  9.74s/it]
 59%|█████▉    | 22334/37963 [53:36:22<39:28:51,  9.09s/it]
 59%|█████▉    | 22335/37963 [53:36:29<37:24:18,  8.62s/it]
 59%|█████▉    | 22336/37963 [53:36:37<35:57:57,  8.29s/it]
 59%|█████▉    | 22337/37963 [53:36:44<34:59:58,  8.06s/it]
 59%|█████▉    | 22338/37963 [53:36:52<34:16:17,  7.90s/it]
 59%|█████▉    | 22339/37963 [53:36:59<33:41:10,  7.76s/it]
 59%|█████▉    | 22340/37963 [53:37:06<33:04:35,  7.62s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '0.9911', 'learning_rate': '7.644e-06', 'epoch': '0.5885'}

 59%|█████▉    | 22340/37963 [53:37:06<33:04:35,  7.62s/it]
 59%|█████▉    | 22341/37963 [53:37:14<32:52:42,  7.58s/it]
 59%|█████▉    | 22342/37963 [53:37:21<32:50:14,  7.57s/it]
 59%|█████▉    | 22343/37963 [53:37:29<32:50:02,  7.57s/it]
 59%|█████▉    | 22344/37963 [53:37:37<32:58:19,  7.60s/it]
 59%|█████▉    | 22345/37963 [53:37:44<33:03:15,  7.62s/it]
 59%|█████▉    | 22346/37963 [53:37:52<33:17:04,  7.67s/it]
 59%|█████▉    | 22347/37963 [53:38:06<41:13:06,  9.50s/it]
 59%|█████▉    | 22348/37963 [53:38:13<38:41:45,  8.92s/it]
 59%|█████▉    | 22349/37963 [53:38:21<36:46:02,  8.48s/it]
 59%|█████▉    | 22350/37963 [53:38:28<35:40:08,  8.22s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.306', 'learning_rate': '7.636e-06', 'epoch': '0.5887'}

 59%|█████▉    | 22350/37963 [53:38:28<35:40:08,  8.22s/it]
 59%|█████▉    | 22351/37963 [53:38:36<34:50:02,  8.03s/it]
 59%|█████▉    | 22352/37963 [53:38:44<34:17:53,  7.91s/it]
 59%|█████▉    | 22353/37963 [53:38:58<42:13:49,  9.74s/it]
 59%|█████▉    | 22354/37963 [53:39:05<39:37:45,  9.14s/it]
 59%|█████▉    | 22355/37963 [53:39:19<45:43:57, 10.55s/it]
 59%|█████▉    | 22356/37963 [53:39:27<41:44:07,  9.63s/it]
 59%|█████▉    | 22357/37963 [53:39:40<46:53:49, 10.82s/it]
 59%|█████▉    | 22358/37963 [53:39:48<42:27:35,  9.80s/it]
 59%|█████▉    | 22359/37963 [53:39:55<39:29:48,  9.11s/it]
 59%|█████▉    | 22360/37963 [53:40:03<37:31:41,  8.66s/it]
                                                           
{'loss': '0.1367', 'grad_norm': '1.883', 'learning_rate': '7.627e-06', 'epoch': '0.589'}

 59%|█████▉    | 22360/37963 [53:40:03<37:31:41,  8.66s/it]
 59%|█████▉    | 22361/37963 [53:40:17<44:40:41, 10.31s/it]
 59%|█████▉    | 22362/37963 [53:40:25<41:15:12,  9.52s/it]
 59%|█████▉    | 22363/37963 [53:40:32<38:42:08,  8.93s/it]
 59%|█████▉    | 22364/37963 [53:40:40<36:58:25,  8.53s/it]
 59%|█████▉    | 22365/37963 [53:40:47<35:40:06,  8.23s/it]
 59%|█████▉    | 22366/37963 [53:41:02<43:19:54, 10.00s/it]
 59%|█████▉    | 22367/37963 [53:41:09<40:09:33,  9.27s/it]
 59%|█████▉    | 22368/37963 [53:41:17<38:05:52,  8.79s/it]
 59%|█████▉    | 22369/37963 [53:41:24<36:30:04,  8.43s/it]
 59%|█████▉    | 22370/37963 [53:41:32<35:30:42,  8.20s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '2.176', 'learning_rate': '7.619e-06', 'epoch': '0.5893'}

 59%|█████▉    | 22370/37963 [53:41:32<35:30:42,  8.20s/it]
 59%|█████▉    | 22371/37963 [53:41:39<34:36:36,  7.99s/it]
 59%|█████▉    | 22372/37963 [53:41:47<33:56:05,  7.84s/it]
 59%|█████▉    | 22373/37963 [53:41:54<33:21:23,  7.70s/it]
 59%|█████▉    | 22374/37963 [53:42:08<41:31:59,  9.59s/it]
 59%|█████▉    | 22375/37963 [53:42:16<39:02:36,  9.02s/it]
 59%|█████▉    | 22376/37963 [53:42:24<37:07:16,  8.57s/it]
 59%|█████▉    | 22377/37963 [53:42:38<44:16:52, 10.23s/it]
 59%|█████▉    | 22378/37963 [53:42:45<41:03:10,  9.48s/it]
 59%|█████▉    | 22379/37963 [53:42:53<38:42:38,  8.94s/it]
 59%|█████▉    | 22380/37963 [53:43:01<36:56:33,  8.53s/it]
                                                           
{'loss': '0.1158', 'grad_norm': '1.006', 'learning_rate': '7.611e-06', 'epoch': '0.5895'}

 59%|█████▉    | 22380/37963 [53:43:01<36:56:33,  8.53s/it]
 59%|█████▉    | 22381/37963 [53:43:08<35:50:13,  8.28s/it]
 59%|█████▉    | 22382/37963 [53:43:16<34:37:46,  8.00s/it]
 59%|█████▉    | 22383/37963 [53:43:23<33:55:46,  7.84s/it]
 59%|█████▉    | 22384/37963 [53:43:31<33:29:40,  7.74s/it]
 59%|█████▉    | 22385/37963 [53:43:38<33:02:45,  7.64s/it]
 59%|█████▉    | 22386/37963 [53:43:46<33:03:38,  7.64s/it]
 59%|█████▉    | 22387/37963 [53:43:53<32:39:10,  7.55s/it]
 59%|█████▉    | 22388/37963 [53:44:01<32:46:23,  7.58s/it]
 59%|█████▉    | 22389/37963 [53:44:08<32:15:48,  7.46s/it]
 59%|█████▉    | 22390/37963 [53:44:16<32:30:13,  7.51s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '1.534', 'learning_rate': '7.602e-06', 'epoch': '0.5898'}

 59%|█████▉    | 22390/37963 [53:44:16<32:30:13,  7.51s/it]
 59%|█████▉    | 22391/37963 [53:44:23<32:31:01,  7.52s/it]
 59%|█████▉    | 22392/37963 [53:44:37<40:54:25,  9.46s/it]
 59%|█████▉    | 22393/37963 [53:44:45<38:27:07,  8.89s/it]
 59%|█████▉    | 22394/37963 [53:44:52<36:43:23,  8.49s/it]
 59%|█████▉    | 22395/37963 [53:45:00<35:33:04,  8.22s/it]
 59%|█████▉    | 22396/37963 [53:45:07<34:49:17,  8.05s/it]
 59%|█████▉    | 22397/37963 [53:45:15<34:02:49,  7.87s/it]
 59%|█████▉    | 22398/37963 [53:45:22<33:07:52,  7.66s/it]
 59%|█████▉    | 22399/37963 [53:45:30<33:02:26,  7.64s/it]
 59%|█████▉    | 22400/37963 [53:45:37<32:52:47,  7.61s/it]
                                                           
{'loss': '0.1331', 'grad_norm': '2.93', 'learning_rate': '7.594e-06', 'epoch': '0.5901'}

 59%|█████▉    | 22400/37963 [53:45:37<32:52:47,  7.61s/it]
 59%|█████▉    | 22401/37963 [53:45:45<32:54:47,  7.61s/it]
 59%|█████▉    | 22402/37963 [53:45:59<40:50:42,  9.45s/it]
 59%|█████▉    | 22403/37963 [53:46:06<38:29:44,  8.91s/it]
 59%|█████▉    | 22404/37963 [53:46:14<36:39:17,  8.48s/it]
 59%|█████▉    | 22405/37963 [53:46:28<43:40:22, 10.11s/it]
 59%|█████▉    | 22406/37963 [53:46:41<48:11:52, 11.15s/it]
 59%|█████▉    | 22407/37963 [53:46:49<43:32:02, 10.07s/it]
 59%|█████▉    | 22408/37963 [53:46:56<40:16:20,  9.32s/it]
 59%|█████▉    | 22409/37963 [53:47:04<37:53:21,  8.77s/it]
 59%|█████▉    | 22410/37963 [53:47:11<36:24:18,  8.43s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '3.617', 'learning_rate': '7.586e-06', 'epoch': '0.5903'}

 59%|█████▉    | 22410/37963 [53:47:11<36:24:18,  8.43s/it]
 59%|█████▉    | 22411/37963 [53:47:19<35:15:48,  8.16s/it]
 59%|█████▉    | 22412/37963 [53:47:40<51:35:25, 11.94s/it]
 59%|█████▉    | 22413/37963 [53:47:47<45:58:24, 10.64s/it]
 59%|█████▉    | 22414/37963 [53:47:55<41:50:57,  9.69s/it]
 59%|█████▉    | 22415/37963 [53:48:02<38:53:14,  9.00s/it]
 59%|█████▉    | 22416/37963 [53:48:09<36:34:53,  8.47s/it]
 59%|█████▉    | 22417/37963 [53:48:17<35:17:55,  8.17s/it]
 59%|█████▉    | 22418/37963 [53:48:24<34:28:13,  7.98s/it]
 59%|█████▉    | 22419/37963 [53:48:32<34:00:56,  7.88s/it]
 59%|█████▉    | 22420/37963 [53:48:39<33:18:01,  7.71s/it]
                                                           
{'loss': '0.1368', 'grad_norm': '2.414', 'learning_rate': '7.578e-06', 'epoch': '0.5906'}

 59%|█████▉    | 22420/37963 [53:48:39<33:18:01,  7.71s/it]
 59%|█████▉    | 22421/37963 [53:48:47<33:06:27,  7.67s/it]
 59%|█████▉    | 22422/37963 [53:48:54<32:53:48,  7.62s/it]
 59%|█████▉    | 22423/37963 [53:49:02<32:47:45,  7.60s/it]
 59%|█████▉    | 22424/37963 [53:49:16<40:59:40,  9.50s/it]
 59%|█████▉    | 22425/37963 [53:49:23<38:27:03,  8.91s/it]
 59%|█████▉    | 22426/37963 [53:49:31<36:18:47,  8.41s/it]
 59%|█████▉    | 22427/37963 [53:49:38<35:23:33,  8.20s/it]
 59%|█████▉    | 22428/37963 [53:49:53<43:08:22, 10.00s/it]
 59%|█████▉    | 22429/37963 [53:50:00<40:06:41,  9.30s/it]
 59%|█████▉    | 22430/37963 [53:50:08<37:47:57,  8.76s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '4.573', 'learning_rate': '7.569e-06', 'epoch': '0.5908'}

 59%|█████▉    | 22430/37963 [53:50:08<37:47:57,  8.76s/it]
 59%|█████▉    | 22431/37963 [53:50:15<36:08:05,  8.38s/it]
 59%|█████▉    | 22432/37963 [53:50:23<35:06:49,  8.14s/it]
 59%|█████▉    | 22433/37963 [53:50:30<34:20:27,  7.96s/it]
 59%|█████▉    | 22434/37963 [53:50:38<33:51:38,  7.85s/it]
 59%|█████▉    | 22435/37963 [53:50:46<33:28:52,  7.76s/it]
 59%|█████▉    | 22436/37963 [53:50:53<33:18:42,  7.72s/it]
 59%|█████▉    | 22437/37963 [53:51:01<33:01:33,  7.66s/it]
 59%|█████▉    | 22438/37963 [53:51:08<32:55:32,  7.63s/it]
 59%|█████▉    | 22439/37963 [53:51:16<32:46:58,  7.60s/it]
 59%|█████▉    | 22440/37963 [53:51:30<40:54:47,  9.49s/it]
                                                           
{'loss': '0.1526', 'grad_norm': '1.54', 'learning_rate': '7.561e-06', 'epoch': '0.5911'}

 59%|█████▉    | 22440/37963 [53:51:30<40:54:47,  9.49s/it]
 59%|█████▉    | 22441/37963 [53:51:37<38:32:59,  8.94s/it]
 59%|█████▉    | 22442/37963 [53:51:45<37:00:26,  8.58s/it]
 59%|█████▉    | 22443/37963 [53:51:53<35:42:22,  8.28s/it]
 59%|█████▉    | 22444/37963 [53:52:00<34:42:57,  8.05s/it]
 59%|█████▉    | 22445/37963 [53:52:08<33:48:50,  7.84s/it]
 59%|█████▉    | 22446/37963 [53:52:15<33:17:44,  7.72s/it]
 59%|█████▉    | 22447/37963 [53:52:22<32:59:39,  7.66s/it]
 59%|█████▉    | 22448/37963 [53:52:30<32:47:06,  7.61s/it]
 59%|█████▉    | 22449/37963 [53:52:37<32:39:37,  7.58s/it]
 59%|█████▉    | 22450/37963 [53:52:52<41:03:44,  9.53s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '0.859', 'learning_rate': '7.553e-06', 'epoch': '0.5914'}

 59%|█████▉    | 22450/37963 [53:52:52<41:03:44,  9.53s/it]
 59%|█████▉    | 22451/37963 [53:52:59<38:32:46,  8.95s/it]
 59%|█████▉    | 22452/37963 [53:53:13<44:55:31, 10.43s/it]
 59%|█████▉    | 22453/37963 [53:53:27<49:21:47, 11.46s/it]
 59%|█████▉    | 22454/37963 [53:53:34<43:58:10, 10.21s/it]
 59%|█████▉    | 22455/37963 [53:53:42<40:30:31,  9.40s/it]
 59%|█████▉    | 22456/37963 [53:53:49<37:41:59,  8.75s/it]
 59%|█████▉    | 22457/37963 [53:53:57<36:23:23,  8.45s/it]
 59%|█████▉    | 22458/37963 [53:54:04<35:13:05,  8.18s/it]
 59%|█████▉    | 22459/37963 [53:54:12<34:16:24,  7.96s/it]
 59%|█████▉    | 22460/37963 [53:54:26<42:01:16,  9.76s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '1.248', 'learning_rate': '7.544e-06', 'epoch': '0.5916'}

 59%|█████▉    | 22460/37963 [53:54:26<42:01:16,  9.76s/it]
 59%|█████▉    | 22461/37963 [53:54:33<39:06:52,  9.08s/it]
 59%|█████▉    | 22462/37963 [53:54:41<37:04:59,  8.61s/it]
 59%|█████▉    | 22463/37963 [53:54:48<35:43:54,  8.30s/it]
 59%|█████▉    | 22464/37963 [53:54:56<34:40:58,  8.06s/it]
 59%|█████▉    | 22465/37963 [53:55:10<42:17:41,  9.82s/it]
 59%|█████▉    | 22466/37963 [53:55:17<39:30:49,  9.18s/it]
 59%|█████▉    | 22467/37963 [53:55:25<37:03:36,  8.61s/it]
 59%|█████▉    | 22468/37963 [53:55:32<35:38:13,  8.28s/it]
 59%|█████▉    | 22469/37963 [53:55:40<34:29:05,  8.01s/it]
 59%|█████▉    | 22470/37963 [53:55:47<33:58:46,  7.90s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '1.239', 'learning_rate': '7.536e-06', 'epoch': '0.5919'}

 59%|█████▉    | 22470/37963 [53:55:47<33:58:46,  7.90s/it]
 59%|█████▉    | 22471/37963 [53:55:55<33:34:05,  7.80s/it]
 59%|█████▉    | 22472/37963 [53:56:02<33:14:30,  7.73s/it]
 59%|█████▉    | 22473/37963 [53:56:10<32:56:41,  7.66s/it]
 59%|█████▉    | 22474/37963 [53:56:24<41:11:25,  9.57s/it]
 59%|█████▉    | 22475/37963 [53:56:38<46:47:26, 10.88s/it]
 59%|█████▉    | 22476/37963 [53:56:45<42:36:01,  9.90s/it]
 59%|█████▉    | 22477/37963 [53:56:53<39:30:00,  9.18s/it]
 59%|█████▉    | 22478/37963 [53:57:00<37:19:23,  8.68s/it]
 59%|█████▉    | 22479/37963 [53:57:08<35:48:23,  8.32s/it]
 59%|█████▉    | 22480/37963 [53:57:15<34:45:23,  8.08s/it]
                                                           
{'loss': '0.1412', 'grad_norm': '1.895', 'learning_rate': '7.528e-06', 'epoch': '0.5922'}

 59%|█████▉    | 22480/37963 [53:57:15<34:45:23,  8.08s/it]
 59%|█████▉    | 22481/37963 [53:57:23<34:13:34,  7.96s/it]
 59%|█████▉    | 22482/37963 [53:57:30<33:32:37,  7.80s/it]
 59%|█████▉    | 22483/37963 [53:57:38<33:15:10,  7.73s/it]
 59%|█████▉    | 22484/37963 [53:57:45<32:36:44,  7.58s/it]
 59%|█████▉    | 22485/37963 [53:57:53<32:20:38,  7.52s/it]
 59%|█████▉    | 22486/37963 [53:58:00<32:18:53,  7.52s/it]
 59%|█████▉    | 22487/37963 [53:58:14<40:37:18,  9.45s/it]
 59%|█████▉    | 22488/37963 [53:58:22<38:26:08,  8.94s/it]
 59%|█████▉    | 22489/37963 [53:58:30<36:54:35,  8.59s/it]
 59%|█████▉    | 22490/37963 [53:58:37<35:29:15,  8.26s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.202', 'learning_rate': '7.52e-06', 'epoch': '0.5924'}

 59%|█████▉    | 22490/37963 [53:58:37<35:29:15,  8.26s/it]
 59%|█████▉    | 22491/37963 [53:58:45<34:46:51,  8.09s/it]
 59%|█████▉    | 22492/37963 [53:58:52<34:07:55,  7.94s/it]
 59%|█████▉    | 22493/37963 [53:59:00<33:41:12,  7.84s/it]
 59%|█████▉    | 22494/37963 [53:59:08<33:14:08,  7.73s/it]
 59%|█████▉    | 22495/37963 [53:59:15<33:01:15,  7.69s/it]
 59%|█████▉    | 22496/37963 [53:59:29<41:14:17,  9.60s/it]
 59%|█████▉    | 22497/37963 [53:59:37<38:54:12,  9.06s/it]
 59%|█████▉    | 22498/37963 [53:59:44<36:56:15,  8.60s/it]
 59%|█████▉    | 22499/37963 [53:59:52<35:40:08,  8.30s/it]
 59%|█████▉    | 22500/37963 [54:00:00<34:39:47,  8.07s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.79', 'learning_rate': '7.511e-06', 'epoch': '0.5927'}

 59%|█████▉    | 22500/37963 [54:00:00<34:39:47,  8.07s/it]
 59%|█████▉    | 22501/37963 [54:00:07<33:52:14,  7.89s/it]
 59%|█████▉    | 22502/37963 [54:00:27<49:51:53, 11.61s/it]
 59%|█████▉    | 22503/37963 [54:00:35<44:35:29, 10.38s/it]
 59%|█████▉    | 22504/37963 [54:00:43<41:11:59,  9.59s/it]
 59%|█████▉    | 22505/37963 [54:00:50<38:44:19,  9.02s/it]
 59%|█████▉    | 22506/37963 [54:00:58<37:06:38,  8.64s/it]
 59%|█████▉    | 22507/37963 [54:01:12<43:52:35, 10.22s/it]
 59%|█████▉    | 22508/37963 [54:01:19<40:16:21,  9.38s/it]
 59%|█████▉    | 22509/37963 [54:01:27<37:55:42,  8.84s/it]
 59%|█████▉    | 22510/37963 [54:01:35<36:20:20,  8.47s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '2.288', 'learning_rate': '7.503e-06', 'epoch': '0.5929'}

 59%|█████▉    | 22510/37963 [54:01:35<36:20:20,  8.47s/it]
 59%|█████▉    | 22511/37963 [54:01:42<35:09:39,  8.19s/it]
 59%|█████▉    | 22512/37963 [54:01:50<34:06:32,  7.95s/it]
 59%|█████▉    | 22513/37963 [54:01:57<33:13:59,  7.74s/it]
 59%|█████▉    | 22514/37963 [54:02:04<33:02:52,  7.70s/it]
 59%|█████▉    | 22515/37963 [54:02:18<41:16:47,  9.62s/it]
 59%|█████▉    | 22516/37963 [54:02:26<38:49:11,  9.05s/it]
 59%|█████▉    | 22517/37963 [54:02:34<37:07:12,  8.65s/it]
 59%|█████▉    | 22518/37963 [54:02:41<35:43:14,  8.33s/it]
 59%|█████▉    | 22519/37963 [54:02:49<34:36:00,  8.07s/it]
 59%|█████▉    | 22520/37963 [54:02:57<34:02:20,  7.94s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.183', 'learning_rate': '7.495e-06', 'epoch': '0.5932'}

 59%|█████▉    | 22520/37963 [54:02:57<34:02:20,  7.94s/it]
 59%|█████▉    | 22521/37963 [54:03:11<42:00:19,  9.79s/it]
 59%|█████▉    | 22522/37963 [54:03:18<39:19:41,  9.17s/it]
 59%|█████▉    | 22523/37963 [54:03:26<37:16:48,  8.69s/it]
 59%|█████▉    | 22524/37963 [54:03:41<44:58:47, 10.49s/it]
 59%|█████▉    | 22525/37963 [54:03:48<41:12:45,  9.61s/it]
 59%|█████▉    | 22526/37963 [54:03:56<38:40:34,  9.02s/it]
 59%|█████▉    | 22527/37963 [54:04:03<36:52:30,  8.60s/it]
 59%|█████▉    | 22528/37963 [54:04:11<35:23:11,  8.25s/it]
 59%|█████▉    | 22529/37963 [54:04:19<34:39:00,  8.08s/it]
 59%|█████▉    | 22530/37963 [54:04:26<34:01:55,  7.94s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '0.9791', 'learning_rate': '7.487e-06', 'epoch': '0.5935'}

 59%|█████▉    | 22530/37963 [54:04:26<34:01:55,  7.94s/it]
 59%|█████▉    | 22531/37963 [54:04:34<33:32:37,  7.83s/it]
 59%|█████▉    | 22532/37963 [54:04:41<33:10:38,  7.74s/it]
 59%|█████▉    | 22533/37963 [54:04:49<32:50:55,  7.66s/it]
 59%|█████▉    | 22534/37963 [54:04:56<32:39:33,  7.62s/it]
 59%|█████▉    | 22535/37963 [54:05:10<40:39:06,  9.49s/it]
 59%|█████▉    | 22536/37963 [54:05:18<38:11:29,  8.91s/it]
 59%|█████▉    | 22537/37963 [54:05:25<36:18:31,  8.47s/it]
 59%|█████▉    | 22538/37963 [54:05:33<35:18:12,  8.24s/it]
 59%|█████▉    | 22539/37963 [54:05:40<34:28:54,  8.05s/it]
 59%|█████▉    | 22540/37963 [54:05:48<34:02:24,  7.95s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '2.051', 'learning_rate': '7.478e-06', 'epoch': '0.5937'}

 59%|█████▉    | 22540/37963 [54:05:48<34:02:24,  7.95s/it]
 59%|█████▉    | 22541/37963 [54:05:56<33:34:03,  7.84s/it]
 59%|█████▉    | 22542/37963 [54:06:03<33:06:08,  7.73s/it]
 59%|█████▉    | 22543/37963 [54:06:11<32:50:55,  7.67s/it]
 59%|█████▉    | 22544/37963 [54:06:25<41:05:41,  9.59s/it]
 59%|█████▉    | 22545/37963 [54:06:32<38:18:18,  8.94s/it]
 59%|█████▉    | 22546/37963 [54:06:40<36:17:54,  8.48s/it]
 59%|█████▉    | 22547/37963 [54:06:47<35:12:20,  8.22s/it]
 59%|█████▉    | 22548/37963 [54:06:55<34:06:31,  7.97s/it]
 59%|█████▉    | 22549/37963 [54:07:02<33:15:42,  7.77s/it]
 59%|█████▉    | 22550/37963 [54:07:16<41:13:18,  9.63s/it]
                                                           
{'loss': '0.1459', 'grad_norm': '2.047', 'learning_rate': '7.47e-06', 'epoch': '0.594'}

 59%|█████▉    | 22550/37963 [54:07:16<41:13:18,  9.63s/it]
 59%|█████▉    | 22551/37963 [54:07:24<38:42:40,  9.04s/it]
 59%|█████▉    | 22552/37963 [54:07:31<36:33:31,  8.54s/it]
 59%|█████▉    | 22553/37963 [54:07:39<35:20:04,  8.25s/it]
 59%|█████▉    | 22554/37963 [54:07:46<34:32:32,  8.07s/it]
 59%|█████▉    | 22555/37963 [54:08:00<42:23:10,  9.90s/it]
 59%|█████▉    | 22556/37963 [54:08:08<39:31:12,  9.23s/it]
 59%|█████▉    | 22557/37963 [54:08:16<37:20:26,  8.73s/it]
 59%|█████▉    | 22558/37963 [54:08:30<44:05:39, 10.30s/it]
 59%|█████▉    | 22559/37963 [54:08:37<40:36:44,  9.49s/it]
 59%|█████▉    | 22560/37963 [54:08:45<37:59:03,  8.88s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '3.226', 'learning_rate': '7.462e-06', 'epoch': '0.5943'}

 59%|█████▉    | 22560/37963 [54:08:45<37:59:03,  8.88s/it]
 59%|█████▉    | 22561/37963 [54:08:52<36:27:20,  8.52s/it]
 59%|█████▉    | 22562/37963 [54:09:00<35:20:33,  8.26s/it]
 59%|█████▉    | 22563/37963 [54:09:07<34:11:23,  7.99s/it]
 59%|█████▉    | 22564/37963 [54:09:15<33:38:52,  7.87s/it]
 59%|█████▉    | 22565/37963 [54:09:23<33:21:21,  7.80s/it]
 59%|█████▉    | 22566/37963 [54:09:30<33:03:28,  7.73s/it]
 59%|█████▉    | 22567/37963 [54:09:38<32:54:51,  7.70s/it]
 59%|█████▉    | 22568/37963 [54:09:45<32:56:16,  7.70s/it]
 59%|█████▉    | 22569/37963 [54:09:53<32:36:51,  7.63s/it]
 59%|█████▉    | 22570/37963 [54:10:00<32:31:21,  7.61s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '0.9822', 'learning_rate': '7.454e-06', 'epoch': '0.5945'}

 59%|█████▉    | 22570/37963 [54:10:00<32:31:21,  7.61s/it]
 59%|█████▉    | 22571/37963 [54:10:08<32:25:08,  7.58s/it]
 59%|█████▉    | 22572/37963 [54:10:22<40:24:35,  9.45s/it]
 59%|█████▉    | 22573/37963 [54:10:29<37:58:53,  8.88s/it]
 59%|█████▉    | 22574/37963 [54:10:43<44:28:43, 10.41s/it]
 59%|█████▉    | 22575/37963 [54:10:51<40:54:27,  9.57s/it]
 59%|█████▉    | 22576/37963 [54:10:58<37:58:14,  8.88s/it]
 59%|█████▉    | 22577/37963 [54:11:06<36:27:30,  8.53s/it]
 59%|█████▉    | 22578/37963 [54:11:13<35:11:24,  8.23s/it]
 59%|█████▉    | 22579/37963 [54:11:21<34:19:04,  8.03s/it]
 59%|█████▉    | 22580/37963 [54:11:35<42:02:02,  9.84s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '2.899', 'learning_rate': '7.445e-06', 'epoch': '0.5948'}

 59%|█████▉    | 22580/37963 [54:11:35<42:02:02,  9.84s/it]
 59%|█████▉    | 22581/37963 [54:11:43<39:21:31,  9.21s/it]
 59%|█████▉    | 22582/37963 [54:11:50<37:13:29,  8.71s/it]
 59%|█████▉    | 22583/37963 [54:11:58<35:42:35,  8.36s/it]
 59%|█████▉    | 22584/37963 [54:12:06<34:49:46,  8.15s/it]
 59%|█████▉    | 22585/37963 [54:12:13<33:57:00,  7.95s/it]
 59%|█████▉    | 22586/37963 [54:12:20<33:10:38,  7.77s/it]
 59%|█████▉    | 22587/37963 [54:12:28<32:59:11,  7.72s/it]
 60%|█████▉    | 22588/37963 [54:12:36<32:46:12,  7.67s/it]
 60%|█████▉    | 22589/37963 [54:12:43<32:36:51,  7.64s/it]
 60%|█████▉    | 22590/37963 [54:12:51<32:24:25,  7.59s/it]
                                                           
{'loss': '0.1524', 'grad_norm': '1.236', 'learning_rate': '7.437e-06', 'epoch': '0.5951'}

 60%|█████▉    | 22590/37963 [54:12:51<32:24:25,  7.59s/it]
 60%|█████▉    | 22591/37963 [54:12:58<32:24:44,  7.59s/it]
 60%|█████▉    | 22592/37963 [54:13:06<32:16:47,  7.56s/it]
 60%|█████▉    | 22593/37963 [54:13:13<32:29:55,  7.61s/it]
 60%|█████▉    | 22594/37963 [54:13:21<32:31:15,  7.62s/it]
 60%|█████▉    | 22595/37963 [54:13:29<32:31:19,  7.62s/it]
 60%|█████▉    | 22596/37963 [54:13:36<32:28:02,  7.61s/it]
 60%|█████▉    | 22597/37963 [54:13:44<32:11:33,  7.54s/it]
 60%|█████▉    | 22598/37963 [54:13:58<40:56:37,  9.59s/it]
 60%|█████▉    | 22599/37963 [54:14:12<46:47:18, 10.96s/it]
 60%|█████▉    | 22600/37963 [54:14:20<42:37:32,  9.99s/it]
                                                           
{'loss': '0.1398', 'grad_norm': '3.591', 'learning_rate': '7.429e-06', 'epoch': '0.5953'}

 60%|█████▉    | 22600/37963 [54:14:20<42:37:32,  9.99s/it]
 60%|█████▉    | 22601/37963 [54:14:34<47:35:34, 11.15s/it]
 60%|█████▉    | 22602/37963 [54:14:48<51:10:59, 12.00s/it]
 60%|█████▉    | 22603/37963 [54:14:55<45:24:17, 10.64s/it]
 60%|█████▉    | 22604/37963 [54:15:03<41:10:48,  9.65s/it]
 60%|█████▉    | 22605/37963 [54:15:10<38:18:07,  8.98s/it]
 60%|█████▉    | 22606/37963 [54:15:17<36:13:32,  8.49s/it]
 60%|█████▉    | 22607/37963 [54:15:25<35:17:06,  8.27s/it]
 60%|█████▉    | 22608/37963 [54:15:33<34:23:32,  8.06s/it]
 60%|█████▉    | 22609/37963 [54:15:40<33:36:30,  7.88s/it]
 60%|█████▉    | 22610/37963 [54:15:48<33:08:03,  7.77s/it]
                                                           
{'loss': '0.1443', 'grad_norm': '2.043', 'learning_rate': '7.421e-06', 'epoch': '0.5956'}

 60%|█████▉    | 22610/37963 [54:15:48<33:08:03,  7.77s/it]
 60%|█████▉    | 22611/37963 [54:15:55<32:53:31,  7.71s/it]
 60%|█████▉    | 22612/37963 [54:16:03<32:38:21,  7.65s/it]
 60%|█████▉    | 22613/37963 [54:16:17<41:03:59,  9.63s/it]
 60%|█████▉    | 22614/37963 [54:16:25<38:40:16,  9.07s/it]
 60%|█████▉    | 22615/37963 [54:16:32<36:42:37,  8.61s/it]
 60%|█████▉    | 22616/37963 [54:16:46<43:14:56, 10.15s/it]
 60%|█████▉    | 22617/37963 [54:17:00<47:58:53, 11.26s/it]
 60%|█████▉    | 22618/37963 [54:17:08<43:30:10, 10.21s/it]
 60%|█████▉    | 22619/37963 [54:17:15<40:03:14,  9.40s/it]
 60%|█████▉    | 22620/37963 [54:17:23<37:49:54,  8.88s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '1.877', 'learning_rate': '7.412e-06', 'epoch': '0.5958'}

 60%|█████▉    | 22620/37963 [54:17:23<37:49:54,  8.88s/it]
 60%|█████▉    | 22621/37963 [54:17:30<36:15:12,  8.51s/it]
 60%|█████▉    | 22622/37963 [54:17:38<35:00:32,  8.22s/it]
 60%|█████▉    | 22623/37963 [54:17:45<34:08:02,  8.01s/it]
 60%|█████▉    | 22624/37963 [54:17:53<33:31:41,  7.87s/it]
 60%|█████▉    | 22625/37963 [54:18:01<33:05:58,  7.77s/it]
 60%|█████▉    | 22626/37963 [54:18:08<32:53:06,  7.72s/it]
 60%|█████▉    | 22627/37963 [54:18:16<32:41:37,  7.67s/it]
 60%|█████▉    | 22628/37963 [54:18:23<32:21:19,  7.60s/it]
 60%|█████▉    | 22629/37963 [54:18:31<32:12:15,  7.56s/it]
 60%|█████▉    | 22630/37963 [54:18:38<32:03:40,  7.53s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '0.9514', 'learning_rate': '7.404e-06', 'epoch': '0.5961'}

 60%|█████▉    | 22630/37963 [54:18:38<32:03:40,  7.53s/it]
 60%|█████▉    | 22631/37963 [54:18:46<32:09:11,  7.55s/it]
 60%|█████▉    | 22632/37963 [54:18:53<32:19:22,  7.59s/it]
 60%|█████▉    | 22633/37963 [54:19:01<32:28:11,  7.63s/it]
 60%|█████▉    | 22634/37963 [54:19:15<40:29:00,  9.51s/it]
 60%|█████▉    | 22635/37963 [54:19:23<38:10:19,  8.97s/it]
 60%|█████▉    | 22636/37963 [54:19:30<35:55:46,  8.44s/it]
 60%|█████▉    | 22637/37963 [54:19:37<34:47:36,  8.17s/it]
 60%|█████▉    | 22638/37963 [54:19:45<33:55:00,  7.97s/it]
 60%|█████▉    | 22639/37963 [54:19:52<33:24:21,  7.85s/it]
 60%|█████▉    | 22640/37963 [54:20:00<32:48:41,  7.71s/it]
                                                           
{'loss': '0.1405', 'grad_norm': '1.165', 'learning_rate': '7.396e-06', 'epoch': '0.5964'}

 60%|█████▉    | 22640/37963 [54:20:00<32:48:41,  7.71s/it]
 60%|█████▉    | 22641/37963 [54:20:08<32:46:07,  7.70s/it]
 60%|█████▉    | 22642/37963 [54:20:15<32:43:41,  7.69s/it]
 60%|█████▉    | 22643/37963 [54:20:30<41:13:11,  9.69s/it]
 60%|█████▉    | 22644/37963 [54:20:37<38:27:09,  9.04s/it]
 60%|█████▉    | 22645/37963 [54:20:44<36:18:28,  8.53s/it]
 60%|█████▉    | 22646/37963 [54:20:52<35:02:42,  8.24s/it]
 60%|█████▉    | 22647/37963 [54:21:13<50:47:22, 11.94s/it]
 60%|█████▉    | 22648/37963 [54:21:20<45:02:37, 10.59s/it]
 60%|█████▉    | 22649/37963 [54:21:28<41:13:02,  9.69s/it]
 60%|█████▉    | 22650/37963 [54:21:35<38:35:54,  9.07s/it]
                                                           
{'loss': '0.1232', 'grad_norm': '1.626', 'learning_rate': '7.388e-06', 'epoch': '0.5966'}

 60%|█████▉    | 22650/37963 [54:21:35<38:35:54,  9.07s/it]
 60%|█████▉    | 22651/37963 [54:21:49<44:55:33, 10.56s/it]
 60%|█████▉    | 22652/37963 [54:21:57<41:16:49,  9.71s/it]
 60%|█████▉    | 22653/37963 [54:22:04<38:23:08,  9.03s/it]
 60%|█████▉    | 22654/37963 [54:22:12<36:38:13,  8.62s/it]
 60%|█████▉    | 22655/37963 [54:22:20<35:22:12,  8.32s/it]
 60%|█████▉    | 22656/37963 [54:22:27<34:28:03,  8.11s/it]
 60%|█████▉    | 22657/37963 [54:22:35<33:51:46,  7.96s/it]
 60%|█████▉    | 22658/37963 [54:22:42<33:02:16,  7.77s/it]
 60%|█████▉    | 22659/37963 [54:22:50<32:59:50,  7.76s/it]
 60%|█████▉    | 22660/37963 [54:22:57<32:38:52,  7.68s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '2.246', 'learning_rate': '7.379e-06', 'epoch': '0.5969'}

 60%|█████▉    | 22660/37963 [54:22:57<32:38:52,  7.68s/it]
 60%|█████▉    | 22661/37963 [54:23:05<32:33:01,  7.66s/it]
 60%|█████▉    | 22662/37963 [54:23:13<32:22:10,  7.62s/it]
 60%|█████▉    | 22663/37963 [54:23:26<40:20:15,  9.49s/it]
 60%|█████▉    | 22664/37963 [54:23:34<37:52:08,  8.91s/it]
 60%|█████▉    | 22665/37963 [54:23:41<35:54:02,  8.45s/it]
 60%|█████▉    | 22666/37963 [54:23:49<34:26:23,  8.11s/it]
 60%|█████▉    | 22667/37963 [54:24:03<41:56:09,  9.87s/it]
 60%|█████▉    | 22668/37963 [54:24:10<38:55:04,  9.16s/it]
 60%|█████▉    | 22669/37963 [54:24:18<36:59:04,  8.71s/it]
 60%|█████▉    | 22670/37963 [54:24:32<43:45:06, 10.30s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '1.338', 'learning_rate': '7.371e-06', 'epoch': '0.5972'}

 60%|█████▉    | 22670/37963 [54:24:32<43:45:06, 10.30s/it]
 60%|█████▉    | 22671/37963 [54:24:40<40:22:51,  9.51s/it]
 60%|█████▉    | 22672/37963 [54:24:47<37:56:01,  8.93s/it]
 60%|█████▉    | 22673/37963 [54:24:54<35:53:55,  8.45s/it]
 60%|█████▉    | 22674/37963 [54:25:02<34:41:04,  8.17s/it]
 60%|█████▉    | 22675/37963 [54:25:09<33:53:51,  7.98s/it]
 60%|█████▉    | 22676/37963 [54:25:17<33:17:05,  7.84s/it]
 60%|█████▉    | 22677/37963 [54:25:25<32:58:09,  7.76s/it]
 60%|█████▉    | 22678/37963 [54:25:32<32:35:46,  7.68s/it]
 60%|█████▉    | 22679/37963 [54:25:40<32:33:09,  7.67s/it]
 60%|█████▉    | 22680/37963 [54:25:54<40:40:24,  9.58s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.123', 'learning_rate': '7.363e-06', 'epoch': '0.5974'}

 60%|█████▉    | 22680/37963 [54:25:54<40:40:24,  9.58s/it]
 60%|█████▉    | 22681/37963 [54:26:01<37:46:38,  8.90s/it]
 60%|█████▉    | 22682/37963 [54:26:08<35:52:50,  8.45s/it]
 60%|█████▉    | 22683/37963 [54:26:16<34:38:56,  8.16s/it]
 60%|█████▉    | 22684/37963 [54:26:23<33:50:03,  7.97s/it]
 60%|█████▉    | 22685/37963 [54:26:31<33:15:58,  7.84s/it]
 60%|█████▉    | 22686/37963 [54:26:39<32:52:31,  7.75s/it]
 60%|█████▉    | 22687/37963 [54:26:46<32:34:58,  7.68s/it]
 60%|█████▉    | 22688/37963 [54:26:53<32:13:25,  7.59s/it]
 60%|█████▉    | 22689/37963 [54:27:07<39:50:11,  9.39s/it]
 60%|█████▉    | 22690/37963 [54:27:14<37:13:43,  8.78s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '1.661', 'learning_rate': '7.355e-06', 'epoch': '0.5977'}

 60%|█████▉    | 22690/37963 [54:27:15<37:13:43,  8.78s/it]
 60%|█████▉    | 22691/37963 [54:27:22<35:56:29,  8.47s/it]
 60%|█████▉    | 22692/37963 [54:27:30<34:43:54,  8.19s/it]
 60%|█████▉    | 22693/37963 [54:27:37<33:54:38,  7.99s/it]
 60%|█████▉    | 22694/37963 [54:27:45<33:31:16,  7.90s/it]
 60%|█████▉    | 22695/37963 [54:27:59<41:25:51,  9.77s/it]
 60%|█████▉    | 22696/37963 [54:28:07<38:31:09,  9.08s/it]
 60%|█████▉    | 22697/37963 [54:28:14<36:40:57,  8.65s/it]
 60%|█████▉    | 22698/37963 [54:28:28<43:41:31, 10.30s/it]
 60%|█████▉    | 22699/37963 [54:28:36<40:15:59,  9.50s/it]
 60%|█████▉    | 22700/37963 [54:28:44<38:04:00,  8.98s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '4.026', 'learning_rate': '7.346e-06', 'epoch': '0.598'}

 60%|█████▉    | 22700/37963 [54:28:44<38:04:00,  8.98s/it]
 60%|█████▉    | 22701/37963 [54:28:51<36:12:52,  8.54s/it]
 60%|█████▉    | 22702/37963 [54:28:59<34:50:04,  8.22s/it]
 60%|█████▉    | 22703/37963 [54:29:06<33:57:10,  8.01s/it]
 60%|█████▉    | 22704/37963 [54:29:20<41:31:37,  9.80s/it]
 60%|█████▉    | 22705/37963 [54:29:28<38:23:22,  9.06s/it]
 60%|█████▉    | 22706/37963 [54:29:35<36:25:59,  8.60s/it]
 60%|█████▉    | 22707/37963 [54:29:43<35:07:56,  8.29s/it]
 60%|█████▉    | 22708/37963 [54:29:50<34:10:55,  8.07s/it]
 60%|█████▉    | 22709/37963 [54:29:58<33:20:28,  7.87s/it]
 60%|█████▉    | 22710/37963 [54:30:11<40:28:56,  9.55s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '2.12', 'learning_rate': '7.338e-06', 'epoch': '0.5982'}

 60%|█████▉    | 22710/37963 [54:30:11<40:28:56,  9.55s/it]
 60%|█████▉    | 22711/37963 [54:30:19<38:01:05,  8.97s/it]
 60%|█████▉    | 22712/37963 [54:30:26<36:29:37,  8.61s/it]
 60%|█████▉    | 22713/37963 [54:30:34<34:58:19,  8.26s/it]
 60%|█████▉    | 22714/37963 [54:30:41<34:04:22,  8.04s/it]
 60%|█████▉    | 22715/37963 [54:30:49<33:10:14,  7.83s/it]
 60%|█████▉    | 22716/37963 [54:30:56<32:55:04,  7.77s/it]
 60%|█████▉    | 22717/37963 [54:31:10<40:52:31,  9.65s/it]
 60%|█████▉    | 22718/37963 [54:31:18<38:00:01,  8.97s/it]
 60%|█████▉    | 22719/37963 [54:31:25<36:11:08,  8.55s/it]
 60%|█████▉    | 22720/37963 [54:31:33<35:04:40,  8.28s/it]
                                                           
{'loss': '0.1491', 'grad_norm': '4.237', 'learning_rate': '7.33e-06', 'epoch': '0.5985'}

 60%|█████▉    | 22720/37963 [54:31:33<35:04:40,  8.28s/it]
 60%|█████▉    | 22721/37963 [54:31:47<42:40:33, 10.08s/it]
 60%|█████▉    | 22722/37963 [54:31:55<39:09:02,  9.25s/it]
 60%|█████▉    | 22723/37963 [54:32:02<37:14:37,  8.80s/it]
 60%|█████▉    | 22724/37963 [54:32:10<35:40:31,  8.43s/it]
 60%|█████▉    | 22725/37963 [54:32:18<34:47:29,  8.22s/it]
 60%|█████▉    | 22726/37963 [54:32:32<42:02:53,  9.93s/it]
 60%|█████▉    | 22727/37963 [54:32:39<39:14:11,  9.27s/it]
 60%|█████▉    | 22728/37963 [54:32:47<37:12:23,  8.79s/it]
 60%|█████▉    | 22729/37963 [54:32:54<35:30:04,  8.39s/it]
 60%|█████▉    | 22730/37963 [54:33:02<34:16:26,  8.10s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '1.591', 'learning_rate': '7.322e-06', 'epoch': '0.5987'}

 60%|█████▉    | 22730/37963 [54:33:02<34:16:26,  8.10s/it]
 60%|█████▉    | 22731/37963 [54:33:09<33:20:37,  7.88s/it]
 60%|█████▉    | 22732/37963 [54:33:17<32:52:56,  7.77s/it]
 60%|█████▉    | 22733/37963 [54:33:24<32:46:02,  7.75s/it]
 60%|█████▉    | 22734/37963 [54:33:32<32:27:33,  7.67s/it]
 60%|█████▉    | 22735/37963 [54:33:40<32:22:13,  7.65s/it]
 60%|█████▉    | 22736/37963 [54:33:47<32:09:07,  7.60s/it]
 60%|█████▉    | 22737/37963 [54:33:55<32:05:20,  7.59s/it]
 60%|█████▉    | 22738/37963 [54:34:09<40:27:17,  9.57s/it]
 60%|█████▉    | 22739/37963 [54:34:16<38:01:37,  8.99s/it]
 60%|█████▉    | 22740/37963 [54:34:31<44:36:47, 10.55s/it]
                                                           
{'loss': '0.1247', 'grad_norm': '1.58', 'learning_rate': '7.314e-06', 'epoch': '0.599'}

 60%|█████▉    | 22740/37963 [54:34:31<44:36:47, 10.55s/it]
 60%|█████▉    | 22741/37963 [54:34:38<40:52:00,  9.67s/it]
 60%|█████▉    | 22742/37963 [54:34:46<38:19:51,  9.07s/it]
 60%|█████▉    | 22743/37963 [54:34:53<36:28:47,  8.63s/it]
 60%|█████▉    | 22744/37963 [54:35:01<35:25:02,  8.38s/it]
 60%|█████▉    | 22745/37963 [54:35:09<34:21:29,  8.13s/it]
 60%|█████▉    | 22746/37963 [54:35:17<33:50:28,  8.01s/it]
 60%|█████▉    | 22747/37963 [54:35:24<33:23:30,  7.90s/it]
 60%|█████▉    | 22748/37963 [54:35:32<33:06:58,  7.84s/it]
 60%|█████▉    | 22749/37963 [54:35:46<40:34:38,  9.60s/it]
 60%|█████▉    | 22750/37963 [54:35:53<37:49:54,  8.95s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '2.299', 'learning_rate': '7.305e-06', 'epoch': '0.5993'}

 60%|█████▉    | 22750/37963 [54:35:53<37:49:54,  8.95s/it]
 60%|█████▉    | 22751/37963 [54:36:01<36:09:36,  8.56s/it]
 60%|█████▉    | 22752/37963 [54:36:14<42:49:54, 10.14s/it]
 60%|█████▉    | 22753/37963 [54:36:22<39:36:01,  9.37s/it]
 60%|█████▉    | 22754/37963 [54:36:30<37:19:23,  8.83s/it]
 60%|█████▉    | 22755/37963 [54:36:37<35:46:11,  8.47s/it]
 60%|█████▉    | 22756/37963 [54:36:52<43:07:35, 10.21s/it]
 60%|█████▉    | 22757/37963 [54:36:59<39:47:03,  9.42s/it]
 60%|█████▉    | 22758/37963 [54:37:07<37:23:12,  8.85s/it]
 60%|█████▉    | 22759/37963 [54:37:14<35:25:17,  8.39s/it]
 60%|█████▉    | 22760/37963 [54:37:21<34:17:16,  8.12s/it]
                                                           
{'loss': '0.1467', 'grad_norm': '2.517', 'learning_rate': '7.297e-06', 'epoch': '0.5995'}

 60%|█████▉    | 22760/37963 [54:37:21<34:17:16,  8.12s/it]
 60%|█████▉    | 22761/37963 [54:37:29<33:30:21,  7.93s/it]
 60%|█████▉    | 22762/37963 [54:37:36<32:55:36,  7.80s/it]
 60%|█████▉    | 22763/37963 [54:37:44<32:01:31,  7.58s/it]
 60%|█████▉    | 22764/37963 [54:37:51<32:09:47,  7.62s/it]
 60%|█████▉    | 22765/37963 [54:38:12<48:42:58, 11.54s/it]
 60%|█████▉    | 22766/37963 [54:38:19<43:41:53, 10.35s/it]
 60%|█████▉    | 22767/37963 [54:38:27<40:00:38,  9.48s/it]
 60%|█████▉    | 22768/37963 [54:38:35<37:51:28,  8.97s/it]
 60%|█████▉    | 22769/37963 [54:38:42<36:01:39,  8.54s/it]
 60%|█████▉    | 22770/37963 [54:38:50<34:33:55,  8.19s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.752', 'learning_rate': '7.289e-06', 'epoch': '0.5998'}

 60%|█████▉    | 22770/37963 [54:38:50<34:33:55,  8.19s/it]
 60%|█████▉    | 22771/37963 [54:38:57<33:41:44,  7.98s/it]
 60%|█████▉    | 22772/37963 [54:39:11<41:24:31,  9.81s/it]
 60%|█████▉    | 22773/37963 [54:39:19<38:45:06,  9.18s/it]
 60%|█████▉    | 22774/37963 [54:39:27<36:45:20,  8.71s/it]
 60%|█████▉    | 22775/37963 [54:39:34<35:23:01,  8.39s/it]
 60%|█████▉    | 22776/37963 [54:39:42<34:16:51,  8.13s/it]
 60%|█████▉    | 22777/37963 [54:39:49<33:43:58,  8.00s/it]
 60%|██████    | 22778/37963 [54:39:57<33:17:10,  7.89s/it]
 60%|██████    | 22779/37963 [54:40:04<32:33:15,  7.72s/it]
 60%|██████    | 22780/37963 [54:40:12<32:23:32,  7.68s/it]
                                                           
{'loss': '0.1354', 'grad_norm': '1.449', 'learning_rate': '7.281e-06', 'epoch': '0.6001'}

 60%|██████    | 22780/37963 [54:40:12<32:23:32,  7.68s/it]
 60%|██████    | 22781/37963 [54:40:19<31:49:00,  7.54s/it]
 60%|██████    | 22782/37963 [54:40:27<31:45:00,  7.53s/it]
 60%|██████    | 22783/37963 [54:40:34<32:03:54,  7.60s/it]
 60%|██████    | 22784/37963 [54:40:42<32:13:21,  7.64s/it]
 60%|██████    | 22785/37963 [54:40:56<40:03:38,  9.50s/it]
 60%|██████    | 22786/37963 [54:41:04<37:37:06,  8.92s/it]
 60%|██████    | 22787/37963 [54:41:11<35:57:17,  8.53s/it]
 60%|██████    | 22788/37963 [54:41:19<34:44:05,  8.24s/it]
 60%|██████    | 22789/37963 [54:41:26<33:39:48,  7.99s/it]
 60%|██████    | 22790/37963 [54:41:34<32:55:27,  7.81s/it]
                                                           
{'loss': '0.1349', 'grad_norm': '2.168', 'learning_rate': '7.273e-06', 'epoch': '0.6003'}

 60%|██████    | 22790/37963 [54:41:34<32:55:27,  7.81s/it]
 60%|██████    | 22791/37963 [54:41:41<32:34:14,  7.73s/it]
 60%|██████    | 22792/37963 [54:41:55<40:47:40,  9.68s/it]
 60%|██████    | 22793/37963 [54:42:03<37:46:02,  8.96s/it]
 60%|██████    | 22794/37963 [54:42:10<35:58:56,  8.54s/it]
 60%|██████    | 22795/37963 [54:42:18<34:47:10,  8.26s/it]
 60%|██████    | 22796/37963 [54:42:25<34:00:47,  8.07s/it]
 60%|██████    | 22797/37963 [54:42:39<41:28:56,  9.85s/it]
 60%|██████    | 22798/37963 [54:42:47<38:25:07,  9.12s/it]
 60%|██████    | 22799/37963 [54:42:54<36:25:41,  8.65s/it]
 60%|██████    | 22800/37963 [54:43:02<35:07:46,  8.34s/it]
                                                           
{'loss': '0.1447', 'grad_norm': '3.71', 'learning_rate': '7.264e-06', 'epoch': '0.6006'}

 60%|██████    | 22800/37963 [54:43:02<35:07:46,  8.34s/it]
 60%|██████    | 22801/37963 [54:43:09<33:55:35,  8.06s/it]
 60%|██████    | 22802/37963 [54:43:17<33:17:48,  7.91s/it]
 60%|██████    | 22803/37963 [54:43:31<40:54:32,  9.71s/it]
 60%|██████    | 22804/37963 [54:43:39<38:23:09,  9.12s/it]
 60%|██████    | 22805/37963 [54:43:52<44:22:57, 10.54s/it]
 60%|██████    | 22806/37963 [54:44:00<40:37:06,  9.65s/it]
 60%|██████    | 22807/37963 [54:44:07<37:29:56,  8.91s/it]
 60%|██████    | 22808/37963 [54:44:15<35:42:09,  8.48s/it]
 60%|██████    | 22809/37963 [54:44:22<34:36:39,  8.22s/it]
 60%|██████    | 22810/37963 [54:44:30<33:41:23,  8.00s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '2.465', 'learning_rate': '7.256e-06', 'epoch': '0.6009'}

 60%|██████    | 22810/37963 [54:44:30<33:41:23,  8.00s/it]
 60%|██████    | 22811/37963 [54:44:37<33:02:59,  7.85s/it]
 60%|██████    | 22812/37963 [54:44:45<32:37:30,  7.75s/it]
 60%|██████    | 22813/37963 [54:44:52<32:13:12,  7.66s/it]
 60%|██████    | 22814/37963 [54:45:00<32:04:01,  7.62s/it]
 60%|██████    | 22815/37963 [54:45:07<32:01:12,  7.61s/it]
 60%|██████    | 22816/37963 [54:45:15<32:06:39,  7.63s/it]
 60%|██████    | 22817/37963 [54:45:29<40:22:40,  9.60s/it]
 60%|██████    | 22818/37963 [54:45:37<37:51:39,  9.00s/it]
 60%|██████    | 22819/37963 [54:45:51<44:04:08, 10.48s/it]
 60%|██████    | 22820/37963 [54:45:58<40:23:30,  9.60s/it]
                                                           
{'loss': '0.1393', 'grad_norm': '1.78', 'learning_rate': '7.248e-06', 'epoch': '0.6011'}

 60%|██████    | 22820/37963 [54:45:58<40:23:30,  9.60s/it]
 60%|██████    | 22821/37963 [54:46:06<37:37:13,  8.94s/it]
 60%|██████    | 22822/37963 [54:46:13<35:53:08,  8.53s/it]
 60%|██████    | 22823/37963 [54:46:21<34:47:09,  8.27s/it]
 60%|██████    | 22824/37963 [54:46:28<33:42:26,  8.02s/it]
 60%|██████    | 22825/37963 [54:46:36<33:08:48,  7.88s/it]
 60%|██████    | 22826/37963 [54:46:50<40:44:50,  9.69s/it]
 60%|██████    | 22827/37963 [54:46:57<38:10:17,  9.08s/it]
 60%|██████    | 22828/37963 [54:47:05<36:21:30,  8.65s/it]
 60%|██████    | 22829/37963 [54:47:13<35:06:02,  8.35s/it]
 60%|██████    | 22830/37963 [54:47:20<34:03:02,  8.10s/it]
                                                           
{'loss': '0.14', 'grad_norm': '3.069', 'learning_rate': '7.24e-06', 'epoch': '0.6014'}

 60%|██████    | 22830/37963 [54:47:20<34:03:02,  8.10s/it]
 60%|██████    | 22831/37963 [54:47:28<33:36:12,  7.99s/it]
 60%|██████    | 22832/37963 [54:47:42<41:15:24,  9.82s/it]
 60%|██████    | 22833/37963 [54:47:50<38:15:07,  9.10s/it]
 60%|██████    | 22834/37963 [54:47:57<36:09:16,  8.60s/it]
 60%|██████    | 22835/37963 [54:48:05<34:48:11,  8.28s/it]
 60%|██████    | 22836/37963 [54:48:12<33:55:04,  8.07s/it]
 60%|██████    | 22837/37963 [54:48:20<33:29:22,  7.97s/it]
 60%|██████    | 22838/37963 [54:48:27<32:58:21,  7.85s/it]
 60%|██████    | 22839/37963 [54:48:35<32:36:46,  7.76s/it]
 60%|██████    | 22840/37963 [54:48:42<32:18:29,  7.69s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '1.166', 'learning_rate': '7.232e-06', 'epoch': '0.6016'}

 60%|██████    | 22840/37963 [54:48:42<32:18:29,  7.69s/it]
 60%|██████    | 22841/37963 [54:48:57<40:17:24,  9.59s/it]
 60%|██████    | 22842/37963 [54:49:04<37:34:35,  8.95s/it]
 60%|██████    | 22843/37963 [54:49:12<35:50:16,  8.53s/it]
 60%|██████    | 22844/37963 [54:49:19<34:13:38,  8.15s/it]
 60%|██████    | 22845/37963 [54:49:33<41:36:44,  9.91s/it]
 60%|██████    | 22846/37963 [54:49:40<38:41:47,  9.22s/it]
 60%|██████    | 22847/37963 [54:49:48<36:32:34,  8.70s/it]
 60%|██████    | 22848/37963 [54:49:55<35:05:29,  8.36s/it]
 60%|██████    | 22849/37963 [54:50:03<34:04:10,  8.12s/it]
 60%|██████    | 22850/37963 [54:50:10<33:01:04,  7.87s/it]
                                                           
{'loss': '0.1409', 'grad_norm': '2.325', 'learning_rate': '7.223e-06', 'epoch': '0.6019'}

 60%|██████    | 22850/37963 [54:50:10<33:01:04,  7.87s/it]
 60%|██████    | 22851/37963 [54:50:17<32:07:07,  7.65s/it]
 60%|██████    | 22852/37963 [54:50:25<31:44:04,  7.56s/it]
 60%|██████    | 22853/37963 [54:50:39<39:48:56,  9.49s/it]
 60%|██████    | 22854/37963 [54:50:46<37:22:39,  8.91s/it]
 60%|██████    | 22855/37963 [54:51:00<43:59:03, 10.48s/it]
 60%|██████    | 22856/37963 [54:51:08<40:26:50,  9.64s/it]
 60%|██████    | 22857/37963 [54:51:16<37:51:28,  9.02s/it]
 60%|██████    | 22858/37963 [54:51:23<36:02:36,  8.59s/it]
 60%|██████    | 22859/37963 [54:51:31<34:23:54,  8.20s/it]
 60%|██████    | 22860/37963 [54:51:38<33:20:21,  7.95s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.682', 'learning_rate': '7.215e-06', 'epoch': '0.6022'}

 60%|██████    | 22860/37963 [54:51:38<33:20:21,  7.95s/it]
 60%|██████    | 22861/37963 [54:51:46<32:55:26,  7.85s/it]
 60%|██████    | 22862/37963 [54:51:53<32:34:43,  7.77s/it]
 60%|██████    | 22863/37963 [54:52:01<32:19:10,  7.71s/it]
 60%|██████    | 22864/37963 [54:52:08<31:46:15,  7.58s/it]
 60%|██████    | 22865/37963 [54:52:16<31:45:04,  7.57s/it]
 60%|██████    | 22866/37963 [54:52:23<31:42:48,  7.56s/it]
 60%|██████    | 22867/37963 [54:52:31<31:43:40,  7.57s/it]
 60%|██████    | 22868/37963 [54:52:38<31:47:59,  7.58s/it]
 60%|██████    | 22869/37963 [54:52:52<39:56:32,  9.53s/it]
 60%|██████    | 22870/37963 [54:53:00<37:35:29,  8.97s/it]
                                                           
{'loss': '0.1341', 'grad_norm': '2.604', 'learning_rate': '7.207e-06', 'epoch': '0.6024'}

 60%|██████    | 22870/37963 [54:53:00<37:35:29,  8.97s/it]
 60%|██████    | 22871/37963 [54:53:08<35:53:37,  8.56s/it]
 60%|██████    | 22872/37963 [54:53:15<34:39:24,  8.27s/it]
 60%|██████    | 22873/37963 [54:53:29<41:44:49,  9.96s/it]
 60%|██████    | 22874/37963 [54:53:37<38:36:35,  9.21s/it]
 60%|██████    | 22875/37963 [54:53:44<36:27:59,  8.70s/it]
 60%|██████    | 22876/37963 [54:53:58<43:00:48, 10.26s/it]
 60%|██████    | 22877/37963 [54:54:06<39:41:31,  9.47s/it]
 60%|██████    | 22878/37963 [54:54:13<37:26:00,  8.93s/it]
 60%|██████    | 22879/37963 [54:54:21<35:41:35,  8.52s/it]
 60%|██████    | 22880/37963 [54:54:28<34:28:09,  8.23s/it]
                                                           
{'loss': '0.1346', 'grad_norm': '2.872', 'learning_rate': '7.199e-06', 'epoch': '0.6027'}

 60%|██████    | 22880/37963 [54:54:28<34:28:09,  8.23s/it]
 60%|██████    | 22881/37963 [54:54:36<33:37:02,  8.02s/it]
 60%|██████    | 22882/37963 [54:54:43<32:57:21,  7.87s/it]
 60%|██████    | 22883/37963 [54:54:51<32:12:05,  7.69s/it]
 60%|██████    | 22884/37963 [54:54:58<31:33:16,  7.53s/it]
 60%|██████    | 22885/37963 [54:55:12<39:52:48,  9.52s/it]
 60%|██████    | 22886/37963 [54:55:19<37:12:05,  8.88s/it]
 60%|██████    | 22887/37963 [54:55:27<35:00:44,  8.36s/it]
 60%|██████    | 22888/37963 [54:55:34<33:55:38,  8.10s/it]
 60%|██████    | 22889/37963 [54:55:42<33:13:28,  7.93s/it]
 60%|██████    | 22890/37963 [54:55:49<32:55:16,  7.86s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '1.465', 'learning_rate': '7.191e-06', 'epoch': '0.603'}

 60%|██████    | 22890/37963 [54:55:49<32:55:16,  7.86s/it]
 60%|██████    | 22891/37963 [54:55:57<32:40:01,  7.80s/it]
 60%|██████    | 22892/37963 [54:56:17<48:10:11, 11.51s/it]
 60%|██████    | 22893/37963 [54:56:25<43:17:20, 10.34s/it]
 60%|██████    | 22894/37963 [54:56:32<39:47:49,  9.51s/it]
 60%|██████    | 22895/37963 [54:56:39<36:50:32,  8.80s/it]
 60%|██████    | 22896/37963 [54:56:47<35:12:05,  8.41s/it]
 60%|██████    | 22897/37963 [54:57:01<42:31:35, 10.16s/it]
 60%|██████    | 22898/37963 [54:57:09<39:21:28,  9.41s/it]
 60%|██████    | 22899/37963 [54:57:16<37:01:10,  8.85s/it]
 60%|██████    | 22900/37963 [54:57:24<35:22:28,  8.45s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '2.322', 'learning_rate': '7.182e-06', 'epoch': '0.6032'}

 60%|██████    | 22900/37963 [54:57:24<35:22:28,  8.45s/it]
 60%|██████    | 22901/37963 [54:57:31<34:09:44,  8.17s/it]
 60%|██████    | 22902/37963 [54:57:39<33:05:04,  7.91s/it]
 60%|██████    | 22903/37963 [54:57:53<40:41:07,  9.73s/it]
 60%|██████    | 22904/37963 [54:58:00<37:54:24,  9.06s/it]
 60%|██████    | 22905/37963 [54:58:08<36:02:52,  8.62s/it]
 60%|██████    | 22906/37963 [54:58:15<34:46:24,  8.31s/it]
 60%|██████    | 22907/37963 [54:58:23<33:53:47,  8.10s/it]
 60%|██████    | 22908/37963 [54:58:31<33:18:25,  7.96s/it]
 60%|██████    | 22909/37963 [54:58:38<32:46:36,  7.84s/it]
 60%|██████    | 22910/37963 [54:58:46<32:26:02,  7.76s/it]
                                                           
{'loss': '0.141', 'grad_norm': '2.105', 'learning_rate': '7.174e-06', 'epoch': '0.6035'}

 60%|██████    | 22910/37963 [54:58:46<32:26:02,  7.76s/it]
 60%|██████    | 22911/37963 [54:58:53<32:19:31,  7.73s/it]
 60%|██████    | 22912/37963 [54:59:01<32:10:11,  7.69s/it]
 60%|██████    | 22913/37963 [54:59:15<40:04:17,  9.59s/it]
 60%|██████    | 22914/37963 [54:59:22<37:22:42,  8.94s/it]
 60%|██████    | 22915/37963 [54:59:30<35:36:13,  8.52s/it]
 60%|██████    | 22916/37963 [54:59:37<34:15:25,  8.20s/it]
 60%|██████    | 22917/37963 [54:59:45<33:33:13,  8.03s/it]
 60%|██████    | 22918/37963 [54:59:53<32:48:16,  7.85s/it]
 60%|██████    | 22919/37963 [55:00:00<32:24:20,  7.75s/it]
 60%|██████    | 22920/37963 [55:00:07<31:56:07,  7.64s/it]
                                                           
{'loss': '0.124', 'grad_norm': '0.8079', 'learning_rate': '7.166e-06', 'epoch': '0.6037'}

 60%|██████    | 22920/37963 [55:00:07<31:56:07,  7.64s/it]
 60%|██████    | 22921/37963 [55:00:15<31:51:05,  7.62s/it]
 60%|██████    | 22922/37963 [55:00:29<39:44:57,  9.51s/it]
 60%|██████    | 22923/37963 [55:00:37<37:24:02,  8.95s/it]
 60%|██████    | 22924/37963 [55:00:44<35:43:15,  8.55s/it]
 60%|██████    | 22925/37963 [55:00:52<34:26:42,  8.25s/it]
 60%|██████    | 22926/37963 [55:00:59<33:31:17,  8.03s/it]
 60%|██████    | 22927/37963 [55:01:07<32:55:49,  7.88s/it]
 60%|██████    | 22928/37963 [55:01:21<40:20:44,  9.66s/it]
 60%|██████    | 22929/37963 [55:01:28<37:35:09,  9.00s/it]
 60%|██████    | 22930/37963 [55:01:36<35:50:22,  8.58s/it]
                                                           
{'loss': '0.1226', 'grad_norm': '1.797', 'learning_rate': '7.158e-06', 'epoch': '0.604'}

 60%|██████    | 22930/37963 [55:01:36<35:50:22,  8.58s/it]
 60%|██████    | 22931/37963 [55:01:43<34:34:27,  8.28s/it]
 60%|██████    | 22932/37963 [55:01:51<33:45:50,  8.09s/it]
 60%|██████    | 22933/37963 [55:02:05<41:19:15,  9.90s/it]
 60%|██████    | 22934/37963 [55:02:13<38:22:12,  9.19s/it]
 60%|██████    | 22935/37963 [55:02:20<36:19:58,  8.70s/it]
 60%|██████    | 22936/37963 [55:02:34<42:48:15, 10.25s/it]
 60%|██████    | 22937/37963 [55:02:42<39:42:10,  9.51s/it]
 60%|██████    | 22938/37963 [55:02:49<37:14:49,  8.92s/it]
 60%|██████    | 22939/37963 [55:02:57<35:10:26,  8.43s/it]
 60%|██████    | 22940/37963 [55:03:04<34:13:53,  8.20s/it]
                                                           
{'loss': '0.1277', 'grad_norm': '2.387', 'learning_rate': '7.15e-06', 'epoch': '0.6043'}

 60%|██████    | 22940/37963 [55:03:04<34:13:53,  8.20s/it]
 60%|██████    | 22941/37963 [55:03:12<33:24:54,  8.01s/it]
 60%|██████    | 22942/37963 [55:03:19<32:47:53,  7.86s/it]
 60%|██████    | 22943/37963 [55:03:33<40:17:07,  9.66s/it]
 60%|██████    | 22944/37963 [55:03:41<37:31:55,  9.00s/it]
 60%|██████    | 22945/37963 [55:03:55<43:51:46, 10.51s/it]
 60%|██████    | 22946/37963 [55:04:02<40:11:03,  9.63s/it]
 60%|██████    | 22947/37963 [55:04:10<37:35:10,  9.01s/it]
 60%|██████    | 22948/37963 [55:04:17<35:43:15,  8.56s/it]
 60%|██████    | 22949/37963 [55:04:25<34:00:10,  8.15s/it]
 60%|██████    | 22950/37963 [55:04:32<33:10:42,  7.96s/it]
                                                           
{'loss': '0.1293', 'grad_norm': '1.534', 'learning_rate': '7.141e-06', 'epoch': '0.6045'}

 60%|██████    | 22950/37963 [55:04:32<33:10:42,  7.96s/it]
 60%|██████    | 22951/37963 [55:04:40<32:39:28,  7.83s/it]
 60%|██████    | 22952/37963 [55:04:54<40:22:23,  9.68s/it]
 60%|██████    | 22953/37963 [55:05:01<37:32:32,  9.00s/it]
 60%|██████    | 22954/37963 [55:05:09<35:42:24,  8.56s/it]
 60%|██████    | 22955/37963 [55:05:16<34:21:17,  8.24s/it]
 60%|██████    | 22956/37963 [55:05:23<33:09:33,  7.95s/it]
 60%|██████    | 22957/37963 [55:05:31<32:38:43,  7.83s/it]
 60%|██████    | 22958/37963 [55:05:38<32:14:56,  7.74s/it]
 60%|██████    | 22959/37963 [55:05:46<31:46:37,  7.62s/it]
 60%|██████    | 22960/37963 [55:05:53<31:44:11,  7.62s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '2.414', 'learning_rate': '7.133e-06', 'epoch': '0.6048'}

 60%|██████    | 22960/37963 [55:05:53<31:44:11,  7.62s/it]
 60%|██████    | 22961/37963 [55:06:01<31:36:34,  7.59s/it]
 60%|██████    | 22962/37963 [55:06:08<31:39:24,  7.60s/it]
 60%|██████    | 22963/37963 [55:06:16<31:34:54,  7.58s/it]
 60%|██████    | 22964/37963 [55:06:30<39:11:27,  9.41s/it]
 60%|██████    | 22965/37963 [55:06:37<36:47:44,  8.83s/it]
 60%|██████    | 22966/37963 [55:06:45<35:12:28,  8.45s/it]
 60%|██████    | 22967/37963 [55:06:52<33:59:38,  8.16s/it]
 61%|██████    | 22968/37963 [55:07:06<41:15:14,  9.90s/it]
 61%|██████    | 22969/37963 [55:07:14<38:03:32,  9.14s/it]
 61%|██████    | 22970/37963 [55:07:21<36:02:36,  8.65s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '4.63', 'learning_rate': '7.125e-06', 'epoch': '0.6051'}

 61%|██████    | 22970/37963 [55:07:21<36:02:36,  8.65s/it]
 61%|██████    | 22971/37963 [55:07:29<34:38:33,  8.32s/it]
 61%|██████    | 22972/37963 [55:07:36<33:35:51,  8.07s/it]
 61%|██████    | 22973/37963 [55:07:44<32:56:20,  7.91s/it]
 61%|██████    | 22974/37963 [55:07:51<32:38:58,  7.84s/it]
 61%|██████    | 22975/37963 [55:07:59<32:23:03,  7.78s/it]
 61%|██████    | 22976/37963 [55:08:13<40:03:15,  9.62s/it]
 61%|██████    | 22977/37963 [55:08:21<37:33:40,  9.02s/it]
 61%|██████    | 22978/37963 [55:08:34<43:43:36, 10.50s/it]
 61%|██████    | 22979/37963 [55:08:42<39:59:37,  9.61s/it]
 61%|██████    | 22980/37963 [55:08:49<36:58:59,  8.89s/it]
                                                           
{'loss': '0.1456', 'grad_norm': '2.239', 'learning_rate': '7.117e-06', 'epoch': '0.6053'}

 61%|██████    | 22980/37963 [55:08:49<36:58:59,  8.89s/it]
 61%|██████    | 22981/37963 [55:08:57<35:18:16,  8.48s/it]
 61%|██████    | 22982/37963 [55:09:04<34:04:22,  8.19s/it]
 61%|██████    | 22983/37963 [55:09:18<41:14:40,  9.91s/it]
 61%|██████    | 22984/37963 [55:09:26<38:23:24,  9.23s/it]
 61%|██████    | 22985/37963 [55:09:33<36:12:47,  8.70s/it]
 61%|██████    | 22986/37963 [55:09:41<34:45:05,  8.35s/it]
 61%|██████    | 22987/37963 [55:09:48<33:42:49,  8.10s/it]
 61%|██████    | 22988/37963 [55:09:56<33:06:43,  7.96s/it]
 61%|██████    | 22989/37963 [55:10:03<32:33:39,  7.83s/it]
 61%|██████    | 22990/37963 [55:10:11<31:59:14,  7.69s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '1.547', 'learning_rate': '7.109e-06', 'epoch': '0.6056'}

 61%|██████    | 22990/37963 [55:10:11<31:59:14,  7.69s/it]
 61%|██████    | 22991/37963 [55:10:18<31:45:16,  7.64s/it]
 61%|██████    | 22992/37963 [55:10:26<31:46:07,  7.64s/it]
 61%|██████    | 22993/37963 [55:10:40<39:13:57,  9.43s/it]
 61%|██████    | 22994/37963 [55:10:54<44:49:37, 10.78s/it]
 61%|██████    | 22995/37963 [55:11:01<40:46:14,  9.81s/it]
 61%|██████    | 22996/37963 [55:11:08<37:40:31,  9.06s/it]
 61%|██████    | 22997/37963 [55:11:16<35:35:17,  8.56s/it]
 61%|██████    | 22998/37963 [55:11:23<34:21:20,  8.26s/it]
 61%|██████    | 22999/37963 [55:11:31<33:34:32,  8.08s/it]
 61%|██████    | 23000/37963 [55:11:45<40:58:41,  9.86s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.118', 'learning_rate': '7.101e-06', 'epoch': '0.6059'}

 61%|██████    | 23000/37963 [55:11:45<40:58:41,  9.86s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.72s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.72s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 61%|██████    | 23001/37963 [55:12:43<100:47:04, 24.25s/it]
 61%|██████    | 23002/37963 [55:12:50<79:39:41, 19.17s/it] 
 61%|██████    | 23003/37963 [55:12:58<65:00:51, 15.65s/it]
 61%|██████    | 23004/37963 [55:13:05<54:54:26, 13.21s/it]
 61%|██████    | 23005/37963 [55:13:13<47:54:26, 11.53s/it]
 61%|██████    | 23006/37963 [55:13:20<43:03:47, 10.36s/it]
 61%|██████    | 23007/37963 [55:13:28<39:27:56,  9.50s/it]
 61%|██████    | 23008/37963 [55:13:36<37:10:09,  8.95s/it]
 61%|██████    | 23009/37963 [55:13:43<35:06:18,  8.45s/it]
 61%|██████    | 23010/37963 [55:13:50<34:08:29,  8.22s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '1.703', 'learning_rate': '7.092e-06', 'epoch': '0.6061'}

 61%|██████    | 23010/37963 [55:13:50<34:08:29,  8.22s/it]
 61%|██████    | 23011/37963 [55:13:58<33:25:06,  8.05s/it]
 61%|██████    | 23012/37963 [55:14:06<32:48:25,  7.90s/it]
 61%|██████    | 23013/37963 [55:14:13<32:21:40,  7.79s/it]
 61%|██████    | 23014/37963 [55:14:21<32:02:33,  7.72s/it]
 61%|██████    | 23015/37963 [55:14:35<40:10:33,  9.68s/it]
 61%|██████    | 23016/37963 [55:14:49<45:35:19, 10.98s/it]
 61%|██████    | 23017/37963 [55:14:57<41:30:33, 10.00s/it]
 61%|██████    | 23018/37963 [55:15:04<38:34:28,  9.29s/it]
 61%|██████    | 23019/37963 [55:15:12<36:18:42,  8.75s/it]
 61%|██████    | 23020/37963 [55:15:19<34:42:15,  8.36s/it]
                                                           
{'loss': '0.1473', 'grad_norm': '2.821', 'learning_rate': '7.084e-06', 'epoch': '0.6064'}

 61%|██████    | 23020/37963 [55:15:19<34:42:15,  8.36s/it]
 61%|██████    | 23021/37963 [55:15:27<33:20:16,  8.03s/it]
 61%|██████    | 23022/37963 [55:15:34<32:44:24,  7.89s/it]
 61%|██████    | 23023/37963 [55:15:42<32:15:50,  7.77s/it]
 61%|██████    | 23024/37963 [55:15:49<31:58:39,  7.71s/it]
 61%|██████    | 23025/37963 [55:15:57<31:40:23,  7.63s/it]
 61%|██████    | 23026/37963 [55:16:11<39:53:00,  9.61s/it]
 61%|██████    | 23027/37963 [55:16:18<37:17:01,  8.99s/it]
 61%|██████    | 23028/37963 [55:16:39<51:49:27, 12.49s/it]
 61%|██████    | 23029/37963 [55:16:47<45:40:05, 11.01s/it]
 61%|██████    | 23030/37963 [55:16:54<41:23:46,  9.98s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '1.173', 'learning_rate': '7.076e-06', 'epoch': '0.6066'}

 61%|██████    | 23030/37963 [55:16:54<41:23:46,  9.98s/it]
 61%|██████    | 23031/37963 [55:17:02<38:22:16,  9.25s/it]
 61%|██████    | 23032/37963 [55:17:09<36:14:55,  8.74s/it]
 61%|██████    | 23033/37963 [55:17:17<34:47:23,  8.39s/it]
 61%|██████    | 23034/37963 [55:17:24<33:45:17,  8.14s/it]
 61%|██████    | 23035/37963 [55:17:32<32:35:30,  7.86s/it]
 61%|██████    | 23036/37963 [55:17:39<32:11:57,  7.77s/it]
 61%|██████    | 23037/37963 [55:17:47<31:50:42,  7.68s/it]
 61%|██████    | 23038/37963 [55:17:54<31:42:31,  7.65s/it]
 61%|██████    | 23039/37963 [55:18:02<31:42:18,  7.65s/it]
 61%|██████    | 23040/37963 [55:18:09<31:36:07,  7.62s/it]
                                                           
{'loss': '0.133', 'grad_norm': '1.986', 'learning_rate': '7.068e-06', 'epoch': '0.6069'}

 61%|██████    | 23040/37963 [55:18:09<31:36:07,  7.62s/it]
 61%|██████    | 23041/37963 [55:18:17<31:27:17,  7.59s/it]
 61%|██████    | 23042/37963 [55:18:31<39:50:02,  9.61s/it]
 61%|██████    | 23043/37963 [55:18:39<37:26:36,  9.03s/it]
 61%|██████    | 23044/37963 [55:18:47<35:34:47,  8.59s/it]
 61%|██████    | 23045/37963 [55:19:00<41:54:59, 10.12s/it]
 61%|██████    | 23046/37963 [55:19:14<46:48:58, 11.30s/it]
 61%|██████    | 23047/37963 [55:19:22<42:10:33, 10.18s/it]
 61%|██████    | 23048/37963 [55:19:29<38:56:10,  9.40s/it]
 61%|██████    | 23049/37963 [55:19:37<36:33:34,  8.82s/it]
 61%|██████    | 23050/37963 [55:19:44<34:55:08,  8.43s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '3.352', 'learning_rate': '7.06e-06', 'epoch': '0.6072'}

 61%|██████    | 23050/37963 [55:19:44<34:55:08,  8.43s/it]
 61%|██████    | 23051/37963 [55:19:52<33:25:35,  8.07s/it]
 61%|██████    | 23052/37963 [55:19:59<32:50:05,  7.93s/it]
 61%|██████    | 23053/37963 [55:20:07<32:22:03,  7.82s/it]
 61%|██████    | 23054/37963 [55:20:14<31:43:47,  7.66s/it]
 61%|██████    | 23055/37963 [55:20:21<31:02:18,  7.50s/it]
 61%|██████    | 23056/37963 [55:20:29<31:02:19,  7.50s/it]
 61%|██████    | 23057/37963 [55:20:36<31:01:04,  7.49s/it]
 61%|██████    | 23058/37963 [55:20:43<30:41:58,  7.41s/it]
 61%|██████    | 23059/37963 [55:20:51<30:48:43,  7.44s/it]
 61%|██████    | 23060/37963 [55:20:58<30:54:58,  7.47s/it]
                                                           
{'loss': '0.1309', 'grad_norm': '1.391', 'learning_rate': '7.052e-06', 'epoch': '0.6074'}

 61%|██████    | 23060/37963 [55:20:58<30:54:58,  7.47s/it]
 61%|██████    | 23061/37963 [55:21:06<30:48:56,  7.44s/it]
 61%|██████    | 23062/37963 [55:21:14<31:05:23,  7.51s/it]
 61%|██████    | 23063/37963 [55:21:28<39:09:23,  9.46s/it]
 61%|██████    | 23064/37963 [55:21:42<45:01:43, 10.88s/it]
 61%|██████    | 23065/37963 [55:21:49<40:42:43,  9.84s/it]
 61%|██████    | 23066/37963 [55:21:57<37:53:33,  9.16s/it]
 61%|██████    | 23067/37963 [55:22:04<35:48:45,  8.66s/it]
 61%|██████    | 23068/37963 [55:22:12<34:28:27,  8.33s/it]
 61%|██████    | 23069/37963 [55:22:19<32:56:00,  7.96s/it]
 61%|██████    | 23070/37963 [55:22:26<32:28:52,  7.85s/it]
                                                           
{'loss': '0.1308', 'grad_norm': '1.208', 'learning_rate': '7.044e-06', 'epoch': '0.6077'}

 61%|██████    | 23070/37963 [55:22:26<32:28:52,  7.85s/it]
 61%|██████    | 23071/37963 [55:22:34<31:46:43,  7.68s/it]
 61%|██████    | 23072/37963 [55:22:41<31:19:12,  7.57s/it]
 61%|██████    | 23073/37963 [55:22:49<31:16:45,  7.56s/it]
 61%|██████    | 23074/37963 [55:23:02<39:04:31,  9.45s/it]
 61%|██████    | 23075/37963 [55:23:16<44:37:12, 10.79s/it]
 61%|██████    | 23076/37963 [55:23:30<48:22:59, 11.70s/it]
 61%|██████    | 23077/37963 [55:23:38<43:10:50, 10.44s/it]
 61%|██████    | 23078/37963 [55:23:45<39:41:26,  9.60s/it]
 61%|██████    | 23079/37963 [55:23:53<37:16:05,  9.01s/it]
 61%|██████    | 23080/37963 [55:24:00<35:23:41,  8.56s/it]
                                                           
{'loss': '0.144', 'grad_norm': '1.083', 'learning_rate': '7.035e-06', 'epoch': '0.608'}

 61%|██████    | 23080/37963 [55:24:00<35:23:41,  8.56s/it]
 61%|██████    | 23081/37963 [55:24:08<34:14:06,  8.28s/it]
 61%|██████    | 23082/37963 [55:24:15<33:01:51,  7.99s/it]
 61%|██████    | 23083/37963 [55:24:23<32:15:30,  7.80s/it]
 61%|██████    | 23084/37963 [55:24:30<31:57:09,  7.73s/it]
 61%|██████    | 23085/37963 [55:24:38<31:43:31,  7.68s/it]
 61%|██████    | 23086/37963 [55:24:45<31:31:05,  7.63s/it]
 61%|██████    | 23087/37963 [55:24:53<31:07:09,  7.53s/it]
 61%|██████    | 23088/37963 [55:25:00<31:03:29,  7.52s/it]
 61%|██████    | 23089/37963 [55:25:08<31:01:52,  7.51s/it]
 61%|██████    | 23090/37963 [55:25:28<46:45:21, 11.32s/it]
                                                           
{'loss': '0.129', 'grad_norm': '2.369', 'learning_rate': '7.027e-06', 'epoch': '0.6082'}

 61%|██████    | 23090/37963 [55:25:28<46:45:21, 11.32s/it]
 61%|██████    | 23091/37963 [55:25:35<41:53:08, 10.14s/it]
 61%|██████    | 23092/37963 [55:25:43<38:41:27,  9.37s/it]
 61%|██████    | 23093/37963 [55:25:57<44:04:16, 10.67s/it]
 61%|██████    | 23094/37963 [55:26:04<40:10:47,  9.73s/it]
 61%|██████    | 23095/37963 [55:26:11<37:19:19,  9.04s/it]
 61%|██████    | 23096/37963 [55:26:19<35:32:00,  8.60s/it]
 61%|██████    | 23097/37963 [55:26:27<34:12:44,  8.28s/it]
 61%|██████    | 23098/37963 [55:26:34<33:05:46,  8.02s/it]
 61%|██████    | 23099/37963 [55:26:42<32:34:19,  7.89s/it]
 61%|██████    | 23100/37963 [55:26:49<31:52:15,  7.72s/it]
                                                           
{'loss': '0.1392', 'grad_norm': '1.838', 'learning_rate': '7.019e-06', 'epoch': '0.6085'}

 61%|██████    | 23100/37963 [55:26:49<31:52:15,  7.72s/it]
 61%|██████    | 23101/37963 [55:26:57<31:45:18,  7.69s/it]
 61%|██████    | 23102/37963 [55:27:04<31:37:59,  7.66s/it]
 61%|██████    | 23103/37963 [55:27:12<31:36:17,  7.66s/it]
 61%|██████    | 23104/37963 [55:27:19<31:35:19,  7.65s/it]
 61%|██████    | 23105/37963 [55:27:27<31:14:58,  7.57s/it]
 61%|██████    | 23106/37963 [55:27:34<31:14:00,  7.57s/it]
 61%|██████    | 23107/37963 [55:27:42<31:09:09,  7.55s/it]
 61%|██████    | 23108/37963 [55:27:50<31:25:12,  7.61s/it]
 61%|██████    | 23109/37963 [55:27:57<31:19:18,  7.59s/it]
 61%|██████    | 23110/37963 [55:28:05<31:13:06,  7.57s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '0.9462', 'learning_rate': '7.011e-06', 'epoch': '0.6088'}

 61%|██████    | 23110/37963 [55:28:05<31:13:06,  7.57s/it]
 61%|██████    | 23111/37963 [55:28:12<31:11:08,  7.56s/it]
 61%|██████    | 23112/37963 [55:28:20<31:09:26,  7.55s/it]
 61%|██████    | 23113/37963 [55:28:34<39:18:03,  9.53s/it]
 61%|██████    | 23114/37963 [55:28:48<44:46:53, 10.86s/it]
 61%|██████    | 23115/37963 [55:28:56<40:46:28,  9.89s/it]
 61%|██████    | 23116/37963 [55:29:03<37:42:04,  9.14s/it]
 61%|██████    | 23117/37963 [55:29:10<35:31:50,  8.62s/it]
 61%|██████    | 23118/37963 [55:29:18<34:10:56,  8.29s/it]
 61%|██████    | 23119/37963 [55:29:32<41:16:54, 10.01s/it]
 61%|██████    | 23120/37963 [55:29:46<46:29:43, 11.28s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '0.9671', 'learning_rate': '7.003e-06', 'epoch': '0.609'}

 61%|██████    | 23120/37963 [55:29:46<46:29:43, 11.28s/it]
 61%|██████    | 23121/37963 [55:29:54<42:04:46, 10.21s/it]
 61%|██████    | 23122/37963 [55:30:08<46:49:35, 11.36s/it]
 61%|██████    | 23123/37963 [55:30:15<41:58:26, 10.18s/it]
 61%|██████    | 23124/37963 [55:30:23<38:38:52,  9.38s/it]
 61%|██████    | 23125/37963 [55:30:30<36:18:37,  8.81s/it]
 61%|██████    | 23126/37963 [55:30:38<34:47:43,  8.44s/it]
 61%|██████    | 23127/37963 [55:30:45<33:47:10,  8.20s/it]
 61%|██████    | 23128/37963 [55:30:53<33:01:18,  8.01s/it]
 61%|██████    | 23129/37963 [55:31:01<32:28:54,  7.88s/it]
 61%|██████    | 23130/37963 [55:31:08<32:05:18,  7.79s/it]
                                                           
{'loss': '0.1325', 'grad_norm': '1.892', 'learning_rate': '6.995e-06', 'epoch': '0.6093'}

 61%|██████    | 23130/37963 [55:31:08<32:05:18,  7.79s/it]
 61%|██████    | 23131/37963 [55:31:16<31:50:42,  7.73s/it]
 61%|██████    | 23132/37963 [55:31:23<31:35:48,  7.67s/it]
 61%|██████    | 23133/37963 [55:31:31<31:34:07,  7.66s/it]
 61%|██████    | 23134/37963 [55:31:39<31:31:27,  7.65s/it]
 61%|██████    | 23135/37963 [55:31:46<31:18:40,  7.60s/it]
 61%|██████    | 23136/37963 [55:32:00<39:13:02,  9.52s/it]
 61%|██████    | 23137/37963 [55:32:14<44:15:40, 10.75s/it]
 61%|██████    | 23138/37963 [55:32:21<40:15:10,  9.77s/it]
 61%|██████    | 23139/37963 [55:32:29<37:17:00,  9.05s/it]
 61%|██████    | 23140/37963 [55:32:36<35:21:01,  8.59s/it]
                                                           
{'loss': '0.1402', 'grad_norm': '2', 'learning_rate': '6.987e-06', 'epoch': '0.6095'}

 61%|██████    | 23140/37963 [55:32:36<35:21:01,  8.59s/it]
 61%|██████    | 23141/37963 [55:32:50<41:32:04, 10.09s/it]
 61%|██████    | 23142/37963 [55:32:57<38:40:16,  9.39s/it]
 61%|██████    | 23143/37963 [55:33:05<36:29:03,  8.86s/it]
 61%|██████    | 23144/37963 [55:33:13<34:57:20,  8.49s/it]
 61%|██████    | 23145/37963 [55:33:20<33:39:03,  8.18s/it]
 61%|██████    | 23146/37963 [55:33:28<32:58:10,  8.01s/it]
 61%|██████    | 23147/37963 [55:33:35<32:15:47,  7.84s/it]
 61%|██████    | 23148/37963 [55:33:43<31:57:40,  7.77s/it]
 61%|██████    | 23149/37963 [55:33:50<31:44:36,  7.71s/it]
 61%|██████    | 23150/37963 [55:33:58<31:36:52,  7.68s/it]
                                                           
{'loss': '0.155', 'grad_norm': '1.419', 'learning_rate': '6.978e-06', 'epoch': '0.6098'}

 61%|██████    | 23150/37963 [55:33:58<31:36:52,  7.68s/it]
 61%|██████    | 23151/37963 [55:34:05<31:22:00,  7.62s/it]
 61%|██████    | 23152/37963 [55:34:13<31:16:32,  7.60s/it]
 61%|██████    | 23153/37963 [55:34:21<31:09:48,  7.58s/it]
 61%|██████    | 23154/37963 [55:34:28<31:15:20,  7.60s/it]
 61%|██████    | 23155/37963 [55:34:35<30:49:39,  7.49s/it]
 61%|██████    | 23156/37963 [55:34:43<30:53:18,  7.51s/it]
 61%|██████    | 23157/37963 [55:34:50<30:53:49,  7.51s/it]
 61%|██████    | 23158/37963 [55:34:58<30:27:39,  7.41s/it]
 61%|██████    | 23159/37963 [55:35:12<38:29:42,  9.36s/it]
 61%|██████    | 23160/37963 [55:35:19<35:54:03,  8.73s/it]
                                                           
{'loss': '0.1426', 'grad_norm': '2.564', 'learning_rate': '6.97e-06', 'epoch': '0.6101'}

 61%|██████    | 23160/37963 [55:35:19<35:54:03,  8.73s/it]
 61%|██████    | 23161/37963 [55:35:26<34:21:08,  8.35s/it]
 61%|██████    | 23162/37963 [55:35:40<41:21:58, 10.06s/it]
 61%|██████    | 23163/37963 [55:35:48<38:34:18,  9.38s/it]
 61%|██████    | 23164/37963 [55:35:56<36:18:05,  8.83s/it]
 61%|██████    | 23165/37963 [55:36:03<34:41:32,  8.44s/it]
 61%|██████    | 23166/37963 [55:36:17<41:26:57, 10.08s/it]
 61%|██████    | 23167/37963 [55:36:31<46:26:36, 11.30s/it]
 61%|██████    | 23168/37963 [55:36:45<49:41:24, 12.09s/it]
 61%|██████    | 23169/37963 [55:36:53<43:59:46, 10.71s/it]
 61%|██████    | 23170/37963 [55:37:00<39:39:28,  9.65s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '1.581', 'learning_rate': '6.962e-06', 'epoch': '0.6103'}

 61%|██████    | 23170/37963 [55:37:00<39:39:28,  9.65s/it]
 61%|██████    | 23171/37963 [55:37:07<37:03:32,  9.02s/it]
 61%|██████    | 23172/37963 [55:37:15<34:59:15,  8.52s/it]
 61%|██████    | 23173/37963 [55:37:22<33:47:35,  8.23s/it]
 61%|██████    | 23174/37963 [55:37:30<32:53:00,  8.00s/it]
 61%|██████    | 23175/37963 [55:37:37<32:13:44,  7.85s/it]
 61%|██████    | 23176/37963 [55:37:44<31:21:25,  7.63s/it]
 61%|██████    | 23177/37963 [55:37:52<31:14:43,  7.61s/it]
 61%|██████    | 23178/37963 [55:37:59<31:00:44,  7.55s/it]
 61%|██████    | 23179/37963 [55:38:07<31:05:24,  7.57s/it]
 61%|██████    | 23180/37963 [55:38:15<31:10:27,  7.59s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.276', 'learning_rate': '6.954e-06', 'epoch': '0.6106'}

 61%|██████    | 23180/37963 [55:38:15<31:10:27,  7.59s/it]
 61%|██████    | 23181/37963 [55:38:22<31:04:16,  7.57s/it]
 61%|██████    | 23182/37963 [55:38:29<30:45:40,  7.49s/it]
 61%|██████    | 23183/37963 [55:38:37<30:42:48,  7.48s/it]
 61%|██████    | 23184/37963 [55:38:45<30:49:40,  7.51s/it]
 61%|██████    | 23185/37963 [55:38:59<38:59:51,  9.50s/it]
 61%|██████    | 23186/37963 [55:39:06<36:34:37,  8.91s/it]
 61%|██████    | 23187/37963 [55:39:14<34:51:11,  8.49s/it]
 61%|██████    | 23188/37963 [55:39:21<33:40:32,  8.21s/it]
 61%|██████    | 23189/37963 [55:39:42<48:35:42, 11.84s/it]
 61%|██████    | 23190/37963 [55:39:49<43:12:31, 10.53s/it]
                                                           
{'loss': '0.1489', 'grad_norm': '2.272', 'learning_rate': '6.946e-06', 'epoch': '0.6109'}

 61%|██████    | 23190/37963 [55:39:49<43:12:31, 10.53s/it]
 61%|██████    | 23191/37963 [55:39:57<39:29:21,  9.62s/it]
 61%|██████    | 23192/37963 [55:40:04<36:54:29,  9.00s/it]
 61%|██████    | 23193/37963 [55:40:12<35:12:28,  8.58s/it]
 61%|██████    | 23194/37963 [55:40:19<33:53:48,  8.26s/it]
 61%|██████    | 23195/37963 [55:40:27<33:04:37,  8.06s/it]
 61%|██████    | 23196/37963 [55:40:34<32:31:49,  7.93s/it]
 61%|██████    | 23197/37963 [55:40:42<31:58:20,  7.79s/it]
 61%|██████    | 23198/37963 [55:40:49<31:27:08,  7.67s/it]
 61%|██████    | 23199/37963 [55:40:57<31:14:19,  7.62s/it]
 61%|██████    | 23200/37963 [55:41:04<31:06:42,  7.59s/it]
                                                           
{'loss': '0.1417', 'grad_norm': '1.23', 'learning_rate': '6.938e-06', 'epoch': '0.6111'}

 61%|██████    | 23200/37963 [55:41:04<31:06:42,  7.59s/it]
 61%|██████    | 23201/37963 [55:41:12<30:40:55,  7.48s/it]
 61%|██████    | 23202/37963 [55:41:19<30:46:53,  7.51s/it]
 61%|██████    | 23203/37963 [55:41:27<30:47:08,  7.51s/it]
 61%|██████    | 23204/37963 [55:41:34<30:49:39,  7.52s/it]
 61%|██████    | 23205/37963 [55:41:42<30:52:34,  7.53s/it]
 61%|██████    | 23206/37963 [55:41:49<30:50:56,  7.53s/it]
 61%|██████    | 23207/37963 [55:42:03<38:41:34,  9.44s/it]
 61%|██████    | 23208/37963 [55:42:10<35:52:30,  8.75s/it]
 61%|██████    | 23209/37963 [55:42:18<34:19:01,  8.37s/it]
 61%|██████    | 23210/37963 [55:42:25<33:14:33,  8.11s/it]
                                                           
{'loss': '0.1342', 'grad_norm': '2.869', 'learning_rate': '6.93e-06', 'epoch': '0.6114'}

 61%|██████    | 23210/37963 [55:42:25<33:14:33,  8.11s/it]
 61%|██████    | 23211/37963 [55:42:39<40:30:38,  9.89s/it]
 61%|██████    | 23212/37963 [55:43:00<53:50:39, 13.14s/it]
 61%|██████    | 23213/37963 [55:43:14<55:06:20, 13.45s/it]
 61%|██████    | 23214/37963 [55:43:22<47:48:42, 11.67s/it]
 61%|██████    | 23215/37963 [55:43:29<42:47:08, 10.44s/it]
 61%|██████    | 23216/37963 [55:43:37<38:51:47,  9.49s/it]
 61%|██████    | 23217/37963 [55:43:44<36:24:47,  8.89s/it]
 61%|██████    | 23218/37963 [55:43:52<34:44:25,  8.48s/it]
 61%|██████    | 23219/37963 [55:43:59<33:35:35,  8.20s/it]
 61%|██████    | 23220/37963 [55:44:07<32:41:46,  7.98s/it]
                                                           
{'loss': '0.1482', 'grad_norm': '2.485', 'learning_rate': '6.922e-06', 'epoch': '0.6117'}

 61%|██████    | 23220/37963 [55:44:07<32:41:46,  7.98s/it]
 61%|██████    | 23221/37963 [55:44:14<32:09:58,  7.85s/it]
 61%|██████    | 23222/37963 [55:44:22<31:44:41,  7.75s/it]
 61%|██████    | 23223/37963 [55:44:29<31:27:45,  7.68s/it]
 61%|██████    | 23224/37963 [55:44:37<31:20:14,  7.65s/it]
 61%|██████    | 23225/37963 [55:44:44<31:15:36,  7.64s/it]
 61%|██████    | 23226/37963 [55:44:52<31:08:26,  7.61s/it]
 61%|██████    | 23227/37963 [55:44:59<30:49:46,  7.53s/it]
 61%|██████    | 23228/37963 [55:45:07<30:55:14,  7.55s/it]
 61%|██████    | 23229/37963 [55:45:14<30:55:27,  7.56s/it]
 61%|██████    | 23230/37963 [55:45:22<30:59:40,  7.57s/it]
                                                           
{'loss': '0.1457', 'grad_norm': '2.39', 'learning_rate': '6.913e-06', 'epoch': '0.6119'}

 61%|██████    | 23230/37963 [55:45:22<30:59:40,  7.57s/it]
 61%|██████    | 23231/37963 [55:45:36<38:49:13,  9.49s/it]
 61%|██████    | 23232/37963 [55:45:44<36:29:50,  8.92s/it]
 61%|██████    | 23233/37963 [55:45:51<34:45:08,  8.49s/it]
 61%|██████    | 23234/37963 [55:45:59<33:33:37,  8.20s/it]
 61%|██████    | 23235/37963 [55:46:06<32:12:52,  7.87s/it]
 61%|██████    | 23236/37963 [55:46:13<31:49:48,  7.78s/it]
 61%|██████    | 23237/37963 [55:46:21<31:32:25,  7.71s/it]
 61%|██████    | 23238/37963 [55:46:35<39:23:38,  9.63s/it]
 61%|██████    | 23239/37963 [55:46:43<37:01:16,  9.05s/it]
 61%|██████    | 23240/37963 [55:46:50<35:10:09,  8.60s/it]
                                                           
{'loss': '0.1434', 'grad_norm': '1.575', 'learning_rate': '6.905e-06', 'epoch': '0.6122'}

 61%|██████    | 23240/37963 [55:46:50<35:10:09,  8.60s/it]
 61%|██████    | 23241/37963 [55:47:04<41:15:34, 10.09s/it]
 61%|██████    | 23242/37963 [55:47:11<38:08:26,  9.33s/it]
 61%|██████    | 23243/37963 [55:47:19<35:51:40,  8.77s/it]
 61%|██████    | 23244/37963 [55:47:26<34:29:08,  8.43s/it]
 61%|██████    | 23245/37963 [55:47:34<33:21:13,  8.16s/it]
 61%|██████    | 23246/37963 [55:47:41<32:30:53,  7.95s/it]
 61%|██████    | 23247/37963 [55:47:49<31:58:32,  7.82s/it]
 61%|██████    | 23248/37963 [55:47:56<31:37:21,  7.74s/it]
 61%|██████    | 23249/37963 [55:48:04<31:23:26,  7.68s/it]
 61%|██████    | 23250/37963 [55:48:11<30:53:32,  7.56s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '2.83', 'learning_rate': '6.897e-06', 'epoch': '0.6124'}

 61%|██████    | 23250/37963 [55:48:11<30:53:32,  7.56s/it]
 61%|██████    | 23251/37963 [55:48:19<30:58:29,  7.58s/it]
 61%|██████    | 23252/37963 [55:48:26<30:55:37,  7.57s/it]
 61%|██████▏   | 23253/37963 [55:48:34<30:28:03,  7.46s/it]
 61%|██████▏   | 23254/37963 [55:48:41<30:44:18,  7.52s/it]
 61%|██████▏   | 23255/37963 [55:48:49<30:32:43,  7.48s/it]
 61%|██████▏   | 23256/37963 [55:49:02<38:00:28,  9.30s/it]
 61%|██████▏   | 23257/37963 [55:49:10<35:48:32,  8.77s/it]
 61%|██████▏   | 23258/37963 [55:49:24<41:56:44, 10.27s/it]
 61%|██████▏   | 23259/37963 [55:49:31<38:35:39,  9.45s/it]
 61%|██████▏   | 23260/37963 [55:49:39<36:13:50,  8.87s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.055', 'learning_rate': '6.889e-06', 'epoch': '0.6127'}

 61%|██████▏   | 23260/37963 [55:49:39<36:13:50,  8.87s/it]
 61%|██████▏   | 23261/37963 [55:49:53<42:28:08, 10.40s/it]
 61%|██████▏   | 23262/37963 [55:50:00<39:12:41,  9.60s/it]
 61%|██████▏   | 23263/37963 [55:50:08<36:41:05,  8.98s/it]
 61%|██████▏   | 23264/37963 [55:50:22<42:43:40, 10.46s/it]
 61%|██████▏   | 23265/37963 [55:50:29<39:16:15,  9.62s/it]
 61%|██████▏   | 23266/37963 [55:50:43<44:20:50, 10.86s/it]
 61%|██████▏   | 23267/37963 [55:50:51<40:04:12,  9.82s/it]
 61%|██████▏   | 23268/37963 [55:50:58<37:14:26,  9.12s/it]
 61%|██████▏   | 23269/37963 [55:51:05<35:05:45,  8.60s/it]
 61%|██████▏   | 23270/37963 [55:51:13<33:44:22,  8.27s/it]
                                                           
{'loss': '0.1403', 'grad_norm': '1.291', 'learning_rate': '6.881e-06', 'epoch': '0.613'}

 61%|██████▏   | 23270/37963 [55:51:13<33:44:22,  8.27s/it]
 61%|██████▏   | 23271/37963 [55:51:20<32:45:50,  8.03s/it]
 61%|██████▏   | 23272/37963 [55:51:28<31:43:24,  7.77s/it]
 61%|██████▏   | 23273/37963 [55:51:35<31:24:21,  7.70s/it]
 61%|██████▏   | 23274/37963 [55:51:42<30:58:27,  7.59s/it]
 61%|██████▏   | 23275/37963 [55:51:50<30:53:47,  7.57s/it]
 61%|██████▏   | 23276/37963 [55:51:58<30:55:02,  7.58s/it]
 61%|██████▏   | 23277/37963 [55:52:11<38:35:31,  9.46s/it]
 61%|██████▏   | 23278/37963 [55:52:19<36:13:09,  8.88s/it]
 61%|██████▏   | 23279/37963 [55:52:26<34:30:58,  8.46s/it]
 61%|██████▏   | 23280/37963 [55:52:34<33:14:44,  8.15s/it]
                                                           
{'loss': '0.1351', 'grad_norm': '2.514', 'learning_rate': '6.873e-06', 'epoch': '0.6132'}

 61%|██████▏   | 23280/37963 [55:52:34<33:14:44,  8.15s/it]
 61%|██████▏   | 23281/37963 [55:52:41<32:27:14,  7.96s/it]
 61%|██████▏   | 23282/37963 [55:52:49<31:51:45,  7.81s/it]
 61%|██████▏   | 23283/37963 [55:52:56<31:27:32,  7.71s/it]
 61%|██████▏   | 23284/37963 [55:53:04<31:11:39,  7.65s/it]
 61%|██████▏   | 23285/37963 [55:53:11<30:59:44,  7.60s/it]
 61%|██████▏   | 23286/37963 [55:53:19<30:52:12,  7.57s/it]
 61%|██████▏   | 23287/37963 [55:53:39<46:30:45, 11.41s/it]
 61%|██████▏   | 23288/37963 [55:53:47<41:48:58, 10.26s/it]
 61%|██████▏   | 23289/37963 [55:53:54<38:08:36,  9.36s/it]
 61%|██████▏   | 23290/37963 [55:54:01<35:30:46,  8.71s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '2.076', 'learning_rate': '6.865e-06', 'epoch': '0.6135'}

 61%|██████▏   | 23290/37963 [55:54:01<35:30:46,  8.71s/it]
 61%|██████▏   | 23291/37963 [55:54:09<33:57:54,  8.33s/it]
 61%|██████▏   | 23292/37963 [55:54:16<32:54:15,  8.07s/it]
 61%|██████▏   | 23293/37963 [55:54:24<32:16:21,  7.92s/it]
 61%|██████▏   | 23294/37963 [55:54:31<31:47:04,  7.80s/it]
 61%|██████▏   | 23295/37963 [55:54:39<31:19:07,  7.69s/it]
 61%|██████▏   | 23296/37963 [55:54:46<31:11:58,  7.66s/it]
 61%|██████▏   | 23297/37963 [55:54:54<31:03:48,  7.63s/it]
 61%|██████▏   | 23298/37963 [55:55:01<31:02:42,  7.62s/it]
 61%|██████▏   | 23299/37963 [55:55:09<30:57:26,  7.60s/it]
 61%|██████▏   | 23300/37963 [55:55:16<30:50:53,  7.57s/it]
                                                           
{'loss': '0.1382', 'grad_norm': '1.885', 'learning_rate': '6.857e-06', 'epoch': '0.6138'}

 61%|██████▏   | 23300/37963 [55:55:16<30:50:53,  7.57s/it]
 61%|██████▏   | 23301/37963 [55:55:24<30:53:52,  7.59s/it]
 61%|██████▏   | 23302/37963 [55:55:38<38:48:53,  9.53s/it]
 61%|██████▏   | 23303/37963 [55:55:46<36:24:30,  8.94s/it]
 61%|██████▏   | 23304/37963 [55:55:53<34:42:20,  8.52s/it]
 61%|██████▏   | 23305/37963 [55:56:01<33:18:06,  8.18s/it]
 61%|██████▏   | 23306/37963 [55:56:08<32:06:20,  7.89s/it]
 61%|██████▏   | 23307/37963 [55:56:22<39:51:42,  9.79s/it]
 61%|██████▏   | 23308/37963 [55:56:30<37:19:51,  9.17s/it]
 61%|██████▏   | 23309/37963 [55:56:37<35:12:38,  8.65s/it]
 61%|██████▏   | 23310/37963 [55:56:45<33:57:04,  8.34s/it]
                                                           
{'loss': '0.1245', 'grad_norm': '1.886', 'learning_rate': '6.849e-06', 'epoch': '0.614'}

 61%|██████▏   | 23310/37963 [55:56:45<33:57:04,  8.34s/it]
 61%|██████▏   | 23311/37963 [55:56:59<40:42:03, 10.00s/it]
 61%|██████▏   | 23312/37963 [55:57:06<37:41:55,  9.26s/it]
 61%|██████▏   | 23313/37963 [55:57:20<43:22:33, 10.66s/it]
 61%|██████▏   | 23314/37963 [55:57:28<39:29:16,  9.70s/it]
 61%|██████▏   | 23315/37963 [55:57:35<36:47:47,  9.04s/it]
 61%|██████▏   | 23316/37963 [55:57:49<42:37:33, 10.48s/it]
 61%|██████▏   | 23317/37963 [55:57:56<38:52:16,  9.55s/it]
 61%|██████▏   | 23318/37963 [55:58:04<36:31:43,  8.98s/it]
 61%|██████▏   | 23319/37963 [55:58:12<34:50:02,  8.56s/it]
 61%|██████▏   | 23320/37963 [55:58:19<33:37:23,  8.27s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '1.161', 'learning_rate': '6.84e-06', 'epoch': '0.6143'}

 61%|██████▏   | 23320/37963 [55:58:19<33:37:23,  8.27s/it]
 61%|██████▏   | 23321/37963 [55:58:33<40:54:26, 10.06s/it]
 61%|██████▏   | 23322/37963 [55:58:41<37:51:53,  9.31s/it]
 61%|██████▏   | 23323/37963 [55:58:49<35:44:07,  8.79s/it]
 61%|██████▏   | 23324/37963 [55:58:56<34:10:49,  8.41s/it]
 61%|██████▏   | 23325/37963 [55:59:04<33:12:37,  8.17s/it]
 61%|██████▏   | 23326/37963 [55:59:11<32:31:36,  8.00s/it]
 61%|██████▏   | 23327/37963 [55:59:19<31:47:22,  7.82s/it]
 61%|██████▏   | 23328/37963 [55:59:26<31:36:24,  7.77s/it]
 61%|██████▏   | 23329/37963 [55:59:34<31:19:57,  7.71s/it]
 61%|██████▏   | 23330/37963 [55:59:42<31:16:44,  7.70s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '1.564', 'learning_rate': '6.832e-06', 'epoch': '0.6145'}

 61%|██████▏   | 23330/37963 [55:59:42<31:16:44,  7.70s/it]
 61%|██████▏   | 23331/37963 [55:59:49<31:03:08,  7.64s/it]
 61%|██████▏   | 23332/37963 [55:59:57<30:58:04,  7.62s/it]
 61%|██████▏   | 23333/37963 [56:00:04<30:53:57,  7.60s/it]
 61%|██████▏   | 23334/37963 [56:00:12<30:51:03,  7.59s/it]
 61%|██████▏   | 23335/37963 [56:00:19<30:46:06,  7.57s/it]
 61%|██████▏   | 23336/37963 [56:00:27<30:25:21,  7.49s/it]
 61%|██████▏   | 23337/37963 [56:00:41<38:17:30,  9.43s/it]
 61%|██████▏   | 23338/37963 [56:00:48<35:59:45,  8.86s/it]
 61%|██████▏   | 23339/37963 [56:00:56<34:18:54,  8.45s/it]
 61%|██████▏   | 23340/37963 [56:01:03<33:13:17,  8.18s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.194', 'learning_rate': '6.824e-06', 'epoch': '0.6148'}

 61%|██████▏   | 23340/37963 [56:01:03<33:13:17,  8.18s/it]
 61%|██████▏   | 23341/37963 [56:01:17<40:23:57,  9.95s/it]
 61%|██████▏   | 23342/37963 [56:01:25<37:25:13,  9.21s/it]
 61%|██████▏   | 23343/37963 [56:01:32<35:24:42,  8.72s/it]
 61%|██████▏   | 23344/37963 [56:01:40<34:01:03,  8.38s/it]
 61%|██████▏   | 23345/37963 [56:01:47<32:55:00,  8.11s/it]
 61%|██████▏   | 23346/37963 [56:01:55<32:14:30,  7.94s/it]
 61%|██████▏   | 23347/37963 [56:02:02<31:45:28,  7.82s/it]
 62%|██████▏   | 23348/37963 [56:02:10<31:27:45,  7.75s/it]
 62%|██████▏   | 23349/37963 [56:02:18<31:09:28,  7.68s/it]
 62%|██████▏   | 23350/37963 [56:02:32<38:51:56,  9.57s/it]
                                                           
{'loss': '0.143', 'grad_norm': '3.151', 'learning_rate': '6.816e-06', 'epoch': '0.6151'}

 62%|██████▏   | 23350/37963 [56:02:32<38:51:56,  9.57s/it]
 62%|██████▏   | 23351/37963 [56:02:46<44:28:59, 10.96s/it]
 62%|██████▏   | 23352/37963 [56:02:53<40:22:53,  9.95s/it]
 62%|██████▏   | 23353/37963 [56:03:01<37:16:13,  9.18s/it]
 62%|██████▏   | 23354/37963 [56:03:08<35:31:03,  8.75s/it]
 62%|██████▏   | 23355/37963 [56:03:16<33:59:58,  8.38s/it]
 62%|██████▏   | 23356/37963 [56:03:23<32:55:51,  8.12s/it]
 62%|██████▏   | 23357/37963 [56:03:31<32:11:21,  7.93s/it]
 62%|██████▏   | 23358/37963 [56:03:39<31:53:31,  7.86s/it]
 62%|██████▏   | 23359/37963 [56:03:46<31:37:49,  7.80s/it]
 62%|██████▏   | 23360/37963 [56:04:01<39:37:41,  9.77s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '4.019', 'learning_rate': '6.808e-06', 'epoch': '0.6153'}

 62%|██████▏   | 23360/37963 [56:04:01<39:37:41,  9.77s/it]
 62%|██████▏   | 23361/37963 [56:04:15<44:34:56, 10.99s/it]
 62%|██████▏   | 23362/37963 [56:04:22<40:35:53, 10.01s/it]
 62%|██████▏   | 23363/37963 [56:04:36<45:29:10, 11.22s/it]
 62%|██████▏   | 23364/37963 [56:04:44<40:50:21, 10.07s/it]
 62%|██████▏   | 23365/37963 [56:04:51<37:30:56,  9.25s/it]
 62%|██████▏   | 23366/37963 [56:04:59<35:22:10,  8.72s/it]
 62%|██████▏   | 23367/37963 [56:05:06<33:54:17,  8.36s/it]
 62%|██████▏   | 23368/37963 [56:05:13<32:49:13,  8.10s/it]
 62%|██████▏   | 23369/37963 [56:05:28<40:01:31,  9.87s/it]
 62%|██████▏   | 23370/37963 [56:05:35<37:06:55,  9.16s/it]
                                                           
{'loss': '0.1379', 'grad_norm': '1.03', 'learning_rate': '6.8e-06', 'epoch': '0.6156'}

 62%|██████▏   | 23370/37963 [56:05:35<37:06:55,  9.16s/it]
 62%|██████▏   | 23371/37963 [56:05:42<34:59:13,  8.63s/it]
 62%|██████▏   | 23372/37963 [56:05:50<33:39:01,  8.30s/it]
 62%|██████▏   | 23373/37963 [56:05:58<32:53:15,  8.11s/it]
 62%|██████▏   | 23374/37963 [56:06:05<32:22:46,  7.99s/it]
 62%|██████▏   | 23375/37963 [56:06:13<31:27:53,  7.76s/it]
 62%|██████▏   | 23376/37963 [56:06:20<31:12:23,  7.70s/it]
 62%|██████▏   | 23377/37963 [56:06:27<30:46:35,  7.60s/it]
 62%|██████▏   | 23378/37963 [56:06:35<30:35:06,  7.55s/it]
 62%|██████▏   | 23379/37963 [56:06:42<30:27:44,  7.52s/it]
 62%|██████▏   | 23380/37963 [56:06:50<30:24:28,  7.51s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '1.589', 'learning_rate': '6.792e-06', 'epoch': '0.6159'}

 62%|██████▏   | 23380/37963 [56:06:50<30:24:28,  7.51s/it]
 62%|██████▏   | 23381/37963 [56:06:57<30:15:55,  7.47s/it]
 62%|██████▏   | 23382/37963 [56:07:05<30:30:07,  7.53s/it]
 62%|██████▏   | 23383/37963 [56:07:19<38:21:40,  9.47s/it]
 62%|██████▏   | 23384/37963 [56:07:26<35:55:46,  8.87s/it]
 62%|██████▏   | 23385/37963 [56:07:34<34:15:08,  8.46s/it]
 62%|██████▏   | 23386/37963 [56:07:41<33:07:41,  8.18s/it]
 62%|██████▏   | 23387/37963 [56:07:56<40:21:56,  9.97s/it]
 62%|██████▏   | 23388/37963 [56:08:03<37:15:20,  9.20s/it]
 62%|██████▏   | 23389/37963 [56:08:10<35:12:37,  8.70s/it]
 62%|██████▏   | 23390/37963 [56:08:18<33:49:00,  8.35s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '3.169', 'learning_rate': '6.784e-06', 'epoch': '0.6161'}

 62%|██████▏   | 23390/37963 [56:08:18<33:49:00,  8.35s/it]
 62%|██████▏   | 23391/37963 [56:08:26<32:50:34,  8.11s/it]
 62%|██████▏   | 23392/37963 [56:08:33<32:10:56,  7.95s/it]
 62%|██████▏   | 23393/37963 [56:08:41<31:38:21,  7.82s/it]
 62%|██████▏   | 23394/37963 [56:08:48<31:19:22,  7.74s/it]
 62%|██████▏   | 23395/37963 [56:09:02<38:54:10,  9.61s/it]
 62%|██████▏   | 23396/37963 [56:09:09<36:05:41,  8.92s/it]
 62%|██████▏   | 23397/37963 [56:09:17<34:13:06,  8.46s/it]
 62%|██████▏   | 23398/37963 [56:09:31<40:48:45, 10.09s/it]
 62%|██████▏   | 23399/37963 [56:09:38<37:46:17,  9.34s/it]
 62%|██████▏   | 23400/37963 [56:09:46<35:33:36,  8.79s/it]
                                                           
{'loss': '0.1399', 'grad_norm': '1.844', 'learning_rate': '6.776e-06', 'epoch': '0.6164'}

 62%|██████▏   | 23400/37963 [56:09:46<35:33:36,  8.79s/it]
 62%|██████▏   | 23401/37963 [56:09:53<33:57:56,  8.40s/it]
 62%|██████▏   | 23402/37963 [56:10:01<33:00:53,  8.16s/it]
 62%|██████▏   | 23403/37963 [56:10:09<32:18:37,  7.99s/it]
 62%|██████▏   | 23404/37963 [56:10:22<39:18:00,  9.72s/it]
 62%|██████▏   | 23405/37963 [56:10:30<36:45:00,  9.09s/it]
 62%|██████▏   | 23406/37963 [56:10:37<34:54:36,  8.63s/it]
 62%|██████▏   | 23407/37963 [56:10:45<33:46:16,  8.35s/it]
 62%|██████▏   | 23408/37963 [56:10:53<32:46:00,  8.10s/it]
 62%|██████▏   | 23409/37963 [56:11:06<39:39:50,  9.81s/it]
 62%|██████▏   | 23410/37963 [56:11:14<36:44:40,  9.09s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.827', 'learning_rate': '6.768e-06', 'epoch': '0.6167'}

 62%|██████▏   | 23410/37963 [56:11:14<36:44:40,  9.09s/it]
 62%|██████▏   | 23411/37963 [56:11:21<34:48:41,  8.61s/it]
 62%|██████▏   | 23412/37963 [56:11:29<33:31:00,  8.29s/it]
 62%|██████▏   | 23413/37963 [56:11:37<32:38:48,  8.08s/it]
 62%|██████▏   | 23414/37963 [56:11:44<31:54:30,  7.90s/it]
 62%|██████▏   | 23415/37963 [56:11:52<31:36:56,  7.82s/it]
 62%|██████▏   | 23416/37963 [56:12:06<39:06:56,  9.68s/it]
 62%|██████▏   | 23417/37963 [56:12:20<44:18:28, 10.97s/it]
 62%|██████▏   | 23418/37963 [56:12:27<40:08:12,  9.93s/it]
 62%|██████▏   | 23419/37963 [56:12:35<37:24:53,  9.26s/it]
 62%|██████▏   | 23420/37963 [56:12:42<35:15:57,  8.73s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '3.431', 'learning_rate': '6.76e-06', 'epoch': '0.6169'}

 62%|██████▏   | 23420/37963 [56:12:42<35:15:57,  8.73s/it]
 62%|██████▏   | 23421/37963 [56:12:50<33:46:19,  8.36s/it]
 62%|██████▏   | 23422/37963 [56:12:57<32:47:19,  8.12s/it]
 62%|██████▏   | 23423/37963 [56:13:05<32:07:17,  7.95s/it]
 62%|██████▏   | 23424/37963 [56:13:13<31:47:55,  7.87s/it]
 62%|██████▏   | 23425/37963 [56:13:20<31:19:42,  7.76s/it]
 62%|██████▏   | 23426/37963 [56:13:27<30:46:23,  7.62s/it]
 62%|██████▏   | 23427/37963 [56:13:35<30:39:03,  7.59s/it]
 62%|██████▏   | 23428/37963 [56:13:42<30:31:28,  7.56s/it]
 62%|██████▏   | 23429/37963 [56:13:50<30:06:26,  7.46s/it]
 62%|██████▏   | 23430/37963 [56:13:57<30:21:29,  7.52s/it]
                                                           
{'loss': '0.1386', 'grad_norm': '3.09', 'learning_rate': '6.752e-06', 'epoch': '0.6172'}

 62%|██████▏   | 23430/37963 [56:13:57<30:21:29,  7.52s/it]
 62%|██████▏   | 23431/37963 [56:14:05<30:25:07,  7.54s/it]
 62%|██████▏   | 23432/37963 [56:14:19<37:52:29,  9.38s/it]
 62%|██████▏   | 23433/37963 [56:14:26<35:39:51,  8.84s/it]
 62%|██████▏   | 23434/37963 [56:14:40<42:00:32, 10.41s/it]
 62%|██████▏   | 23435/37963 [56:14:48<38:36:14,  9.57s/it]
 62%|██████▏   | 23436/37963 [56:14:55<35:55:52,  8.90s/it]
 62%|██████▏   | 23437/37963 [56:15:03<34:13:32,  8.48s/it]
 62%|██████▏   | 23438/37963 [56:15:10<32:56:49,  8.17s/it]
 62%|██████▏   | 23439/37963 [56:15:18<32:15:06,  7.99s/it]
 62%|██████▏   | 23440/37963 [56:15:26<32:06:43,  7.96s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '1.914', 'learning_rate': '6.743e-06', 'epoch': '0.6174'}

 62%|██████▏   | 23440/37963 [56:15:26<32:06:43,  7.96s/it]
 62%|██████▏   | 23441/37963 [56:15:33<31:32:18,  7.82s/it]
 62%|██████▏   | 23442/37963 [56:15:47<39:28:13,  9.79s/it]
 62%|██████▏   | 23443/37963 [56:15:55<36:46:07,  9.12s/it]
 62%|██████▏   | 23444/37963 [56:16:03<34:52:22,  8.65s/it]
 62%|██████▏   | 23445/37963 [56:16:10<33:42:04,  8.36s/it]
 62%|██████▏   | 23446/37963 [56:16:18<32:36:06,  8.08s/it]
 62%|██████▏   | 23447/37963 [56:16:25<32:01:34,  7.94s/it]
 62%|██████▏   | 23448/37963 [56:16:33<31:33:23,  7.83s/it]
 62%|██████▏   | 23449/37963 [56:16:47<38:48:38,  9.63s/it]
 62%|██████▏   | 23450/37963 [56:16:54<36:19:04,  9.01s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.567', 'learning_rate': '6.735e-06', 'epoch': '0.6177'}

 62%|██████▏   | 23450/37963 [56:16:54<36:19:04,  9.01s/it]
 62%|██████▏   | 23451/37963 [56:17:02<34:36:55,  8.59s/it]
 62%|██████▏   | 23452/37963 [56:17:09<33:22:55,  8.28s/it]
 62%|██████▏   | 23453/37963 [56:17:17<32:15:22,  8.00s/it]
 62%|██████▏   | 23454/37963 [56:17:24<31:26:36,  7.80s/it]
 62%|██████▏   | 23455/37963 [56:17:32<31:09:30,  7.73s/it]
 62%|██████▏   | 23456/37963 [56:17:39<30:54:47,  7.67s/it]
 62%|██████▏   | 23457/37963 [56:17:53<38:51:47,  9.64s/it]
 62%|██████▏   | 23458/37963 [56:18:01<36:28:41,  9.05s/it]
 62%|██████▏   | 23459/37963 [56:18:15<42:37:42, 10.58s/it]
 62%|██████▏   | 23460/37963 [56:18:23<39:00:58,  9.68s/it]
                                                           
{'loss': '0.1378', 'grad_norm': '1.721', 'learning_rate': '6.727e-06', 'epoch': '0.618'}

 62%|██████▏   | 23460/37963 [56:18:23<39:00:58,  9.68s/it]
 62%|██████▏   | 23461/37963 [56:18:30<36:26:27,  9.05s/it]
 62%|██████▏   | 23462/37963 [56:18:38<34:27:47,  8.56s/it]
 62%|██████▏   | 23463/37963 [56:18:45<33:16:51,  8.26s/it]
 62%|██████▏   | 23464/37963 [56:19:00<40:56:01, 10.16s/it]
 62%|██████▏   | 23465/37963 [56:19:08<37:47:44,  9.39s/it]
 62%|██████▏   | 23466/37963 [56:19:15<35:35:20,  8.84s/it]
 62%|██████▏   | 23467/37963 [56:19:23<33:57:04,  8.43s/it]
 62%|██████▏   | 23468/37963 [56:19:30<32:52:42,  8.17s/it]
 62%|██████▏   | 23469/37963 [56:19:38<32:06:11,  7.97s/it]
 62%|██████▏   | 23470/37963 [56:19:52<39:19:23,  9.77s/it]
                                                           
{'loss': '0.1321', 'grad_norm': '1.876', 'learning_rate': '6.719e-06', 'epoch': '0.6182'}

 62%|██████▏   | 23470/37963 [56:19:52<39:19:23,  9.77s/it]
 62%|██████▏   | 23471/37963 [56:19:59<36:31:20,  9.07s/it]
 62%|██████▏   | 23472/37963 [56:20:07<34:40:26,  8.61s/it]
 62%|██████▏   | 23473/37963 [56:20:14<33:28:42,  8.32s/it]
 62%|██████▏   | 23474/37963 [56:20:22<32:35:25,  8.10s/it]
 62%|██████▏   | 23475/37963 [56:20:29<31:55:49,  7.93s/it]
 62%|██████▏   | 23476/37963 [56:20:37<31:28:31,  7.82s/it]
 62%|██████▏   | 23477/37963 [56:20:44<30:59:19,  7.70s/it]
 62%|██████▏   | 23478/37963 [56:20:58<38:33:52,  9.58s/it]
 62%|██████▏   | 23479/37963 [56:21:06<35:54:10,  8.92s/it]
 62%|██████▏   | 23480/37963 [56:21:13<34:12:30,  8.50s/it]
                                                           
{'loss': '0.136', 'grad_norm': '1.773', 'learning_rate': '6.711e-06', 'epoch': '0.6185'}

 62%|██████▏   | 23480/37963 [56:21:13<34:12:30,  8.50s/it]
 62%|██████▏   | 23481/37963 [56:21:21<33:06:35,  8.23s/it]
 62%|██████▏   | 23482/37963 [56:21:35<40:00:19,  9.95s/it]
 62%|██████▏   | 23483/37963 [56:21:42<37:12:56,  9.25s/it]
 62%|██████▏   | 23484/37963 [56:21:50<35:08:13,  8.74s/it]
 62%|██████▏   | 23485/37963 [56:21:57<33:29:55,  8.33s/it]
 62%|██████▏   | 23486/37963 [56:22:05<32:32:31,  8.09s/it]
 62%|██████▏   | 23487/37963 [56:22:12<31:24:03,  7.81s/it]
 62%|██████▏   | 23488/37963 [56:22:20<31:07:21,  7.74s/it]
 62%|██████▏   | 23489/37963 [56:22:27<30:41:41,  7.63s/it]
 62%|██████▏   | 23490/37963 [56:22:35<30:34:42,  7.61s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '2.406', 'learning_rate': '6.703e-06', 'epoch': '0.6188'}

 62%|██████▏   | 23490/37963 [56:22:35<30:34:42,  7.61s/it]
 62%|██████▏   | 23491/37963 [56:22:42<30:30:30,  7.59s/it]
 62%|██████▏   | 23492/37963 [56:22:50<30:24:47,  7.57s/it]
 62%|██████▏   | 23493/37963 [56:22:57<30:13:27,  7.52s/it]
 62%|██████▏   | 23494/37963 [56:23:05<30:20:15,  7.55s/it]
 62%|██████▏   | 23495/37963 [56:23:12<30:21:50,  7.56s/it]
 62%|██████▏   | 23496/37963 [56:23:26<38:16:00,  9.52s/it]
 62%|██████▏   | 23497/37963 [56:23:34<35:50:25,  8.92s/it]
 62%|██████▏   | 23498/37963 [56:23:41<34:11:49,  8.51s/it]
 62%|██████▏   | 23499/37963 [56:23:49<33:06:34,  8.24s/it]
 62%|██████▏   | 23500/37963 [56:23:57<32:18:08,  8.04s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '2.759', 'learning_rate': '6.695e-06', 'epoch': '0.619'}

 62%|██████▏   | 23500/37963 [56:23:57<32:18:08,  8.04s/it]
 62%|██████▏   | 23501/37963 [56:24:04<31:43:31,  7.90s/it]
 62%|██████▏   | 23502/37963 [56:24:12<31:23:38,  7.82s/it]
 62%|██████▏   | 23503/37963 [56:24:26<38:50:31,  9.67s/it]
 62%|██████▏   | 23504/37963 [56:24:33<36:23:39,  9.06s/it]
 62%|██████▏   | 23505/37963 [56:24:54<50:25:25, 12.56s/it]
 62%|██████▏   | 23506/37963 [56:25:02<44:21:13, 11.04s/it]
 62%|██████▏   | 23507/37963 [56:25:09<40:07:04,  9.99s/it]
 62%|██████▏   | 23508/37963 [56:25:17<37:08:44,  9.25s/it]
 62%|██████▏   | 23509/37963 [56:25:24<35:11:12,  8.76s/it]
 62%|██████▏   | 23510/37963 [56:25:32<33:52:04,  8.44s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.69', 'learning_rate': '6.687e-06', 'epoch': '0.6193'}

 62%|██████▏   | 23510/37963 [56:25:32<33:52:04,  8.44s/it]
 62%|██████▏   | 23511/37963 [56:25:40<32:52:10,  8.19s/it]
 62%|██████▏   | 23512/37963 [56:25:47<32:10:23,  8.01s/it]
 62%|██████▏   | 23513/37963 [56:25:55<31:31:39,  7.85s/it]
 62%|██████▏   | 23514/37963 [56:26:02<31:02:48,  7.74s/it]
 62%|██████▏   | 23515/37963 [56:26:10<30:51:54,  7.69s/it]
 62%|██████▏   | 23516/37963 [56:26:23<37:59:43,  9.47s/it]
 62%|██████▏   | 23517/37963 [56:26:31<35:44:49,  8.91s/it]
 62%|██████▏   | 23518/37963 [56:26:45<41:47:00, 10.41s/it]
 62%|██████▏   | 23519/37963 [56:26:52<38:20:15,  9.56s/it]
 62%|██████▏   | 23520/37963 [56:27:00<35:50:37,  8.93s/it]
                                                           
{'loss': '0.1481', 'grad_norm': '2.663', 'learning_rate': '6.679e-06', 'epoch': '0.6196'}

 62%|██████▏   | 23520/37963 [56:27:00<35:50:37,  8.93s/it]
 62%|██████▏   | 23521/37963 [56:27:07<33:57:33,  8.47s/it]
 62%|██████▏   | 23522/37963 [56:27:15<33:03:50,  8.24s/it]
 62%|██████▏   | 23523/37963 [56:27:23<32:21:49,  8.07s/it]
 62%|██████▏   | 23524/37963 [56:27:30<31:33:02,  7.87s/it]
 62%|██████▏   | 23525/37963 [56:27:37<30:36:47,  7.63s/it]
 62%|██████▏   | 23526/37963 [56:27:45<30:28:32,  7.60s/it]
 62%|██████▏   | 23527/37963 [56:27:52<30:15:55,  7.55s/it]
 62%|██████▏   | 23528/37963 [56:28:00<30:21:49,  7.57s/it]
 62%|██████▏   | 23529/37963 [56:28:14<38:22:28,  9.57s/it]
 62%|██████▏   | 23530/37963 [56:28:22<36:01:36,  8.99s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '1.239', 'learning_rate': '6.671e-06', 'epoch': '0.6198'}

 62%|██████▏   | 23530/37963 [56:28:22<36:01:36,  8.99s/it]
 62%|██████▏   | 23531/37963 [56:28:36<42:09:09, 10.51s/it]
 62%|██████▏   | 23532/37963 [56:28:43<38:47:30,  9.68s/it]
 62%|██████▏   | 23533/37963 [56:28:51<36:18:52,  9.06s/it]
 62%|██████▏   | 23534/37963 [56:28:59<34:26:48,  8.59s/it]
 62%|██████▏   | 23535/37963 [56:29:06<33:07:17,  8.26s/it]
 62%|██████▏   | 23536/37963 [56:29:14<32:38:00,  8.14s/it]
 62%|██████▏   | 23537/37963 [56:29:21<31:55:15,  7.97s/it]
 62%|██████▏   | 23538/37963 [56:29:29<31:22:38,  7.83s/it]
 62%|██████▏   | 23539/37963 [56:29:36<30:46:34,  7.68s/it]
 62%|██████▏   | 23540/37963 [56:29:44<30:35:35,  7.64s/it]
                                                           
{'loss': '0.1209', 'grad_norm': '2.278', 'learning_rate': '6.663e-06', 'epoch': '0.6201'}

 62%|██████▏   | 23540/37963 [56:29:44<30:35:35,  7.64s/it]
 62%|██████▏   | 23541/37963 [56:29:51<30:31:51,  7.62s/it]
 62%|██████▏   | 23542/37963 [56:29:59<30:05:49,  7.51s/it]
 62%|██████▏   | 23543/37963 [56:30:06<30:14:34,  7.55s/it]
 62%|██████▏   | 23544/37963 [56:30:14<30:14:41,  7.55s/it]
 62%|██████▏   | 23545/37963 [56:30:21<30:11:35,  7.54s/it]
 62%|██████▏   | 23546/37963 [56:30:29<30:12:15,  7.54s/it]
 62%|██████▏   | 23547/37963 [56:30:36<30:14:04,  7.55s/it]
 62%|██████▏   | 23548/37963 [56:30:44<30:11:49,  7.54s/it]
 62%|██████▏   | 23549/37963 [56:30:58<37:53:54,  9.47s/it]
 62%|██████▏   | 23550/37963 [56:31:12<43:21:14, 10.83s/it]
                                                           
{'loss': '0.1435', 'grad_norm': '1.906', 'learning_rate': '6.655e-06', 'epoch': '0.6203'}

 62%|██████▏   | 23550/37963 [56:31:12<43:21:14, 10.83s/it]
 62%|██████▏   | 23551/37963 [56:31:19<39:03:13,  9.76s/it]
 62%|██████▏   | 23552/37963 [56:31:33<44:09:30, 11.03s/it]
 62%|██████▏   | 23553/37963 [56:31:41<39:57:59,  9.98s/it]
 62%|██████▏   | 23554/37963 [56:31:48<37:00:33,  9.25s/it]
 62%|██████▏   | 23555/37963 [56:31:56<34:38:29,  8.66s/it]
 62%|██████▏   | 23556/37963 [56:32:03<33:21:44,  8.34s/it]
 62%|██████▏   | 23557/37963 [56:32:17<40:08:29, 10.03s/it]
 62%|██████▏   | 23558/37963 [56:32:25<37:25:12,  9.35s/it]
 62%|██████▏   | 23559/37963 [56:32:32<35:12:36,  8.80s/it]
 62%|██████▏   | 23560/37963 [56:32:40<33:52:01,  8.46s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '3.002', 'learning_rate': '6.647e-06', 'epoch': '0.6206'}

 62%|██████▏   | 23560/37963 [56:32:40<33:52:01,  8.46s/it]
 62%|██████▏   | 23561/37963 [56:32:54<40:26:24, 10.11s/it]
 62%|██████▏   | 23562/37963 [56:33:02<37:32:02,  9.38s/it]
 62%|██████▏   | 23563/37963 [56:33:09<35:21:58,  8.84s/it]
 62%|██████▏   | 23564/37963 [56:33:17<33:48:11,  8.45s/it]
 62%|██████▏   | 23565/37963 [56:33:24<32:34:10,  8.14s/it]
 62%|██████▏   | 23566/37963 [56:33:32<31:52:03,  7.97s/it]
 62%|██████▏   | 23567/37963 [56:33:39<31:00:12,  7.75s/it]
 62%|██████▏   | 23568/37963 [56:33:53<37:51:31,  9.47s/it]
 62%|██████▏   | 23569/37963 [56:34:00<35:41:11,  8.93s/it]
 62%|██████▏   | 23570/37963 [56:34:08<33:57:23,  8.49s/it]
                                                           
{'loss': '0.1445', 'grad_norm': '1.394', 'learning_rate': '6.639e-06', 'epoch': '0.6209'}

 62%|██████▏   | 23570/37963 [56:34:08<33:57:23,  8.49s/it]
 62%|██████▏   | 23571/37963 [56:34:15<32:38:19,  8.16s/it]
 62%|██████▏   | 23572/37963 [56:34:23<31:51:17,  7.97s/it]
 62%|██████▏   | 23573/37963 [56:34:30<31:21:02,  7.84s/it]
 62%|██████▏   | 23574/37963 [56:34:38<30:51:33,  7.72s/it]
 62%|██████▏   | 23575/37963 [56:34:45<30:29:40,  7.63s/it]
 62%|██████▏   | 23576/37963 [56:34:53<30:20:40,  7.59s/it]
 62%|██████▏   | 23577/37963 [56:35:06<37:58:39,  9.50s/it]
 62%|██████▏   | 23578/37963 [56:35:14<35:21:53,  8.85s/it]
 62%|██████▏   | 23579/37963 [56:35:21<33:41:38,  8.43s/it]
 62%|██████▏   | 23580/37963 [56:35:29<32:31:41,  8.14s/it]
                                                           
{'loss': '0.129', 'grad_norm': '2.75', 'learning_rate': '6.631e-06', 'epoch': '0.6211'}

 62%|██████▏   | 23580/37963 [56:35:29<32:31:41,  8.14s/it]
 62%|██████▏   | 23581/37963 [56:35:36<31:58:02,  8.00s/it]
 62%|██████▏   | 23582/37963 [56:35:44<31:04:41,  7.78s/it]
 62%|██████▏   | 23583/37963 [56:35:58<38:29:39,  9.64s/it]
 62%|██████▏   | 23584/37963 [56:36:05<35:57:35,  9.00s/it]
 62%|██████▏   | 23585/37963 [56:36:13<34:16:44,  8.58s/it]
 62%|██████▏   | 23586/37963 [56:36:20<33:01:37,  8.27s/it]
 62%|██████▏   | 23587/37963 [56:36:28<32:10:44,  8.06s/it]
 62%|██████▏   | 23588/37963 [56:36:35<31:35:45,  7.91s/it]
 62%|██████▏   | 23589/37963 [56:36:43<31:08:31,  7.80s/it]
 62%|██████▏   | 23590/37963 [56:36:50<30:34:55,  7.66s/it]
                                                           
{'loss': '0.117', 'grad_norm': '1.243', 'learning_rate': '6.623e-06', 'epoch': '0.6214'}

 62%|██████▏   | 23590/37963 [56:36:50<30:34:55,  7.66s/it]
 62%|██████▏   | 23591/37963 [56:36:58<30:28:39,  7.63s/it]
 62%|██████▏   | 23592/37963 [56:37:05<30:23:56,  7.62s/it]
 62%|██████▏   | 23593/37963 [56:37:13<30:18:38,  7.59s/it]
 62%|██████▏   | 23594/37963 [56:37:21<30:21:08,  7.60s/it]
 62%|██████▏   | 23595/37963 [56:37:34<37:27:01,  9.38s/it]
 62%|██████▏   | 23596/37963 [56:37:42<35:23:26,  8.87s/it]
 62%|██████▏   | 23597/37963 [56:37:56<41:33:13, 10.41s/it]
 62%|██████▏   | 23598/37963 [56:38:03<38:12:57,  9.58s/it]
 62%|██████▏   | 23599/37963 [56:38:11<35:57:27,  9.01s/it]
 62%|██████▏   | 23600/37963 [56:38:25<41:53:09, 10.50s/it]
                                                           
{'loss': '0.1365', 'grad_norm': '1.939', 'learning_rate': '6.615e-06', 'epoch': '0.6217'}

 62%|██████▏   | 23600/37963 [56:38:25<41:53:09, 10.50s/it]
 62%|██████▏   | 23601/37963 [56:38:33<38:27:50,  9.64s/it]
 62%|██████▏   | 23602/37963 [56:38:40<36:00:52,  9.03s/it]
 62%|██████▏   | 23603/37963 [56:38:48<34:10:15,  8.57s/it]
 62%|██████▏   | 23604/37963 [56:38:55<32:38:25,  8.18s/it]
 62%|██████▏   | 23605/37963 [56:39:03<31:54:30,  8.00s/it]
 62%|██████▏   | 23606/37963 [56:39:10<31:07:25,  7.80s/it]
 62%|██████▏   | 23607/37963 [56:39:18<30:47:16,  7.72s/it]
 62%|██████▏   | 23608/37963 [56:39:25<30:38:42,  7.69s/it]
 62%|██████▏   | 23609/37963 [56:39:33<30:31:17,  7.65s/it]
 62%|██████▏   | 23610/37963 [56:39:47<38:25:30,  9.64s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '3.274', 'learning_rate': '6.607e-06', 'epoch': '0.6219'}

 62%|██████▏   | 23610/37963 [56:39:47<38:25:30,  9.64s/it]
 62%|██████▏   | 23611/37963 [56:40:01<43:58:20, 11.03s/it]
 62%|██████▏   | 23612/37963 [56:40:09<39:38:10,  9.94s/it]
 62%|██████▏   | 23613/37963 [56:40:16<36:26:17,  9.14s/it]
 62%|██████▏   | 23614/37963 [56:40:30<41:50:16, 10.50s/it]
 62%|██████▏   | 23615/37963 [56:40:37<38:37:16,  9.69s/it]
 62%|██████▏   | 23616/37963 [56:40:45<36:05:35,  9.06s/it]
 62%|██████▏   | 23617/37963 [56:40:53<34:14:02,  8.59s/it]
 62%|██████▏   | 23618/37963 [56:41:00<33:03:02,  8.29s/it]
 62%|██████▏   | 23619/37963 [56:41:08<32:11:18,  8.08s/it]
 62%|██████▏   | 23620/37963 [56:41:15<31:33:50,  7.92s/it]
                                                           
{'loss': '0.133', 'grad_norm': '2.118', 'learning_rate': '6.599e-06', 'epoch': '0.6222'}

 62%|██████▏   | 23620/37963 [56:41:15<31:33:50,  7.92s/it]
 62%|██████▏   | 23621/37963 [56:41:23<31:08:46,  7.82s/it]
 62%|██████▏   | 23622/37963 [56:41:30<30:41:37,  7.71s/it]
 62%|██████▏   | 23623/37963 [56:41:38<30:26:02,  7.64s/it]
 62%|██████▏   | 23624/37963 [56:41:45<30:04:30,  7.55s/it]
 62%|██████▏   | 23625/37963 [56:41:53<30:02:49,  7.54s/it]
 62%|██████▏   | 23626/37963 [56:42:00<30:08:37,  7.57s/it]
 62%|██████▏   | 23627/37963 [56:42:08<30:07:16,  7.56s/it]
 62%|██████▏   | 23628/37963 [56:42:22<37:42:29,  9.47s/it]
 62%|██████▏   | 23629/37963 [56:42:29<35:18:31,  8.87s/it]
 62%|██████▏   | 23630/37963 [56:42:43<41:33:48, 10.44s/it]
                                                           
{'loss': '0.1343', 'grad_norm': '1.832', 'learning_rate': '6.591e-06', 'epoch': '0.6225'}

 62%|██████▏   | 23630/37963 [56:42:43<41:33:48, 10.44s/it]
 62%|██████▏   | 23631/37963 [56:42:51<38:04:47,  9.57s/it]
 62%|██████▏   | 23632/37963 [56:42:58<35:40:06,  8.96s/it]
 62%|██████▏   | 23633/37963 [56:43:06<33:58:53,  8.54s/it]
 62%|██████▏   | 23634/37963 [56:43:14<32:49:32,  8.25s/it]
 62%|██████▏   | 23635/37963 [56:43:21<32:05:22,  8.06s/it]
 62%|██████▏   | 23636/37963 [56:43:29<31:21:50,  7.88s/it]
 62%|██████▏   | 23637/37963 [56:43:36<31:01:34,  7.80s/it]
 62%|██████▏   | 23638/37963 [56:43:44<30:56:15,  7.77s/it]
 62%|██████▏   | 23639/37963 [56:43:52<30:45:02,  7.73s/it]
 62%|██████▏   | 23640/37963 [56:43:59<30:24:51,  7.64s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '2.712', 'learning_rate': '6.583e-06', 'epoch': '0.6227'}

 62%|██████▏   | 23640/37963 [56:43:59<30:24:51,  7.64s/it]
 62%|██████▏   | 23641/37963 [56:44:06<29:51:31,  7.51s/it]
 62%|██████▏   | 23642/37963 [56:44:14<29:58:27,  7.53s/it]
 62%|██████▏   | 23643/37963 [56:44:21<29:51:47,  7.51s/it]
 62%|██████▏   | 23644/37963 [56:44:36<38:04:23,  9.57s/it]
 62%|██████▏   | 23645/37963 [56:44:50<43:22:16, 10.90s/it]
 62%|██████▏   | 23646/37963 [56:44:57<39:30:24,  9.93s/it]
 62%|██████▏   | 23647/37963 [56:45:05<36:44:38,  9.24s/it]
 62%|██████▏   | 23648/37963 [56:45:13<34:49:59,  8.76s/it]
 62%|██████▏   | 23649/37963 [56:45:27<41:03:21, 10.33s/it]
 62%|██████▏   | 23650/37963 [56:45:34<37:39:19,  9.47s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '1.577', 'learning_rate': '6.575e-06', 'epoch': '0.623'}

 62%|██████▏   | 23650/37963 [56:45:34<37:39:19,  9.47s/it]
 62%|██████▏   | 23651/37963 [56:45:42<35:28:52,  8.92s/it]
 62%|██████▏   | 23652/37963 [56:45:49<33:47:47,  8.50s/it]
 62%|██████▏   | 23653/37963 [56:46:03<40:22:41, 10.16s/it]
 62%|██████▏   | 23654/37963 [56:46:11<37:29:22,  9.43s/it]
 62%|██████▏   | 23655/37963 [56:46:19<35:15:30,  8.87s/it]
 62%|██████▏   | 23656/37963 [56:46:26<33:38:50,  8.47s/it]
 62%|██████▏   | 23657/37963 [56:46:34<32:33:57,  8.19s/it]
 62%|██████▏   | 23658/37963 [56:46:41<31:50:24,  8.01s/it]
 62%|██████▏   | 23659/37963 [56:46:49<31:11:58,  7.85s/it]
 62%|██████▏   | 23660/37963 [56:46:56<30:39:14,  7.72s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '1.852', 'learning_rate': '6.567e-06', 'epoch': '0.6232'}

 62%|██████▏   | 23660/37963 [56:46:56<30:39:14,  7.72s/it]
 62%|██████▏   | 23661/37963 [56:47:03<30:03:18,  7.57s/it]
 62%|██████▏   | 23662/37963 [56:47:11<29:43:07,  7.48s/it]
 62%|██████▏   | 23663/37963 [56:47:18<29:46:38,  7.50s/it]
 62%|██████▏   | 23664/37963 [56:47:26<29:52:06,  7.52s/it]
 62%|██████▏   | 23665/37963 [56:47:40<37:43:03,  9.50s/it]
 62%|██████▏   | 23666/37963 [56:47:54<43:21:28, 10.92s/it]
 62%|██████▏   | 23667/37963 [56:48:02<39:24:21,  9.92s/it]
 62%|██████▏   | 23668/37963 [56:48:09<36:29:07,  9.19s/it]
 62%|██████▏   | 23669/37963 [56:48:17<34:32:12,  8.70s/it]
 62%|██████▏   | 23670/37963 [56:48:24<33:07:27,  8.34s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '1.875', 'learning_rate': '6.559e-06', 'epoch': '0.6235'}

 62%|██████▏   | 23670/37963 [56:48:24<33:07:27,  8.34s/it]
 62%|██████▏   | 23671/37963 [56:48:32<32:06:50,  8.09s/it]
 62%|██████▏   | 23672/37963 [56:48:39<31:27:43,  7.93s/it]
 62%|██████▏   | 23673/37963 [56:48:47<31:04:02,  7.83s/it]
 62%|██████▏   | 23674/37963 [56:48:54<30:29:56,  7.68s/it]
 62%|██████▏   | 23675/37963 [56:49:08<37:45:39,  9.51s/it]
 62%|██████▏   | 23676/37963 [56:49:22<42:59:37, 10.83s/it]
 62%|██████▏   | 23677/37963 [56:49:30<39:14:55,  9.89s/it]
 62%|██████▏   | 23678/37963 [56:49:37<36:34:16,  9.22s/it]
 62%|██████▏   | 23679/37963 [56:49:45<34:44:12,  8.75s/it]
 62%|██████▏   | 23680/37963 [56:49:53<33:26:49,  8.43s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '2.49', 'learning_rate': '6.551e-06', 'epoch': '0.6238'}

 62%|██████▏   | 23680/37963 [56:49:53<33:26:49,  8.43s/it]
 62%|██████▏   | 23681/37963 [56:50:00<32:18:26,  8.14s/it]
 62%|██████▏   | 23682/37963 [56:50:08<31:32:51,  7.95s/it]
 62%|██████▏   | 23683/37963 [56:50:15<30:59:24,  7.81s/it]
 62%|██████▏   | 23684/37963 [56:50:23<30:40:42,  7.73s/it]
 62%|██████▏   | 23685/37963 [56:50:30<30:21:09,  7.65s/it]
 62%|██████▏   | 23686/37963 [56:50:37<30:08:55,  7.60s/it]
 62%|██████▏   | 23687/37963 [56:50:45<29:40:33,  7.48s/it]
 62%|██████▏   | 23688/37963 [56:50:52<29:43:02,  7.49s/it]
 62%|██████▏   | 23689/37963 [56:51:00<29:46:01,  7.51s/it]
 62%|██████▏   | 23690/37963 [56:51:07<29:44:55,  7.50s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '4.459', 'learning_rate': '6.543e-06', 'epoch': '0.624'}

 62%|██████▏   | 23690/37963 [56:51:07<29:44:55,  7.50s/it]
 62%|██████▏   | 23691/37963 [56:51:14<29:26:18,  7.43s/it]
 62%|██████▏   | 23692/37963 [56:51:29<37:19:50,  9.42s/it]
 62%|██████▏   | 23693/37963 [56:51:36<35:06:46,  8.86s/it]
 62%|██████▏   | 23694/37963 [56:51:44<33:28:01,  8.44s/it]
 62%|██████▏   | 23695/37963 [56:51:51<32:22:49,  8.17s/it]
 62%|██████▏   | 23696/37963 [56:51:59<31:36:13,  7.97s/it]
 62%|██████▏   | 23697/37963 [56:52:19<46:31:20, 11.74s/it]
 62%|██████▏   | 23698/37963 [56:52:27<41:31:58, 10.48s/it]
 62%|██████▏   | 23699/37963 [56:52:41<45:29:55, 11.48s/it]
 62%|██████▏   | 23700/37963 [56:52:48<40:49:39, 10.30s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.474', 'learning_rate': '6.535e-06', 'epoch': '0.6243'}

 62%|██████▏   | 23700/37963 [56:52:48<40:49:39, 10.30s/it]
 62%|██████▏   | 23701/37963 [56:52:56<37:40:04,  9.51s/it]
 62%|██████▏   | 23702/37963 [56:53:03<35:12:18,  8.89s/it]
 62%|██████▏   | 23703/37963 [56:53:11<33:42:35,  8.51s/it]
 62%|██████▏   | 23704/37963 [56:53:18<32:33:29,  8.22s/it]
 62%|██████▏   | 23705/37963 [56:53:26<31:54:20,  8.06s/it]
 62%|██████▏   | 23706/37963 [56:53:34<31:24:14,  7.93s/it]
 62%|██████▏   | 23707/37963 [56:53:41<30:54:41,  7.81s/it]
 62%|██████▏   | 23708/37963 [56:53:49<30:34:05,  7.72s/it]
 62%|██████▏   | 23709/37963 [56:53:56<30:17:43,  7.65s/it]
 62%|██████▏   | 23710/37963 [56:54:04<30:06:10,  7.60s/it]
                                                           
{'loss': '0.1462', 'grad_norm': '1.262', 'learning_rate': '6.527e-06', 'epoch': '0.6246'}

 62%|██████▏   | 23710/37963 [56:54:04<30:06:10,  7.60s/it]
 62%|██████▏   | 23711/37963 [56:54:11<30:06:04,  7.60s/it]
 62%|██████▏   | 23712/37963 [56:54:19<29:59:12,  7.58s/it]
 62%|██████▏   | 23713/37963 [56:54:33<37:25:58,  9.46s/it]
 62%|██████▏   | 23714/37963 [56:54:40<35:03:26,  8.86s/it]
 62%|██████▏   | 23715/37963 [56:54:48<33:27:55,  8.46s/it]
 62%|██████▏   | 23716/37963 [56:55:02<40:03:10, 10.12s/it]
 62%|██████▏   | 23717/37963 [56:55:09<37:04:35,  9.37s/it]
 62%|██████▏   | 23718/37963 [56:55:17<34:53:44,  8.82s/it]
 62%|██████▏   | 23719/37963 [56:55:24<33:26:30,  8.45s/it]
 62%|██████▏   | 23720/37963 [56:55:32<32:07:37,  8.12s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '3.334', 'learning_rate': '6.519e-06', 'epoch': '0.6248'}

 62%|██████▏   | 23720/37963 [56:55:32<32:07:37,  8.12s/it]
 62%|██████▏   | 23721/37963 [56:55:46<39:08:19,  9.89s/it]
 62%|██████▏   | 23722/37963 [56:55:53<36:28:20,  9.22s/it]
 62%|██████▏   | 23723/37963 [56:56:01<34:25:42,  8.70s/it]
 62%|██████▏   | 23724/37963 [56:56:08<33:06:42,  8.37s/it]
 62%|██████▏   | 23725/37963 [56:56:22<39:43:35, 10.04s/it]
 62%|██████▏   | 23726/37963 [56:56:30<36:45:25,  9.29s/it]
 63%|██████▎   | 23727/37963 [56:56:38<34:43:01,  8.78s/it]
 63%|██████▎   | 23728/37963 [56:56:45<33:11:58,  8.40s/it]
 63%|██████▎   | 23729/37963 [56:56:52<31:51:02,  8.06s/it]
 63%|██████▎   | 23730/37963 [56:57:00<31:14:54,  7.90s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '2.846', 'learning_rate': '6.511e-06', 'epoch': '0.6251'}

 63%|██████▎   | 23730/37963 [56:57:00<31:14:54,  7.90s/it]
 63%|██████▎   | 23731/37963 [56:57:07<30:47:54,  7.79s/it]
 63%|██████▎   | 23732/37963 [56:57:15<30:28:01,  7.71s/it]
 63%|██████▎   | 23733/37963 [56:57:22<30:11:50,  7.64s/it]
 63%|██████▎   | 23734/37963 [56:57:30<29:44:11,  7.52s/it]
 63%|██████▎   | 23735/37963 [56:57:37<29:49:52,  7.55s/it]
 63%|██████▎   | 23736/37963 [56:57:44<29:27:37,  7.45s/it]
 63%|██████▎   | 23737/37963 [56:57:52<29:38:04,  7.50s/it]
 63%|██████▎   | 23738/37963 [56:58:00<29:43:05,  7.52s/it]
 63%|██████▎   | 23739/37963 [56:58:14<37:33:17,  9.50s/it]
 63%|██████▎   | 23740/37963 [56:58:21<35:15:26,  8.92s/it]
                                                           
{'loss': '0.1323', 'grad_norm': '1.839', 'learning_rate': '6.503e-06', 'epoch': '0.6253'}

 63%|██████▎   | 23740/37963 [56:58:21<35:15:26,  8.92s/it]
 63%|██████▎   | 23741/37963 [56:58:35<41:10:33, 10.42s/it]
 63%|██████▎   | 23742/37963 [56:58:43<37:31:23,  9.50s/it]
 63%|██████▎   | 23743/37963 [56:58:50<35:15:00,  8.92s/it]
 63%|██████▎   | 23744/37963 [56:58:58<33:21:50,  8.45s/it]
 63%|██████▎   | 23745/37963 [56:59:05<31:53:21,  8.07s/it]
 63%|██████▎   | 23746/37963 [56:59:12<31:14:01,  7.91s/it]
 63%|██████▎   | 23747/37963 [56:59:20<30:45:21,  7.79s/it]
 63%|██████▎   | 23748/37963 [56:59:27<30:23:30,  7.70s/it]
 63%|██████▎   | 23749/37963 [56:59:35<30:02:03,  7.61s/it]
 63%|██████▎   | 23750/37963 [56:59:49<37:36:08,  9.52s/it]
                                                           
{'loss': '0.1419', 'grad_norm': '2.047', 'learning_rate': '6.495e-06', 'epoch': '0.6256'}

 63%|██████▎   | 23750/37963 [56:59:49<37:36:08,  9.52s/it]
 63%|██████▎   | 23751/37963 [56:59:56<35:00:15,  8.87s/it]
 63%|██████▎   | 23752/37963 [57:00:03<33:21:13,  8.45s/it]
 63%|██████▎   | 23753/37963 [57:00:11<32:16:14,  8.18s/it]
 63%|██████▎   | 23754/37963 [57:00:25<38:52:56,  9.85s/it]
 63%|██████▎   | 23755/37963 [57:00:32<36:08:11,  9.16s/it]
 63%|██████▎   | 23756/37963 [57:00:40<34:17:40,  8.69s/it]
 63%|██████▎   | 23757/37963 [57:00:47<32:57:25,  8.35s/it]
 63%|██████▎   | 23758/37963 [57:00:55<31:59:11,  8.11s/it]
 63%|██████▎   | 23759/37963 [57:01:03<31:17:45,  7.93s/it]
 63%|██████▎   | 23760/37963 [57:01:17<38:40:48,  9.80s/it]
                                                           
{'loss': '0.1318', 'grad_norm': '1.349', 'learning_rate': '6.487e-06', 'epoch': '0.6259'}

 63%|██████▎   | 23760/37963 [57:01:17<38:40:48,  9.80s/it]
 63%|██████▎   | 23761/37963 [57:01:24<35:48:13,  9.08s/it]
 63%|██████▎   | 23762/37963 [57:01:31<33:27:20,  8.48s/it]
 63%|██████▎   | 23763/37963 [57:01:45<40:03:29, 10.16s/it]
 63%|██████▎   | 23764/37963 [57:01:53<36:55:15,  9.36s/it]
 63%|██████▎   | 23765/37963 [57:02:00<34:46:41,  8.82s/it]
 63%|██████▎   | 23766/37963 [57:02:08<33:16:10,  8.44s/it]
 63%|██████▎   | 23767/37963 [57:02:15<32:05:56,  8.14s/it]
 63%|██████▎   | 23768/37963 [57:02:23<31:20:56,  7.95s/it]
 63%|██████▎   | 23769/37963 [57:02:30<30:55:29,  7.84s/it]
 63%|██████▎   | 23770/37963 [57:02:38<30:32:32,  7.75s/it]
                                                           
{'loss': '0.1339', 'grad_norm': '1.248', 'learning_rate': '6.479e-06', 'epoch': '0.6261'}

 63%|██████▎   | 23770/37963 [57:02:38<30:32:32,  7.75s/it]
 63%|██████▎   | 23771/37963 [57:02:58<45:26:18, 11.53s/it]
 63%|██████▎   | 23772/37963 [57:03:06<40:41:54, 10.32s/it]
 63%|██████▎   | 23773/37963 [57:03:13<37:05:12,  9.41s/it]
 63%|██████▎   | 23774/37963 [57:03:20<34:33:44,  8.77s/it]
 63%|██████▎   | 23775/37963 [57:03:28<33:14:18,  8.43s/it]
 63%|██████▎   | 23776/37963 [57:03:35<32:09:49,  8.16s/it]
 63%|██████▎   | 23777/37963 [57:03:43<31:34:02,  8.01s/it]
 63%|██████▎   | 23778/37963 [57:03:51<30:56:35,  7.85s/it]
 63%|██████▎   | 23779/37963 [57:03:58<30:45:12,  7.81s/it]
 63%|██████▎   | 23780/37963 [57:04:06<30:21:34,  7.71s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '2.01', 'learning_rate': '6.471e-06', 'epoch': '0.6264'}

 63%|██████▎   | 23780/37963 [57:04:06<30:21:34,  7.71s/it]
 63%|██████▎   | 23781/37963 [57:04:13<30:02:52,  7.63s/it]
 63%|██████▎   | 23782/37963 [57:04:21<29:54:12,  7.59s/it]
 63%|██████▎   | 23783/37963 [57:04:28<29:45:06,  7.55s/it]
 63%|██████▎   | 23784/37963 [57:04:36<29:46:45,  7.56s/it]
 63%|██████▎   | 23785/37963 [57:04:43<29:37:33,  7.52s/it]
 63%|██████▎   | 23786/37963 [57:04:51<29:38:08,  7.53s/it]
 63%|██████▎   | 23787/37963 [57:05:11<44:33:02, 11.31s/it]
 63%|██████▎   | 23788/37963 [57:05:18<40:08:34, 10.20s/it]
 63%|██████▎   | 23789/37963 [57:05:26<37:05:58,  9.42s/it]
 63%|██████▎   | 23790/37963 [57:05:34<34:57:37,  8.88s/it]
                                                           
{'loss': '0.132', 'grad_norm': '1.341', 'learning_rate': '6.463e-06', 'epoch': '0.6267'}

 63%|██████▎   | 23790/37963 [57:05:34<34:57:37,  8.88s/it]
 63%|██████▎   | 23791/37963 [57:05:41<33:21:34,  8.47s/it]
 63%|██████▎   | 23792/37963 [57:05:49<32:18:40,  8.21s/it]
 63%|██████▎   | 23793/37963 [57:05:56<31:30:53,  8.01s/it]
 63%|██████▎   | 23794/37963 [57:06:04<30:55:26,  7.86s/it]
 63%|██████▎   | 23795/37963 [57:06:11<30:27:13,  7.74s/it]
 63%|██████▎   | 23796/37963 [57:06:19<30:15:37,  7.69s/it]
 63%|██████▎   | 23797/37963 [57:06:33<37:51:57,  9.62s/it]
 63%|██████▎   | 23798/37963 [57:06:41<35:29:54,  9.02s/it]
 63%|██████▎   | 23799/37963 [57:06:48<33:50:02,  8.60s/it]
 63%|██████▎   | 23800/37963 [57:06:56<32:45:55,  8.33s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '2.917', 'learning_rate': '6.455e-06', 'epoch': '0.6269'}

 63%|██████▎   | 23800/37963 [57:06:56<32:45:55,  8.33s/it]
 63%|██████▎   | 23801/37963 [57:07:03<31:46:01,  8.08s/it]
 63%|██████▎   | 23802/37963 [57:07:11<31:00:18,  7.88s/it]
 63%|██████▎   | 23803/37963 [57:07:25<38:28:42,  9.78s/it]
 63%|██████▎   | 23804/37963 [57:07:33<36:11:31,  9.20s/it]
 63%|██████▎   | 23805/37963 [57:07:40<34:06:47,  8.67s/it]
 63%|██████▎   | 23806/37963 [57:07:48<32:39:37,  8.31s/it]
 63%|██████▎   | 23807/37963 [57:08:08<46:42:00, 11.88s/it]
 63%|██████▎   | 23808/37963 [57:08:16<41:40:09, 10.60s/it]
 63%|██████▎   | 23809/37963 [57:08:23<37:51:21,  9.63s/it]
 63%|██████▎   | 23810/37963 [57:08:31<35:25:29,  9.01s/it]
                                                           
{'loss': '0.1185', 'grad_norm': '1.8', 'learning_rate': '6.447e-06', 'epoch': '0.6272'}

 63%|██████▎   | 23810/37963 [57:08:31<35:25:29,  9.01s/it]
 63%|██████▎   | 23811/37963 [57:08:38<33:49:32,  8.60s/it]
 63%|██████▎   | 23812/37963 [57:08:46<32:21:13,  8.23s/it]
 63%|██████▎   | 23813/37963 [57:08:53<31:29:45,  8.01s/it]
 63%|██████▎   | 23814/37963 [57:09:01<30:45:37,  7.83s/it]
 63%|██████▎   | 23815/37963 [57:09:08<30:08:56,  7.67s/it]
 63%|██████▎   | 23816/37963 [57:09:15<30:03:43,  7.65s/it]
 63%|██████▎   | 23817/37963 [57:09:23<29:55:22,  7.62s/it]
 63%|██████▎   | 23818/37963 [57:09:30<29:45:39,  7.57s/it]
 63%|██████▎   | 23819/37963 [57:09:38<29:51:41,  7.60s/it]
 63%|██████▎   | 23820/37963 [57:09:46<29:44:01,  7.57s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '2.222', 'learning_rate': '6.439e-06', 'epoch': '0.6275'}

 63%|██████▎   | 23820/37963 [57:09:46<29:44:01,  7.57s/it]
 63%|██████▎   | 23821/37963 [57:10:06<45:06:48, 11.48s/it]
 63%|██████▎   | 23822/37963 [57:10:14<40:38:20, 10.35s/it]
 63%|██████▎   | 23823/37963 [57:10:21<37:20:22,  9.51s/it]
 63%|██████▎   | 23824/37963 [57:10:29<35:06:07,  8.94s/it]
 63%|██████▎   | 23825/37963 [57:10:36<33:17:32,  8.48s/it]
 63%|██████▎   | 23826/37963 [57:10:44<31:57:32,  8.14s/it]
 63%|██████▎   | 23827/37963 [57:10:51<31:20:20,  7.98s/it]
 63%|██████▎   | 23828/37963 [57:10:59<30:47:30,  7.84s/it]
 63%|██████▎   | 23829/37963 [57:11:06<30:02:35,  7.65s/it]
 63%|██████▎   | 23830/37963 [57:11:14<29:43:36,  7.57s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '2.205', 'learning_rate': '6.431e-06', 'epoch': '0.6277'}

 63%|██████▎   | 23830/37963 [57:11:14<29:43:36,  7.57s/it]
 63%|██████▎   | 23831/37963 [57:11:21<29:45:12,  7.58s/it]
 63%|██████▎   | 23832/37963 [57:11:28<29:23:37,  7.49s/it]
 63%|██████▎   | 23833/37963 [57:11:36<29:29:47,  7.52s/it]
 63%|██████▎   | 23834/37963 [57:11:50<37:08:17,  9.46s/it]
 63%|██████▎   | 23835/37963 [57:11:58<34:51:23,  8.88s/it]
 63%|██████▎   | 23836/37963 [57:12:05<33:21:49,  8.50s/it]
 63%|██████▎   | 23837/37963 [57:12:19<39:20:31, 10.03s/it]
 63%|██████▎   | 23838/37963 [57:12:27<36:41:40,  9.35s/it]
 63%|██████▎   | 23839/37963 [57:12:34<34:23:27,  8.77s/it]
 63%|██████▎   | 23840/37963 [57:12:41<32:55:50,  8.39s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '2.746', 'learning_rate': '6.423e-06', 'epoch': '0.628'}

 63%|██████▎   | 23840/37963 [57:12:41<32:55:50,  8.39s/it]
 63%|██████▎   | 23841/37963 [57:12:49<31:55:19,  8.14s/it]
 63%|██████▎   | 23842/37963 [57:12:56<31:08:07,  7.94s/it]
 63%|██████▎   | 23843/37963 [57:13:04<30:37:03,  7.81s/it]
 63%|██████▎   | 23844/37963 [57:13:11<30:05:58,  7.67s/it]
 63%|██████▎   | 23845/37963 [57:13:25<37:22:35,  9.53s/it]
 63%|██████▎   | 23846/37963 [57:13:33<35:04:23,  8.94s/it]
 63%|██████▎   | 23847/37963 [57:13:40<33:18:47,  8.50s/it]
 63%|██████▎   | 23848/37963 [57:13:48<32:00:44,  8.16s/it]
 63%|██████▎   | 23849/37963 [57:13:55<31:14:13,  7.97s/it]
 63%|██████▎   | 23850/37963 [57:14:03<30:39:53,  7.82s/it]
                                                           
{'loss': '0.129', 'grad_norm': '2.218', 'learning_rate': '6.415e-06', 'epoch': '0.6282'}

 63%|██████▎   | 23850/37963 [57:14:03<30:39:53,  7.82s/it]
 63%|██████▎   | 23851/37963 [57:14:10<30:19:04,  7.73s/it]
 63%|██████▎   | 23852/37963 [57:14:18<30:04:28,  7.67s/it]
 63%|██████▎   | 23853/37963 [57:14:25<29:51:36,  7.62s/it]
 63%|██████▎   | 23854/37963 [57:14:33<29:46:43,  7.60s/it]
 63%|██████▎   | 23855/37963 [57:14:40<29:39:33,  7.57s/it]
 63%|██████▎   | 23856/37963 [57:14:54<37:07:45,  9.48s/it]
 63%|██████▎   | 23857/37963 [57:15:08<42:26:57, 10.83s/it]
 63%|██████▎   | 23858/37963 [57:15:16<38:36:58,  9.86s/it]
 63%|██████▎   | 23859/37963 [57:15:23<36:05:24,  9.21s/it]
 63%|██████▎   | 23860/37963 [57:15:31<34:09:33,  8.72s/it]
                                                           
{'loss': '0.1175', 'grad_norm': '1.717', 'learning_rate': '6.407e-06', 'epoch': '0.6285'}

 63%|██████▎   | 23860/37963 [57:15:31<34:09:33,  8.72s/it]
 63%|██████▎   | 23861/37963 [57:15:45<40:27:56, 10.33s/it]
 63%|██████▎   | 23862/37963 [57:15:53<37:17:24,  9.52s/it]
 63%|██████▎   | 23863/37963 [57:16:00<34:54:57,  8.91s/it]
 63%|██████▎   | 23864/37963 [57:16:08<33:10:07,  8.47s/it]
 63%|██████▎   | 23865/37963 [57:16:15<32:04:42,  8.19s/it]
 63%|██████▎   | 23866/37963 [57:16:29<38:26:58,  9.82s/it]
 63%|██████▎   | 23867/37963 [57:16:36<35:44:05,  9.13s/it]
 63%|██████▎   | 23868/37963 [57:16:44<33:37:54,  8.59s/it]
 63%|██████▎   | 23869/37963 [57:16:57<39:50:10, 10.18s/it]
 63%|██████▎   | 23870/37963 [57:17:05<36:47:03,  9.40s/it]
                                                           
{'loss': '0.1362', 'grad_norm': '2.188', 'learning_rate': '6.399e-06', 'epoch': '0.6288'}

 63%|██████▎   | 23870/37963 [57:17:05<36:47:03,  9.40s/it]
 63%|██████▎   | 23871/37963 [57:17:13<34:31:10,  8.82s/it]
 63%|██████▎   | 23872/37963 [57:17:20<33:07:29,  8.46s/it]
 63%|██████▎   | 23873/37963 [57:17:28<32:00:18,  8.18s/it]
 63%|██████▎   | 23874/37963 [57:17:35<31:17:30,  8.00s/it]
 63%|██████▎   | 23875/37963 [57:17:43<30:43:35,  7.85s/it]
 63%|██████▎   | 23876/37963 [57:17:50<30:14:43,  7.73s/it]
 63%|██████▎   | 23877/37963 [57:17:58<29:59:46,  7.67s/it]
 63%|██████▎   | 23878/37963 [57:18:05<29:54:50,  7.65s/it]
 63%|██████▎   | 23879/37963 [57:18:13<29:47:16,  7.61s/it]
 63%|██████▎   | 23880/37963 [57:18:20<29:40:35,  7.59s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.975', 'learning_rate': '6.391e-06', 'epoch': '0.629'}

 63%|██████▎   | 23880/37963 [57:18:20<29:40:35,  7.59s/it]
 63%|██████▎   | 23881/37963 [57:18:28<29:46:15,  7.61s/it]
 63%|██████▎   | 23882/37963 [57:18:35<29:31:08,  7.55s/it]
 63%|██████▎   | 23883/37963 [57:18:50<37:10:08,  9.50s/it]
 63%|██████▎   | 23884/37963 [57:18:57<34:56:39,  8.94s/it]
 63%|██████▎   | 23885/37963 [57:19:12<41:23:40, 10.59s/it]
 63%|██████▎   | 23886/37963 [57:19:19<37:47:21,  9.66s/it]
 63%|██████▎   | 23887/37963 [57:19:27<35:13:17,  9.01s/it]
 63%|██████▎   | 23888/37963 [57:19:34<33:35:26,  8.59s/it]
 63%|██████▎   | 23889/37963 [57:19:41<31:59:57,  8.19s/it]
 63%|██████▎   | 23890/37963 [57:19:49<31:09:35,  7.97s/it]
                                                           
{'loss': '0.1416', 'grad_norm': '3.046', 'learning_rate': '6.383e-06', 'epoch': '0.6293'}

 63%|██████▎   | 23890/37963 [57:19:49<31:09:35,  7.97s/it]
 63%|██████▎   | 23891/37963 [57:19:56<30:24:47,  7.78s/it]
 63%|██████▎   | 23892/37963 [57:20:04<30:03:43,  7.69s/it]
 63%|██████▎   | 23893/37963 [57:20:17<37:06:44,  9.50s/it]
 63%|██████▎   | 23894/37963 [57:20:25<34:54:21,  8.93s/it]
 63%|██████▎   | 23895/37963 [57:20:33<33:19:21,  8.53s/it]
 63%|██████▎   | 23896/37963 [57:20:40<32:11:21,  8.24s/it]
 63%|██████▎   | 23897/37963 [57:20:48<31:21:15,  8.02s/it]
 63%|██████▎   | 23898/37963 [57:20:55<30:48:25,  7.89s/it]
 63%|██████▎   | 23899/37963 [57:21:03<30:23:49,  7.78s/it]
 63%|██████▎   | 23900/37963 [57:21:10<30:08:23,  7.72s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '1.297', 'learning_rate': '6.375e-06', 'epoch': '0.6296'}

 63%|██████▎   | 23900/37963 [57:21:10<30:08:23,  7.72s/it]
 63%|██████▎   | 23901/37963 [57:21:18<30:01:32,  7.69s/it]
 63%|██████▎   | 23902/37963 [57:21:25<29:45:14,  7.62s/it]
 63%|██████▎   | 23903/37963 [57:21:33<29:45:40,  7.62s/it]
 63%|██████▎   | 23904/37963 [57:21:41<29:42:35,  7.61s/it]
 63%|██████▎   | 23905/37963 [57:21:55<37:17:43,  9.55s/it]
 63%|██████▎   | 23906/37963 [57:22:02<34:55:29,  8.94s/it]
 63%|██████▎   | 23907/37963 [57:22:10<33:15:30,  8.52s/it]
 63%|██████▎   | 23908/37963 [57:22:24<39:44:37, 10.18s/it]
 63%|██████▎   | 23909/37963 [57:22:31<36:45:56,  9.42s/it]
 63%|██████▎   | 23910/37963 [57:22:39<34:36:54,  8.87s/it]
                                                           
{'loss': '0.1444', 'grad_norm': '3.236', 'learning_rate': '6.367e-06', 'epoch': '0.6298'}

 63%|██████▎   | 23910/37963 [57:22:39<34:36:54,  8.87s/it]
 63%|██████▎   | 23911/37963 [57:22:53<40:33:24, 10.39s/it]
 63%|██████▎   | 23912/37963 [57:23:01<37:28:12,  9.60s/it]
 63%|██████▎   | 23913/37963 [57:23:08<35:03:33,  8.98s/it]
 63%|██████▎   | 23914/37963 [57:23:16<33:19:38,  8.54s/it]
 63%|██████▎   | 23915/37963 [57:23:36<47:26:55, 12.16s/it]
 63%|██████▎   | 23916/37963 [57:23:44<42:08:17, 10.80s/it]
 63%|██████▎   | 23917/37963 [57:23:51<38:10:43,  9.79s/it]
 63%|██████▎   | 23918/37963 [57:23:59<35:30:40,  9.10s/it]
 63%|██████▎   | 23919/37963 [57:24:07<33:41:50,  8.64s/it]
 63%|██████▎   | 23920/37963 [57:24:14<32:21:48,  8.30s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '1.426', 'learning_rate': '6.359e-06', 'epoch': '0.6301'}

 63%|██████▎   | 23920/37963 [57:24:14<32:21:48,  8.30s/it]
 63%|██████▎   | 23921/37963 [57:24:22<31:41:25,  8.12s/it]
 63%|██████▎   | 23922/37963 [57:24:29<31:03:37,  7.96s/it]
 63%|██████▎   | 23923/37963 [57:24:37<30:33:43,  7.84s/it]
 63%|██████▎   | 23924/37963 [57:24:45<30:20:24,  7.78s/it]
 63%|██████▎   | 23925/37963 [57:24:52<30:02:59,  7.71s/it]
 63%|██████▎   | 23926/37963 [57:25:00<29:59:03,  7.69s/it]
 63%|██████▎   | 23927/37963 [57:25:07<29:50:57,  7.66s/it]
 63%|██████▎   | 23928/37963 [57:25:22<37:30:29,  9.62s/it]
 63%|██████▎   | 23929/37963 [57:25:36<42:52:47, 11.00s/it]
 63%|██████▎   | 23930/37963 [57:25:43<38:43:19,  9.93s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.694', 'learning_rate': '6.351e-06', 'epoch': '0.6304'}

 63%|██████▎   | 23930/37963 [57:25:43<38:43:19,  9.93s/it]
 63%|██████▎   | 23931/37963 [57:25:51<35:52:52,  9.21s/it]
 63%|██████▎   | 23932/37963 [57:25:58<34:01:24,  8.73s/it]
 63%|██████▎   | 23933/37963 [57:26:06<32:39:42,  8.38s/it]
 63%|██████▎   | 23934/37963 [57:26:13<31:46:14,  8.15s/it]
 63%|██████▎   | 23935/37963 [57:26:21<31:01:19,  7.96s/it]
 63%|██████▎   | 23936/37963 [57:26:29<30:37:59,  7.86s/it]
 63%|██████▎   | 23937/37963 [57:26:36<30:16:48,  7.77s/it]
 63%|██████▎   | 23938/37963 [57:26:44<29:56:41,  7.69s/it]
 63%|██████▎   | 23939/37963 [57:26:51<29:46:27,  7.64s/it]
 63%|██████▎   | 23940/37963 [57:26:59<29:46:39,  7.64s/it]
                                                           
{'loss': '0.1344', 'grad_norm': '1.247', 'learning_rate': '6.343e-06', 'epoch': '0.6306'}

 63%|██████▎   | 23940/37963 [57:26:59<29:46:39,  7.64s/it]
 63%|██████▎   | 23941/37963 [57:27:13<37:00:27,  9.50s/it]
 63%|██████▎   | 23942/37963 [57:27:20<34:37:27,  8.89s/it]
 63%|██████▎   | 23943/37963 [57:27:28<33:01:54,  8.48s/it]
 63%|██████▎   | 23944/37963 [57:27:35<31:58:39,  8.21s/it]
 63%|██████▎   | 23945/37963 [57:27:43<31:14:31,  8.02s/it]
 63%|██████▎   | 23946/37963 [57:27:51<30:51:10,  7.92s/it]
 63%|██████▎   | 23947/37963 [57:27:58<30:26:39,  7.82s/it]
 63%|██████▎   | 23948/37963 [57:28:06<29:58:55,  7.70s/it]
 63%|██████▎   | 23949/37963 [57:28:13<29:44:42,  7.64s/it]
 63%|██████▎   | 23950/37963 [57:28:20<29:24:12,  7.55s/it]
                                                           
{'loss': '0.1446', 'grad_norm': '2.505', 'learning_rate': '6.335e-06', 'epoch': '0.6309'}

 63%|██████▎   | 23950/37963 [57:28:20<29:24:12,  7.55s/it]
 63%|██████▎   | 23951/37963 [57:28:28<29:20:13,  7.54s/it]
 63%|██████▎   | 23952/37963 [57:28:35<29:01:28,  7.46s/it]
 63%|██████▎   | 23953/37963 [57:28:49<36:32:59,  9.39s/it]
 63%|██████▎   | 23954/37963 [57:29:03<41:57:23, 10.78s/it]
 63%|██████▎   | 23955/37963 [57:29:11<38:10:39,  9.81s/it]
 63%|██████▎   | 23956/37963 [57:29:18<35:29:32,  9.12s/it]
 63%|██████▎   | 23957/37963 [57:29:26<33:48:21,  8.69s/it]
 63%|██████▎   | 23958/37963 [57:29:33<32:32:35,  8.37s/it]
 63%|██████▎   | 23959/37963 [57:29:41<31:21:35,  8.06s/it]
 63%|██████▎   | 23960/37963 [57:29:48<30:40:15,  7.89s/it]
                                                           
{'loss': '0.133', 'grad_norm': '2.871', 'learning_rate': '6.327e-06', 'epoch': '0.6311'}

 63%|██████▎   | 23960/37963 [57:29:48<30:40:15,  7.89s/it]
 63%|██████▎   | 23961/37963 [57:30:09<45:50:33, 11.79s/it]
 63%|██████▎   | 23962/37963 [57:30:17<41:00:55, 10.55s/it]
 63%|██████▎   | 23963/37963 [57:30:25<37:42:38,  9.70s/it]
 63%|██████▎   | 23964/37963 [57:30:39<42:44:05, 10.99s/it]
 63%|██████▎   | 23965/37963 [57:30:46<38:42:54,  9.96s/it]
 63%|██████▎   | 23966/37963 [57:30:54<35:49:15,  9.21s/it]
 63%|██████▎   | 23967/37963 [57:31:01<33:53:09,  8.72s/it]
 63%|██████▎   | 23968/37963 [57:31:09<32:33:48,  8.38s/it]
 63%|██████▎   | 23969/37963 [57:31:16<31:34:19,  8.12s/it]
 63%|██████▎   | 23970/37963 [57:31:24<30:49:22,  7.93s/it]
                                                           
{'loss': '0.1258', 'grad_norm': '3.783', 'learning_rate': '6.319e-06', 'epoch': '0.6314'}

 63%|██████▎   | 23970/37963 [57:31:24<30:49:22,  7.93s/it]
 63%|██████▎   | 23971/37963 [57:31:31<30:27:15,  7.84s/it]
 63%|██████▎   | 23972/37963 [57:31:39<30:13:40,  7.78s/it]
 63%|██████▎   | 23973/37963 [57:31:53<37:31:10,  9.65s/it]
 63%|██████▎   | 23974/37963 [57:32:01<35:01:51,  9.02s/it]
 63%|██████▎   | 23975/37963 [57:32:08<33:17:05,  8.57s/it]
 63%|██████▎   | 23976/37963 [57:32:16<32:14:02,  8.30s/it]
 63%|██████▎   | 23977/37963 [57:32:23<31:18:29,  8.06s/it]
 63%|██████▎   | 23978/37963 [57:32:37<38:02:17,  9.79s/it]
 63%|██████▎   | 23979/37963 [57:32:45<35:26:39,  9.12s/it]
 63%|██████▎   | 23980/37963 [57:32:52<33:40:36,  8.67s/it]
                                                           
{'loss': '0.132', 'grad_norm': '1.158', 'learning_rate': '6.312e-06', 'epoch': '0.6317'}

 63%|██████▎   | 23980/37963 [57:32:52<33:40:36,  8.67s/it]
 63%|██████▎   | 23981/37963 [57:33:00<32:24:51,  8.35s/it]
 63%|██████▎   | 23982/37963 [57:33:07<31:24:05,  8.09s/it]
 63%|██████▎   | 23983/37963 [57:33:15<30:41:28,  7.90s/it]
 63%|██████▎   | 23984/37963 [57:33:22<29:57:08,  7.71s/it]
 63%|██████▎   | 23985/37963 [57:33:30<29:46:35,  7.67s/it]
 63%|██████▎   | 23986/37963 [57:33:37<29:31:17,  7.60s/it]
 63%|██████▎   | 23987/37963 [57:33:45<29:26:06,  7.58s/it]
 63%|██████▎   | 23988/37963 [57:33:52<29:24:42,  7.58s/it]
 63%|██████▎   | 23989/37963 [57:34:00<29:28:05,  7.59s/it]
 63%|██████▎   | 23990/37963 [57:34:07<29:07:04,  7.50s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '1.503', 'learning_rate': '6.304e-06', 'epoch': '0.6319'}

 63%|██████▎   | 23990/37963 [57:34:07<29:07:04,  7.50s/it]
 63%|██████▎   | 23991/37963 [57:34:15<29:19:02,  7.55s/it]
 63%|██████▎   | 23992/37963 [57:34:22<29:14:41,  7.54s/it]
 63%|██████▎   | 23993/37963 [57:34:30<29:02:10,  7.48s/it]
 63%|██████▎   | 23994/37963 [57:34:37<29:12:00,  7.53s/it]
 63%|██████▎   | 23995/37963 [57:34:51<36:39:44,  9.45s/it]
 63%|██████▎   | 23996/37963 [57:34:59<34:24:51,  8.87s/it]
 63%|██████▎   | 23997/37963 [57:35:06<32:31:19,  8.38s/it]
 63%|██████▎   | 23998/37963 [57:35:19<38:29:17,  9.92s/it]
 63%|██████▎   | 23999/37963 [57:35:27<36:01:39,  9.29s/it]
 63%|██████▎   | 24000/37963 [57:35:35<33:49:00,  8.72s/it]
                                                           
{'loss': '0.127', 'grad_norm': '1.404', 'learning_rate': '6.296e-06', 'epoch': '0.6322'}

 63%|██████▎   | 24000/37963 [57:35:35<33:49:00,  8.72s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.03s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.03s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 63%|██████▎   | 24001/37963 [57:36:32<90:56:11, 23.45s/it]
 63%|██████▎   | 24002/37963 [57:36:47<80:54:52, 20.86s/it]
 63%|██████▎   | 24003/37963 [57:36:55<65:28:18, 16.88s/it]
 63%|██████▎   | 24004/37963 [57:37:02<54:34:38, 14.08s/it]
 63%|██████▎   | 24005/37963 [57:37:10<47:01:00, 12.13s/it]
 63%|██████▎   | 24006/37963 [57:37:17<41:27:25, 10.69s/it]
 63%|██████▎   | 24007/37963 [57:37:25<37:43:58,  9.73s/it]
 63%|██████▎   | 24008/37963 [57:37:32<35:06:29,  9.06s/it]
 63%|██████▎   | 24009/37963 [57:37:59<55:46:53, 14.39s/it]
 63%|██████▎   | 24010/37963 [57:38:07<47:54:37, 12.36s/it]
                                                           
{'loss': '0.1267', 'grad_norm': '3.363', 'learning_rate': '6.288e-06', 'epoch': '0.6325'}

 63%|██████▎   | 24010/37963 [57:38:07<47:54:37, 12.36s/it]
 63%|██████▎   | 24011/37963 [57:38:14<42:28:29, 10.96s/it]
 63%|██████▎   | 24012/37963 [57:38:22<38:28:50,  9.93s/it]
 63%|██████▎   | 24013/37963 [57:38:29<35:26:05,  9.14s/it]
 63%|██████▎   | 24014/37963 [57:38:37<33:36:18,  8.67s/it]
 63%|██████▎   | 24015/37963 [57:38:44<32:22:35,  8.36s/it]
 63%|██████▎   | 24016/37963 [57:38:52<31:19:52,  8.09s/it]
 63%|██████▎   | 24017/37963 [57:38:59<30:34:37,  7.89s/it]
 63%|██████▎   | 24018/37963 [57:39:07<30:12:21,  7.80s/it]
 63%|██████▎   | 24019/37963 [57:39:21<37:43:44,  9.74s/it]
 63%|██████▎   | 24020/37963 [57:39:29<35:10:19,  9.08s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '4.669', 'learning_rate': '6.28e-06', 'epoch': '0.6327'}

 63%|██████▎   | 24020/37963 [57:39:29<35:10:19,  9.08s/it]
 63%|██████▎   | 24021/37963 [57:39:36<33:05:36,  8.55s/it]
 63%|██████▎   | 24022/37963 [57:39:44<31:55:09,  8.24s/it]
 63%|██████▎   | 24023/37963 [57:39:51<31:05:26,  8.03s/it]
 63%|██████▎   | 24024/37963 [57:39:59<30:37:52,  7.91s/it]
 63%|██████▎   | 24025/37963 [57:40:06<30:13:17,  7.81s/it]
 63%|██████▎   | 24026/37963 [57:40:14<30:12:53,  7.80s/it]
 63%|██████▎   | 24027/37963 [57:40:28<37:29:17,  9.68s/it]
 63%|██████▎   | 24028/37963 [57:40:36<35:04:02,  9.06s/it]
 63%|██████▎   | 24029/37963 [57:40:43<33:16:27,  8.60s/it]
 63%|██████▎   | 24030/37963 [57:40:51<32:05:48,  8.29s/it]
                                                           
{'loss': '0.146', 'grad_norm': '3.534', 'learning_rate': '6.272e-06', 'epoch': '0.633'}

 63%|██████▎   | 24030/37963 [57:40:51<32:05:48,  8.29s/it]
 63%|██████▎   | 24031/37963 [57:40:59<31:25:37,  8.12s/it]
 63%|██████▎   | 24032/37963 [57:41:06<30:44:20,  7.94s/it]
 63%|██████▎   | 24033/37963 [57:41:14<30:21:12,  7.84s/it]
 63%|██████▎   | 24034/37963 [57:41:21<29:51:00,  7.71s/it]
 63%|██████▎   | 24035/37963 [57:41:29<29:54:18,  7.73s/it]
 63%|██████▎   | 24036/37963 [57:41:37<29:46:21,  7.70s/it]
 63%|██████▎   | 24037/37963 [57:41:44<29:38:47,  7.66s/it]
 63%|██████▎   | 24038/37963 [57:41:52<29:29:42,  7.63s/it]
 63%|██████▎   | 24039/37963 [57:42:00<29:42:14,  7.68s/it]
 63%|██████▎   | 24040/37963 [57:42:07<29:13:26,  7.56s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '2.475', 'learning_rate': '6.264e-06', 'epoch': '0.6333'}

 63%|██████▎   | 24040/37963 [57:42:07<29:13:26,  7.56s/it]
 63%|██████▎   | 24041/37963 [57:42:14<29:10:37,  7.54s/it]
 63%|██████▎   | 24042/37963 [57:42:28<36:40:03,  9.48s/it]
 63%|██████▎   | 24043/37963 [57:42:36<34:05:53,  8.82s/it]
 63%|██████▎   | 24044/37963 [57:42:43<32:24:16,  8.38s/it]
 63%|██████▎   | 24045/37963 [57:42:57<38:51:58, 10.05s/it]
 63%|██████▎   | 24046/37963 [57:43:05<36:05:34,  9.34s/it]
 63%|██████▎   | 24047/37963 [57:43:12<34:01:00,  8.80s/it]
 63%|██████▎   | 24048/37963 [57:43:20<32:24:31,  8.38s/it]
 63%|██████▎   | 24049/37963 [57:43:27<31:23:35,  8.12s/it]
 63%|██████▎   | 24050/37963 [57:43:35<30:46:01,  7.96s/it]
                                                           
{'loss': '0.1396', 'grad_norm': '1.08', 'learning_rate': '6.256e-06', 'epoch': '0.6335'}

 63%|██████▎   | 24050/37963 [57:43:35<30:46:01,  7.96s/it]
 63%|██████▎   | 24051/37963 [57:43:42<30:24:25,  7.87s/it]
 63%|██████▎   | 24052/37963 [57:43:50<30:09:24,  7.80s/it]
 63%|██████▎   | 24053/37963 [57:44:11<45:10:19, 11.69s/it]
 63%|██████▎   | 24054/37963 [57:44:18<40:32:03, 10.49s/it]
 63%|██████▎   | 24055/37963 [57:44:26<36:50:30,  9.54s/it]
 63%|██████▎   | 24056/37963 [57:44:40<41:50:15, 10.83s/it]
 63%|██████▎   | 24057/37963 [57:44:47<38:04:20,  9.86s/it]
 63%|██████▎   | 24058/37963 [57:44:55<35:32:46,  9.20s/it]
 63%|██████▎   | 24059/37963 [57:45:02<33:47:44,  8.75s/it]
 63%|██████▎   | 24060/37963 [57:45:10<32:28:38,  8.41s/it]
                                                           
{'loss': '0.1381', 'grad_norm': '1.389', 'learning_rate': '6.248e-06', 'epoch': '0.6338'}

 63%|██████▎   | 24060/37963 [57:45:10<32:28:38,  8.41s/it]
 63%|██████▎   | 24061/37963 [57:45:24<38:51:41, 10.06s/it]
 63%|██████▎   | 24062/37963 [57:45:32<35:59:06,  9.32s/it]
 63%|██████▎   | 24063/37963 [57:45:39<34:02:29,  8.82s/it]
 63%|██████▎   | 24064/37963 [57:45:47<32:39:08,  8.46s/it]
 63%|██████▎   | 24065/37963 [57:45:54<31:20:33,  8.12s/it]
 63%|██████▎   | 24066/37963 [57:46:02<30:41:14,  7.95s/it]
 63%|██████▎   | 24067/37963 [57:46:09<29:58:44,  7.77s/it]
 63%|██████▎   | 24068/37963 [57:46:17<29:36:48,  7.67s/it]
 63%|██████▎   | 24069/37963 [57:46:24<29:31:44,  7.65s/it]
 63%|██████▎   | 24070/37963 [57:46:32<29:26:32,  7.63s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '1.476', 'learning_rate': '6.24e-06', 'epoch': '0.634'}

 63%|██████▎   | 24070/37963 [57:46:32<29:26:32,  7.63s/it]
 63%|██████▎   | 24071/37963 [57:46:39<29:32:59,  7.66s/it]
 63%|██████▎   | 24072/37963 [57:46:53<36:36:39,  9.49s/it]
 63%|██████▎   | 24073/37963 [57:47:07<41:49:23, 10.84s/it]
 63%|██████▎   | 24074/37963 [57:47:15<38:02:04,  9.86s/it]
 63%|██████▎   | 24075/37963 [57:47:22<35:24:42,  9.18s/it]
 63%|██████▎   | 24076/37963 [57:47:30<33:28:21,  8.68s/it]
 63%|██████▎   | 24077/37963 [57:47:37<32:11:15,  8.34s/it]
 63%|██████▎   | 24078/37963 [57:47:45<31:09:12,  8.08s/it]
 63%|██████▎   | 24079/37963 [57:47:52<30:06:16,  7.81s/it]
 63%|██████▎   | 24080/37963 [57:48:00<29:42:19,  7.70s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '1.852', 'learning_rate': '6.232e-06', 'epoch': '0.6343'}

 63%|██████▎   | 24080/37963 [57:48:00<29:42:19,  7.70s/it]
 63%|██████▎   | 24081/37963 [57:48:07<29:23:39,  7.62s/it]
 63%|██████▎   | 24082/37963 [57:48:15<29:20:29,  7.61s/it]
 63%|██████▎   | 24083/37963 [57:48:22<29:01:25,  7.53s/it]
 63%|██████▎   | 24084/37963 [57:48:30<29:10:11,  7.57s/it]
 63%|██████▎   | 24085/37963 [57:48:43<36:13:51,  9.40s/it]
 63%|██████▎   | 24086/37963 [57:48:51<34:03:32,  8.84s/it]
 63%|██████▎   | 24087/37963 [57:48:58<32:33:03,  8.45s/it]
 63%|██████▎   | 24088/37963 [57:49:06<31:31:26,  8.18s/it]
 63%|██████▎   | 24089/37963 [57:49:13<30:29:49,  7.91s/it]
 63%|██████▎   | 24090/37963 [57:49:21<30:01:25,  7.79s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '1.73', 'learning_rate': '6.224e-06', 'epoch': '0.6346'}

 63%|██████▎   | 24090/37963 [57:49:21<30:01:25,  7.79s/it]
 63%|██████▎   | 24091/37963 [57:49:28<29:41:36,  7.71s/it]
 63%|██████▎   | 24092/37963 [57:49:42<37:00:51,  9.61s/it]
 63%|██████▎   | 24093/37963 [57:49:50<34:30:49,  8.96s/it]
 63%|██████▎   | 24094/37963 [57:49:57<32:58:02,  8.56s/it]
 63%|██████▎   | 24095/37963 [57:50:04<31:25:00,  8.16s/it]
 63%|██████▎   | 24096/37963 [57:50:12<30:40:55,  7.97s/it]
 63%|██████▎   | 24097/37963 [57:50:26<37:49:07,  9.82s/it]
 63%|██████▎   | 24098/37963 [57:50:34<35:05:48,  9.11s/it]
 63%|██████▎   | 24099/37963 [57:50:41<33:13:15,  8.63s/it]
 63%|██████▎   | 24100/37963 [57:50:49<32:01:32,  8.32s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '2.436', 'learning_rate': '6.217e-06', 'epoch': '0.6348'}

 63%|██████▎   | 24100/37963 [57:50:49<32:01:32,  8.32s/it]
 63%|██████▎   | 24101/37963 [57:51:09<45:49:49, 11.90s/it]
 63%|██████▎   | 24102/37963 [57:51:17<40:54:17, 10.62s/it]
 63%|██████▎   | 24103/37963 [57:51:24<37:05:15,  9.63s/it]
 63%|██████▎   | 24104/37963 [57:51:31<34:37:22,  8.99s/it]
 63%|██████▎   | 24105/37963 [57:51:39<32:58:37,  8.57s/it]
 63%|██████▎   | 24106/37963 [57:51:46<31:45:25,  8.25s/it]
 64%|██████▎   | 24107/37963 [57:51:54<30:50:01,  8.01s/it]
 64%|██████▎   | 24108/37963 [57:52:01<30:00:30,  7.80s/it]
 64%|██████▎   | 24109/37963 [57:52:15<37:06:04,  9.64s/it]
 64%|██████▎   | 24110/37963 [57:52:23<34:31:19,  8.97s/it]
                                                           
{'loss': '0.1316', 'grad_norm': '2.888', 'learning_rate': '6.209e-06', 'epoch': '0.6351'}

 64%|██████▎   | 24110/37963 [57:52:23<34:31:19,  8.97s/it]
 64%|██████▎   | 24111/37963 [57:52:30<32:41:16,  8.50s/it]
 64%|██████▎   | 24112/37963 [57:52:38<31:43:04,  8.24s/it]
 64%|██████▎   | 24113/37963 [57:52:45<30:53:04,  8.03s/it]
 64%|██████▎   | 24114/37963 [57:52:53<30:20:25,  7.89s/it]
 64%|██████▎   | 24115/37963 [57:53:00<29:46:40,  7.74s/it]
 64%|██████▎   | 24116/37963 [57:53:08<29:27:52,  7.66s/it]
 64%|██████▎   | 24117/37963 [57:53:15<29:12:57,  7.60s/it]
 64%|██████▎   | 24118/37963 [57:53:22<29:03:18,  7.55s/it]
 64%|██████▎   | 24119/37963 [57:53:30<28:59:22,  7.54s/it]
 64%|██████▎   | 24120/37963 [57:53:37<28:57:14,  7.53s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '3.701', 'learning_rate': '6.201e-06', 'epoch': '0.6354'}

 64%|██████▎   | 24120/37963 [57:53:37<28:57:14,  7.53s/it]
 64%|██████▎   | 24121/37963 [57:53:51<36:16:58,  9.44s/it]
 64%|██████▎   | 24122/37963 [57:54:05<41:30:26, 10.80s/it]
 64%|██████▎   | 24123/37963 [57:54:13<37:52:11,  9.85s/it]
 64%|██████▎   | 24124/37963 [57:54:20<35:02:35,  9.12s/it]
 64%|██████▎   | 24125/37963 [57:54:28<33:14:03,  8.65s/it]
 64%|██████▎   | 24126/37963 [57:54:35<31:35:23,  8.22s/it]
 64%|██████▎   | 24127/37963 [57:54:43<30:56:23,  8.05s/it]
 64%|██████▎   | 24128/37963 [57:54:50<30:14:47,  7.87s/it]
 64%|██████▎   | 24129/37963 [57:54:58<29:45:01,  7.74s/it]
 64%|██████▎   | 24130/37963 [57:55:05<29:28:12,  7.67s/it]
                                                           
{'loss': '0.1304', 'grad_norm': '1.193', 'learning_rate': '6.193e-06', 'epoch': '0.6356'}

 64%|██████▎   | 24130/37963 [57:55:05<29:28:12,  7.67s/it]
 64%|██████▎   | 24131/37963 [57:55:13<29:20:13,  7.64s/it]
 64%|██████▎   | 24132/37963 [57:55:20<29:08:45,  7.59s/it]
 64%|██████▎   | 24133/37963 [57:55:34<36:24:07,  9.48s/it]
 64%|██████▎   | 24134/37963 [57:55:42<34:11:28,  8.90s/it]
 64%|██████▎   | 24135/37963 [57:55:49<32:20:59,  8.42s/it]
 64%|██████▎   | 24136/37963 [57:55:57<31:21:34,  8.16s/it]
 64%|██████▎   | 24137/37963 [57:56:04<30:26:51,  7.93s/it]
 64%|██████▎   | 24138/37963 [57:56:11<29:51:47,  7.78s/it]
 64%|██████▎   | 24139/37963 [57:56:19<29:33:23,  7.70s/it]
 64%|██████▎   | 24140/37963 [57:56:27<29:30:34,  7.69s/it]
                                                           
{'loss': '0.1364', 'grad_norm': '1.516', 'learning_rate': '6.185e-06', 'epoch': '0.6359'}

 64%|██████▎   | 24140/37963 [57:56:27<29:30:34,  7.69s/it]
 64%|██████▎   | 24141/37963 [57:56:41<36:48:38,  9.59s/it]
 64%|██████▎   | 24142/37963 [57:56:48<34:32:46,  9.00s/it]
 64%|██████▎   | 24143/37963 [57:56:56<33:02:04,  8.61s/it]
 64%|██████▎   | 24144/37963 [57:57:03<31:49:07,  8.29s/it]
 64%|██████▎   | 24145/37963 [57:57:24<45:31:29, 11.86s/it]
 64%|██████▎   | 24146/37963 [57:57:31<40:38:19, 10.59s/it]
 64%|██████▎   | 24147/37963 [57:57:39<37:05:35,  9.67s/it]
 64%|██████▎   | 24148/37963 [57:57:46<34:27:53,  8.98s/it]
 64%|██████▎   | 24149/37963 [57:57:54<32:50:18,  8.56s/it]
 64%|██████▎   | 24150/37963 [57:58:01<31:38:16,  8.25s/it]
                                                           
{'loss': '0.1237', 'grad_norm': '2.84', 'learning_rate': '6.177e-06', 'epoch': '0.6361'}

 64%|██████▎   | 24150/37963 [57:58:01<31:38:16,  8.25s/it]
 64%|██████▎   | 24151/37963 [57:58:09<30:39:45,  7.99s/it]
 64%|██████▎   | 24152/37963 [57:58:23<37:34:25,  9.79s/it]
 64%|██████▎   | 24153/37963 [57:58:30<34:56:48,  9.11s/it]
 64%|██████▎   | 24154/37963 [57:58:37<32:42:21,  8.53s/it]
 64%|██████▎   | 24155/37963 [57:58:51<38:55:47, 10.15s/it]
 64%|██████▎   | 24156/37963 [57:58:59<36:02:29,  9.40s/it]
 64%|██████▎   | 24157/37963 [57:59:06<33:51:15,  8.83s/it]
 64%|██████▎   | 24158/37963 [57:59:14<32:08:27,  8.38s/it]
 64%|██████▎   | 24159/37963 [57:59:21<31:14:23,  8.15s/it]
 64%|██████▎   | 24160/37963 [57:59:29<30:36:41,  7.98s/it]
                                                           
{'loss': '0.133', 'grad_norm': '1.344', 'learning_rate': '6.169e-06', 'epoch': '0.6364'}

 64%|██████▎   | 24160/37963 [57:59:29<30:36:41,  7.98s/it]
 64%|██████▎   | 24161/37963 [57:59:36<30:03:45,  7.84s/it]
 64%|██████▎   | 24162/37963 [57:59:44<29:43:16,  7.75s/it]
 64%|██████▎   | 24163/37963 [57:59:51<29:24:02,  7.67s/it]
 64%|██████▎   | 24164/37963 [57:59:59<29:18:48,  7.65s/it]
 64%|██████▎   | 24165/37963 [58:00:07<29:16:02,  7.64s/it]
 64%|██████▎   | 24166/37963 [58:00:14<29:07:14,  7.60s/it]
 64%|██████▎   | 24167/37963 [58:00:22<28:59:00,  7.56s/it]
 64%|██████▎   | 24168/37963 [58:00:29<29:15:58,  7.64s/it]
 64%|██████▎   | 24169/37963 [58:00:37<29:05:19,  7.59s/it]
 64%|██████▎   | 24170/37963 [58:00:45<29:12:19,  7.62s/it]
                                                           
{'loss': '0.1363', 'grad_norm': '4.186', 'learning_rate': '6.161e-06', 'epoch': '0.6367'}

 64%|██████▎   | 24170/37963 [58:00:45<29:12:19,  7.62s/it]
 64%|██████▎   | 24171/37963 [58:00:52<29:04:27,  7.59s/it]
 64%|██████▎   | 24172/37963 [58:01:00<29:05:35,  7.59s/it]
 64%|██████▎   | 24173/37963 [58:01:14<36:22:37,  9.50s/it]
 64%|██████▎   | 24174/37963 [58:01:21<34:08:07,  8.91s/it]
 64%|██████▎   | 24175/37963 [58:01:29<32:33:05,  8.50s/it]
 64%|██████▎   | 24176/37963 [58:01:43<38:49:49, 10.14s/it]
 64%|██████▎   | 24177/37963 [58:01:50<35:50:10,  9.36s/it]
 64%|██████▎   | 24178/37963 [58:01:58<33:45:20,  8.82s/it]
 64%|██████▎   | 24179/37963 [58:02:05<32:16:44,  8.43s/it]
 64%|██████▎   | 24180/37963 [58:02:13<31:14:16,  8.16s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.856', 'learning_rate': '6.153e-06', 'epoch': '0.6369'}

 64%|██████▎   | 24180/37963 [58:02:13<31:14:16,  8.16s/it]
 64%|██████▎   | 24181/37963 [58:02:20<30:28:43,  7.96s/it]
 64%|██████▎   | 24182/37963 [58:02:28<29:58:52,  7.83s/it]
 64%|██████▎   | 24183/37963 [58:02:35<29:39:31,  7.75s/it]
 64%|██████▎   | 24184/37963 [58:02:49<36:52:38,  9.63s/it]
 64%|██████▎   | 24185/37963 [58:02:57<34:26:36,  9.00s/it]
 64%|██████▎   | 24186/37963 [58:03:05<32:46:29,  8.56s/it]
 64%|██████▎   | 24187/37963 [58:03:12<31:34:37,  8.25s/it]
 64%|██████▎   | 24188/37963 [58:03:20<30:43:32,  8.03s/it]
 64%|██████▎   | 24189/37963 [58:03:27<30:08:00,  7.88s/it]
 64%|██████▎   | 24190/37963 [58:03:35<29:36:47,  7.74s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.864', 'learning_rate': '6.146e-06', 'epoch': '0.6372'}

 64%|██████▎   | 24190/37963 [58:03:35<29:36:47,  7.74s/it]
 64%|██████▎   | 24191/37963 [58:03:48<36:30:41,  9.54s/it]
 64%|██████▎   | 24192/37963 [58:03:56<34:14:13,  8.95s/it]
 64%|██████▎   | 24193/37963 [58:04:16<47:34:07, 12.44s/it]
 64%|██████▎   | 24194/37963 [58:04:24<41:59:03, 10.98s/it]
 64%|██████▎   | 24195/37963 [58:04:31<37:49:00,  9.89s/it]
 64%|██████▎   | 24196/37963 [58:04:39<34:59:11,  9.15s/it]
 64%|██████▎   | 24197/37963 [58:04:46<32:52:19,  8.60s/it]
 64%|██████▎   | 24198/37963 [58:04:53<31:25:24,  8.22s/it]
 64%|██████▎   | 24199/37963 [58:05:01<30:37:59,  8.01s/it]
 64%|██████▎   | 24200/37963 [58:05:08<29:58:39,  7.84s/it]
                                                           
{'loss': '0.1279', 'grad_norm': '2.587', 'learning_rate': '6.138e-06', 'epoch': '0.6375'}

 64%|██████▎   | 24200/37963 [58:05:08<29:58:39,  7.84s/it]
 64%|██████▎   | 24201/37963 [58:05:16<29:21:46,  7.68s/it]
 64%|██████▍   | 24202/37963 [58:05:23<29:10:33,  7.63s/it]
 64%|██████▍   | 24203/37963 [58:05:31<28:49:27,  7.54s/it]
 64%|██████▍   | 24204/37963 [58:05:44<35:54:44,  9.40s/it]
 64%|██████▍   | 24205/37963 [58:05:51<33:24:54,  8.74s/it]
 64%|██████▍   | 24206/37963 [58:05:59<31:59:33,  8.37s/it]
 64%|██████▍   | 24207/37963 [58:06:06<30:55:27,  8.09s/it]
 64%|██████▍   | 24208/37963 [58:06:20<37:15:40,  9.75s/it]
 64%|██████▍   | 24209/37963 [58:06:27<34:31:16,  9.04s/it]
 64%|██████▍   | 24210/37963 [58:06:35<32:44:55,  8.57s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '2.676', 'learning_rate': '6.13e-06', 'epoch': '0.6377'}

 64%|██████▍   | 24210/37963 [58:06:35<32:44:55,  8.57s/it]
 64%|██████▍   | 24211/37963 [58:06:43<31:39:40,  8.29s/it]
 64%|██████▍   | 24212/37963 [58:06:50<30:48:30,  8.07s/it]
 64%|██████▍   | 24213/37963 [58:06:57<30:02:13,  7.86s/it]
 64%|██████▍   | 24214/37963 [58:07:05<29:39:32,  7.77s/it]
 64%|██████▍   | 24215/37963 [58:07:13<29:25:53,  7.71s/it]
 64%|██████▍   | 24216/37963 [58:07:20<29:17:18,  7.67s/it]
 64%|██████▍   | 24217/37963 [58:07:28<29:09:55,  7.64s/it]
 64%|██████▍   | 24218/37963 [58:07:35<28:54:16,  7.57s/it]
 64%|██████▍   | 24219/37963 [58:07:43<29:02:40,  7.61s/it]
 64%|██████▍   | 24220/37963 [58:07:50<28:56:34,  7.58s/it]
                                                           
{'loss': '0.122', 'grad_norm': '2.213', 'learning_rate': '6.122e-06', 'epoch': '0.638'}

 64%|██████▍   | 24220/37963 [58:07:50<28:56:34,  7.58s/it]
 64%|██████▍   | 24221/37963 [58:08:04<36:21:00,  9.52s/it]
 64%|██████▍   | 24222/37963 [58:08:12<34:08:38,  8.95s/it]
 64%|██████▍   | 24223/37963 [58:08:19<32:27:01,  8.50s/it]
 64%|██████▍   | 24224/37963 [58:08:27<31:14:32,  8.19s/it]
 64%|██████▍   | 24225/37963 [58:08:34<30:27:50,  7.98s/it]
 64%|██████▍   | 24226/37963 [58:08:42<30:04:40,  7.88s/it]
 64%|██████▍   | 24227/37963 [58:08:56<36:57:07,  9.68s/it]
 64%|██████▍   | 24228/37963 [58:09:04<34:39:14,  9.08s/it]
 64%|██████▍   | 24229/37963 [58:09:11<32:30:33,  8.52s/it]
 64%|██████▍   | 24230/37963 [58:09:18<31:23:57,  8.23s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.662', 'learning_rate': '6.114e-06', 'epoch': '0.6383'}

 64%|██████▍   | 24230/37963 [58:09:18<31:23:57,  8.23s/it]
 64%|██████▍   | 24231/37963 [58:09:26<30:38:00,  8.03s/it]
 64%|██████▍   | 24232/37963 [58:09:33<30:03:06,  7.88s/it]
 64%|██████▍   | 24233/37963 [58:09:41<29:46:07,  7.81s/it]
 64%|██████▍   | 24234/37963 [58:09:55<36:41:54,  9.62s/it]
 64%|██████▍   | 24235/37963 [58:10:03<34:24:31,  9.02s/it]
 64%|██████▍   | 24236/37963 [58:10:10<32:39:37,  8.57s/it]
 64%|██████▍   | 24237/37963 [58:10:24<38:49:42, 10.18s/it]
 64%|██████▍   | 24238/37963 [58:10:32<35:45:43,  9.38s/it]
 64%|██████▍   | 24239/37963 [58:10:45<40:52:50, 10.72s/it]
 64%|██████▍   | 24240/37963 [58:10:53<37:21:51,  9.80s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '1.606', 'learning_rate': '6.106e-06', 'epoch': '0.6385'}

 64%|██████▍   | 24240/37963 [58:10:53<37:21:51,  9.80s/it]
 64%|██████▍   | 24241/37963 [58:11:00<34:33:04,  9.06s/it]
 64%|██████▍   | 24242/37963 [58:11:14<40:11:23, 10.54s/it]
 64%|██████▍   | 24243/37963 [58:11:22<36:32:00,  9.59s/it]
 64%|██████▍   | 24244/37963 [58:11:29<34:06:21,  8.95s/it]
 64%|██████▍   | 24245/37963 [58:11:37<32:28:38,  8.52s/it]
 64%|██████▍   | 24246/37963 [58:11:44<31:05:39,  8.16s/it]
 64%|██████▍   | 24247/37963 [58:11:52<30:21:59,  7.97s/it]
 64%|██████▍   | 24248/37963 [58:11:59<29:48:47,  7.83s/it]
 64%|██████▍   | 24249/37963 [58:12:07<29:34:01,  7.76s/it]
 64%|██████▍   | 24250/37963 [58:12:14<29:26:55,  7.73s/it]
                                                           
{'loss': '0.1373', 'grad_norm': '2.212', 'learning_rate': '6.098e-06', 'epoch': '0.6388'}

 64%|██████▍   | 24250/37963 [58:12:14<29:26:55,  7.73s/it]
 64%|██████▍   | 24251/37963 [58:12:22<29:11:15,  7.66s/it]
 64%|██████▍   | 24252/37963 [58:12:29<29:02:56,  7.63s/it]
 64%|██████▍   | 24253/37963 [58:12:37<28:51:31,  7.58s/it]
 64%|██████▍   | 24254/37963 [58:12:51<35:59:49,  9.45s/it]
 64%|██████▍   | 24255/37963 [58:12:58<33:51:44,  8.89s/it]
 64%|██████▍   | 24256/37963 [58:13:06<32:05:11,  8.43s/it]
 64%|██████▍   | 24257/37963 [58:13:13<31:08:16,  8.18s/it]
 64%|██████▍   | 24258/37963 [58:13:21<30:22:07,  7.98s/it]
 64%|██████▍   | 24259/37963 [58:13:35<37:27:22,  9.84s/it]
 64%|██████▍   | 24260/37963 [58:13:43<34:53:30,  9.17s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '1.131', 'learning_rate': '6.091e-06', 'epoch': '0.639'}

 64%|██████▍   | 24260/37963 [58:13:43<34:53:30,  9.17s/it]
 64%|██████▍   | 24261/37963 [58:13:50<32:59:48,  8.67s/it]
 64%|██████▍   | 24262/37963 [58:13:58<31:38:10,  8.31s/it]
 64%|██████▍   | 24263/37963 [58:14:05<30:43:21,  8.07s/it]
 64%|██████▍   | 24264/37963 [58:14:13<30:06:59,  7.91s/it]
 64%|██████▍   | 24265/37963 [58:14:20<29:24:17,  7.73s/it]
 64%|██████▍   | 24266/37963 [58:14:28<29:19:09,  7.71s/it]
 64%|██████▍   | 24267/37963 [58:14:35<29:04:00,  7.64s/it]
 64%|██████▍   | 24268/37963 [58:14:43<28:58:44,  7.62s/it]
 64%|██████▍   | 24269/37963 [58:14:50<28:56:48,  7.61s/it]
 64%|██████▍   | 24270/37963 [58:15:04<36:05:55,  9.49s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.808', 'learning_rate': '6.083e-06', 'epoch': '0.6393'}

 64%|██████▍   | 24270/37963 [58:15:04<36:05:55,  9.49s/it]
 64%|██████▍   | 24271/37963 [58:15:12<34:04:02,  8.96s/it]
 64%|██████▍   | 24272/37963 [58:15:19<32:28:18,  8.54s/it]
 64%|██████▍   | 24273/37963 [58:15:27<31:23:59,  8.26s/it]
 64%|██████▍   | 24274/37963 [58:15:34<30:31:34,  8.03s/it]
 64%|██████▍   | 24275/37963 [58:15:42<29:51:44,  7.85s/it]
 64%|██████▍   | 24276/37963 [58:15:50<29:46:54,  7.83s/it]
 64%|██████▍   | 24277/37963 [58:16:04<37:03:03,  9.75s/it]
 64%|██████▍   | 24278/37963 [58:16:11<34:34:53,  9.10s/it]
 64%|██████▍   | 24279/37963 [58:16:19<32:35:57,  8.58s/it]
 64%|██████▍   | 24280/37963 [58:16:26<31:26:37,  8.27s/it]
                                                           
{'loss': '0.1265', 'grad_norm': '1.99', 'learning_rate': '6.075e-06', 'epoch': '0.6396'}

 64%|██████▍   | 24280/37963 [58:16:26<31:26:37,  8.27s/it]
 64%|██████▍   | 24281/37963 [58:16:34<30:42:40,  8.08s/it]
 64%|██████▍   | 24282/37963 [58:16:48<37:22:54,  9.84s/it]
 64%|██████▍   | 24283/37963 [58:16:55<34:44:44,  9.14s/it]
 64%|██████▍   | 24284/37963 [58:17:03<32:41:45,  8.60s/it]
 64%|██████▍   | 24285/37963 [58:17:10<31:37:29,  8.32s/it]
 64%|██████▍   | 24286/37963 [58:17:18<30:40:05,  8.07s/it]
 64%|██████▍   | 24287/37963 [58:17:32<37:03:04,  9.75s/it]
 64%|██████▍   | 24288/37963 [58:17:46<41:57:50, 11.05s/it]
 64%|██████▍   | 24289/37963 [58:17:53<37:57:32,  9.99s/it]
 64%|██████▍   | 24290/37963 [58:18:01<35:10:34,  9.26s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '1.183', 'learning_rate': '6.067e-06', 'epoch': '0.6398'}

 64%|██████▍   | 24290/37963 [58:18:01<35:10:34,  9.26s/it]
 64%|██████▍   | 24291/37963 [58:18:08<33:15:36,  8.76s/it]
 64%|██████▍   | 24292/37963 [58:18:16<31:49:47,  8.38s/it]
 64%|██████▍   | 24293/37963 [58:18:23<30:49:25,  8.12s/it]
 64%|██████▍   | 24294/37963 [58:18:37<37:32:39,  9.89s/it]
 64%|██████▍   | 24295/37963 [58:18:45<34:56:31,  9.20s/it]
 64%|██████▍   | 24296/37963 [58:18:53<33:04:53,  8.71s/it]
 64%|██████▍   | 24297/37963 [58:19:00<31:28:57,  8.29s/it]
 64%|██████▍   | 24298/37963 [58:19:07<30:39:24,  8.08s/it]
 64%|██████▍   | 24299/37963 [58:19:15<30:12:54,  7.96s/it]
 64%|██████▍   | 24300/37963 [58:19:23<29:38:33,  7.81s/it]
                                                           
{'loss': '0.1247', 'grad_norm': '1.93', 'learning_rate': '6.059e-06', 'epoch': '0.6401'}

 64%|██████▍   | 24300/37963 [58:19:23<29:38:33,  7.81s/it]
 64%|██████▍   | 24301/37963 [58:19:30<29:17:36,  7.72s/it]
 64%|██████▍   | 24302/37963 [58:19:44<36:19:08,  9.57s/it]
 64%|██████▍   | 24303/37963 [58:19:52<33:59:05,  8.96s/it]
 64%|██████▍   | 24304/37963 [58:19:59<32:27:57,  8.56s/it]
 64%|██████▍   | 24305/37963 [58:20:07<31:19:07,  8.26s/it]
 64%|██████▍   | 24306/37963 [58:20:21<37:41:47,  9.94s/it]
 64%|██████▍   | 24307/37963 [58:20:28<34:54:35,  9.20s/it]
 64%|██████▍   | 24308/37963 [58:20:36<32:57:54,  8.69s/it]
 64%|██████▍   | 24309/37963 [58:20:43<31:39:54,  8.35s/it]
 64%|██████▍   | 24310/37963 [58:20:51<30:41:30,  8.09s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.483', 'learning_rate': '6.051e-06', 'epoch': '0.6404'}

 64%|██████▍   | 24310/37963 [58:20:51<30:41:30,  8.09s/it]
 64%|██████▍   | 24311/37963 [58:20:58<30:00:52,  7.91s/it]
 64%|██████▍   | 24312/37963 [58:21:06<29:30:48,  7.78s/it]
 64%|██████▍   | 24313/37963 [58:21:13<29:10:57,  7.70s/it]
 64%|██████▍   | 24314/37963 [58:21:20<28:50:42,  7.61s/it]
 64%|██████▍   | 24315/37963 [58:21:28<28:53:29,  7.62s/it]
 64%|██████▍   | 24316/37963 [58:21:36<28:45:54,  7.59s/it]
 64%|██████▍   | 24317/37963 [58:21:43<28:40:34,  7.57s/it]
 64%|██████▍   | 24318/37963 [58:21:57<36:08:51,  9.54s/it]
 64%|██████▍   | 24319/37963 [58:22:05<33:47:40,  8.92s/it]
 64%|██████▍   | 24320/37963 [58:22:12<32:08:24,  8.48s/it]
                                                           
{'loss': '0.1358', 'grad_norm': '1.502', 'learning_rate': '6.043e-06', 'epoch': '0.6406'}

 64%|██████▍   | 24320/37963 [58:22:12<32:08:24,  8.48s/it]
 64%|██████▍   | 24321/37963 [58:22:20<30:59:38,  8.18s/it]
 64%|██████▍   | 24322/37963 [58:22:27<30:28:33,  8.04s/it]
 64%|██████▍   | 24323/37963 [58:22:35<29:42:00,  7.84s/it]
 64%|██████▍   | 24324/37963 [58:22:42<29:21:14,  7.75s/it]
 64%|██████▍   | 24325/37963 [58:22:50<29:10:17,  7.70s/it]
 64%|██████▍   | 24326/37963 [58:22:57<28:31:27,  7.53s/it]
 64%|██████▍   | 24327/37963 [58:23:11<35:54:01,  9.48s/it]
 64%|██████▍   | 24328/37963 [58:23:19<33:41:41,  8.90s/it]
 64%|██████▍   | 24329/37963 [58:23:26<32:04:53,  8.47s/it]
 64%|██████▍   | 24330/37963 [58:23:34<31:09:40,  8.23s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '1.295', 'learning_rate': '6.036e-06', 'epoch': '0.6409'}

 64%|██████▍   | 24330/37963 [58:23:34<31:09:40,  8.23s/it]
 64%|██████▍   | 24331/37963 [58:23:41<30:30:08,  8.06s/it]
 64%|██████▍   | 24332/37963 [58:23:49<29:52:00,  7.89s/it]
 64%|██████▍   | 24333/37963 [58:23:56<29:30:17,  7.79s/it]
 64%|██████▍   | 24334/37963 [58:24:10<36:10:03,  9.55s/it]
 64%|██████▍   | 24335/37963 [58:24:18<33:57:45,  8.97s/it]
 64%|██████▍   | 24336/37963 [58:24:31<39:13:05, 10.36s/it]
 64%|██████▍   | 24337/37963 [58:24:39<35:54:29,  9.49s/it]
 64%|██████▍   | 24338/37963 [58:24:46<33:45:45,  8.92s/it]
 64%|██████▍   | 24339/37963 [58:24:54<31:50:45,  8.41s/it]
 64%|██████▍   | 24340/37963 [58:25:08<38:08:24, 10.08s/it]
                                                           
{'loss': '0.1388', 'grad_norm': '2.287', 'learning_rate': '6.028e-06', 'epoch': '0.6412'}

 64%|██████▍   | 24340/37963 [58:25:08<38:08:24, 10.08s/it]
 64%|██████▍   | 24341/37963 [58:25:15<35:23:55,  9.36s/it]
 64%|██████▍   | 24342/37963 [58:25:29<40:25:13, 10.68s/it]
 64%|██████▍   | 24343/37963 [58:25:37<36:56:32,  9.76s/it]
 64%|██████▍   | 24344/37963 [58:25:44<34:23:43,  9.09s/it]
 64%|██████▍   | 24345/37963 [58:25:51<32:13:22,  8.52s/it]
 64%|██████▍   | 24346/37963 [58:25:59<30:46:26,  8.14s/it]
 64%|██████▍   | 24347/37963 [58:26:06<29:59:43,  7.93s/it]
 64%|██████▍   | 24348/37963 [58:26:14<29:30:59,  7.80s/it]
 64%|██████▍   | 24349/37963 [58:26:21<29:03:02,  7.68s/it]
 64%|██████▍   | 24350/37963 [58:26:29<28:54:39,  7.65s/it]
                                                           
{'loss': '0.1374', 'grad_norm': '1.398', 'learning_rate': '6.02e-06', 'epoch': '0.6414'}

 64%|██████▍   | 24350/37963 [58:26:29<28:54:39,  7.65s/it]
 64%|██████▍   | 24351/37963 [58:26:36<28:32:41,  7.55s/it]
 64%|██████▍   | 24352/37963 [58:26:50<35:39:53,  9.43s/it]
 64%|██████▍   | 24353/37963 [58:26:57<33:32:36,  8.87s/it]
 64%|██████▍   | 24354/37963 [58:27:05<32:11:37,  8.52s/it]
 64%|██████▍   | 24355/37963 [58:27:12<31:05:13,  8.22s/it]
 64%|██████▍   | 24356/37963 [58:27:20<30:21:35,  8.03s/it]
 64%|██████▍   | 24357/37963 [58:27:34<36:56:33,  9.77s/it]
 64%|██████▍   | 24358/37963 [58:27:41<34:29:30,  9.13s/it]
 64%|██████▍   | 24359/37963 [58:27:49<32:43:32,  8.66s/it]
 64%|██████▍   | 24360/37963 [58:27:57<31:24:15,  8.31s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.579', 'learning_rate': '6.012e-06', 'epoch': '0.6417'}

 64%|██████▍   | 24360/37963 [58:27:57<31:24:15,  8.31s/it]
 64%|██████▍   | 24361/37963 [58:28:04<30:04:22,  7.96s/it]
 64%|██████▍   | 24362/37963 [58:28:11<29:38:18,  7.84s/it]
 64%|██████▍   | 24363/37963 [58:28:19<29:19:54,  7.76s/it]
 64%|██████▍   | 24364/37963 [58:28:26<29:03:14,  7.69s/it]
 64%|██████▍   | 24365/37963 [58:28:40<36:13:50,  9.59s/it]
 64%|██████▍   | 24366/37963 [58:28:48<33:56:10,  8.99s/it]
 64%|██████▍   | 24367/37963 [58:28:55<32:05:15,  8.50s/it]
 64%|██████▍   | 24368/37963 [58:29:03<31:04:25,  8.23s/it]
 64%|██████▍   | 24369/37963 [58:29:11<30:22:09,  8.04s/it]
 64%|██████▍   | 24370/37963 [58:29:18<29:52:01,  7.91s/it]
                                                           
{'loss': '0.1136', 'grad_norm': '3.041', 'learning_rate': '6.004e-06', 'epoch': '0.6419'}

 64%|██████▍   | 24370/37963 [58:29:18<29:52:01,  7.91s/it]
 64%|██████▍   | 24371/37963 [58:29:26<29:27:01,  7.80s/it]
 64%|██████▍   | 24372/37963 [58:29:33<29:07:35,  7.72s/it]
 64%|██████▍   | 24373/37963 [58:29:41<29:01:56,  7.69s/it]
 64%|██████▍   | 24374/37963 [58:29:48<28:38:30,  7.59s/it]
 64%|██████▍   | 24375/37963 [58:30:02<35:58:23,  9.53s/it]
 64%|██████▍   | 24376/37963 [58:30:10<33:52:05,  8.97s/it]
 64%|██████▍   | 24377/37963 [58:30:17<32:08:40,  8.52s/it]
 64%|██████▍   | 24378/37963 [58:30:31<38:25:46, 10.18s/it]
 64%|██████▍   | 24379/37963 [58:30:39<35:31:00,  9.41s/it]
 64%|██████▍   | 24380/37963 [58:30:53<40:52:28, 10.83s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.602', 'learning_rate': '5.997e-06', 'epoch': '0.6422'}

 64%|██████▍   | 24380/37963 [58:30:53<40:52:28, 10.83s/it]
 64%|██████▍   | 24381/37963 [58:31:01<37:02:29,  9.82s/it]
 64%|██████▍   | 24382/37963 [58:31:08<34:28:45,  9.14s/it]
 64%|██████▍   | 24383/37963 [58:31:16<32:35:13,  8.64s/it]
 64%|██████▍   | 24384/37963 [58:31:23<31:25:42,  8.33s/it]
 64%|██████▍   | 24385/37963 [58:31:31<30:16:18,  8.03s/it]
 64%|██████▍   | 24386/37963 [58:31:38<29:42:31,  7.88s/it]
 64%|██████▍   | 24387/37963 [58:31:46<29:16:14,  7.76s/it]
 64%|██████▍   | 24388/37963 [58:31:53<29:02:03,  7.70s/it]
 64%|██████▍   | 24389/37963 [58:32:01<28:43:34,  7.62s/it]
 64%|██████▍   | 24390/37963 [58:32:15<36:09:19,  9.59s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.126', 'learning_rate': '5.989e-06', 'epoch': '0.6425'}

 64%|██████▍   | 24390/37963 [58:32:15<36:09:19,  9.59s/it]
 64%|██████▍   | 24391/37963 [58:32:22<33:56:39,  9.00s/it]
 64%|██████▍   | 24392/37963 [58:32:30<32:18:12,  8.57s/it]
 64%|██████▍   | 24393/37963 [58:32:37<31:04:10,  8.24s/it]
 64%|██████▍   | 24394/37963 [58:32:52<37:52:38, 10.05s/it]
 64%|██████▍   | 24395/37963 [58:32:59<35:02:50,  9.30s/it]
 64%|██████▍   | 24396/37963 [58:33:07<33:02:22,  8.77s/it]
 64%|██████▍   | 24397/37963 [58:33:14<31:36:42,  8.39s/it]
 64%|██████▍   | 24398/37963 [58:33:22<30:42:17,  8.15s/it]
 64%|██████▍   | 24399/37963 [58:33:29<30:01:06,  7.97s/it]
 64%|██████▍   | 24400/37963 [58:33:37<29:34:54,  7.85s/it]
                                                           
{'loss': '0.1307', 'grad_norm': '1.273', 'learning_rate': '5.981e-06', 'epoch': '0.6427'}

 64%|██████▍   | 24400/37963 [58:33:37<29:34:54,  7.85s/it]
 64%|██████▍   | 24401/37963 [58:33:44<28:53:07,  7.67s/it]
 64%|██████▍   | 24402/37963 [58:33:58<35:33:34,  9.44s/it]
 64%|██████▍   | 24403/37963 [58:34:12<40:31:03, 10.76s/it]
 64%|██████▍   | 24404/37963 [58:34:19<36:48:48,  9.77s/it]
 64%|██████▍   | 24405/37963 [58:34:27<34:15:21,  9.10s/it]
 64%|██████▍   | 24406/37963 [58:34:34<32:22:47,  8.60s/it]
 64%|██████▍   | 24407/37963 [58:34:42<31:11:26,  8.28s/it]
 64%|██████▍   | 24408/37963 [58:34:55<37:23:00,  9.93s/it]
 64%|██████▍   | 24409/37963 [58:35:03<34:42:41,  9.22s/it]
 64%|██████▍   | 24410/37963 [58:35:11<32:51:28,  8.73s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.927', 'learning_rate': '5.973e-06', 'epoch': '0.643'}

 64%|██████▍   | 24410/37963 [58:35:11<32:51:28,  8.73s/it]
 64%|██████▍   | 24411/37963 [58:35:18<31:31:44,  8.38s/it]
 64%|██████▍   | 24412/37963 [58:35:26<30:40:53,  8.15s/it]
 64%|██████▍   | 24413/37963 [58:35:33<29:42:32,  7.89s/it]
 64%|██████▍   | 24414/37963 [58:35:41<29:15:42,  7.77s/it]
 64%|██████▍   | 24415/37963 [58:35:48<28:58:09,  7.70s/it]
 64%|██████▍   | 24416/37963 [58:35:56<28:45:45,  7.64s/it]
 64%|██████▍   | 24417/37963 [58:36:03<28:26:18,  7.56s/it]
 64%|██████▍   | 24418/37963 [58:36:11<28:26:03,  7.56s/it]
 64%|██████▍   | 24419/37963 [58:36:18<28:09:44,  7.49s/it]
 64%|██████▍   | 24420/37963 [58:36:25<28:08:56,  7.48s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '3.966', 'learning_rate': '5.965e-06', 'epoch': '0.6433'}

 64%|██████▍   | 24420/37963 [58:36:25<28:08:56,  7.48s/it]
 64%|██████▍   | 24421/37963 [58:36:32<27:43:50,  7.37s/it]
 64%|██████▍   | 24422/37963 [58:36:40<27:56:42,  7.43s/it]
 64%|██████▍   | 24423/37963 [58:36:54<35:03:25,  9.32s/it]
 64%|██████▍   | 24424/37963 [58:37:08<40:31:41, 10.78s/it]
 64%|██████▍   | 24425/37963 [58:37:16<37:08:16,  9.88s/it]
 64%|██████▍   | 24426/37963 [58:37:23<34:26:18,  9.16s/it]
 64%|██████▍   | 24427/37963 [58:37:30<32:20:12,  8.60s/it]
 64%|██████▍   | 24428/37963 [58:37:44<38:08:55, 10.15s/it]
 64%|██████▍   | 24429/37963 [58:37:52<35:14:01,  9.37s/it]
 64%|██████▍   | 24430/37963 [58:37:59<32:46:00,  8.72s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '2.717', 'learning_rate': '5.957e-06', 'epoch': '0.6435'}

 64%|██████▍   | 24430/37963 [58:37:59<32:46:00,  8.72s/it]
 64%|██████▍   | 24431/37963 [58:38:06<31:26:03,  8.36s/it]
 64%|██████▍   | 24432/37963 [58:38:14<30:27:05,  8.10s/it]
 64%|██████▍   | 24433/37963 [58:38:22<29:52:50,  7.95s/it]
 64%|██████▍   | 24434/37963 [58:38:36<37:00:49,  9.85s/it]
 64%|██████▍   | 24435/37963 [58:38:43<34:28:13,  9.17s/it]
 64%|██████▍   | 24436/37963 [58:38:51<32:43:15,  8.71s/it]
 64%|██████▍   | 24437/37963 [58:38:59<31:22:03,  8.35s/it]
 64%|██████▍   | 24438/37963 [58:39:06<30:09:20,  8.03s/it]
 64%|██████▍   | 24439/37963 [58:39:13<29:23:08,  7.82s/it]
 64%|██████▍   | 24440/37963 [58:39:27<35:49:26,  9.54s/it]
                                                           
{'loss': '0.1237', 'grad_norm': '2.02', 'learning_rate': '5.95e-06', 'epoch': '0.6438'}

 64%|██████▍   | 24440/37963 [58:39:27<35:49:26,  9.54s/it]
 64%|██████▍   | 24441/37963 [58:39:34<33:33:42,  8.94s/it]
 64%|██████▍   | 24442/37963 [58:39:42<31:59:20,  8.52s/it]
 64%|██████▍   | 24443/37963 [58:39:49<30:52:55,  8.22s/it]
 64%|██████▍   | 24444/37963 [58:39:57<29:54:17,  7.96s/it]
 64%|██████▍   | 24445/37963 [58:40:04<29:25:30,  7.84s/it]
 64%|██████▍   | 24446/37963 [58:40:12<29:07:33,  7.76s/it]
 64%|██████▍   | 24447/37963 [58:40:19<28:49:21,  7.68s/it]
 64%|██████▍   | 24448/37963 [58:40:27<28:36:58,  7.62s/it]
 64%|██████▍   | 24449/37963 [58:40:34<28:31:36,  7.60s/it]
 64%|██████▍   | 24450/37963 [58:40:42<28:25:22,  7.57s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '2.639', 'learning_rate': '5.942e-06', 'epoch': '0.6441'}

 64%|██████▍   | 24450/37963 [58:40:42<28:25:22,  7.57s/it]
 64%|██████▍   | 24451/37963 [58:40:56<35:45:01,  9.52s/it]
 64%|██████▍   | 24452/37963 [58:41:10<40:39:17, 10.83s/it]
 64%|██████▍   | 24453/37963 [58:41:17<36:54:21,  9.83s/it]
 64%|██████▍   | 24454/37963 [58:41:31<41:26:52, 11.05s/it]
 64%|██████▍   | 24455/37963 [58:41:39<37:37:59, 10.03s/it]
 64%|██████▍   | 24456/37963 [58:41:46<34:29:21,  9.19s/it]
 64%|██████▍   | 24457/37963 [58:41:54<32:34:38,  8.68s/it]
 64%|██████▍   | 24458/37963 [58:42:01<31:21:24,  8.36s/it]
 64%|██████▍   | 24459/37963 [58:42:09<30:23:19,  8.10s/it]
 64%|██████▍   | 24460/37963 [58:42:16<29:25:20,  7.84s/it]
                                                           
{'loss': '0.134', 'grad_norm': '1.816', 'learning_rate': '5.934e-06', 'epoch': '0.6443'}

 64%|██████▍   | 24460/37963 [58:42:16<29:25:20,  7.84s/it]
 64%|██████▍   | 24461/37963 [58:42:23<29:02:17,  7.74s/it]
 64%|██████▍   | 24462/37963 [58:42:31<28:35:12,  7.62s/it]
 64%|██████▍   | 24463/37963 [58:42:38<28:29:49,  7.60s/it]
 64%|██████▍   | 24464/37963 [58:42:46<28:25:16,  7.58s/it]
 64%|██████▍   | 24465/37963 [58:42:53<28:23:57,  7.57s/it]
 64%|██████▍   | 24466/37963 [58:43:01<28:19:49,  7.56s/it]
 64%|██████▍   | 24467/37963 [58:43:09<28:31:43,  7.61s/it]
 64%|██████▍   | 24468/37963 [58:43:16<28:33:54,  7.62s/it]
 64%|██████▍   | 24469/37963 [58:43:23<28:03:29,  7.49s/it]
 64%|██████▍   | 24470/37963 [58:43:37<35:22:23,  9.44s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '1.918', 'learning_rate': '5.926e-06', 'epoch': '0.6446'}

 64%|██████▍   | 24470/37963 [58:43:37<35:22:23,  9.44s/it]
 64%|██████▍   | 24471/37963 [58:43:45<33:04:55,  8.83s/it]
 64%|██████▍   | 24472/37963 [58:43:59<39:05:43, 10.43s/it]
 64%|██████▍   | 24473/37963 [58:44:07<35:56:50,  9.59s/it]
 64%|██████▍   | 24474/37963 [58:44:14<33:37:34,  8.97s/it]
 64%|██████▍   | 24475/37963 [58:44:22<31:51:49,  8.50s/it]
 64%|██████▍   | 24476/37963 [58:44:36<38:07:45, 10.18s/it]
 64%|██████▍   | 24477/37963 [58:44:43<35:06:56,  9.37s/it]
 64%|██████▍   | 24478/37963 [58:44:51<32:57:50,  8.80s/it]
 64%|██████▍   | 24479/37963 [58:44:58<31:30:27,  8.41s/it]
 64%|██████▍   | 24480/37963 [58:45:06<30:29:31,  8.14s/it]
                                                           
{'loss': '0.131', 'grad_norm': '2.166', 'learning_rate': '5.919e-06', 'epoch': '0.6448'}

 64%|██████▍   | 24480/37963 [58:45:06<30:29:31,  8.14s/it]
 64%|██████▍   | 24481/37963 [58:45:13<29:37:24,  7.91s/it]
 64%|██████▍   | 24482/37963 [58:45:27<36:15:47,  9.68s/it]
 64%|██████▍   | 24483/37963 [58:45:34<33:27:35,  8.94s/it]
 64%|██████▍   | 24484/37963 [58:45:42<31:53:43,  8.52s/it]
 64%|██████▍   | 24485/37963 [58:45:49<30:55:25,  8.26s/it]
 64%|██████▍   | 24486/37963 [58:45:57<29:59:44,  8.01s/it]
 65%|██████▍   | 24487/37963 [58:46:04<29:35:43,  7.91s/it]
 65%|██████▍   | 24488/37963 [58:46:12<29:21:00,  7.84s/it]
 65%|██████▍   | 24489/37963 [58:46:20<29:03:43,  7.76s/it]
 65%|██████▍   | 24490/37963 [58:46:27<28:37:20,  7.65s/it]
                                                           
{'loss': '0.1461', 'grad_norm': '2.659', 'learning_rate': '5.911e-06', 'epoch': '0.6451'}

 65%|██████▍   | 24490/37963 [58:46:27<28:37:20,  7.65s/it]
 65%|██████▍   | 24491/37963 [58:46:34<28:20:11,  7.57s/it]
 65%|██████▍   | 24492/37963 [58:46:42<28:18:55,  7.57s/it]
 65%|██████▍   | 24493/37963 [58:46:49<28:10:54,  7.53s/it]
 65%|██████▍   | 24494/37963 [58:47:03<35:17:06,  9.43s/it]
 65%|██████▍   | 24495/37963 [58:47:11<33:09:26,  8.86s/it]
 65%|██████▍   | 24496/37963 [58:47:18<31:34:05,  8.44s/it]
 65%|██████▍   | 24497/37963 [58:47:26<30:36:33,  8.18s/it]
 65%|██████▍   | 24498/37963 [58:47:33<29:58:57,  8.02s/it]
 65%|██████▍   | 24499/37963 [58:47:41<29:26:09,  7.87s/it]
 65%|██████▍   | 24500/37963 [58:47:55<36:28:11,  9.75s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.819', 'learning_rate': '5.903e-06', 'epoch': '0.6454'}

 65%|██████▍   | 24500/37963 [58:47:55<36:28:11,  9.75s/it]
 65%|██████▍   | 24501/37963 [58:48:02<33:44:06,  9.02s/it]
 65%|██████▍   | 24502/37963 [58:48:16<39:20:00, 10.52s/it]
 65%|██████▍   | 24503/37963 [58:48:24<36:00:40,  9.63s/it]
 65%|██████▍   | 24504/37963 [58:48:38<40:50:23, 10.92s/it]
 65%|██████▍   | 24505/37963 [58:48:45<37:00:01,  9.90s/it]
 65%|██████▍   | 24506/37963 [58:48:53<34:17:55,  9.18s/it]
 65%|██████▍   | 24507/37963 [58:49:00<32:25:09,  8.67s/it]
 65%|██████▍   | 24508/37963 [58:49:08<31:20:05,  8.38s/it]
 65%|██████▍   | 24509/37963 [58:49:16<30:20:55,  8.12s/it]
 65%|██████▍   | 24510/37963 [58:49:23<29:17:17,  7.84s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '1.427', 'learning_rate': '5.895e-06', 'epoch': '0.6456'}

 65%|██████▍   | 24510/37963 [58:49:23<29:17:17,  7.84s/it]
 65%|██████▍   | 24511/37963 [58:49:30<28:54:47,  7.74s/it]
 65%|██████▍   | 24512/37963 [58:49:38<28:27:32,  7.62s/it]
 65%|██████▍   | 24513/37963 [58:49:45<28:22:35,  7.60s/it]
 65%|██████▍   | 24514/37963 [58:49:53<28:35:35,  7.65s/it]
 65%|██████▍   | 24515/37963 [58:50:01<28:25:41,  7.61s/it]
 65%|██████▍   | 24516/37963 [58:50:15<35:35:38,  9.53s/it]
 65%|██████▍   | 24517/37963 [58:50:22<33:29:24,  8.97s/it]
 65%|██████▍   | 24518/37963 [58:50:30<31:44:24,  8.50s/it]
 65%|██████▍   | 24519/37963 [58:50:37<30:41:29,  8.22s/it]
 65%|██████▍   | 24520/37963 [58:50:45<29:52:49,  8.00s/it]
                                                           
{'loss': '0.1527', 'grad_norm': '2.227', 'learning_rate': '5.887e-06', 'epoch': '0.6459'}

 65%|██████▍   | 24520/37963 [58:50:45<29:52:49,  8.00s/it]
 65%|██████▍   | 24521/37963 [58:50:52<29:21:04,  7.86s/it]
 65%|██████▍   | 24522/37963 [58:51:00<28:59:21,  7.76s/it]
 65%|██████▍   | 24523/37963 [58:51:07<28:41:23,  7.68s/it]
 65%|██████▍   | 24524/37963 [58:51:28<42:52:09, 11.48s/it]
 65%|██████▍   | 24525/37963 [58:51:35<38:24:53, 10.29s/it]
 65%|██████▍   | 24526/37963 [58:51:43<35:16:58,  9.45s/it]
 65%|██████▍   | 24527/37963 [58:51:57<40:16:03, 10.79s/it]
 65%|██████▍   | 24528/37963 [58:52:04<36:39:49,  9.82s/it]
 65%|██████▍   | 24529/37963 [58:52:12<33:57:34,  9.10s/it]
 65%|██████▍   | 24530/37963 [58:52:19<31:54:10,  8.55s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.403', 'learning_rate': '5.88e-06', 'epoch': '0.6462'}

 65%|██████▍   | 24530/37963 [58:52:19<31:54:10,  8.55s/it]
 65%|██████▍   | 24531/37963 [58:52:26<30:29:48,  8.17s/it]
 65%|██████▍   | 24532/37963 [58:52:34<29:47:11,  7.98s/it]
 65%|██████▍   | 24533/37963 [58:52:41<29:17:46,  7.85s/it]
 65%|██████▍   | 24534/37963 [58:52:49<28:55:17,  7.75s/it]
 65%|██████▍   | 24535/37963 [58:52:56<28:11:00,  7.56s/it]
 65%|██████▍   | 24536/37963 [58:53:03<28:14:34,  7.57s/it]
 65%|██████▍   | 24537/37963 [58:53:11<27:55:00,  7.49s/it]
 65%|██████▍   | 24538/37963 [58:53:25<35:12:28,  9.44s/it]
 65%|██████▍   | 24539/37963 [58:53:32<33:05:02,  8.87s/it]
 65%|██████▍   | 24540/37963 [58:53:40<31:36:02,  8.48s/it]
                                                           
{'loss': '0.14', 'grad_norm': '2.23', 'learning_rate': '5.872e-06', 'epoch': '0.6464'}

 65%|██████▍   | 24540/37963 [58:53:40<31:36:02,  8.48s/it]
 65%|██████▍   | 24541/37963 [58:53:47<30:39:59,  8.23s/it]
 65%|██████▍   | 24542/37963 [58:53:55<29:53:48,  8.02s/it]
 65%|██████▍   | 24543/37963 [58:54:02<29:15:47,  7.85s/it]
 65%|██████▍   | 24544/37963 [58:54:10<28:29:18,  7.64s/it]
 65%|██████▍   | 24545/37963 [58:54:17<28:22:10,  7.61s/it]
 65%|██████▍   | 24546/37963 [58:54:24<28:04:46,  7.53s/it]
 65%|██████▍   | 24547/37963 [58:54:32<28:02:58,  7.53s/it]
 65%|██████▍   | 24548/37963 [58:54:39<28:01:07,  7.52s/it]
 65%|██████▍   | 24549/37963 [58:54:53<35:15:59,  9.46s/it]
 65%|██████▍   | 24550/37963 [58:55:07<40:14:11, 10.80s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '3.062', 'learning_rate': '5.864e-06', 'epoch': '0.6467'}

 65%|██████▍   | 24550/37963 [58:55:07<40:14:11, 10.80s/it]
 65%|██████▍   | 24551/37963 [58:55:15<36:37:40,  9.83s/it]
 65%|██████▍   | 24552/37963 [58:55:23<34:05:27,  9.15s/it]
 65%|██████▍   | 24553/37963 [58:55:30<32:11:15,  8.64s/it]
 65%|██████▍   | 24554/37963 [58:55:37<30:56:13,  8.31s/it]
 65%|██████▍   | 24555/37963 [58:55:45<30:10:26,  8.10s/it]
 65%|██████▍   | 24556/37963 [58:55:53<29:41:24,  7.97s/it]
 65%|██████▍   | 24557/37963 [58:56:00<29:13:31,  7.85s/it]
 65%|██████▍   | 24558/37963 [58:56:14<35:53:21,  9.64s/it]
 65%|██████▍   | 24559/37963 [58:56:22<33:42:12,  9.05s/it]
 65%|██████▍   | 24560/37963 [58:56:36<39:31:48, 10.62s/it]
                                                           
{'loss': '0.1204', 'grad_norm': '1.269', 'learning_rate': '5.856e-06', 'epoch': '0.6469'}

 65%|██████▍   | 24560/37963 [58:56:36<39:31:48, 10.62s/it]
 65%|██████▍   | 24561/37963 [58:56:44<36:05:20,  9.69s/it]
 65%|██████▍   | 24562/37963 [58:56:51<33:46:54,  9.08s/it]
 65%|██████▍   | 24563/37963 [58:56:59<31:55:49,  8.58s/it]
 65%|██████▍   | 24564/37963 [58:57:06<30:26:26,  8.18s/it]
 65%|██████▍   | 24565/37963 [58:57:14<29:45:54,  8.00s/it]
 65%|██████▍   | 24566/37963 [58:57:21<29:22:49,  7.89s/it]
 65%|██████▍   | 24567/37963 [58:57:29<28:58:07,  7.78s/it]
 65%|██████▍   | 24568/37963 [58:57:36<28:48:08,  7.74s/it]
 65%|██████▍   | 24569/37963 [58:57:44<28:40:23,  7.71s/it]
 65%|██████▍   | 24570/37963 [58:57:51<28:27:12,  7.65s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.664', 'learning_rate': '5.849e-06', 'epoch': '0.6472'}

 65%|██████▍   | 24570/37963 [58:57:51<28:27:12,  7.65s/it]
 65%|██████▍   | 24571/37963 [58:58:12<42:29:51, 11.42s/it]
 65%|██████▍   | 24572/37963 [58:58:26<45:36:53, 12.26s/it]
 65%|██████▍   | 24573/37963 [58:58:34<40:22:15, 10.85s/it]
 65%|██████▍   | 24574/37963 [58:58:41<36:39:49,  9.86s/it]
 65%|██████▍   | 24575/37963 [58:58:48<33:56:11,  9.13s/it]
 65%|██████▍   | 24576/37963 [58:58:56<32:07:01,  8.64s/it]
 65%|██████▍   | 24577/37963 [58:59:03<30:40:19,  8.25s/it]
 65%|██████▍   | 24578/37963 [58:59:11<29:53:39,  8.04s/it]
 65%|██████▍   | 24579/37963 [58:59:18<29:08:35,  7.84s/it]
 65%|██████▍   | 24580/37963 [58:59:26<28:48:03,  7.75s/it]
                                                           
{'loss': '0.1237', 'grad_norm': '1.749', 'learning_rate': '5.841e-06', 'epoch': '0.6475'}

 65%|██████▍   | 24580/37963 [58:59:26<28:48:03,  7.75s/it]
 65%|██████▍   | 24581/37963 [58:59:33<28:31:45,  7.67s/it]
 65%|██████▍   | 24582/37963 [58:59:41<28:30:14,  7.67s/it]
 65%|██████▍   | 24583/37963 [58:59:48<28:21:01,  7.63s/it]
 65%|██████▍   | 24584/37963 [58:59:56<28:13:02,  7.59s/it]
 65%|██████▍   | 24585/37963 [59:00:03<27:50:52,  7.49s/it]
 65%|██████▍   | 24586/37963 [59:00:17<34:34:01,  9.30s/it]
 65%|██████▍   | 24587/37963 [59:00:24<32:34:26,  8.77s/it]
 65%|██████▍   | 24588/37963 [59:00:32<31:09:03,  8.38s/it]
 65%|██████▍   | 24589/37963 [59:00:39<30:15:10,  8.14s/it]
 65%|██████▍   | 24590/37963 [59:00:47<29:34:55,  7.96s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.169', 'learning_rate': '5.833e-06', 'epoch': '0.6477'}

 65%|██████▍   | 24590/37963 [59:00:47<29:34:55,  7.96s/it]
 65%|██████▍   | 24591/37963 [59:00:54<29:04:12,  7.83s/it]
 65%|██████▍   | 24592/37963 [59:01:02<28:51:49,  7.77s/it]
 65%|██████▍   | 24593/37963 [59:01:09<28:20:00,  7.63s/it]
 65%|██████▍   | 24594/37963 [59:01:23<35:30:17,  9.56s/it]
 65%|██████▍   | 24595/37963 [59:01:31<33:18:41,  8.97s/it]
 65%|██████▍   | 24596/37963 [59:01:39<31:43:41,  8.55s/it]
 65%|██████▍   | 24597/37963 [59:01:46<30:37:47,  8.25s/it]
 65%|██████▍   | 24598/37963 [59:02:00<36:56:10,  9.95s/it]
 65%|██████▍   | 24599/37963 [59:02:08<34:32:46,  9.31s/it]
 65%|██████▍   | 24600/37963 [59:02:15<32:37:25,  8.79s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.809', 'learning_rate': '5.825e-06', 'epoch': '0.648'}

 65%|██████▍   | 24600/37963 [59:02:15<32:37:25,  8.79s/it]
 65%|██████▍   | 24601/37963 [59:02:23<31:02:07,  8.36s/it]
 65%|██████▍   | 24602/37963 [59:02:30<30:11:22,  8.13s/it]
 65%|██████▍   | 24603/37963 [59:02:38<29:28:34,  7.94s/it]
 65%|██████▍   | 24604/37963 [59:02:46<29:08:38,  7.85s/it]
 65%|██████▍   | 24605/37963 [59:02:53<28:48:33,  7.76s/it]
 65%|██████▍   | 24606/37963 [59:03:01<28:33:36,  7.70s/it]
 65%|██████▍   | 24607/37963 [59:03:14<35:08:56,  9.47s/it]
 65%|██████▍   | 24608/37963 [59:03:28<40:08:02, 10.82s/it]
 65%|██████▍   | 24609/37963 [59:03:36<36:14:42,  9.77s/it]
 65%|██████▍   | 24610/37963 [59:03:43<33:25:57,  9.01s/it]
                                                           
{'loss': '0.1294', 'grad_norm': '2.501', 'learning_rate': '5.818e-06', 'epoch': '0.6483'}

 65%|██████▍   | 24610/37963 [59:03:43<33:25:57,  9.01s/it]
 65%|██████▍   | 24611/37963 [59:03:50<31:45:09,  8.56s/it]
 65%|██████▍   | 24612/37963 [59:03:58<30:40:38,  8.27s/it]
 65%|██████▍   | 24613/37963 [59:04:05<29:49:24,  8.04s/it]
 65%|██████▍   | 24614/37963 [59:04:13<29:16:52,  7.90s/it]
 65%|██████▍   | 24615/37963 [59:04:27<36:02:36,  9.72s/it]
 65%|██████▍   | 24616/37963 [59:04:35<33:45:43,  9.11s/it]
 65%|██████▍   | 24617/37963 [59:04:42<32:04:27,  8.65s/it]
 65%|██████▍   | 24618/37963 [59:04:50<30:56:45,  8.35s/it]
 65%|██████▍   | 24619/37963 [59:05:04<37:21:07, 10.08s/it]
 65%|██████▍   | 24620/37963 [59:05:11<34:29:35,  9.31s/it]
                                                           
{'loss': '0.13', 'grad_norm': '2.074', 'learning_rate': '5.81e-06', 'epoch': '0.6485'}

 65%|██████▍   | 24620/37963 [59:05:11<34:29:35,  9.31s/it]
 65%|██████▍   | 24621/37963 [59:05:25<39:37:17, 10.69s/it]
 65%|██████▍   | 24622/37963 [59:05:33<36:14:29,  9.78s/it]
 65%|██████▍   | 24623/37963 [59:05:41<33:43:24,  9.10s/it]
 65%|██████▍   | 24624/37963 [59:05:48<31:44:17,  8.57s/it]
 65%|██████▍   | 24625/37963 [59:05:56<30:45:08,  8.30s/it]
 65%|██████▍   | 24626/37963 [59:06:03<29:41:28,  8.01s/it]
 65%|██████▍   | 24627/37963 [59:06:10<29:13:45,  7.89s/it]
 65%|██████▍   | 24628/37963 [59:06:18<29:00:18,  7.83s/it]
 65%|██████▍   | 24629/37963 [59:06:25<28:22:34,  7.66s/it]
 65%|██████▍   | 24630/37963 [59:06:33<28:23:21,  7.67s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '2.586', 'learning_rate': '5.802e-06', 'epoch': '0.6488'}

 65%|██████▍   | 24630/37963 [59:06:33<28:23:21,  7.67s/it]
 65%|██████▍   | 24631/37963 [59:06:41<28:12:08,  7.62s/it]
 65%|██████▍   | 24632/37963 [59:06:48<28:14:34,  7.63s/it]
 65%|██████▍   | 24633/37963 [59:06:56<28:07:28,  7.60s/it]
 65%|██████▍   | 24634/37963 [59:07:09<34:47:08,  9.40s/it]
 65%|██████▍   | 24635/37963 [59:07:17<32:52:19,  8.88s/it]
 65%|██████▍   | 24636/37963 [59:07:25<31:20:51,  8.47s/it]
 65%|██████▍   | 24637/37963 [59:07:32<30:22:48,  8.21s/it]
 65%|██████▍   | 24638/37963 [59:07:40<29:41:13,  8.02s/it]
 65%|██████▍   | 24639/37963 [59:07:47<29:07:31,  7.87s/it]
 65%|██████▍   | 24640/37963 [59:07:55<28:43:06,  7.76s/it]
                                                           
{'loss': '0.1281', 'grad_norm': '2.253', 'learning_rate': '5.794e-06', 'epoch': '0.6491'}

 65%|██████▍   | 24640/37963 [59:07:55<28:43:06,  7.76s/it]
 65%|██████▍   | 24641/37963 [59:08:02<28:19:13,  7.65s/it]
 65%|██████▍   | 24642/37963 [59:08:09<27:56:22,  7.55s/it]
 65%|██████▍   | 24643/37963 [59:08:17<27:31:36,  7.44s/it]
 65%|██████▍   | 24644/37963 [59:08:37<42:12:27, 11.41s/it]
 65%|██████▍   | 24645/37963 [59:08:45<37:54:56, 10.25s/it]
 65%|██████▍   | 24646/37963 [59:08:52<34:59:29,  9.46s/it]
 65%|██████▍   | 24647/37963 [59:09:00<32:44:26,  8.85s/it]
 65%|██████▍   | 24648/37963 [59:09:07<31:02:21,  8.39s/it]
 65%|██████▍   | 24649/37963 [59:09:15<30:03:34,  8.13s/it]
 65%|██████▍   | 24650/37963 [59:09:22<29:11:35,  7.89s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '2.338', 'learning_rate': '5.787e-06', 'epoch': '0.6493'}

 65%|██████▍   | 24650/37963 [59:09:22<29:11:35,  7.89s/it]
 65%|██████▍   | 24651/37963 [59:09:30<28:45:41,  7.78s/it]
 65%|██████▍   | 24652/37963 [59:09:37<28:28:36,  7.70s/it]
 65%|██████▍   | 24653/37963 [59:09:45<28:19:42,  7.66s/it]
 65%|██████▍   | 24654/37963 [59:09:52<27:51:56,  7.54s/it]
 65%|██████▍   | 24655/37963 [59:09:59<27:48:41,  7.52s/it]
 65%|██████▍   | 24656/37963 [59:10:07<27:35:28,  7.46s/it]
 65%|██████▍   | 24657/37963 [59:10:14<27:37:39,  7.47s/it]
 65%|██████▍   | 24658/37963 [59:10:28<34:33:16,  9.35s/it]
 65%|██████▍   | 24659/37963 [59:10:42<39:57:44, 10.81s/it]
 65%|██████▍   | 24660/37963 [59:10:50<36:12:24,  9.80s/it]
                                                           
{'loss': '0.1231', 'grad_norm': '1.705', 'learning_rate': '5.779e-06', 'epoch': '0.6496'}

 65%|██████▍   | 24660/37963 [59:10:50<36:12:24,  9.80s/it]
 65%|██████▍   | 24661/37963 [59:11:04<40:48:28, 11.04s/it]
 65%|██████▍   | 24662/37963 [59:11:11<37:06:31, 10.04s/it]
 65%|██████▍   | 24663/37963 [59:11:19<34:24:47,  9.31s/it]
 65%|██████▍   | 24664/37963 [59:11:26<32:23:52,  8.77s/it]
 65%|██████▍   | 24665/37963 [59:11:34<31:11:18,  8.44s/it]
 65%|██████▍   | 24666/37963 [59:11:42<30:25:17,  8.24s/it]
 65%|██████▍   | 24667/37963 [59:11:49<29:37:59,  8.02s/it]
 65%|██████▍   | 24668/37963 [59:11:57<29:02:25,  7.86s/it]
 65%|██████▍   | 24669/37963 [59:12:04<28:31:45,  7.73s/it]
 65%|██████▍   | 24670/37963 [59:12:25<42:35:02, 11.53s/it]
                                                           
{'loss': '0.1322', 'grad_norm': '1.412', 'learning_rate': '5.771e-06', 'epoch': '0.6498'}

 65%|██████▍   | 24670/37963 [59:12:25<42:35:02, 11.53s/it]
 65%|██████▍   | 24671/37963 [59:12:32<38:14:32, 10.36s/it]
 65%|██████▍   | 24672/37963 [59:12:40<35:06:44,  9.51s/it]
 65%|██████▍   | 24673/37963 [59:12:47<32:47:57,  8.88s/it]
 65%|██████▍   | 24674/37963 [59:12:55<31:17:09,  8.48s/it]
 65%|██████▍   | 24675/37963 [59:13:02<30:12:17,  8.18s/it]
 65%|██████▌   | 24676/37963 [59:13:10<29:22:48,  7.96s/it]
 65%|██████▌   | 24677/37963 [59:13:17<28:57:35,  7.85s/it]
 65%|██████▌   | 24678/37963 [59:13:25<28:33:24,  7.74s/it]
 65%|██████▌   | 24679/37963 [59:13:32<28:23:29,  7.69s/it]
 65%|██████▌   | 24680/37963 [59:13:40<28:04:44,  7.61s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.148', 'learning_rate': '5.763e-06', 'epoch': '0.6501'}

 65%|██████▌   | 24680/37963 [59:13:40<28:04:44,  7.61s/it]
 65%|██████▌   | 24681/37963 [59:13:47<28:01:38,  7.60s/it]
 65%|██████▌   | 24682/37963 [59:13:55<28:07:20,  7.62s/it]
 65%|██████▌   | 24683/37963 [59:14:03<28:00:10,  7.59s/it]
 65%|██████▌   | 24684/37963 [59:14:10<27:59:41,  7.59s/it]
 65%|██████▌   | 24685/37963 [59:14:24<35:06:30,  9.52s/it]
 65%|██████▌   | 24686/37963 [59:14:32<32:56:44,  8.93s/it]
 65%|██████▌   | 24687/37963 [59:14:39<31:18:28,  8.49s/it]
 65%|██████▌   | 24688/37963 [59:14:47<30:01:35,  8.14s/it]
 65%|██████▌   | 24689/37963 [59:14:54<29:20:34,  7.96s/it]
 65%|██████▌   | 24690/37963 [59:15:02<28:48:11,  7.81s/it]
                                                           
{'loss': '0.125', 'grad_norm': '1.717', 'learning_rate': '5.756e-06', 'epoch': '0.6504'}

 65%|██████▌   | 24690/37963 [59:15:02<28:48:11,  7.81s/it]
 65%|██████▌   | 24691/37963 [59:15:09<28:11:17,  7.65s/it]
 65%|██████▌   | 24692/37963 [59:15:16<27:48:23,  7.54s/it]
 65%|██████▌   | 24693/37963 [59:15:23<27:33:46,  7.48s/it]
 65%|██████▌   | 24694/37963 [59:15:37<34:35:39,  9.39s/it]
 65%|██████▌   | 24695/37963 [59:15:51<39:36:47, 10.75s/it]
 65%|██████▌   | 24696/37963 [59:15:59<36:07:47,  9.80s/it]
 65%|██████▌   | 24697/37963 [59:16:06<33:19:39,  9.04s/it]
 65%|██████▌   | 24698/37963 [59:16:13<31:26:10,  8.53s/it]
 65%|██████▌   | 24699/37963 [59:16:21<30:21:40,  8.24s/it]
 65%|██████▌   | 24700/37963 [59:16:28<29:36:06,  8.03s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '3.365', 'learning_rate': '5.748e-06', 'epoch': '0.6506'}

 65%|██████▌   | 24700/37963 [59:16:28<29:36:06,  8.03s/it]
 65%|██████▌   | 24701/37963 [59:16:36<29:05:21,  7.90s/it]
 65%|██████▌   | 24702/37963 [59:16:44<28:47:41,  7.82s/it]
 65%|██████▌   | 24703/37963 [59:16:58<35:27:13,  9.63s/it]
 65%|██████▌   | 24704/37963 [59:17:12<40:21:51, 10.96s/it]
 65%|██████▌   | 24705/37963 [59:17:19<36:35:46,  9.94s/it]
 65%|██████▌   | 24706/37963 [59:17:27<33:59:45,  9.23s/it]
 65%|██████▌   | 24707/37963 [59:17:34<32:02:05,  8.70s/it]
 65%|██████▌   | 24708/37963 [59:17:42<30:49:46,  8.37s/it]
 65%|██████▌   | 24709/37963 [59:17:56<36:59:29, 10.05s/it]
 65%|██████▌   | 24710/37963 [59:18:03<34:14:21,  9.30s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '2.639', 'learning_rate': '5.74e-06', 'epoch': '0.6509'}

 65%|██████▌   | 24710/37963 [59:18:03<34:14:21,  9.30s/it]
 65%|██████▌   | 24711/37963 [59:18:11<32:17:11,  8.77s/it]
 65%|██████▌   | 24712/37963 [59:18:18<30:55:39,  8.40s/it]
 65%|██████▌   | 24713/37963 [59:18:26<29:44:54,  8.08s/it]
 65%|██████▌   | 24714/37963 [59:18:33<29:06:55,  7.91s/it]
 65%|██████▌   | 24715/37963 [59:18:47<35:49:38,  9.74s/it]
 65%|██████▌   | 24716/37963 [59:18:55<33:26:25,  9.09s/it]
 65%|██████▌   | 24717/37963 [59:19:02<31:40:15,  8.61s/it]
 65%|██████▌   | 24718/37963 [59:19:10<30:13:06,  8.21s/it]
 65%|██████▌   | 24719/37963 [59:19:17<29:09:09,  7.92s/it]
 65%|██████▌   | 24720/37963 [59:19:24<28:39:32,  7.79s/it]
                                                           
{'loss': '0.1285', 'grad_norm': '1.393', 'learning_rate': '5.732e-06', 'epoch': '0.6512'}

 65%|██████▌   | 24720/37963 [59:19:24<28:39:32,  7.79s/it]
 65%|██████▌   | 24721/37963 [59:19:38<35:32:05,  9.66s/it]
 65%|██████▌   | 24722/37963 [59:19:46<33:22:23,  9.07s/it]
 65%|██████▌   | 24723/37963 [59:19:54<31:50:13,  8.66s/it]
 65%|██████▌   | 24724/37963 [59:20:01<30:28:22,  8.29s/it]
 65%|██████▌   | 24725/37963 [59:20:09<29:45:41,  8.09s/it]
 65%|██████▌   | 24726/37963 [59:20:16<29:14:16,  7.95s/it]
 65%|██████▌   | 24727/37963 [59:20:24<28:51:25,  7.85s/it]
 65%|██████▌   | 24728/37963 [59:20:32<28:30:06,  7.75s/it]
 65%|██████▌   | 24729/37963 [59:20:39<27:48:25,  7.56s/it]
 65%|██████▌   | 24730/37963 [59:20:46<27:42:29,  7.54s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '3.405', 'learning_rate': '5.725e-06', 'epoch': '0.6514'}

 65%|██████▌   | 24730/37963 [59:20:46<27:42:29,  7.54s/it]
 65%|██████▌   | 24731/37963 [59:20:54<27:29:42,  7.48s/it]
 65%|██████▌   | 24732/37963 [59:21:01<27:34:13,  7.50s/it]
 65%|██████▌   | 24733/37963 [59:21:09<27:33:31,  7.50s/it]
 65%|██████▌   | 24734/37963 [59:21:16<27:18:12,  7.43s/it]
 65%|██████▌   | 24735/37963 [59:21:23<27:06:42,  7.38s/it]
 65%|██████▌   | 24736/37963 [59:21:31<27:21:57,  7.45s/it]
 65%|██████▌   | 24737/37963 [59:21:38<27:25:54,  7.47s/it]
 65%|██████▌   | 24738/37963 [59:21:46<27:37:52,  7.52s/it]
 65%|██████▌   | 24739/37963 [59:21:53<27:13:05,  7.41s/it]
 65%|██████▌   | 24740/37963 [59:22:07<34:20:26,  9.35s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '2.179', 'learning_rate': '5.717e-06', 'epoch': '0.6517'}

 65%|██████▌   | 24740/37963 [59:22:07<34:20:26,  9.35s/it]
 65%|██████▌   | 24741/37963 [59:22:14<32:17:10,  8.79s/it]
 65%|██████▌   | 24742/37963 [59:22:22<30:52:13,  8.41s/it]
 65%|██████▌   | 24743/37963 [59:22:35<36:30:02,  9.94s/it]
 65%|██████▌   | 24744/37963 [59:22:50<41:11:24, 11.22s/it]
 65%|██████▌   | 24745/37963 [59:22:57<36:59:52, 10.08s/it]
 65%|██████▌   | 24746/37963 [59:23:05<34:11:01,  9.31s/it]
 65%|██████▌   | 24747/37963 [59:23:19<39:34:14, 10.78s/it]
 65%|██████▌   | 24748/37963 [59:23:26<36:03:07,  9.82s/it]
 65%|██████▌   | 24749/37963 [59:23:34<33:10:51,  9.04s/it]
 65%|██████▌   | 24750/37963 [59:23:41<31:30:26,  8.58s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '1.331', 'learning_rate': '5.709e-06', 'epoch': '0.652'}

 65%|██████▌   | 24750/37963 [59:23:41<31:30:26,  8.58s/it]
 65%|██████▌   | 24751/37963 [59:23:49<30:28:08,  8.30s/it]
 65%|██████▌   | 24752/37963 [59:23:56<29:32:36,  8.05s/it]
 65%|██████▌   | 24753/37963 [59:24:04<28:57:10,  7.89s/it]
 65%|██████▌   | 24754/37963 [59:24:18<35:51:41,  9.77s/it]
 65%|██████▌   | 24755/37963 [59:24:25<33:22:56,  9.10s/it]
 65%|██████▌   | 24756/37963 [59:24:33<31:40:48,  8.64s/it]
 65%|██████▌   | 24757/37963 [59:24:40<30:17:38,  8.26s/it]
 65%|██████▌   | 24758/37963 [59:24:48<29:26:38,  8.03s/it]
 65%|██████▌   | 24759/37963 [59:25:02<35:50:27,  9.77s/it]
 65%|██████▌   | 24760/37963 [59:25:09<33:21:01,  9.09s/it]
                                                           
{'loss': '0.1387', 'grad_norm': '1.409', 'learning_rate': '5.702e-06', 'epoch': '0.6522'}

 65%|██████▌   | 24760/37963 [59:25:09<33:21:01,  9.09s/it]
 65%|██████▌   | 24761/37963 [59:25:17<31:44:20,  8.65s/it]
 65%|██████▌   | 24762/37963 [59:25:24<30:32:34,  8.33s/it]
 65%|██████▌   | 24763/37963 [59:25:38<36:49:30, 10.04s/it]
 65%|██████▌   | 24764/37963 [59:25:46<33:56:43,  9.26s/it]
 65%|██████▌   | 24765/37963 [59:25:53<32:04:12,  8.75s/it]
 65%|██████▌   | 24766/37963 [59:26:01<30:42:14,  8.38s/it]
 65%|██████▌   | 24767/37963 [59:26:08<29:41:13,  8.10s/it]
 65%|██████▌   | 24768/37963 [59:26:23<36:27:14,  9.95s/it]
 65%|██████▌   | 24769/37963 [59:26:30<33:49:21,  9.23s/it]
 65%|██████▌   | 24770/37963 [59:26:38<31:53:12,  8.70s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '1.408', 'learning_rate': '5.694e-06', 'epoch': '0.6525'}

 65%|██████▌   | 24770/37963 [59:26:38<31:53:12,  8.70s/it]
 65%|██████▌   | 24771/37963 [59:26:45<30:36:08,  8.35s/it]
 65%|██████▌   | 24772/37963 [59:26:53<29:40:16,  8.10s/it]
 65%|██████▌   | 24773/37963 [59:27:00<28:42:24,  7.84s/it]
 65%|██████▌   | 24774/37963 [59:27:07<28:23:50,  7.75s/it]
 65%|██████▌   | 24775/37963 [59:27:15<28:13:34,  7.71s/it]
 65%|██████▌   | 24776/37963 [59:27:23<28:15:30,  7.71s/it]
 65%|██████▌   | 24777/37963 [59:27:30<28:01:56,  7.65s/it]
 65%|██████▌   | 24778/37963 [59:27:38<27:54:51,  7.62s/it]
 65%|██████▌   | 24779/37963 [59:27:45<27:49:29,  7.60s/it]
 65%|██████▌   | 24780/37963 [59:27:53<27:50:57,  7.61s/it]
                                                           
{'loss': '0.1223', 'grad_norm': '1.421', 'learning_rate': '5.686e-06', 'epoch': '0.6527'}

 65%|██████▌   | 24780/37963 [59:27:53<27:50:57,  7.61s/it]
 65%|██████▌   | 24781/37963 [59:28:00<27:36:57,  7.54s/it]
 65%|██████▌   | 24782/37963 [59:28:08<27:41:20,  7.56s/it]
 65%|██████▌   | 24783/37963 [59:28:16<27:37:22,  7.54s/it]
 65%|██████▌   | 24784/37963 [59:28:30<34:48:59,  9.51s/it]
 65%|██████▌   | 24785/37963 [59:28:37<32:48:03,  8.96s/it]
 65%|██████▌   | 24786/37963 [59:28:45<31:24:41,  8.58s/it]
 65%|██████▌   | 24787/37963 [59:28:52<30:13:02,  8.26s/it]
 65%|██████▌   | 24788/37963 [59:29:00<29:24:47,  8.04s/it]
 65%|██████▌   | 24789/37963 [59:29:07<28:39:43,  7.83s/it]
 65%|██████▌   | 24790/37963 [59:29:22<35:36:42,  9.73s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '5.363', 'learning_rate': '5.679e-06', 'epoch': '0.653'}

 65%|██████▌   | 24790/37963 [59:29:22<35:36:42,  9.73s/it]
 65%|██████▌   | 24791/37963 [59:29:29<33:08:02,  9.06s/it]
 65%|██████▌   | 24792/37963 [59:29:37<31:33:26,  8.63s/it]
 65%|██████▌   | 24793/37963 [59:29:51<37:35:11, 10.27s/it]
 65%|██████▌   | 24794/37963 [59:29:58<34:37:31,  9.47s/it]
 65%|██████▌   | 24795/37963 [59:30:06<32:31:23,  8.89s/it]
 65%|██████▌   | 24796/37963 [59:30:14<31:08:32,  8.51s/it]
 65%|██████▌   | 24797/37963 [59:30:21<30:03:55,  8.22s/it]
 65%|██████▌   | 24798/37963 [59:30:28<29:02:31,  7.94s/it]
 65%|██████▌   | 24799/37963 [59:30:36<28:45:57,  7.87s/it]
 65%|██████▌   | 24800/37963 [59:30:50<35:15:53,  9.64s/it]
                                                           
{'loss': '0.1288', 'grad_norm': '2.559', 'learning_rate': '5.671e-06', 'epoch': '0.6533'}

 65%|██████▌   | 24800/37963 [59:30:50<35:15:53,  9.64s/it]
 65%|██████▌   | 24801/37963 [59:31:04<39:59:19, 10.94s/it]
 65%|██████▌   | 24802/37963 [59:31:11<36:14:19,  9.91s/it]
 65%|██████▌   | 24803/37963 [59:31:19<33:36:48,  9.20s/it]
 65%|██████▌   | 24804/37963 [59:31:26<31:41:43,  8.67s/it]
 65%|██████▌   | 24805/37963 [59:31:34<30:26:40,  8.33s/it]
 65%|██████▌   | 24806/37963 [59:31:48<36:23:58,  9.96s/it]
 65%|██████▌   | 24807/37963 [59:32:01<40:44:51, 11.15s/it]
 65%|██████▌   | 24808/37963 [59:32:09<36:48:27, 10.07s/it]
 65%|██████▌   | 24809/37963 [59:32:17<34:08:36,  9.34s/it]
 65%|██████▌   | 24810/37963 [59:32:24<32:24:22,  8.87s/it]
                                                           
{'loss': '0.131', 'grad_norm': '1.034', 'learning_rate': '5.663e-06', 'epoch': '0.6535'}

 65%|██████▌   | 24810/37963 [59:32:24<32:24:22,  8.87s/it]
 65%|██████▌   | 24811/37963 [59:32:32<31:04:29,  8.51s/it]
 65%|██████▌   | 24812/37963 [59:32:40<29:54:28,  8.19s/it]
 65%|██████▌   | 24813/37963 [59:32:47<29:20:18,  8.03s/it]
 65%|██████▌   | 24814/37963 [59:32:55<28:47:45,  7.88s/it]
 65%|██████▌   | 24815/37963 [59:33:09<35:40:48,  9.77s/it]
 65%|██████▌   | 24816/37963 [59:33:17<33:20:26,  9.13s/it]
 65%|██████▌   | 24817/37963 [59:33:24<31:44:53,  8.69s/it]
 65%|██████▌   | 24818/37963 [59:33:32<30:33:35,  8.37s/it]
 65%|██████▌   | 24819/37963 [59:33:40<29:47:10,  8.16s/it]
 65%|██████▌   | 24820/37963 [59:33:47<29:16:42,  8.02s/it]
                                                           
{'loss': '0.1433', 'grad_norm': '1.15', 'learning_rate': '5.655e-06', 'epoch': '0.6538'}

 65%|██████▌   | 24820/37963 [59:33:47<29:16:42,  8.02s/it]
 65%|██████▌   | 24821/37963 [59:33:55<28:51:52,  7.91s/it]
 65%|██████▌   | 24822/37963 [59:34:02<28:32:50,  7.82s/it]
 65%|██████▌   | 24823/37963 [59:34:10<28:19:22,  7.76s/it]
 65%|██████▌   | 24824/37963 [59:34:18<28:14:27,  7.74s/it]
 65%|██████▌   | 24825/37963 [59:34:25<27:50:24,  7.63s/it]
 65%|██████▌   | 24826/37963 [59:34:33<27:47:11,  7.61s/it]
 65%|██████▌   | 24827/37963 [59:34:40<27:39:13,  7.58s/it]
 65%|██████▌   | 24828/37963 [59:34:48<27:41:15,  7.59s/it]
 65%|██████▌   | 24829/37963 [59:34:56<27:49:15,  7.63s/it]
 65%|██████▌   | 24830/37963 [59:35:03<27:51:50,  7.64s/it]
                                                           
{'loss': '0.1248', 'grad_norm': '2.604', 'learning_rate': '5.648e-06', 'epoch': '0.6541'}

 65%|██████▌   | 24830/37963 [59:35:03<27:51:50,  7.64s/it]
 65%|██████▌   | 24831/37963 [59:35:11<27:37:37,  7.57s/it]
 65%|██████▌   | 24832/37963 [59:35:18<27:42:14,  7.60s/it]
 65%|██████▌   | 24833/37963 [59:35:32<34:36:15,  9.49s/it]
 65%|██████▌   | 24834/37963 [59:35:40<32:40:50,  8.96s/it]
 65%|██████▌   | 24835/37963 [59:35:48<31:13:40,  8.56s/it]
 65%|██████▌   | 24836/37963 [59:35:55<30:18:23,  8.31s/it]
 65%|██████▌   | 24837/37963 [59:36:03<29:28:41,  8.08s/it]
 65%|██████▌   | 24838/37963 [59:36:17<36:04:53,  9.90s/it]
 65%|██████▌   | 24839/37963 [59:36:24<33:22:50,  9.16s/it]
 65%|██████▌   | 24840/37963 [59:36:32<31:41:34,  8.69s/it]
                                                           
{'loss': '0.1298', 'grad_norm': '1.798', 'learning_rate': '5.64e-06', 'epoch': '0.6543'}

 65%|██████▌   | 24840/37963 [59:36:32<31:41:34,  8.69s/it]
 65%|██████▌   | 24841/37963 [59:36:40<30:28:00,  8.36s/it]
 65%|██████▌   | 24842/37963 [59:36:47<29:48:01,  8.18s/it]
 65%|██████▌   | 24843/37963 [59:36:55<29:14:00,  8.02s/it]
 65%|██████▌   | 24844/37963 [59:37:03<28:52:16,  7.92s/it]
 65%|██████▌   | 24845/37963 [59:37:17<36:21:12,  9.98s/it]
 65%|██████▌   | 24846/37963 [59:37:25<33:54:55,  9.31s/it]
 65%|██████▌   | 24847/37963 [59:37:47<47:10:12, 12.95s/it]
 65%|██████▌   | 24848/37963 [59:37:54<41:18:18, 11.34s/it]
 65%|██████▌   | 24849/37963 [59:38:02<36:55:17, 10.14s/it]
 65%|██████▌   | 24850/37963 [59:38:09<34:13:49,  9.40s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '1.097', 'learning_rate': '5.632e-06', 'epoch': '0.6546'}

 65%|██████▌   | 24850/37963 [59:38:09<34:13:49,  9.40s/it]
 65%|██████▌   | 24851/37963 [59:38:17<32:22:32,  8.89s/it]
 65%|██████▌   | 24852/37963 [59:38:25<31:01:59,  8.52s/it]
 65%|██████▌   | 24853/37963 [59:38:32<30:03:26,  8.25s/it]
 65%|██████▌   | 24854/37963 [59:38:47<37:06:55, 10.19s/it]
 65%|██████▌   | 24855/37963 [59:38:54<34:09:09,  9.38s/it]
 65%|██████▌   | 24856/37963 [59:39:02<32:07:59,  8.83s/it]
 65%|██████▌   | 24857/37963 [59:39:10<30:49:08,  8.47s/it]
 65%|██████▌   | 24858/37963 [59:39:17<29:55:38,  8.22s/it]
 65%|██████▌   | 24859/37963 [59:39:31<36:07:51,  9.93s/it]
 65%|██████▌   | 24860/37963 [59:39:39<33:40:26,  9.25s/it]
                                                           
{'loss': '0.1246', 'grad_norm': '1.936', 'learning_rate': '5.625e-06', 'epoch': '0.6549'}

 65%|██████▌   | 24860/37963 [59:39:39<33:40:26,  9.25s/it]
 65%|██████▌   | 24861/37963 [59:39:46<31:43:18,  8.72s/it]
 65%|██████▌   | 24862/37963 [59:39:54<30:16:26,  8.32s/it]
 65%|██████▌   | 24863/37963 [59:40:01<29:28:43,  8.10s/it]
 65%|██████▌   | 24864/37963 [59:40:09<28:54:39,  7.95s/it]
 65%|██████▌   | 24865/37963 [59:40:24<36:49:27, 10.12s/it]
 66%|██████▌   | 24866/37963 [59:40:32<34:15:52,  9.42s/it]
 66%|██████▌   | 24867/37963 [59:40:39<32:14:40,  8.86s/it]
 66%|██████▌   | 24868/37963 [59:40:47<30:44:24,  8.45s/it]
 66%|██████▌   | 24869/37963 [59:40:55<30:02:30,  8.26s/it]
 66%|██████▌   | 24870/37963 [59:41:02<29:08:14,  8.01s/it]
                                                           
{'loss': '0.1291', 'grad_norm': '1.334', 'learning_rate': '5.617e-06', 'epoch': '0.6551'}

 66%|██████▌   | 24870/37963 [59:41:02<29:08:14,  8.01s/it]
 66%|██████▌   | 24871/37963 [59:41:10<28:42:04,  7.89s/it]
 66%|██████▌   | 24872/37963 [59:41:17<28:19:12,  7.79s/it]
 66%|██████▌   | 24873/37963 [59:41:25<28:10:01,  7.75s/it]
 66%|██████▌   | 24874/37963 [59:41:33<28:08:52,  7.74s/it]
 66%|██████▌   | 24875/37963 [59:41:40<27:46:28,  7.64s/it]
 66%|██████▌   | 24876/37963 [59:41:48<27:43:57,  7.63s/it]
 66%|██████▌   | 24877/37963 [59:41:55<27:47:26,  7.65s/it]
 66%|██████▌   | 24878/37963 [59:42:03<27:51:44,  7.67s/it]
 66%|██████▌   | 24879/37963 [59:42:11<27:56:47,  7.69s/it]
 66%|██████▌   | 24880/37963 [59:42:25<34:57:04,  9.62s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '1.489', 'learning_rate': '5.609e-06', 'epoch': '0.6554'}

 66%|██████▌   | 24880/37963 [59:42:25<34:57:04,  9.62s/it]
 66%|██████▌   | 24881/37963 [59:42:33<32:58:38,  9.07s/it]
 66%|██████▌   | 24882/37963 [59:42:40<31:24:59,  8.65s/it]
 66%|██████▌   | 24883/37963 [59:42:48<30:36:14,  8.42s/it]
 66%|██████▌   | 24884/37963 [59:42:56<29:44:26,  8.19s/it]
 66%|██████▌   | 24885/37963 [59:43:04<29:22:28,  8.09s/it]
 66%|██████▌   | 24886/37963 [59:43:11<28:44:02,  7.91s/it]
 66%|██████▌   | 24887/37963 [59:43:19<28:23:02,  7.81s/it]
 66%|██████▌   | 24888/37963 [59:43:26<28:03:07,  7.72s/it]
 66%|██████▌   | 24889/37963 [59:43:42<36:11:47,  9.97s/it]
 66%|██████▌   | 24890/37963 [59:43:49<33:46:26,  9.30s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '2.08', 'learning_rate': '5.602e-06', 'epoch': '0.6556'}

 66%|██████▌   | 24890/37963 [59:43:49<33:46:26,  9.30s/it]
 66%|██████▌   | 24891/37963 [59:43:57<31:57:52,  8.80s/it]
 66%|██████▌   | 24892/37963 [59:44:11<37:34:11, 10.35s/it]
 66%|██████▌   | 24893/37963 [59:44:18<34:17:36,  9.45s/it]
 66%|██████▌   | 24894/37963 [59:44:26<32:10:24,  8.86s/it]
 66%|██████▌   | 24895/37963 [59:44:33<30:55:49,  8.52s/it]
 66%|██████▌   | 24896/37963 [59:44:41<30:03:29,  8.28s/it]
 66%|██████▌   | 24897/37963 [59:44:56<37:08:14, 10.23s/it]
 66%|██████▌   | 24898/37963 [59:45:04<34:23:04,  9.47s/it]
 66%|██████▌   | 24899/37963 [59:45:11<32:23:52,  8.93s/it]
 66%|██████▌   | 24900/37963 [59:45:19<30:48:01,  8.49s/it]
                                                           
{'loss': '0.1332', 'grad_norm': '3.435', 'learning_rate': '5.594e-06', 'epoch': '0.6559'}

 66%|██████▌   | 24900/37963 [59:45:19<30:48:01,  8.49s/it]
 66%|██████▌   | 24901/37963 [59:45:33<36:43:54, 10.12s/it]
 66%|██████▌   | 24902/37963 [59:45:47<41:44:02, 11.50s/it]
 66%|██████▌   | 24903/37963 [59:45:55<37:34:24, 10.36s/it]
 66%|██████▌   | 24904/37963 [59:46:03<34:37:56,  9.55s/it]
 66%|██████▌   | 24905/37963 [59:46:16<39:02:58, 10.77s/it]
 66%|██████▌   | 24906/37963 [59:46:24<35:44:30,  9.85s/it]
 66%|██████▌   | 24907/37963 [59:46:32<33:31:43,  9.25s/it]
 66%|██████▌   | 24908/37963 [59:46:39<31:37:37,  8.72s/it]
 66%|██████▌   | 24909/37963 [59:46:47<30:34:04,  8.43s/it]
 66%|██████▌   | 24910/37963 [59:46:55<29:40:20,  8.18s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '1.813', 'learning_rate': '5.586e-06', 'epoch': '0.6562'}

 66%|██████▌   | 24910/37963 [59:46:55<29:40:20,  8.18s/it]
 66%|██████▌   | 24911/37963 [59:47:09<36:15:18, 10.00s/it]
 66%|██████▌   | 24912/37963 [59:47:16<33:24:00,  9.21s/it]
 66%|██████▌   | 24913/37963 [59:47:24<31:39:45,  8.73s/it]
 66%|██████▌   | 24914/37963 [59:47:32<30:34:38,  8.44s/it]
 66%|██████▌   | 24915/37963 [59:47:39<29:43:45,  8.20s/it]
 66%|██████▌   | 24916/37963 [59:47:47<28:53:55,  7.97s/it]
 66%|██████▌   | 24917/37963 [59:47:54<28:17:46,  7.81s/it]
 66%|██████▌   | 24918/37963 [59:48:02<28:06:11,  7.76s/it]
 66%|██████▌   | 24919/37963 [59:48:10<28:01:57,  7.74s/it]
 66%|██████▌   | 24920/37963 [59:48:17<27:39:42,  7.63s/it]
                                                           
{'loss': '0.1347', 'grad_norm': '1.917', 'learning_rate': '5.579e-06', 'epoch': '0.6564'}

 66%|██████▌   | 24920/37963 [59:48:17<27:39:42,  7.63s/it]
 66%|██████▌   | 24921/37963 [59:48:25<27:37:32,  7.63s/it]
 66%|██████▌   | 24922/37963 [59:48:32<27:34:56,  7.61s/it]
 66%|██████▌   | 24923/37963 [59:48:40<27:44:48,  7.66s/it]
 66%|██████▌   | 24924/37963 [59:48:48<27:38:00,  7.63s/it]
 66%|██████▌   | 24925/37963 [59:48:55<27:37:53,  7.63s/it]
 66%|██████▌   | 24926/37963 [59:49:03<27:39:51,  7.64s/it]
 66%|██████▌   | 24927/37963 [59:49:11<27:43:47,  7.66s/it]
 66%|██████▌   | 24928/37963 [59:49:18<27:43:13,  7.66s/it]
 66%|██████▌   | 24929/37963 [59:49:26<27:49:23,  7.68s/it]
 66%|██████▌   | 24930/37963 [59:49:34<27:54:50,  7.71s/it]
                                                           
{'loss': '0.1284', 'grad_norm': '2.321', 'learning_rate': '5.571e-06', 'epoch': '0.6567'}

 66%|██████▌   | 24930/37963 [59:49:34<27:54:50,  7.71s/it]
 66%|██████▌   | 24931/37963 [59:49:41<27:57:57,  7.73s/it]
 66%|██████▌   | 24932/37963 [59:49:49<27:53:41,  7.71s/it]
 66%|██████▌   | 24933/37963 [59:50:05<36:23:59, 10.06s/it]
 66%|██████▌   | 24934/37963 [59:50:13<34:02:39,  9.41s/it]
 66%|██████▌   | 24935/37963 [59:50:20<32:09:40,  8.89s/it]
 66%|██████▌   | 24936/37963 [59:50:28<30:50:55,  8.53s/it]
 66%|██████▌   | 24937/37963 [59:50:35<29:37:44,  8.19s/it]
 66%|██████▌   | 24938/37963 [59:50:43<28:53:35,  7.99s/it]
 66%|██████▌   | 24939/37963 [59:50:51<28:40:27,  7.93s/it]
 66%|██████▌   | 24940/37963 [59:50:58<28:18:25,  7.83s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '3.301', 'learning_rate': '5.563e-06', 'epoch': '0.657'}

 66%|██████▌   | 24940/37963 [59:50:58<28:18:25,  7.83s/it]
 66%|██████▌   | 24941/37963 [59:51:06<28:04:51,  7.76s/it]
 66%|██████▌   | 24942/37963 [59:51:14<28:04:38,  7.76s/it]
 66%|██████▌   | 24943/37963 [59:51:28<35:15:51,  9.75s/it]
 66%|██████▌   | 24944/37963 [59:51:36<33:01:14,  9.13s/it]
 66%|██████▌   | 24945/37963 [59:51:51<39:39:06, 10.97s/it]
 66%|██████▌   | 24946/37963 [59:52:06<43:53:08, 12.14s/it]
 66%|██████▌   | 24947/37963 [59:52:13<39:00:17, 10.79s/it]
 66%|██████▌   | 24948/37963 [59:52:29<43:53:44, 12.14s/it]
 66%|██████▌   | 24949/37963 [59:52:44<47:16:33, 13.08s/it]
 66%|██████▌   | 24950/37963 [59:52:59<48:50:02, 13.51s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '1.863', 'learning_rate': '5.556e-06', 'epoch': '0.6572'}

 66%|██████▌   | 24950/37963 [59:52:59<48:50:02, 13.51s/it]
 66%|██████▌   | 24951/37963 [59:53:06<42:29:44, 11.76s/it]
 66%|██████▌   | 24952/37963 [59:53:14<37:56:10, 10.50s/it]
 66%|██████▌   | 24953/37963 [59:53:21<34:50:46,  9.64s/it]
 66%|██████▌   | 24954/37963 [59:53:29<32:40:14,  9.04s/it]
 66%|██████▌   | 24955/37963 [59:53:36<30:51:35,  8.54s/it]
 66%|██████▌   | 24956/37963 [59:53:51<37:13:18, 10.30s/it]
 66%|██████▌   | 24957/37963 [59:53:58<34:19:23,  9.50s/it]
 66%|██████▌   | 24958/37963 [59:54:06<32:13:17,  8.92s/it]
 66%|██████▌   | 24959/37963 [59:54:14<30:50:47,  8.54s/it]
 66%|██████▌   | 24960/37963 [59:54:21<29:45:25,  8.24s/it]
                                                           
{'loss': '0.1353', 'grad_norm': '1.42', 'learning_rate': '5.548e-06', 'epoch': '0.6575'}

 66%|██████▌   | 24960/37963 [59:54:21<29:45:25,  8.24s/it]
 66%|██████▌   | 24961/37963 [59:54:29<29:12:04,  8.09s/it]
 66%|██████▌   | 24962/37963 [59:54:37<28:40:45,  7.94s/it]
 66%|██████▌   | 24963/37963 [59:54:44<28:08:40,  7.79s/it]
 66%|██████▌   | 24964/37963 [59:54:52<28:01:57,  7.76s/it]
 66%|██████▌   | 24965/37963 [59:54:59<27:47:19,  7.70s/it]
 66%|██████▌   | 24966/37963 [59:55:07<27:44:25,  7.68s/it]
 66%|██████▌   | 24967/37963 [59:55:15<27:41:12,  7.67s/it]
 66%|██████▌   | 24968/37963 [59:55:22<27:36:59,  7.65s/it]
 66%|██████▌   | 24969/37963 [59:55:30<27:38:02,  7.66s/it]
 66%|██████▌   | 24970/37963 [59:55:37<27:39:21,  7.66s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '1.21', 'learning_rate': '5.541e-06', 'epoch': '0.6577'}

 66%|██████▌   | 24970/37963 [59:55:37<27:39:21,  7.66s/it]
 66%|██████▌   | 24971/37963 [59:55:45<27:25:36,  7.60s/it]
 66%|██████▌   | 24972/37963 [59:55:53<27:34:24,  7.64s/it]
 66%|██████▌   | 24973/37963 [59:56:00<27:44:08,  7.69s/it]
 66%|██████▌   | 24974/37963 [59:56:08<27:44:43,  7.69s/it]
 66%|██████▌   | 24975/37963 [59:56:16<27:43:33,  7.69s/it]
 66%|██████▌   | 24976/37963 [59:56:23<27:23:41,  7.59s/it]
 66%|██████▌   | 24977/37963 [59:56:31<27:32:49,  7.64s/it]
 66%|██████▌   | 24978/37963 [59:56:39<27:35:33,  7.65s/it]
 66%|██████▌   | 24979/37963 [59:56:54<35:35:31,  9.87s/it]
 66%|██████▌   | 24980/37963 [59:57:01<32:58:56,  9.15s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '2.001', 'learning_rate': '5.533e-06', 'epoch': '0.658'}

 66%|██████▌   | 24980/37963 [59:57:01<32:58:56,  9.15s/it]
 66%|██████▌   | 24981/37963 [59:57:09<31:23:28,  8.70s/it]
 66%|██████▌   | 24982/37963 [59:57:16<30:16:56,  8.40s/it]
 66%|██████▌   | 24983/37963 [59:57:24<29:36:35,  8.21s/it]
 66%|██████▌   | 24984/37963 [59:57:32<29:03:27,  8.06s/it]
 66%|██████▌   | 24985/37963 [59:57:39<28:20:14,  7.86s/it]
 66%|██████▌   | 24986/37963 [59:57:47<28:05:51,  7.79s/it]
 66%|██████▌   | 24987/37963 [59:57:55<28:08:00,  7.81s/it]
 66%|██████▌   | 24988/37963 [59:58:02<27:35:09,  7.65s/it]
 66%|██████▌   | 24989/37963 [59:58:10<27:30:42,  7.63s/it]
 66%|██████▌   | 24990/37963 [59:58:17<27:37:49,  7.67s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '1.422', 'learning_rate': '5.525e-06', 'epoch': '0.6583'}

 66%|██████▌   | 24990/37963 [59:58:17<27:37:49,  7.67s/it]
 66%|██████▌   | 24991/37963 [59:58:25<27:33:56,  7.65s/it]
 66%|██████▌   | 24992/37963 [59:58:33<27:36:48,  7.66s/it]
 66%|██████▌   | 24993/37963 [59:58:40<27:31:31,  7.64s/it]
 66%|██████▌   | 24994/37963 [59:58:56<36:01:28, 10.00s/it]
 66%|██████▌   | 24995/37963 [59:59:04<33:30:47,  9.30s/it]
 66%|██████▌   | 24996/37963 [59:59:11<31:33:21,  8.76s/it]
 66%|██████▌   | 24997/37963 [59:59:40<53:46:25, 14.93s/it]
 66%|██████▌   | 24998/37963 [59:59:56<54:05:45, 15.02s/it]
 66%|██████▌   | 24999/37963 [60:00:03<46:17:59, 12.86s/it]
 66%|██████▌   | 25000/37963 [60:00:11<40:45:06, 11.32s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '1.793', 'learning_rate': '5.518e-06', 'epoch': '0.6585'}

 66%|██████▌   | 25000/37963 [60:00:11<40:45:06, 11.32s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.75s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.76s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 66%|██████▌   | 25001/37963 [60:01:23<106:12:38, 29.50s/it]
 66%|██████▌   | 25002/37963 [60:01:38<90:54:17, 25.25s/it] 
 66%|██████▌   | 25003/37963 [60:01:46<72:06:30, 20.03s/it]
 66%|██████▌   | 25004/37963 [60:01:54<58:44:25, 16.32s/it]
 66%|██████▌   | 25005/37963 [60:02:01<49:01:27, 13.62s/it]
 66%|██████▌   | 25006/37963 [60:02:09<42:39:30, 11.85s/it]
 66%|██████▌   | 25007/37963 [60:02:17<38:19:11, 10.65s/it]
 66%|██████▌   | 25008/37963 [60:02:25<35:14:15,  9.79s/it]
 66%|██████▌   | 25009/37963 [60:02:32<32:49:40,  9.12s/it]
 66%|██████▌   | 25010/37963 [60:02:40<31:27:46,  8.74s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '3.372', 'learning_rate': '5.51e-06', 'epoch': '0.6588'}

 66%|██████▌   | 25010/37963 [60:02:40<31:27:46,  8.74s/it]
 66%|██████▌   | 25011/37963 [60:02:48<30:11:29,  8.39s/it]
 66%|██████▌   | 25012/37963 [60:02:55<29:29:06,  8.20s/it]
 66%|██████▌   | 25013/37963 [60:03:03<29:06:53,  8.09s/it]
 66%|██████▌   | 25014/37963 [60:03:11<28:41:38,  7.98s/it]
 66%|██████▌   | 25015/37963 [60:03:18<28:12:51,  7.84s/it]
 66%|██████▌   | 25016/37963 [60:03:26<27:58:15,  7.78s/it]
 66%|██████▌   | 25017/37963 [60:03:34<27:55:03,  7.76s/it]
 66%|██████▌   | 25018/37963 [60:03:41<27:49:13,  7.74s/it]
 66%|██████▌   | 25019/37963 [60:03:49<27:35:24,  7.67s/it]
 66%|██████▌   | 25020/37963 [60:03:57<27:35:23,  7.67s/it]
                                                           
{'loss': '0.1287', 'grad_norm': '2.263', 'learning_rate': '5.502e-06', 'epoch': '0.6591'}

 66%|██████▌   | 25020/37963 [60:03:57<27:35:23,  7.67s/it]
 66%|██████▌   | 25021/37963 [60:04:04<27:40:41,  7.70s/it]
 66%|██████▌   | 25022/37963 [60:04:12<27:41:53,  7.71s/it]
 66%|██████▌   | 25023/37963 [60:04:20<27:31:30,  7.66s/it]
 66%|██████▌   | 25024/37963 [60:04:35<35:41:29,  9.93s/it]
 66%|██████▌   | 25025/37963 [60:04:42<33:10:54,  9.23s/it]
 66%|██████▌   | 25026/37963 [60:04:50<31:36:22,  8.80s/it]
 66%|██████▌   | 25027/37963 [60:04:58<30:08:31,  8.39s/it]
 66%|██████▌   | 25028/37963 [60:05:05<29:06:05,  8.10s/it]
 66%|██████▌   | 25029/37963 [60:05:13<28:45:55,  8.01s/it]
 66%|██████▌   | 25030/37963 [60:05:20<28:07:16,  7.83s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.356', 'learning_rate': '5.495e-06', 'epoch': '0.6593'}

 66%|██████▌   | 25030/37963 [60:05:20<28:07:16,  7.83s/it]
 66%|██████▌   | 25031/37963 [60:05:28<27:33:23,  7.67s/it]
 66%|██████▌   | 25032/37963 [60:05:35<27:25:12,  7.63s/it]
 66%|██████▌   | 25033/37963 [60:05:43<27:31:28,  7.66s/it]
 66%|██████▌   | 25034/37963 [60:05:51<27:36:00,  7.69s/it]
 66%|██████▌   | 25035/37963 [60:05:58<27:26:30,  7.64s/it]
 66%|██████▌   | 25036/37963 [60:06:06<27:18:39,  7.61s/it]
 66%|██████▌   | 25037/37963 [60:06:13<27:06:32,  7.55s/it]
 66%|██████▌   | 25038/37963 [60:06:21<27:11:14,  7.57s/it]
 66%|██████▌   | 25039/37963 [60:06:28<27:16:49,  7.60s/it]
 66%|██████▌   | 25040/37963 [60:06:36<27:15:30,  7.59s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '2.125', 'learning_rate': '5.487e-06', 'epoch': '0.6596'}

 66%|██████▌   | 25040/37963 [60:06:36<27:15:30,  7.59s/it]
 66%|██████▌   | 25041/37963 [60:06:43<27:02:17,  7.53s/it]
 66%|██████▌   | 25042/37963 [60:06:51<27:22:41,  7.63s/it]
 66%|██████▌   | 25043/37963 [60:07:06<34:41:22,  9.67s/it]
 66%|██████▌   | 25044/37963 [60:07:14<32:47:59,  9.14s/it]
 66%|██████▌   | 25045/37963 [60:07:35<45:51:44, 12.78s/it]
 66%|██████▌   | 25046/37963 [60:07:43<40:23:36, 11.26s/it]
 66%|██████▌   | 25047/37963 [60:07:50<36:16:59, 10.11s/it]
 66%|██████▌   | 25048/37963 [60:08:05<41:38:38, 11.61s/it]
 66%|██████▌   | 25049/37963 [60:08:28<53:28:20, 14.91s/it]
 66%|██████▌   | 25050/37963 [60:08:35<45:41:07, 12.74s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '1.842', 'learning_rate': '5.48e-06', 'epoch': '0.6599'}

 66%|██████▌   | 25050/37963 [60:08:35<45:41:07, 12.74s/it]
 66%|██████▌   | 25051/37963 [60:08:43<40:12:16, 11.21s/it]
 66%|██████▌   | 25052/37963 [60:08:51<36:21:54, 10.14s/it]
 66%|██████▌   | 25053/37963 [60:08:58<33:41:09,  9.39s/it]
 66%|██████▌   | 25054/37963 [60:09:06<31:54:15,  8.90s/it]
 66%|██████▌   | 25055/37963 [60:09:20<37:49:57, 10.55s/it]
 66%|██████▌   | 25056/37963 [60:09:28<34:29:10,  9.62s/it]
 66%|██████▌   | 25057/37963 [60:09:36<32:20:26,  9.02s/it]
 66%|██████▌   | 25058/37963 [60:09:43<30:42:57,  8.57s/it]
 66%|██████▌   | 25059/37963 [60:09:51<29:40:37,  8.28s/it]
 66%|██████▌   | 25060/37963 [60:09:58<28:57:42,  8.08s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '1.165', 'learning_rate': '5.472e-06', 'epoch': '0.6601'}

 66%|██████▌   | 25060/37963 [60:09:58<28:57:42,  8.08s/it]
 66%|██████▌   | 25061/37963 [60:10:06<28:28:10,  7.94s/it]
 66%|██████▌   | 25062/37963 [60:10:14<28:17:59,  7.90s/it]
 66%|██████▌   | 25063/37963 [60:10:21<28:01:40,  7.82s/it]
 66%|██████▌   | 25064/37963 [60:10:29<27:52:50,  7.78s/it]
 66%|██████▌   | 25065/37963 [60:10:37<27:47:29,  7.76s/it]
 66%|██████▌   | 25066/37963 [60:10:44<27:39:17,  7.72s/it]
 66%|██████▌   | 25067/37963 [60:10:52<27:15:12,  7.61s/it]
 66%|██████▌   | 25068/37963 [60:10:59<27:16:39,  7.62s/it]
 66%|██████▌   | 25069/37963 [60:11:07<27:18:39,  7.63s/it]
 66%|██████▌   | 25070/37963 [60:11:21<34:28:36,  9.63s/it]
                                                           
{'loss': '0.127', 'grad_norm': '1.118', 'learning_rate': '5.464e-06', 'epoch': '0.6604'}

 66%|██████▌   | 25070/37963 [60:11:21<34:28:36,  9.63s/it]
 66%|██████▌   | 25071/37963 [60:11:29<32:24:15,  9.05s/it]
 66%|██████▌   | 25072/37963 [60:11:37<30:52:26,  8.62s/it]
 66%|██████▌   | 25073/37963 [60:11:44<29:48:16,  8.32s/it]
 66%|██████▌   | 25074/37963 [60:11:52<29:03:04,  8.11s/it]
 66%|██████▌   | 25075/37963 [60:11:59<28:13:54,  7.89s/it]
 66%|██████▌   | 25076/37963 [60:12:07<28:06:56,  7.85s/it]
 66%|██████▌   | 25077/37963 [60:12:14<27:40:48,  7.73s/it]
 66%|██████▌   | 25078/37963 [60:12:22<27:20:02,  7.64s/it]
 66%|██████▌   | 25079/37963 [60:12:29<27:16:22,  7.62s/it]
 66%|██████▌   | 25080/37963 [60:12:37<27:17:41,  7.63s/it]
                                                           
{'loss': '0.1328', 'grad_norm': '1.31', 'learning_rate': '5.457e-06', 'epoch': '0.6606'}

 66%|██████▌   | 25080/37963 [60:12:37<27:17:41,  7.63s/it]
 66%|██████▌   | 25081/37963 [60:12:45<27:11:26,  7.60s/it]
 66%|██████▌   | 25082/37963 [60:12:52<27:18:25,  7.63s/it]
 66%|██████▌   | 25083/37963 [60:13:00<27:23:19,  7.66s/it]
 66%|██████▌   | 25084/37963 [60:13:08<27:21:41,  7.65s/it]
 66%|██████▌   | 25085/37963 [60:13:15<27:25:35,  7.67s/it]
 66%|██████▌   | 25086/37963 [60:13:23<27:22:07,  7.65s/it]
 66%|██████▌   | 25087/37963 [60:13:31<27:18:46,  7.64s/it]
 66%|██████▌   | 25088/37963 [60:13:38<27:20:37,  7.65s/it]
 66%|██████▌   | 25089/37963 [60:13:52<34:16:47,  9.59s/it]
 66%|██████▌   | 25090/37963 [60:14:00<32:12:53,  9.01s/it]
                                                           
{'loss': '0.1237', 'grad_norm': '1.356', 'learning_rate': '5.449e-06', 'epoch': '0.6609'}

 66%|██████▌   | 25090/37963 [60:14:00<32:12:53,  9.01s/it]
 66%|██████▌   | 25091/37963 [60:14:15<38:12:53, 10.69s/it]
 66%|██████▌   | 25092/37963 [60:14:29<42:18:02, 11.83s/it]
 66%|██████▌   | 25093/37963 [60:14:37<37:48:02, 10.57s/it]
 66%|██████▌   | 25094/37963 [60:14:44<34:15:04,  9.58s/it]
 66%|██████▌   | 25095/37963 [60:14:52<32:02:47,  8.97s/it]
 66%|██████▌   | 25096/37963 [60:14:59<30:33:08,  8.55s/it]
 66%|██████▌   | 25097/37963 [60:15:07<29:34:30,  8.28s/it]
 66%|██████▌   | 25098/37963 [60:15:22<37:00:52, 10.36s/it]
 66%|██████▌   | 25099/37963 [60:15:37<42:10:47, 11.80s/it]
 66%|██████▌   | 25100/37963 [60:15:45<37:29:47, 10.49s/it]
                                                           
{'loss': '0.128', 'grad_norm': '3.077', 'learning_rate': '5.442e-06', 'epoch': '0.6612'}

 66%|██████▌   | 25100/37963 [60:15:45<37:29:47, 10.49s/it]
 66%|██████▌   | 25101/37963 [60:15:59<42:03:46, 11.77s/it]
 66%|██████▌   | 25102/37963 [60:16:07<37:40:17, 10.54s/it]
 66%|██████▌   | 25103/37963 [60:16:15<34:38:17,  9.70s/it]
 66%|██████▌   | 25104/37963 [60:16:22<32:17:14,  9.04s/it]
 66%|██████▌   | 25105/37963 [60:16:30<31:02:50,  8.69s/it]
 66%|██████▌   | 25106/37963 [60:16:38<30:03:01,  8.41s/it]
 66%|██████▌   | 25107/37963 [60:16:46<29:14:41,  8.19s/it]
 66%|██████▌   | 25108/37963 [60:16:53<28:25:49,  7.96s/it]
 66%|██████▌   | 25109/37963 [60:17:08<35:28:47,  9.94s/it]
 66%|██████▌   | 25110/37963 [60:17:15<33:00:29,  9.25s/it]
                                                           
{'loss': '0.1183', 'grad_norm': '2.513', 'learning_rate': '5.434e-06', 'epoch': '0.6614'}

 66%|██████▌   | 25110/37963 [60:17:15<33:00:29,  9.25s/it]
 66%|██████▌   | 25111/37963 [60:17:23<31:21:26,  8.78s/it]
 66%|██████▌   | 25112/37963 [60:17:31<30:15:45,  8.48s/it]
 66%|██████▌   | 25113/37963 [60:17:39<29:38:28,  8.30s/it]
 66%|██████▌   | 25114/37963 [60:17:46<29:06:25,  8.16s/it]
 66%|██████▌   | 25115/37963 [60:17:54<28:45:38,  8.06s/it]
 66%|██████▌   | 25116/37963 [60:18:02<28:20:44,  7.94s/it]
 66%|██████▌   | 25117/37963 [60:18:09<27:53:53,  7.82s/it]
 66%|██████▌   | 25118/37963 [60:18:17<27:42:14,  7.76s/it]
 66%|██████▌   | 25119/37963 [60:18:25<27:32:54,  7.72s/it]
 66%|██████▌   | 25120/37963 [60:18:32<27:12:40,  7.63s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '1.288', 'learning_rate': '5.426e-06', 'epoch': '0.6617'}

 66%|██████▌   | 25120/37963 [60:18:32<27:12:40,  7.63s/it]
 66%|██████▌   | 25121/37963 [60:18:40<27:16:13,  7.64s/it]
 66%|██████▌   | 25122/37963 [60:18:47<27:15:53,  7.64s/it]
 66%|██████▌   | 25123/37963 [60:19:02<34:34:22,  9.69s/it]
 66%|██████▌   | 25124/37963 [60:19:09<32:14:40,  9.04s/it]
 66%|██████▌   | 25125/37963 [60:19:17<30:30:24,  8.55s/it]
 66%|██████▌   | 25126/37963 [60:19:25<29:37:40,  8.31s/it]
 66%|██████▌   | 25127/37963 [60:19:32<28:52:18,  8.10s/it]
 66%|██████▌   | 25128/37963 [60:19:40<28:13:52,  7.92s/it]
 66%|██████▌   | 25129/37963 [60:19:47<27:51:33,  7.81s/it]
 66%|██████▌   | 25130/37963 [60:19:55<27:49:47,  7.81s/it]
                                                           
{'loss': '0.139', 'grad_norm': '2.124', 'learning_rate': '5.419e-06', 'epoch': '0.662'}

 66%|██████▌   | 25130/37963 [60:19:55<27:49:47,  7.81s/it]
 66%|██████▌   | 25131/37963 [60:20:03<27:40:07,  7.76s/it]
 66%|██████▌   | 25132/37963 [60:20:10<27:42:07,  7.77s/it]
 66%|██████▌   | 25133/37963 [60:20:18<27:32:46,  7.73s/it]
 66%|██████▌   | 25134/37963 [60:20:26<27:16:28,  7.65s/it]
 66%|██████▌   | 25135/37963 [60:20:33<27:11:57,  7.63s/it]
 66%|██████▌   | 25136/37963 [60:20:48<35:11:32,  9.88s/it]
 66%|██████▌   | 25137/37963 [60:20:56<32:51:41,  9.22s/it]
 66%|██████▌   | 25138/37963 [60:21:04<31:12:52,  8.76s/it]
 66%|██████▌   | 25139/37963 [60:21:11<29:51:28,  8.38s/it]
 66%|██████▌   | 25140/37963 [60:21:19<29:01:51,  8.15s/it]
                                                           
{'loss': '0.12', 'grad_norm': '1.417', 'learning_rate': '5.411e-06', 'epoch': '0.6622'}

 66%|██████▌   | 25140/37963 [60:21:19<29:01:51,  8.15s/it]
 66%|██████▌   | 25141/37963 [60:21:33<35:12:40,  9.89s/it]
 66%|██████▌   | 25142/37963 [60:21:47<40:17:12, 11.31s/it]
 66%|██████▌   | 25143/37963 [60:22:02<43:38:12, 12.25s/it]
 66%|██████▌   | 25144/37963 [60:22:17<46:19:09, 13.01s/it]
 66%|██████▌   | 25145/37963 [60:22:24<40:33:57, 11.39s/it]
 66%|██████▌   | 25146/37963 [60:22:32<36:37:05, 10.29s/it]
 66%|██████▌   | 25147/37963 [60:22:40<33:53:44,  9.52s/it]
 66%|██████▌   | 25148/37963 [60:22:47<31:48:42,  8.94s/it]
 66%|██████▌   | 25149/37963 [60:22:55<30:31:01,  8.57s/it]
 66%|██████▌   | 25150/37963 [60:23:03<29:52:51,  8.40s/it]
                                                           
{'loss': '0.1324', 'grad_norm': '2.886', 'learning_rate': '5.404e-06', 'epoch': '0.6625'}

 66%|██████▌   | 25150/37963 [60:23:03<29:52:51,  8.40s/it]
 66%|██████▋   | 25151/37963 [60:23:18<36:45:52, 10.33s/it]
 66%|██████▋   | 25152/37963 [60:23:25<33:37:32,  9.45s/it]
 66%|██████▋   | 25153/37963 [60:23:33<31:41:06,  8.90s/it]
 66%|██████▋   | 25154/37963 [60:23:40<30:21:53,  8.53s/it]
 66%|██████▋   | 25155/37963 [60:23:55<36:30:57, 10.26s/it]
 66%|██████▋   | 25156/37963 [60:24:02<33:35:52,  9.44s/it]
 66%|██████▋   | 25157/37963 [60:24:10<31:47:10,  8.94s/it]
 66%|██████▋   | 25158/37963 [60:24:17<30:01:26,  8.44s/it]
 66%|██████▋   | 25159/37963 [60:24:25<29:08:54,  8.20s/it]
 66%|██████▋   | 25160/37963 [60:24:33<28:35:37,  8.04s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '2.179', 'learning_rate': '5.396e-06', 'epoch': '0.6628'}

 66%|██████▋   | 25160/37963 [60:24:33<28:35:37,  8.04s/it]
 66%|██████▋   | 25161/37963 [60:24:40<28:10:43,  7.92s/it]
 66%|██████▋   | 25162/37963 [60:24:48<27:49:36,  7.83s/it]
 66%|██████▋   | 25163/37963 [60:24:55<27:37:51,  7.77s/it]
 66%|██████▋   | 25164/37963 [60:25:03<27:31:04,  7.74s/it]
 66%|██████▋   | 25165/37963 [60:25:11<27:24:58,  7.71s/it]
 66%|██████▋   | 25166/37963 [60:25:19<27:26:16,  7.72s/it]
 66%|██████▋   | 25167/37963 [60:25:26<27:27:02,  7.72s/it]
 66%|██████▋   | 25168/37963 [60:25:34<27:31:42,  7.75s/it]
 66%|██████▋   | 25169/37963 [60:25:42<27:22:56,  7.70s/it]
 66%|██████▋   | 25170/37963 [60:25:49<27:00:31,  7.60s/it]
                                                           
{'loss': '0.1413', 'grad_norm': '1.776', 'learning_rate': '5.388e-06', 'epoch': '0.663'}

 66%|██████▋   | 25170/37963 [60:25:49<27:00:31,  7.60s/it]
 66%|██████▋   | 25171/37963 [60:26:03<33:46:14,  9.50s/it]
 66%|██████▋   | 25172/37963 [60:26:11<31:52:23,  8.97s/it]
 66%|██████▋   | 25173/37963 [60:26:18<30:14:59,  8.51s/it]
 66%|██████▋   | 25174/37963 [60:26:26<29:24:58,  8.28s/it]
 66%|██████▋   | 25175/37963 [60:26:34<28:49:12,  8.11s/it]
 66%|██████▋   | 25176/37963 [60:26:41<28:11:54,  7.94s/it]
 66%|██████▋   | 25177/37963 [60:26:49<27:51:26,  7.84s/it]
 66%|██████▋   | 25178/37963 [60:26:56<27:41:55,  7.80s/it]
 66%|██████▋   | 25179/37963 [60:27:05<28:11:28,  7.94s/it]
 66%|██████▋   | 25180/37963 [60:27:14<29:14:39,  8.24s/it]
                                                           
{'loss': '0.134', 'grad_norm': '2.3', 'learning_rate': '5.381e-06', 'epoch': '0.6633'}

 66%|██████▋   | 25180/37963 [60:27:14<29:14:39,  8.24s/it]
 66%|██████▋   | 25181/37963 [60:27:23<30:00:39,  8.45s/it]
 66%|██████▋   | 25182/37963 [60:27:32<30:49:22,  8.68s/it]
 66%|██████▋   | 25183/37963 [60:27:48<38:41:00, 10.90s/it]
 66%|██████▋   | 25184/37963 [60:27:56<35:19:59,  9.95s/it]
 66%|██████▋   | 25185/37963 [60:28:03<32:48:19,  9.24s/it]
 66%|██████▋   | 25186/37963 [60:28:18<38:47:41, 10.93s/it]
 66%|██████▋   | 25187/37963 [60:28:26<35:37:08, 10.04s/it]
 66%|██████▋   | 25188/37963 [60:28:33<32:46:34,  9.24s/it]
 66%|██████▋   | 25189/37963 [60:28:41<31:07:25,  8.77s/it]
 66%|██████▋   | 25190/37963 [60:28:49<29:51:49,  8.42s/it]
                                                           
{'loss': '0.1136', 'grad_norm': '1.689', 'learning_rate': '5.373e-06', 'epoch': '0.6635'}

 66%|██████▋   | 25190/37963 [60:28:49<29:51:49,  8.42s/it]
 66%|██████▋   | 25191/37963 [60:28:56<29:09:33,  8.22s/it]
 66%|██████▋   | 25192/37963 [60:29:10<35:12:04,  9.92s/it]
 66%|██████▋   | 25193/37963 [60:29:18<32:45:33,  9.24s/it]
 66%|██████▋   | 25194/37963 [60:29:32<38:09:32, 10.76s/it]
 66%|██████▋   | 25195/37963 [60:29:47<42:14:54, 11.91s/it]
 66%|██████▋   | 25196/37963 [60:29:55<37:41:23, 10.63s/it]
 66%|██████▋   | 25197/37963 [60:30:02<34:33:35,  9.75s/it]
 66%|██████▋   | 25198/37963 [60:30:10<32:14:49,  9.09s/it]
 66%|██████▋   | 25199/37963 [60:30:24<37:19:32, 10.53s/it]
 66%|██████▋   | 25200/37963 [60:30:31<34:07:57,  9.63s/it]
                                                           
{'loss': '0.1384', 'grad_norm': '2.3', 'learning_rate': '5.366e-06', 'epoch': '0.6638'}

 66%|██████▋   | 25200/37963 [60:30:31<34:07:57,  9.63s/it]
 66%|██████▋   | 25201/37963 [60:30:39<31:58:24,  9.02s/it]
 66%|██████▋   | 25202/37963 [60:30:46<30:20:25,  8.56s/it]
 66%|██████▋   | 25203/37963 [60:31:00<36:01:46, 10.17s/it]
 66%|██████▋   | 25204/37963 [60:31:08<33:01:48,  9.32s/it]
 66%|██████▋   | 25205/37963 [60:31:15<31:07:39,  8.78s/it]
 66%|██████▋   | 25206/37963 [60:31:22<29:33:22,  8.34s/it]
 66%|██████▋   | 25207/37963 [60:31:30<28:41:02,  8.10s/it]
 66%|██████▋   | 25208/37963 [60:31:37<27:56:08,  7.88s/it]
 66%|██████▋   | 25209/37963 [60:31:45<27:31:52,  7.77s/it]
 66%|██████▋   | 25210/37963 [60:31:52<27:14:30,  7.69s/it]
                                                           
{'loss': '0.1228', 'grad_norm': '1.765', 'learning_rate': '5.358e-06', 'epoch': '0.6641'}

 66%|██████▋   | 25210/37963 [60:31:52<27:14:30,  7.69s/it]
 66%|██████▋   | 25211/37963 [60:32:00<27:08:26,  7.66s/it]
 66%|██████▋   | 25212/37963 [60:32:08<27:07:26,  7.66s/it]
 66%|██████▋   | 25213/37963 [60:32:15<27:05:09,  7.65s/it]
 66%|██████▋   | 25214/37963 [60:32:23<27:08:02,  7.66s/it]
 66%|██████▋   | 25215/37963 [60:32:30<27:03:19,  7.64s/it]
 66%|██████▋   | 25216/37963 [60:32:38<26:57:24,  7.61s/it]
 66%|██████▋   | 25217/37963 [60:32:46<26:50:06,  7.58s/it]
 66%|██████▋   | 25218/37963 [60:32:53<26:48:19,  7.57s/it]
 66%|██████▋   | 25219/37963 [60:33:01<26:51:52,  7.59s/it]
 66%|██████▋   | 25220/37963 [60:33:08<26:50:24,  7.58s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.555', 'learning_rate': '5.351e-06', 'epoch': '0.6643'}

 66%|██████▋   | 25220/37963 [60:33:08<26:50:24,  7.58s/it]
 66%|██████▋   | 25221/37963 [60:33:16<26:51:09,  7.59s/it]
 66%|██████▋   | 25222/37963 [60:33:24<26:56:30,  7.61s/it]
 66%|██████▋   | 25223/37963 [60:33:31<26:56:34,  7.61s/it]
 66%|██████▋   | 25224/37963 [60:33:39<26:55:32,  7.61s/it]
 66%|██████▋   | 25225/37963 [60:33:53<33:49:53,  9.56s/it]
 66%|██████▋   | 25226/37963 [60:34:00<31:42:20,  8.96s/it]
 66%|██████▋   | 25227/37963 [60:34:08<30:12:54,  8.54s/it]
 66%|██████▋   | 25228/37963 [60:34:15<29:01:23,  8.20s/it]
 66%|██████▋   | 25229/37963 [60:34:23<28:10:25,  7.96s/it]
 66%|██████▋   | 25230/37963 [60:34:30<27:43:43,  7.84s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '2.262', 'learning_rate': '5.343e-06', 'epoch': '0.6646'}

 66%|██████▋   | 25230/37963 [60:34:30<27:43:43,  7.84s/it]
 66%|██████▋   | 25231/37963 [60:34:38<27:22:30,  7.74s/it]
 66%|██████▋   | 25232/37963 [60:34:45<27:08:11,  7.67s/it]
 66%|██████▋   | 25233/37963 [60:34:53<26:56:44,  7.62s/it]
 66%|██████▋   | 25234/37963 [60:35:00<26:51:30,  7.60s/it]
 66%|██████▋   | 25235/37963 [60:35:14<33:19:20,  9.42s/it]
 66%|██████▋   | 25236/37963 [60:35:22<31:18:59,  8.86s/it]
 66%|██████▋   | 25237/37963 [60:35:29<29:53:38,  8.46s/it]
 66%|██████▋   | 25238/37963 [60:35:43<35:44:56, 10.11s/it]
 66%|██████▋   | 25239/37963 [60:35:51<33:00:05,  9.34s/it]
 66%|██████▋   | 25240/37963 [60:35:58<31:03:40,  8.79s/it]
                                                           
{'loss': '0.127', 'grad_norm': '1.39', 'learning_rate': '5.336e-06', 'epoch': '0.6649'}

 66%|██████▋   | 25240/37963 [60:35:58<31:03:40,  8.79s/it]
 66%|██████▋   | 25241/37963 [60:36:12<36:33:18, 10.34s/it]
 66%|██████▋   | 25242/37963 [60:36:20<33:33:07,  9.50s/it]
 66%|██████▋   | 25243/37963 [60:36:27<31:31:55,  8.92s/it]
 66%|██████▋   | 25244/37963 [60:36:48<44:01:41, 12.46s/it]
 66%|██████▋   | 25245/37963 [60:36:56<38:51:51, 11.00s/it]
 67%|██████▋   | 25246/37963 [60:37:03<35:15:29,  9.98s/it]
 67%|██████▋   | 25247/37963 [60:37:17<38:56:58, 11.03s/it]
 67%|██████▋   | 25248/37963 [60:37:24<35:11:14,  9.96s/it]
 67%|██████▋   | 25249/37963 [60:37:38<39:25:49, 11.16s/it]
 67%|██████▋   | 25250/37963 [60:37:46<35:39:42, 10.10s/it]
                                                           
{'loss': '0.1207', 'grad_norm': '2.443', 'learning_rate': '5.328e-06', 'epoch': '0.6651'}

 67%|██████▋   | 25250/37963 [60:37:46<35:39:42, 10.10s/it]
 67%|██████▋   | 25251/37963 [60:37:53<32:54:40,  9.32s/it]
 67%|██████▋   | 25252/37963 [60:38:01<30:57:26,  8.77s/it]
 67%|██████▋   | 25253/37963 [60:38:08<29:44:11,  8.42s/it]
 67%|██████▋   | 25254/37963 [60:38:16<28:44:22,  8.14s/it]
 67%|██████▋   | 25255/37963 [60:38:23<28:03:05,  7.95s/it]
 67%|██████▋   | 25256/37963 [60:38:31<27:44:30,  7.86s/it]
 67%|██████▋   | 25257/37963 [60:38:38<27:23:26,  7.76s/it]
 67%|██████▋   | 25258/37963 [60:38:46<27:02:01,  7.66s/it]
 67%|██████▋   | 25259/37963 [60:38:53<26:55:50,  7.63s/it]
 67%|██████▋   | 25260/37963 [60:39:01<26:52:04,  7.61s/it]
                                                           
{'loss': '0.1182', 'grad_norm': '2.678', 'learning_rate': '5.32e-06', 'epoch': '0.6654'}

 67%|██████▋   | 25260/37963 [60:39:01<26:52:04,  7.61s/it]
 67%|██████▋   | 25261/37963 [60:39:09<26:46:00,  7.59s/it]
 67%|██████▋   | 25262/37963 [60:39:16<26:38:12,  7.55s/it]
 67%|██████▋   | 25263/37963 [60:39:23<26:32:59,  7.53s/it]
 67%|██████▋   | 25264/37963 [60:39:31<26:33:31,  7.53s/it]
 67%|██████▋   | 25265/37963 [60:39:39<26:39:26,  7.56s/it]
 67%|██████▋   | 25266/37963 [60:39:46<26:36:53,  7.55s/it]
 67%|██████▋   | 25267/37963 [60:39:54<26:35:47,  7.54s/it]
 67%|██████▋   | 25268/37963 [60:40:01<26:35:01,  7.54s/it]
 67%|██████▋   | 25269/37963 [60:40:15<32:59:02,  9.35s/it]
 67%|██████▋   | 25270/37963 [60:40:22<30:59:58,  8.79s/it]
                                                           
{'loss': '0.1244', 'grad_norm': '2.113', 'learning_rate': '5.313e-06', 'epoch': '0.6657'}

 67%|██████▋   | 25270/37963 [60:40:22<30:59:58,  8.79s/it]
 67%|██████▋   | 25271/37963 [60:40:30<29:36:21,  8.40s/it]
 67%|██████▋   | 25272/37963 [60:40:37<28:39:46,  8.13s/it]
 67%|██████▋   | 25273/37963 [60:40:45<27:54:44,  7.92s/it]
 67%|██████▋   | 25274/37963 [60:40:52<27:26:32,  7.79s/it]
 67%|██████▋   | 25275/37963 [60:41:00<27:04:38,  7.68s/it]
 67%|██████▋   | 25276/37963 [60:41:07<26:51:26,  7.62s/it]
 67%|██████▋   | 25277/37963 [60:41:15<26:47:00,  7.60s/it]
 67%|██████▋   | 25278/37963 [60:41:22<26:48:10,  7.61s/it]
 67%|██████▋   | 25279/37963 [60:41:30<26:41:08,  7.57s/it]
 67%|██████▋   | 25280/37963 [60:41:37<26:37:32,  7.56s/it]
                                                           
{'loss': '0.1245', 'grad_norm': '1.721', 'learning_rate': '5.305e-06', 'epoch': '0.6659'}

 67%|██████▋   | 25280/37963 [60:41:37<26:37:32,  7.56s/it]
 67%|██████▋   | 25281/37963 [60:41:45<26:37:02,  7.56s/it]
 67%|██████▋   | 25282/37963 [60:42:05<40:10:02, 11.40s/it]
 67%|██████▋   | 25283/37963 [60:42:13<36:08:24, 10.26s/it]
 67%|██████▋   | 25284/37963 [60:42:20<33:16:24,  9.45s/it]
 67%|██████▋   | 25285/37963 [60:42:27<30:44:56,  8.73s/it]
 67%|██████▋   | 25286/37963 [60:42:35<29:27:32,  8.37s/it]
 67%|██████▋   | 25287/37963 [60:42:42<28:32:05,  8.10s/it]
 67%|██████▋   | 25288/37963 [60:42:50<27:54:14,  7.93s/it]
 67%|██████▋   | 25289/37963 [60:43:04<34:28:08,  9.79s/it]
 67%|██████▋   | 25290/37963 [60:43:12<32:10:48,  9.14s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '1.665', 'learning_rate': '5.298e-06', 'epoch': '0.6662'}

 67%|██████▋   | 25290/37963 [60:43:12<32:10:48,  9.14s/it]
 67%|██████▋   | 25291/37963 [60:43:19<29:57:04,  8.51s/it]
 67%|██████▋   | 25292/37963 [60:43:26<28:54:15,  8.21s/it]
 67%|██████▋   | 25293/37963 [60:43:34<27:58:39,  7.95s/it]
 67%|██████▋   | 25294/37963 [60:43:47<33:54:26,  9.64s/it]
 67%|██████▋   | 25295/37963 [60:44:01<38:20:10, 10.89s/it]
 67%|██████▋   | 25296/37963 [60:44:09<34:48:48,  9.89s/it]
 67%|██████▋   | 25297/37963 [60:44:22<38:57:57, 11.08s/it]
 67%|██████▋   | 25298/37963 [60:44:30<35:13:09, 10.01s/it]
 67%|██████▋   | 25299/37963 [60:44:44<39:32:14, 11.24s/it]
 67%|██████▋   | 25300/37963 [60:44:52<35:40:37, 10.14s/it]
                                                           
{'loss': '0.12', 'grad_norm': '1.894', 'learning_rate': '5.29e-06', 'epoch': '0.6664'}

 67%|██████▋   | 25300/37963 [60:44:52<35:40:37, 10.14s/it]
 67%|██████▋   | 25301/37963 [60:44:59<33:06:04,  9.41s/it]
 67%|██████▋   | 25302/37963 [60:45:07<31:05:38,  8.84s/it]
 67%|██████▋   | 25303/37963 [60:45:14<29:23:24,  8.36s/it]
 67%|██████▋   | 25304/37963 [60:45:22<28:36:36,  8.14s/it]
 67%|██████▋   | 25305/37963 [60:45:29<27:35:33,  7.85s/it]
 67%|██████▋   | 25306/37963 [60:45:36<27:20:32,  7.78s/it]
 67%|██████▋   | 25307/37963 [60:45:44<27:09:38,  7.73s/it]
 67%|██████▋   | 25308/37963 [60:45:51<26:50:53,  7.64s/it]
 67%|██████▋   | 25309/37963 [60:45:59<26:46:09,  7.62s/it]
 67%|██████▋   | 25310/37963 [60:46:07<26:42:14,  7.60s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '2.333', 'learning_rate': '5.283e-06', 'epoch': '0.6667'}

 67%|██████▋   | 25310/37963 [60:46:07<26:42:14,  7.60s/it]
 67%|██████▋   | 25311/37963 [60:46:14<26:33:16,  7.56s/it]
 67%|██████▋   | 25312/37963 [60:46:22<26:33:18,  7.56s/it]
 67%|██████▋   | 25313/37963 [60:46:29<26:11:03,  7.45s/it]
 67%|██████▋   | 25314/37963 [60:46:36<25:55:15,  7.38s/it]
 67%|██████▋   | 25315/37963 [60:46:43<25:53:24,  7.37s/it]
 67%|██████▋   | 25316/37963 [60:46:58<33:00:33,  9.40s/it]
 67%|██████▋   | 25317/37963 [60:47:05<30:53:52,  8.80s/it]
 67%|██████▋   | 25318/37963 [60:47:12<29:36:13,  8.43s/it]
 67%|██████▋   | 25319/37963 [60:47:20<28:37:44,  8.15s/it]
 67%|██████▋   | 25320/37963 [60:47:28<27:57:32,  7.96s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '1.614', 'learning_rate': '5.275e-06', 'epoch': '0.667'}

 67%|██████▋   | 25320/37963 [60:47:28<27:57:32,  7.96s/it]
 67%|██████▋   | 25321/37963 [60:47:35<27:23:15,  7.80s/it]
 67%|██████▋   | 25322/37963 [60:47:42<26:50:29,  7.64s/it]
 67%|██████▋   | 25323/37963 [60:47:50<26:41:44,  7.60s/it]
 67%|██████▋   | 25324/37963 [60:47:57<26:37:59,  7.59s/it]
 67%|██████▋   | 25325/37963 [60:48:05<26:41:50,  7.60s/it]
 67%|██████▋   | 25326/37963 [60:48:13<26:44:56,  7.62s/it]
 67%|██████▋   | 25327/37963 [60:48:20<26:40:18,  7.60s/it]
 67%|██████▋   | 25328/37963 [60:48:28<26:44:15,  7.62s/it]
 67%|██████▋   | 25329/37963 [60:48:35<26:48:27,  7.64s/it]
 67%|██████▋   | 25330/37963 [60:48:50<33:36:37,  9.58s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '3.013', 'learning_rate': '5.268e-06', 'epoch': '0.6672'}

 67%|██████▋   | 25330/37963 [60:48:50<33:36:37,  9.58s/it]
 67%|██████▋   | 25331/37963 [60:49:03<38:01:31, 10.84s/it]
 67%|██████▋   | 25332/37963 [60:49:11<34:25:44,  9.81s/it]
 67%|██████▋   | 25333/37963 [60:49:18<31:53:25,  9.09s/it]
 67%|██████▋   | 25334/37963 [60:49:26<30:17:08,  8.63s/it]
 67%|██████▋   | 25335/37963 [60:49:33<28:57:27,  8.26s/it]
 67%|██████▋   | 25336/37963 [60:49:41<28:10:16,  8.03s/it]
 67%|██████▋   | 25337/37963 [60:49:48<27:37:29,  7.88s/it]
 67%|██████▋   | 25338/37963 [60:49:56<27:14:22,  7.77s/it]
 67%|██████▋   | 25339/37963 [60:50:10<33:46:21,  9.63s/it]
 67%|██████▋   | 25340/37963 [60:50:17<31:19:18,  8.93s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.36', 'learning_rate': '5.26e-06', 'epoch': '0.6675'}

 67%|██████▋   | 25340/37963 [60:50:17<31:19:18,  8.93s/it]
 67%|██████▋   | 25341/37963 [60:50:25<29:58:03,  8.55s/it]
 67%|██████▋   | 25342/37963 [60:50:32<28:56:02,  8.25s/it]
 67%|██████▋   | 25343/37963 [60:50:40<28:15:45,  8.06s/it]
 67%|██████▋   | 25344/37963 [60:50:47<27:45:58,  7.92s/it]
 67%|██████▋   | 25345/37963 [60:51:01<33:47:53,  9.64s/it]
 67%|██████▋   | 25346/37963 [60:51:15<38:21:16, 10.94s/it]
 67%|██████▋   | 25347/37963 [60:51:29<41:35:38, 11.87s/it]
 67%|██████▋   | 25348/37963 [60:51:36<36:42:14, 10.47s/it]
 67%|██████▋   | 25349/37963 [60:51:50<40:20:15, 11.51s/it]
 67%|██████▋   | 25350/37963 [60:51:58<36:06:42, 10.31s/it]
                                                           
{'loss': '0.1292', 'grad_norm': '2.277', 'learning_rate': '5.253e-06', 'epoch': '0.6678'}

 67%|██████▋   | 25350/37963 [60:51:58<36:06:42, 10.31s/it]
 67%|██████▋   | 25351/37963 [60:52:05<33:09:52,  9.47s/it]
 67%|██████▋   | 25352/37963 [60:52:13<31:01:30,  8.86s/it]
 67%|██████▋   | 25353/37963 [60:52:20<29:30:34,  8.42s/it]
 67%|██████▋   | 25354/37963 [60:52:28<28:40:55,  8.19s/it]
 67%|██████▋   | 25355/37963 [60:52:35<27:57:33,  7.98s/it]
 67%|██████▋   | 25356/37963 [60:52:43<27:32:34,  7.87s/it]
 67%|██████▋   | 25357/37963 [60:52:50<27:12:47,  7.77s/it]
 67%|██████▋   | 25358/37963 [60:52:58<26:59:15,  7.71s/it]
 67%|██████▋   | 25359/37963 [60:53:05<26:48:41,  7.66s/it]
 67%|██████▋   | 25360/37963 [60:53:13<26:35:14,  7.59s/it]
                                                           
{'loss': '0.1142', 'grad_norm': '2.341', 'learning_rate': '5.245e-06', 'epoch': '0.668'}

 67%|██████▋   | 25360/37963 [60:53:13<26:35:14,  7.59s/it]
 67%|██████▋   | 25361/37963 [60:53:20<26:33:06,  7.59s/it]
 67%|██████▋   | 25362/37963 [60:53:28<26:35:13,  7.60s/it]
 67%|██████▋   | 25363/37963 [60:53:35<26:11:04,  7.48s/it]
 67%|██████▋   | 25364/37963 [60:53:43<26:19:23,  7.52s/it]
 67%|██████▋   | 25365/37963 [60:53:50<26:20:08,  7.53s/it]
 67%|██████▋   | 25366/37963 [60:53:58<26:22:51,  7.54s/it]
 67%|██████▋   | 25367/37963 [60:54:05<26:19:15,  7.52s/it]
 67%|██████▋   | 25368/37963 [60:54:13<26:24:04,  7.55s/it]
 67%|██████▋   | 25369/37963 [60:54:27<33:03:42,  9.45s/it]
 67%|██████▋   | 25370/37963 [60:54:34<30:47:46,  8.80s/it]
                                                           
{'loss': '0.1357', 'grad_norm': '2.374', 'learning_rate': '5.238e-06', 'epoch': '0.6683'}

 67%|██████▋   | 25370/37963 [60:54:34<30:47:46,  8.80s/it]
 67%|██████▋   | 25371/37963 [60:54:42<29:37:55,  8.47s/it]
 67%|██████▋   | 25372/37963 [60:54:50<28:40:00,  8.20s/it]
 67%|██████▋   | 25373/37963 [60:54:57<27:57:03,  7.99s/it]
 67%|██████▋   | 25374/37963 [60:55:05<27:33:19,  7.88s/it]
 67%|██████▋   | 25375/37963 [60:55:12<27:07:33,  7.76s/it]
 67%|██████▋   | 25376/37963 [60:55:26<33:25:53,  9.56s/it]
 67%|██████▋   | 25377/37963 [60:55:34<31:28:48,  9.00s/it]
 67%|██████▋   | 25378/37963 [60:55:41<29:55:00,  8.56s/it]
 67%|██████▋   | 25379/37963 [60:55:49<28:52:45,  8.26s/it]
 67%|██████▋   | 25380/37963 [60:55:56<27:49:39,  7.96s/it]
                                                           
{'loss': '0.1361', 'grad_norm': '1.113', 'learning_rate': '5.23e-06', 'epoch': '0.6685'}

 67%|██████▋   | 25380/37963 [60:55:56<27:49:39,  7.96s/it]
 67%|██████▋   | 25381/37963 [60:56:04<27:30:22,  7.87s/it]
 67%|██████▋   | 25382/37963 [60:56:11<26:57:49,  7.72s/it]
 67%|██████▋   | 25383/37963 [60:56:18<26:47:43,  7.67s/it]
 67%|██████▋   | 25384/37963 [60:56:26<26:36:47,  7.62s/it]
 67%|██████▋   | 25385/37963 [60:56:40<33:19:32,  9.54s/it]
 67%|██████▋   | 25386/37963 [60:56:54<37:41:53, 10.79s/it]
 67%|██████▋   | 25387/37963 [60:57:01<34:03:44,  9.75s/it]
 67%|██████▋   | 25388/37963 [60:57:09<31:45:18,  9.09s/it]
 67%|██████▋   | 25389/37963 [60:57:16<30:09:19,  8.63s/it]
 67%|██████▋   | 25390/37963 [60:57:30<35:43:13, 10.23s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '1.557', 'learning_rate': '5.223e-06', 'epoch': '0.6688'}

 67%|██████▋   | 25390/37963 [60:57:30<35:43:13, 10.23s/it]
 67%|██████▋   | 25391/37963 [60:57:38<32:50:38,  9.40s/it]
 67%|██████▋   | 25392/37963 [60:57:45<30:56:28,  8.86s/it]
 67%|██████▋   | 25393/37963 [60:57:53<29:25:03,  8.43s/it]
 67%|██████▋   | 25394/37963 [60:58:06<35:07:55, 10.06s/it]
 67%|██████▋   | 25395/37963 [60:58:21<39:25:52, 11.29s/it]
 67%|██████▋   | 25396/37963 [60:58:28<35:28:40, 10.16s/it]
 67%|██████▋   | 25397/37963 [60:58:36<32:46:19,  9.39s/it]
 67%|██████▋   | 25398/37963 [60:58:50<37:32:44, 10.76s/it]
 67%|██████▋   | 25399/37963 [60:58:58<34:27:11,  9.87s/it]
 67%|██████▋   | 25400/37963 [60:59:05<31:50:46,  9.13s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.25', 'learning_rate': '5.215e-06', 'epoch': '0.6691'}

 67%|██████▋   | 25400/37963 [60:59:05<31:50:46,  9.13s/it]
 67%|██████▋   | 25401/37963 [60:59:12<30:12:44,  8.66s/it]
 67%|██████▋   | 25402/37963 [60:59:20<29:04:36,  8.33s/it]
 67%|██████▋   | 25403/37963 [60:59:28<28:09:31,  8.07s/it]
 67%|██████▋   | 25404/37963 [60:59:35<27:44:22,  7.95s/it]
 67%|██████▋   | 25405/37963 [60:59:43<27:20:48,  7.84s/it]
 67%|██████▋   | 25406/37963 [60:59:50<27:01:55,  7.75s/it]
 67%|██████▋   | 25407/37963 [60:59:58<26:44:07,  7.67s/it]
 67%|██████▋   | 25408/37963 [61:00:05<26:21:33,  7.56s/it]
 67%|██████▋   | 25409/37963 [61:00:13<26:18:44,  7.55s/it]
 67%|██████▋   | 25410/37963 [61:00:20<26:18:33,  7.55s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '1.371', 'learning_rate': '5.208e-06', 'epoch': '0.6693'}

 67%|██████▋   | 25410/37963 [61:00:20<26:18:33,  7.55s/it]
 67%|██████▋   | 25411/37963 [61:00:28<26:26:10,  7.58s/it]
 67%|██████▋   | 25412/37963 [61:00:35<26:21:58,  7.56s/it]
 67%|██████▋   | 25413/37963 [61:00:43<26:21:31,  7.56s/it]
 67%|██████▋   | 25414/37963 [61:00:50<26:19:40,  7.55s/it]
 67%|██████▋   | 25415/37963 [61:00:58<26:20:27,  7.56s/it]
 67%|██████▋   | 25416/37963 [61:01:06<26:29:15,  7.60s/it]
 67%|██████▋   | 25417/37963 [61:01:13<26:29:31,  7.60s/it]
 67%|██████▋   | 25418/37963 [61:01:21<26:24:20,  7.58s/it]
 67%|██████▋   | 25419/37963 [61:01:29<26:32:22,  7.62s/it]
 67%|██████▋   | 25420/37963 [61:01:36<26:30:10,  7.61s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '2.039', 'learning_rate': '5.2e-06', 'epoch': '0.6696'}

 67%|██████▋   | 25420/37963 [61:01:36<26:30:10,  7.61s/it]
 67%|██████▋   | 25421/37963 [61:01:44<26:22:43,  7.57s/it]
 67%|██████▋   | 25422/37963 [61:01:51<26:10:41,  7.51s/it]
 67%|██████▋   | 25423/37963 [61:02:12<39:54:31, 11.46s/it]
 67%|██████▋   | 25424/37963 [61:02:19<35:53:35, 10.31s/it]
 67%|██████▋   | 25425/37963 [61:02:27<32:58:51,  9.47s/it]
 67%|██████▋   | 25426/37963 [61:02:34<31:06:12,  8.93s/it]
 67%|██████▋   | 25427/37963 [61:02:42<29:38:43,  8.51s/it]
 67%|██████▋   | 25428/37963 [61:02:49<28:28:53,  8.18s/it]
 67%|██████▋   | 25429/37963 [61:02:57<27:49:26,  7.99s/it]
 67%|██████▋   | 25430/37963 [61:03:04<27:18:41,  7.84s/it]
                                                           
{'loss': '0.1313', 'grad_norm': '1.953', 'learning_rate': '5.193e-06', 'epoch': '0.6699'}

 67%|██████▋   | 25430/37963 [61:03:04<27:18:41,  7.84s/it]
 67%|██████▋   | 25431/37963 [61:03:12<26:56:03,  7.74s/it]
 67%|██████▋   | 25432/37963 [61:03:19<26:45:10,  7.69s/it]
 67%|██████▋   | 25433/37963 [61:03:27<26:32:46,  7.63s/it]
 67%|██████▋   | 25434/37963 [61:03:41<32:42:57,  9.40s/it]
 67%|██████▋   | 25435/37963 [61:03:48<30:49:06,  8.86s/it]
 67%|██████▋   | 25436/37963 [61:03:56<29:27:41,  8.47s/it]
 67%|██████▋   | 25437/37963 [61:04:10<35:17:19, 10.14s/it]
 67%|██████▋   | 25438/37963 [61:04:17<32:34:57,  9.37s/it]
 67%|██████▋   | 25439/37963 [61:04:31<37:25:08, 10.76s/it]
 67%|██████▋   | 25440/37963 [61:04:46<41:03:25, 11.80s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '1.368', 'learning_rate': '5.185e-06', 'epoch': '0.6701'}

 67%|██████▋   | 25440/37963 [61:04:46<41:03:25, 11.80s/it]
 67%|██████▋   | 25441/37963 [61:04:53<36:34:53, 10.52s/it]
 67%|██████▋   | 25442/37963 [61:05:07<39:51:59, 11.46s/it]
 67%|██████▋   | 25443/37963 [61:05:14<35:52:06, 10.31s/it]
 67%|██████▋   | 25444/37963 [61:05:22<32:56:52,  9.47s/it]
 67%|██████▋   | 25445/37963 [61:05:29<30:49:50,  8.87s/it]
 67%|██████▋   | 25446/37963 [61:05:37<29:26:41,  8.47s/it]
 67%|██████▋   | 25447/37963 [61:05:51<35:23:42, 10.18s/it]
 67%|██████▋   | 25448/37963 [61:05:59<32:43:05,  9.41s/it]
 67%|██████▋   | 25449/37963 [61:06:06<30:45:30,  8.85s/it]
 67%|██████▋   | 25450/37963 [61:06:14<29:24:26,  8.46s/it]
                                                           
{'loss': '0.1303', 'grad_norm': '1.897', 'learning_rate': '5.178e-06', 'epoch': '0.6704'}

 67%|██████▋   | 25450/37963 [61:06:14<29:24:26,  8.46s/it]
 67%|██████▋   | 25451/37963 [61:06:21<28:25:25,  8.18s/it]
 67%|██████▋   | 25452/37963 [61:06:29<27:50:34,  8.01s/it]
 67%|██████▋   | 25453/37963 [61:06:36<27:15:49,  7.85s/it]
 67%|██████▋   | 25454/37963 [61:06:44<26:44:17,  7.70s/it]
 67%|██████▋   | 25455/37963 [61:06:51<26:24:06,  7.60s/it]
 67%|██████▋   | 25456/37963 [61:06:59<26:25:20,  7.61s/it]
 67%|██████▋   | 25457/37963 [61:07:06<26:23:11,  7.60s/it]
 67%|██████▋   | 25458/37963 [61:07:14<26:15:00,  7.56s/it]
 67%|██████▋   | 25459/37963 [61:07:21<26:05:34,  7.51s/it]
 67%|██████▋   | 25460/37963 [61:07:29<26:04:23,  7.51s/it]
                                                           
{'loss': '0.1167', 'grad_norm': '2.107', 'learning_rate': '5.17e-06', 'epoch': '0.6707'}

 67%|██████▋   | 25460/37963 [61:07:29<26:04:23,  7.51s/it]
 67%|██████▋   | 25461/37963 [61:07:36<26:05:16,  7.51s/it]
 67%|██████▋   | 25462/37963 [61:07:44<26:07:34,  7.52s/it]
 67%|██████▋   | 25463/37963 [61:07:51<26:09:21,  7.53s/it]
 67%|██████▋   | 25464/37963 [61:07:59<26:10:53,  7.54s/it]
 67%|██████▋   | 25465/37963 [61:08:06<26:07:04,  7.52s/it]
 67%|██████▋   | 25466/37963 [61:08:14<26:07:47,  7.53s/it]
 67%|██████▋   | 25467/37963 [61:08:21<25:59:14,  7.49s/it]
 67%|██████▋   | 25468/37963 [61:08:29<26:08:58,  7.53s/it]
 67%|██████▋   | 25469/37963 [61:08:36<26:02:32,  7.50s/it]
 67%|██████▋   | 25470/37963 [61:08:50<32:51:58,  9.47s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '1.859', 'learning_rate': '5.163e-06', 'epoch': '0.6709'}

 67%|██████▋   | 25470/37963 [61:08:50<32:51:58,  9.47s/it]
 67%|██████▋   | 25471/37963 [61:09:05<37:58:13, 10.94s/it]
 67%|██████▋   | 25472/37963 [61:09:12<34:18:24,  9.89s/it]
 67%|██████▋   | 25473/37963 [61:09:20<31:51:53,  9.18s/it]
 67%|██████▋   | 25474/37963 [61:09:27<30:05:47,  8.68s/it]
 67%|██████▋   | 25475/37963 [61:09:35<28:53:22,  8.33s/it]
 67%|██████▋   | 25476/37963 [61:09:42<28:02:10,  8.08s/it]
 67%|██████▋   | 25477/37963 [61:09:50<27:26:40,  7.91s/it]
 67%|██████▋   | 25478/37963 [61:09:57<27:05:36,  7.81s/it]
 67%|██████▋   | 25479/37963 [61:10:05<26:47:26,  7.73s/it]
 67%|██████▋   | 25480/37963 [61:10:12<26:28:43,  7.64s/it]
                                                           
{'loss': '0.1305', 'grad_norm': '1.407', 'learning_rate': '5.155e-06', 'epoch': '0.6712'}

 67%|██████▋   | 25480/37963 [61:10:12<26:28:43,  7.64s/it]
 67%|██████▋   | 25481/37963 [61:10:20<26:20:31,  7.60s/it]
 67%|██████▋   | 25482/37963 [61:10:27<26:13:11,  7.56s/it]
 67%|██████▋   | 25483/37963 [61:10:35<26:11:27,  7.56s/it]
 67%|██████▋   | 25484/37963 [61:10:55<39:42:01, 11.45s/it]
 67%|██████▋   | 25485/37963 [61:11:03<35:41:01, 10.30s/it]
 67%|██████▋   | 25486/37963 [61:11:17<39:33:56, 11.42s/it]
 67%|██████▋   | 25487/37963 [61:11:31<42:15:42, 12.19s/it]
 67%|██████▋   | 25488/37963 [61:11:45<44:18:10, 12.78s/it]
 67%|██████▋   | 25489/37963 [61:11:53<38:52:31, 11.22s/it]
 67%|██████▋   | 25490/37963 [61:12:00<35:06:24, 10.13s/it]
                                                           
{'loss': '0.1167', 'grad_norm': '1.974', 'learning_rate': '5.148e-06', 'epoch': '0.6714'}

 67%|██████▋   | 25490/37963 [61:12:00<35:06:24, 10.13s/it]
 67%|██████▋   | 25491/37963 [61:12:08<32:24:43,  9.36s/it]
 67%|██████▋   | 25492/37963 [61:12:15<30:35:11,  8.83s/it]
 67%|██████▋   | 25493/37963 [61:12:23<29:08:52,  8.41s/it]
 67%|██████▋   | 25494/37963 [61:12:37<35:04:06, 10.12s/it]
 67%|██████▋   | 25495/37963 [61:12:45<32:25:42,  9.36s/it]
 67%|██████▋   | 25496/37963 [61:12:52<30:25:56,  8.79s/it]
 67%|██████▋   | 25497/37963 [61:13:00<29:15:27,  8.45s/it]
 67%|██████▋   | 25498/37963 [61:13:07<28:19:17,  8.18s/it]
 67%|██████▋   | 25499/37963 [61:13:15<27:41:30,  8.00s/it]
 67%|██████▋   | 25500/37963 [61:13:22<27:14:17,  7.87s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '2.153', 'learning_rate': '5.141e-06', 'epoch': '0.6717'}

 67%|██████▋   | 25500/37963 [61:13:22<27:14:17,  7.87s/it]
 67%|██████▋   | 25501/37963 [61:13:30<26:51:14,  7.76s/it]
 67%|██████▋   | 25502/37963 [61:13:37<26:25:59,  7.64s/it]
 67%|██████▋   | 25503/37963 [61:13:45<26:19:39,  7.61s/it]
 67%|██████▋   | 25504/37963 [61:13:52<26:15:30,  7.59s/it]
 67%|██████▋   | 25505/37963 [61:14:00<26:09:09,  7.56s/it]
 67%|██████▋   | 25506/37963 [61:14:07<26:02:21,  7.53s/it]
 67%|██████▋   | 25507/37963 [61:14:15<26:00:41,  7.52s/it]
 67%|██████▋   | 25508/37963 [61:14:22<26:00:58,  7.52s/it]
 67%|██████▋   | 25509/37963 [61:14:30<25:59:30,  7.51s/it]
 67%|██████▋   | 25510/37963 [61:14:37<26:00:24,  7.52s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '1.396', 'learning_rate': '5.133e-06', 'epoch': '0.672'}

 67%|██████▋   | 25510/37963 [61:14:37<26:00:24,  7.52s/it]
 67%|██████▋   | 25511/37963 [61:14:45<25:51:36,  7.48s/it]
 67%|██████▋   | 25512/37963 [61:14:52<25:37:59,  7.41s/it]
 67%|██████▋   | 25513/37963 [61:15:00<25:48:24,  7.46s/it]
 67%|██████▋   | 25514/37963 [61:15:07<25:51:42,  7.48s/it]
 67%|██████▋   | 25515/37963 [61:15:14<25:32:37,  7.39s/it]
 67%|██████▋   | 25516/37963 [61:15:28<32:20:40,  9.35s/it]
 67%|██████▋   | 25517/37963 [61:15:36<30:22:44,  8.79s/it]
 67%|██████▋   | 25518/37963 [61:15:50<35:45:23, 10.34s/it]
 67%|██████▋   | 25519/37963 [61:15:57<32:54:58,  9.52s/it]
 67%|██████▋   | 25520/37963 [61:16:05<30:47:36,  8.91s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '2.433', 'learning_rate': '5.126e-06', 'epoch': '0.6722'}

 67%|██████▋   | 25520/37963 [61:16:05<30:47:36,  8.91s/it]
 67%|██████▋   | 25521/37963 [61:16:12<29:32:18,  8.55s/it]
 67%|██████▋   | 25522/37963 [61:16:20<28:36:46,  8.28s/it]
 67%|██████▋   | 25523/37963 [61:16:28<27:52:21,  8.07s/it]
 67%|██████▋   | 25524/37963 [61:16:35<27:22:31,  7.92s/it]
 67%|██████▋   | 25525/37963 [61:16:43<26:58:17,  7.81s/it]
 67%|██████▋   | 25526/37963 [61:16:50<26:43:07,  7.73s/it]
 67%|██████▋   | 25527/37963 [61:16:58<26:29:28,  7.67s/it]
 67%|██████▋   | 25528/37963 [61:17:12<32:55:43,  9.53s/it]
 67%|██████▋   | 25529/37963 [61:17:19<31:07:55,  9.01s/it]
 67%|██████▋   | 25530/37963 [61:17:27<29:35:53,  8.57s/it]
                                                           
{'loss': '0.1397', 'grad_norm': '3.366', 'learning_rate': '5.118e-06', 'epoch': '0.6725'}

 67%|██████▋   | 25530/37963 [61:17:27<29:35:53,  8.57s/it]
 67%|██████▋   | 25531/37963 [61:17:35<28:30:01,  8.25s/it]
 67%|██████▋   | 25532/37963 [61:17:42<27:49:15,  8.06s/it]
 67%|██████▋   | 25533/37963 [61:17:50<27:14:09,  7.89s/it]
 67%|██████▋   | 25534/37963 [61:18:03<33:14:59,  9.63s/it]
 67%|██████▋   | 25535/37963 [61:18:11<31:07:10,  9.01s/it]
 67%|██████▋   | 25536/37963 [61:18:25<36:24:14, 10.55s/it]
 67%|██████▋   | 25537/37963 [61:18:33<33:19:25,  9.65s/it]
 67%|██████▋   | 25538/37963 [61:18:40<31:21:40,  9.09s/it]
 67%|██████▋   | 25539/37963 [61:18:54<36:29:17, 10.57s/it]
 67%|██████▋   | 25540/37963 [61:19:02<33:25:53,  9.69s/it]
                                                           
{'loss': '0.1306', 'grad_norm': '1.93', 'learning_rate': '5.111e-06', 'epoch': '0.6728'}

 67%|██████▋   | 25540/37963 [61:19:02<33:25:53,  9.69s/it]
 67%|██████▋   | 25541/37963 [61:19:16<37:36:45, 10.90s/it]
 67%|██████▋   | 25542/37963 [61:19:23<34:07:04,  9.89s/it]
 67%|██████▋   | 25543/37963 [61:19:31<31:44:08,  9.20s/it]
 67%|██████▋   | 25544/37963 [61:19:38<29:58:23,  8.69s/it]
 67%|██████▋   | 25545/37963 [61:19:52<35:22:43, 10.26s/it]
 67%|██████▋   | 25546/37963 [61:20:00<32:27:31,  9.41s/it]
 67%|██████▋   | 25547/37963 [61:20:07<30:30:03,  8.84s/it]
 67%|██████▋   | 25548/37963 [61:20:15<28:55:20,  8.39s/it]
 67%|██████▋   | 25549/37963 [61:20:22<28:01:40,  8.13s/it]
 67%|██████▋   | 25550/37963 [61:20:29<27:05:27,  7.86s/it]
                                                           
{'loss': '0.1255', 'grad_norm': '2.141', 'learning_rate': '5.103e-06', 'epoch': '0.673'}

 67%|██████▋   | 25550/37963 [61:20:29<27:05:27,  7.86s/it]
 67%|██████▋   | 25551/37963 [61:20:37<26:30:58,  7.69s/it]
 67%|██████▋   | 25552/37963 [61:20:44<26:06:03,  7.57s/it]
 67%|██████▋   | 25553/37963 [61:20:51<25:57:33,  7.53s/it]
 67%|██████▋   | 25554/37963 [61:20:59<25:57:09,  7.53s/it]
 67%|██████▋   | 25555/37963 [61:21:06<25:56:20,  7.53s/it]
 67%|██████▋   | 25556/37963 [61:21:14<25:46:17,  7.48s/it]
 67%|██████▋   | 25557/37963 [61:21:21<25:48:10,  7.49s/it]
 67%|██████▋   | 25558/37963 [61:21:29<25:46:00,  7.48s/it]
 67%|██████▋   | 25559/37963 [61:21:36<26:02:32,  7.56s/it]
 67%|██████▋   | 25560/37963 [61:21:44<26:00:47,  7.55s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '3.104', 'learning_rate': '5.096e-06', 'epoch': '0.6733'}

 67%|██████▋   | 25560/37963 [61:21:44<26:00:47,  7.55s/it]
 67%|██████▋   | 25561/37963 [61:21:52<26:04:15,  7.57s/it]
 67%|██████▋   | 25562/37963 [61:21:59<26:01:48,  7.56s/it]
 67%|██████▋   | 25563/37963 [61:22:07<26:02:07,  7.56s/it]
 67%|██████▋   | 25564/37963 [61:22:27<39:30:58, 11.47s/it]
 67%|██████▋   | 25565/37963 [61:22:35<35:34:10, 10.33s/it]
 67%|██████▋   | 25566/37963 [61:22:42<32:36:17,  9.47s/it]
 67%|██████▋   | 25567/37963 [61:22:50<30:44:47,  8.93s/it]
 67%|██████▋   | 25568/37963 [61:22:58<29:22:56,  8.53s/it]
 67%|██████▋   | 25569/37963 [61:23:05<28:21:02,  8.23s/it]
 67%|██████▋   | 25570/37963 [61:23:13<27:28:34,  7.98s/it]
                                                           
{'loss': '0.1234', 'grad_norm': '1.634', 'learning_rate': '5.088e-06', 'epoch': '0.6736'}

 67%|██████▋   | 25570/37963 [61:23:13<27:28:34,  7.98s/it]
 67%|██████▋   | 25571/37963 [61:23:20<27:05:49,  7.87s/it]
 67%|██████▋   | 25572/37963 [61:23:28<26:31:00,  7.70s/it]
 67%|██████▋   | 25573/37963 [61:23:35<26:23:22,  7.67s/it]
 67%|██████▋   | 25574/37963 [61:23:43<26:15:16,  7.63s/it]
 67%|██████▋   | 25575/37963 [61:23:50<26:12:41,  7.62s/it]
 67%|██████▋   | 25576/37963 [61:24:04<32:53:26,  9.56s/it]
 67%|██████▋   | 25577/37963 [61:24:18<37:05:32, 10.78s/it]
 67%|██████▋   | 25578/37963 [61:24:25<33:30:19,  9.74s/it]
 67%|██████▋   | 25579/37963 [61:24:33<31:13:44,  9.08s/it]
 67%|██████▋   | 25580/37963 [61:24:40<29:43:07,  8.64s/it]
                                                           
{'loss': '0.115', 'grad_norm': '1.795', 'learning_rate': '5.081e-06', 'epoch': '0.6738'}

 67%|██████▋   | 25580/37963 [61:24:40<29:43:07,  8.64s/it]
 67%|██████▋   | 25581/37963 [61:24:48<28:33:04,  8.30s/it]
 67%|██████▋   | 25582/37963 [61:24:56<27:46:41,  8.08s/it]
 67%|██████▋   | 25583/37963 [61:25:03<27:15:29,  7.93s/it]
 67%|██████▋   | 25584/37963 [61:25:11<26:50:19,  7.81s/it]
 67%|██████▋   | 25585/37963 [61:25:25<33:32:36,  9.76s/it]
 67%|██████▋   | 25586/37963 [61:25:32<31:11:55,  9.07s/it]
 67%|██████▋   | 25587/37963 [61:25:46<36:21:12, 10.57s/it]
 67%|██████▋   | 25588/37963 [61:26:00<39:48:52, 11.58s/it]
 67%|██████▋   | 25589/37963 [61:26:08<35:27:05, 10.31s/it]
 67%|██████▋   | 25590/37963 [61:26:15<32:37:49,  9.49s/it]
                                                           
{'loss': '0.128', 'grad_norm': '4.67', 'learning_rate': '5.074e-06', 'epoch': '0.6741'}

 67%|██████▋   | 25590/37963 [61:26:15<32:37:49,  9.49s/it]
 67%|██████▋   | 25591/37963 [61:26:29<37:18:22, 10.86s/it]
 67%|██████▋   | 25592/37963 [61:26:37<34:06:23,  9.93s/it]
 67%|██████▋   | 25593/37963 [61:26:45<31:38:07,  9.21s/it]
 67%|██████▋   | 25594/37963 [61:26:52<29:56:25,  8.71s/it]
 67%|██████▋   | 25595/37963 [61:27:00<28:45:29,  8.37s/it]
 67%|██████▋   | 25596/37963 [61:27:07<27:34:45,  8.03s/it]
 67%|██████▋   | 25597/37963 [61:27:15<27:00:45,  7.86s/it]
 67%|██████▋   | 25598/37963 [61:27:22<26:42:40,  7.78s/it]
 67%|██████▋   | 25599/37963 [61:27:30<26:38:20,  7.76s/it]
 67%|██████▋   | 25600/37963 [61:27:37<26:08:13,  7.61s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '1.511', 'learning_rate': '5.066e-06', 'epoch': '0.6743'}

 67%|██████▋   | 25600/37963 [61:27:37<26:08:13,  7.61s/it]
 67%|██████▋   | 25601/37963 [61:27:45<25:57:55,  7.56s/it]
 67%|██████▋   | 25602/37963 [61:27:52<25:45:49,  7.50s/it]
 67%|██████▋   | 25603/37963 [61:27:59<25:29:19,  7.42s/it]
 67%|██████▋   | 25604/37963 [61:28:07<25:39:25,  7.47s/it]
 67%|██████▋   | 25605/37963 [61:28:14<25:13:07,  7.35s/it]
 67%|██████▋   | 25606/37963 [61:28:21<25:28:35,  7.42s/it]
 67%|██████▋   | 25607/37963 [61:28:29<25:31:46,  7.44s/it]
 67%|██████▋   | 25608/37963 [61:28:36<25:14:44,  7.36s/it]
 67%|██████▋   | 25609/37963 [61:28:44<25:34:25,  7.45s/it]
 67%|██████▋   | 25610/37963 [61:28:51<25:40:42,  7.48s/it]
                                                           
{'loss': '0.13', 'grad_norm': '1.889', 'learning_rate': '5.059e-06', 'epoch': '0.6746'}

 67%|██████▋   | 25610/37963 [61:28:51<25:40:42,  7.48s/it]
 67%|██████▋   | 25611/37963 [61:29:05<32:23:48,  9.44s/it]
 67%|██████▋   | 25612/37963 [61:29:13<30:36:03,  8.92s/it]
 67%|██████▋   | 25613/37963 [61:29:27<35:55:50, 10.47s/it]
 67%|██████▋   | 25614/37963 [61:29:34<32:49:33,  9.57s/it]
 67%|██████▋   | 25615/37963 [61:29:42<30:44:45,  8.96s/it]
 67%|██████▋   | 25616/37963 [61:29:50<29:18:43,  8.55s/it]
 67%|██████▋   | 25617/37963 [61:29:57<28:15:33,  8.24s/it]
 67%|██████▋   | 25618/37963 [61:30:04<27:20:01,  7.97s/it]
 67%|██████▋   | 25619/37963 [61:30:12<26:53:05,  7.84s/it]
 67%|██████▋   | 25620/37963 [61:30:20<26:34:48,  7.75s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '2.151', 'learning_rate': '5.051e-06', 'epoch': '0.6749'}

 67%|██████▋   | 25620/37963 [61:30:20<26:34:48,  7.75s/it]
 67%|██████▋   | 25621/37963 [61:30:27<26:06:05,  7.61s/it]
 67%|██████▋   | 25622/37963 [61:30:34<26:01:46,  7.59s/it]
 67%|██████▋   | 25623/37963 [61:30:48<32:40:55,  9.53s/it]
 67%|██████▋   | 25624/37963 [61:30:56<30:38:00,  8.94s/it]
 67%|██████▋   | 25625/37963 [61:31:04<29:12:26,  8.52s/it]
 68%|██████▊   | 25626/37963 [61:31:11<28:14:14,  8.24s/it]
 68%|██████▊   | 25627/37963 [61:31:25<34:08:18,  9.96s/it]
 68%|██████▊   | 25628/37963 [61:31:33<31:39:25,  9.24s/it]
 68%|██████▊   | 25629/37963 [61:31:40<29:55:35,  8.73s/it]
 68%|██████▊   | 25630/37963 [61:31:48<28:39:28,  8.37s/it]
                                                           
{'loss': '0.1283', 'grad_norm': '1.749', 'learning_rate': '5.044e-06', 'epoch': '0.6751'}

 68%|██████▊   | 25630/37963 [61:31:48<28:39:28,  8.37s/it]
 68%|██████▊   | 25631/37963 [61:31:55<27:51:20,  8.13s/it]
 68%|██████▊   | 25632/37963 [61:32:09<33:41:01,  9.83s/it]
 68%|██████▊   | 25633/37963 [61:32:17<31:40:26,  9.25s/it]
 68%|██████▊   | 25634/37963 [61:32:24<29:49:33,  8.71s/it]
 68%|██████▊   | 25635/37963 [61:32:32<28:22:08,  8.28s/it]
 68%|██████▊   | 25636/37963 [61:32:46<34:34:39, 10.10s/it]
 68%|██████▊   | 25637/37963 [61:32:54<31:57:55,  9.34s/it]
 68%|██████▊   | 25638/37963 [61:33:01<30:18:39,  8.85s/it]
 68%|██████▊   | 25639/37963 [61:33:15<35:29:46, 10.37s/it]
 68%|██████▊   | 25640/37963 [61:33:23<32:22:59,  9.46s/it]
                                                           
{'loss': '0.1172', 'grad_norm': '2.813', 'learning_rate': '5.036e-06', 'epoch': '0.6754'}

 68%|██████▊   | 25640/37963 [61:33:23<32:22:59,  9.46s/it]
 68%|██████▊   | 25641/37963 [61:33:30<30:24:47,  8.89s/it]
 68%|██████▊   | 25642/37963 [61:33:38<29:02:11,  8.48s/it]
 68%|██████▊   | 25643/37963 [61:33:52<34:33:01, 10.10s/it]
 68%|██████▊   | 25644/37963 [61:33:59<31:52:05,  9.31s/it]
 68%|██████▊   | 25645/37963 [61:34:07<30:01:06,  8.77s/it]
 68%|██████▊   | 25646/37963 [61:34:14<28:43:15,  8.39s/it]
 68%|██████▊   | 25647/37963 [61:34:22<27:54:45,  8.16s/it]
 68%|██████▊   | 25648/37963 [61:34:29<27:04:44,  7.92s/it]
 68%|██████▊   | 25649/37963 [61:34:36<26:34:42,  7.77s/it]
 68%|██████▊   | 25650/37963 [61:34:44<26:21:08,  7.70s/it]
                                                           
{'loss': '0.12', 'grad_norm': '1.192', 'learning_rate': '5.029e-06', 'epoch': '0.6757'}

 68%|██████▊   | 25650/37963 [61:34:44<26:21:08,  7.70s/it]
 68%|██████▊   | 25651/37963 [61:34:52<26:17:21,  7.69s/it]
 68%|██████▊   | 25652/37963 [61:34:59<26:01:08,  7.61s/it]
 68%|██████▊   | 25653/37963 [61:35:07<25:56:04,  7.58s/it]
 68%|██████▊   | 25654/37963 [61:35:14<25:56:28,  7.59s/it]
 68%|██████▊   | 25655/37963 [61:35:22<25:49:48,  7.56s/it]
 68%|██████▊   | 25656/37963 [61:35:29<25:26:56,  7.44s/it]
 68%|██████▊   | 25657/37963 [61:35:36<25:25:36,  7.44s/it]
 68%|██████▊   | 25658/37963 [61:35:44<25:35:35,  7.49s/it]
 68%|██████▊   | 25659/37963 [61:35:58<32:07:58,  9.40s/it]
 68%|██████▊   | 25660/37963 [61:36:05<30:02:53,  8.79s/it]
                                                           
{'loss': '0.1131', 'grad_norm': '1.843', 'learning_rate': '5.022e-06', 'epoch': '0.6759'}

 68%|██████▊   | 25660/37963 [61:36:05<30:02:53,  8.79s/it]
 68%|██████▊   | 25661/37963 [61:36:13<28:47:28,  8.43s/it]
 68%|██████▊   | 25662/37963 [61:36:20<27:53:48,  8.16s/it]
 68%|██████▊   | 25663/37963 [61:36:34<33:51:14,  9.91s/it]
 68%|██████▊   | 25664/37963 [61:36:42<31:25:55,  9.20s/it]
 68%|██████▊   | 25665/37963 [61:36:49<29:30:57,  8.64s/it]
 68%|██████▊   | 25666/37963 [61:36:57<28:25:36,  8.32s/it]
 68%|██████▊   | 25667/37963 [61:37:04<27:47:22,  8.14s/it]
 68%|██████▊   | 25668/37963 [61:37:12<27:16:03,  7.98s/it]
 68%|██████▊   | 25669/37963 [61:37:19<26:39:45,  7.81s/it]
 68%|██████▊   | 25670/37963 [61:37:33<32:46:21,  9.60s/it]
                                                           
{'loss': '0.1247', 'grad_norm': '1.508', 'learning_rate': '5.014e-06', 'epoch': '0.6762'}

 68%|██████▊   | 25670/37963 [61:37:33<32:46:21,  9.60s/it]
 68%|██████▊   | 25671/37963 [61:37:47<36:57:27, 10.82s/it]
 68%|██████▊   | 25672/37963 [61:37:54<33:22:46,  9.78s/it]
 68%|██████▊   | 25673/37963 [61:38:02<30:59:10,  9.08s/it]
 68%|██████▊   | 25674/37963 [61:38:09<29:01:55,  8.50s/it]
 68%|██████▊   | 25675/37963 [61:38:16<27:59:41,  8.20s/it]
 68%|██████▊   | 25676/37963 [61:38:24<27:17:42,  8.00s/it]
 68%|██████▊   | 25677/37963 [61:38:31<26:31:17,  7.77s/it]
 68%|██████▊   | 25678/37963 [61:38:38<26:05:22,  7.65s/it]
 68%|██████▊   | 25679/37963 [61:38:46<25:50:08,  7.57s/it]
 68%|██████▊   | 25680/37963 [61:38:53<25:52:12,  7.58s/it]
                                                           
{'loss': '0.1217', 'grad_norm': '1.267', 'learning_rate': '5.007e-06', 'epoch': '0.6765'}

 68%|██████▊   | 25680/37963 [61:38:53<25:52:12,  7.58s/it]
 68%|██████▊   | 25681/37963 [61:39:01<25:54:05,  7.59s/it]
 68%|██████▊   | 25682/37963 [61:39:09<25:50:18,  7.57s/it]
 68%|██████▊   | 25683/37963 [61:39:16<25:49:13,  7.57s/it]
 68%|██████▊   | 25684/37963 [61:39:36<38:49:12, 11.38s/it]
 68%|██████▊   | 25685/37963 [61:39:51<41:39:08, 12.21s/it]
 68%|██████▊   | 25686/37963 [61:39:58<36:52:22, 10.81s/it]
 68%|██████▊   | 25687/37963 [61:40:06<33:29:10,  9.82s/it]
 68%|██████▊   | 25688/37963 [61:40:13<31:09:44,  9.14s/it]
 68%|██████▊   | 25689/37963 [61:40:21<29:37:00,  8.69s/it]
 68%|██████▊   | 25690/37963 [61:40:28<28:29:01,  8.36s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '1.378', 'learning_rate': '5e-06', 'epoch': '0.6767'}

 68%|██████▊   | 25690/37963 [61:40:28<28:29:01,  8.36s/it]
 68%|██████▊   | 25691/37963 [61:40:36<27:35:50,  8.10s/it]
 68%|██████▊   | 25692/37963 [61:40:43<27:05:17,  7.95s/it]
 68%|██████▊   | 25693/37963 [61:40:51<26:44:46,  7.85s/it]
 68%|██████▊   | 25694/37963 [61:40:59<26:26:23,  7.76s/it]
 68%|██████▊   | 25695/37963 [61:41:06<26:20:42,  7.73s/it]
 68%|██████▊   | 25696/37963 [61:41:14<26:06:49,  7.66s/it]
 68%|██████▊   | 25697/37963 [61:41:28<32:39:47,  9.59s/it]
 68%|██████▊   | 25698/37963 [61:41:35<30:31:12,  8.96s/it]
 68%|██████▊   | 25699/37963 [61:41:43<29:02:05,  8.52s/it]
 68%|██████▊   | 25700/37963 [61:41:51<28:10:35,  8.27s/it]
                                                           
{'loss': '0.133', 'grad_norm': '1.467', 'learning_rate': '4.992e-06', 'epoch': '0.677'}

 68%|██████▊   | 25700/37963 [61:41:51<28:10:35,  8.27s/it]
 68%|██████▊   | 25701/37963 [61:41:58<27:08:00,  7.97s/it]
 68%|██████▊   | 25702/37963 [61:42:05<26:34:04,  7.80s/it]
 68%|██████▊   | 25703/37963 [61:42:13<26:16:45,  7.72s/it]
 68%|██████▊   | 25704/37963 [61:42:27<32:27:06,  9.53s/it]
 68%|██████▊   | 25705/37963 [61:42:34<30:26:57,  8.94s/it]
 68%|██████▊   | 25706/37963 [61:42:42<29:03:04,  8.53s/it]
 68%|██████▊   | 25707/37963 [61:42:49<27:50:26,  8.18s/it]
 68%|██████▊   | 25708/37963 [61:42:57<27:17:40,  8.02s/it]
 68%|██████▊   | 25709/37963 [61:43:04<26:58:31,  7.92s/it]
 68%|██████▊   | 25710/37963 [61:43:12<26:32:59,  7.80s/it]
                                                           
{'loss': '0.1274', 'grad_norm': '1.832', 'learning_rate': '4.985e-06', 'epoch': '0.6772'}

 68%|██████▊   | 25710/37963 [61:43:12<26:32:59,  7.80s/it]
 68%|██████▊   | 25711/37963 [61:43:19<26:01:19,  7.65s/it]
 68%|██████▊   | 25712/37963 [61:43:27<25:58:01,  7.63s/it]
 68%|██████▊   | 25713/37963 [61:43:34<25:53:18,  7.61s/it]
 68%|██████▊   | 25714/37963 [61:43:42<25:47:40,  7.58s/it]
 68%|██████▊   | 25715/37963 [61:43:56<32:07:43,  9.44s/it]
 68%|██████▊   | 25716/37963 [61:44:10<36:43:30, 10.80s/it]
 68%|██████▊   | 25717/37963 [61:44:17<33:31:24,  9.86s/it]
 68%|██████▊   | 25718/37963 [61:44:25<31:09:03,  9.16s/it]
 68%|██████▊   | 25719/37963 [61:44:32<29:26:26,  8.66s/it]
 68%|██████▊   | 25720/37963 [61:44:40<28:07:45,  8.27s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.452', 'learning_rate': '4.977e-06', 'epoch': '0.6775'}

 68%|██████▊   | 25720/37963 [61:44:40<28:07:45,  8.27s/it]
 68%|██████▊   | 25721/37963 [61:44:47<27:21:19,  8.04s/it]
 68%|██████▊   | 25722/37963 [61:44:55<26:50:31,  7.89s/it]
 68%|██████▊   | 25723/37963 [61:45:09<32:59:47,  9.70s/it]
 68%|██████▊   | 25724/37963 [61:45:16<30:40:08,  9.02s/it]
 68%|██████▊   | 25725/37963 [61:45:24<29:09:42,  8.58s/it]
 68%|██████▊   | 25726/37963 [61:45:31<27:46:26,  8.17s/it]
 68%|██████▊   | 25727/37963 [61:45:38<27:09:07,  7.99s/it]
 68%|██████▊   | 25728/37963 [61:45:53<33:25:53,  9.84s/it]
 68%|██████▊   | 25729/37963 [61:46:00<30:42:34,  9.04s/it]
 68%|██████▊   | 25730/37963 [61:46:13<35:28:51, 10.44s/it]
                                                           
{'loss': '0.1317', 'grad_norm': '1.416', 'learning_rate': '4.97e-06', 'epoch': '0.6778'}

 68%|██████▊   | 25730/37963 [61:46:13<35:28:51, 10.44s/it]
 68%|██████▊   | 25731/37963 [61:46:21<32:24:59,  9.54s/it]
 68%|██████▊   | 25732/37963 [61:46:28<30:21:37,  8.94s/it]
 68%|██████▊   | 25733/37963 [61:46:36<29:07:47,  8.57s/it]
 68%|██████▊   | 25734/37963 [61:46:44<28:03:08,  8.26s/it]
 68%|██████▊   | 25735/37963 [61:46:51<27:24:28,  8.07s/it]
 68%|██████▊   | 25736/37963 [61:46:59<26:51:05,  7.91s/it]
 68%|██████▊   | 25737/37963 [61:47:06<26:28:27,  7.80s/it]
 68%|██████▊   | 25738/37963 [61:47:20<32:47:55,  9.66s/it]
 68%|██████▊   | 25739/37963 [61:47:28<30:37:15,  9.02s/it]
 68%|██████▊   | 25740/37963 [61:47:35<28:50:41,  8.50s/it]
                                                           
{'loss': '0.113', 'grad_norm': '1.89', 'learning_rate': '4.963e-06', 'epoch': '0.678'}

 68%|██████▊   | 25740/37963 [61:47:35<28:50:41,  8.50s/it]
 68%|██████▊   | 25741/37963 [61:47:42<27:34:26,  8.12s/it]
 68%|██████▊   | 25742/37963 [61:47:50<27:05:29,  7.98s/it]
 68%|██████▊   | 25743/37963 [61:47:57<26:27:06,  7.79s/it]
 68%|██████▊   | 25744/37963 [61:48:05<26:09:17,  7.71s/it]
 68%|██████▊   | 25745/37963 [61:48:19<32:10:15,  9.48s/it]
 68%|██████▊   | 25746/37963 [61:48:26<30:12:22,  8.90s/it]
 68%|██████▊   | 25747/37963 [61:48:34<28:53:13,  8.51s/it]
 68%|██████▊   | 25748/37963 [61:48:41<27:53:20,  8.22s/it]
 68%|██████▊   | 25749/37963 [61:48:49<27:12:07,  8.02s/it]
 68%|██████▊   | 25750/37963 [61:48:56<26:22:39,  7.78s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '1.528', 'learning_rate': '4.955e-06', 'epoch': '0.6783'}

 68%|██████▊   | 25750/37963 [61:48:56<26:22:39,  7.78s/it]
 68%|██████▊   | 25751/37963 [61:49:04<26:10:52,  7.72s/it]
 68%|██████▊   | 25752/37963 [61:49:11<26:01:41,  7.67s/it]
 68%|██████▊   | 25753/37963 [61:49:19<25:59:13,  7.66s/it]
 68%|██████▊   | 25754/37963 [61:49:26<25:48:49,  7.61s/it]
 68%|██████▊   | 25755/37963 [61:49:40<32:25:27,  9.56s/it]
 68%|██████▊   | 25756/37963 [61:49:48<30:26:35,  8.98s/it]
 68%|██████▊   | 25757/37963 [61:49:56<29:09:41,  8.60s/it]
 68%|██████▊   | 25758/37963 [61:50:03<28:01:24,  8.27s/it]
 68%|██████▊   | 25759/37963 [61:50:11<27:14:59,  8.04s/it]
 68%|██████▊   | 25760/37963 [61:50:18<26:42:22,  7.88s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '1.602', 'learning_rate': '4.948e-06', 'epoch': '0.6786'}

 68%|██████▊   | 25760/37963 [61:50:18<26:42:22,  7.88s/it]
 68%|██████▊   | 25761/37963 [61:50:25<26:02:16,  7.68s/it]
 68%|██████▊   | 25762/37963 [61:50:40<32:34:12,  9.61s/it]
 68%|██████▊   | 25763/37963 [61:50:47<30:29:27,  9.00s/it]
 68%|██████▊   | 25764/37963 [61:51:01<35:41:22, 10.53s/it]
 68%|██████▊   | 25765/37963 [61:51:09<32:40:03,  9.64s/it]
 68%|██████▊   | 25766/37963 [61:51:16<30:27:46,  8.99s/it]
 68%|██████▊   | 25767/37963 [61:51:24<29:01:47,  8.57s/it]
 68%|██████▊   | 25768/37963 [61:51:31<28:02:06,  8.28s/it]
 68%|██████▊   | 25769/37963 [61:51:39<27:19:26,  8.07s/it]
 68%|██████▊   | 25770/37963 [61:51:47<26:52:07,  7.93s/it]
                                                           
{'loss': '0.1307', 'grad_norm': '2.339', 'learning_rate': '4.941e-06', 'epoch': '0.6788'}

 68%|██████▊   | 25770/37963 [61:51:47<26:52:07,  7.93s/it]
 68%|██████▊   | 25771/37963 [61:51:54<26:30:03,  7.83s/it]
 68%|██████▊   | 25772/37963 [61:52:02<26:09:50,  7.73s/it]
 68%|██████▊   | 25773/37963 [61:52:16<32:22:18,  9.56s/it]
 68%|██████▊   | 25774/37963 [61:52:23<30:22:02,  8.97s/it]
 68%|██████▊   | 25775/37963 [61:52:37<35:16:35, 10.42s/it]
 68%|██████▊   | 25776/37963 [61:52:44<32:18:20,  9.54s/it]
 68%|██████▊   | 25777/37963 [61:52:52<30:04:39,  8.89s/it]
 68%|██████▊   | 25778/37963 [61:52:59<28:42:11,  8.48s/it]
 68%|██████▊   | 25779/37963 [61:53:13<34:20:46, 10.15s/it]
 68%|██████▊   | 25780/37963 [61:53:21<31:45:09,  9.38s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '1.153', 'learning_rate': '4.933e-06', 'epoch': '0.6791'}

 68%|██████▊   | 25780/37963 [61:53:21<31:45:09,  9.38s/it]
 68%|██████▊   | 25781/37963 [61:53:28<29:44:40,  8.79s/it]
 68%|██████▊   | 25782/37963 [61:53:36<28:27:13,  8.41s/it]
 68%|██████▊   | 25783/37963 [61:53:43<27:33:38,  8.15s/it]
 68%|██████▊   | 25784/37963 [61:53:51<26:55:51,  7.96s/it]
 68%|██████▊   | 25785/37963 [61:53:58<26:18:19,  7.78s/it]
 68%|██████▊   | 25786/37963 [61:54:12<32:40:06,  9.66s/it]
 68%|██████▊   | 25787/37963 [61:54:20<30:31:47,  9.03s/it]
 68%|██████▊   | 25788/37963 [61:54:27<29:02:50,  8.59s/it]
 68%|██████▊   | 25789/37963 [61:54:35<28:03:22,  8.30s/it]
 68%|██████▊   | 25790/37963 [61:54:42<27:05:27,  8.01s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '1.736', 'learning_rate': '4.926e-06', 'epoch': '0.6793'}

 68%|██████▊   | 25790/37963 [61:54:42<27:05:27,  8.01s/it]
 68%|██████▊   | 25791/37963 [61:54:50<26:34:39,  7.86s/it]
 68%|██████▊   | 25792/37963 [61:54:58<26:22:55,  7.80s/it]
 68%|██████▊   | 25793/37963 [61:55:11<32:17:47,  9.55s/it]
 68%|██████▊   | 25794/37963 [61:55:19<30:14:48,  8.95s/it]
 68%|██████▊   | 25795/37963 [61:55:26<28:49:09,  8.53s/it]
 68%|██████▊   | 25796/37963 [61:55:34<27:53:23,  8.25s/it]
 68%|██████▊   | 25797/37963 [61:55:41<27:10:08,  8.04s/it]
 68%|██████▊   | 25798/37963 [61:55:49<26:39:34,  7.89s/it]
 68%|██████▊   | 25799/37963 [61:55:56<26:12:13,  7.76s/it]
 68%|██████▊   | 25800/37963 [61:56:04<25:56:23,  7.68s/it]
                                                           
{'loss': '0.1208', 'grad_norm': '1.246', 'learning_rate': '4.918e-06', 'epoch': '0.6796'}

 68%|██████▊   | 25800/37963 [61:56:04<25:56:23,  7.68s/it]
 68%|██████▊   | 25801/37963 [61:56:11<25:48:08,  7.64s/it]
 68%|██████▊   | 25802/37963 [61:56:25<31:52:32,  9.44s/it]
 68%|██████▊   | 25803/37963 [61:56:33<29:58:16,  8.87s/it]
 68%|██████▊   | 25804/37963 [61:56:40<28:43:28,  8.50s/it]
 68%|██████▊   | 25805/37963 [61:56:48<27:41:32,  8.20s/it]
 68%|██████▊   | 25806/37963 [61:56:55<27:00:24,  8.00s/it]
 68%|██████▊   | 25807/37963 [61:57:03<26:15:38,  7.78s/it]
 68%|██████▊   | 25808/37963 [61:57:10<25:46:24,  7.63s/it]
 68%|██████▊   | 25809/37963 [61:57:24<32:01:29,  9.49s/it]
 68%|██████▊   | 25810/37963 [61:57:31<30:03:57,  8.91s/it]
                                                           
{'loss': '0.1098', 'grad_norm': '1.948', 'learning_rate': '4.911e-06', 'epoch': '0.6799'}

 68%|██████▊   | 25810/37963 [61:57:31<30:03:57,  8.91s/it]
 68%|██████▊   | 25811/37963 [61:57:39<28:36:27,  8.47s/it]
 68%|██████▊   | 25812/37963 [61:57:46<27:34:44,  8.17s/it]
 68%|██████▊   | 25813/37963 [61:57:54<26:56:48,  7.98s/it]
 68%|██████▊   | 25814/37963 [61:58:01<26:27:35,  7.84s/it]
 68%|██████▊   | 25815/37963 [61:58:09<26:01:16,  7.71s/it]
 68%|██████▊   | 25816/37963 [61:58:16<25:56:17,  7.69s/it]
 68%|██████▊   | 25817/37963 [61:58:24<25:49:57,  7.66s/it]
 68%|██████▊   | 25818/37963 [61:58:38<32:11:39,  9.54s/it]
 68%|██████▊   | 25819/37963 [61:58:45<29:58:51,  8.89s/it]
 68%|██████▊   | 25820/37963 [61:58:53<28:39:03,  8.49s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '3.925', 'learning_rate': '4.904e-06', 'epoch': '0.6801'}

 68%|██████▊   | 25820/37963 [61:58:53<28:39:03,  8.49s/it]
 68%|██████▊   | 25821/37963 [61:59:00<27:40:25,  8.21s/it]
 68%|██████▊   | 25822/37963 [61:59:15<33:48:36, 10.03s/it]
 68%|██████▊   | 25823/37963 [61:59:22<31:31:30,  9.35s/it]
 68%|██████▊   | 25824/37963 [61:59:30<29:47:41,  8.84s/it]
 68%|██████▊   | 25825/37963 [61:59:37<28:27:30,  8.44s/it]
 68%|██████▊   | 25826/37963 [61:59:45<27:40:23,  8.21s/it]
 68%|██████▊   | 25827/37963 [61:59:53<26:50:51,  7.96s/it]
 68%|██████▊   | 25828/37963 [62:00:00<26:26:38,  7.84s/it]
 68%|██████▊   | 25829/37963 [62:00:21<39:18:14, 11.66s/it]
 68%|██████▊   | 25830/37963 [62:00:35<41:34:04, 12.33s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.9', 'learning_rate': '4.896e-06', 'epoch': '0.6804'}

 68%|██████▊   | 25830/37963 [62:00:35<41:34:04, 12.33s/it]
 68%|██████▊   | 25831/37963 [62:00:42<36:52:13, 10.94s/it]
 68%|██████▊   | 25832/37963 [62:00:50<33:25:19,  9.92s/it]
 68%|██████▊   | 25833/37963 [62:00:57<31:01:21,  9.21s/it]
 68%|██████▊   | 25834/37963 [62:01:04<28:54:48,  8.58s/it]
 68%|██████▊   | 25835/37963 [62:01:12<27:59:41,  8.31s/it]
 68%|██████▊   | 25836/37963 [62:01:20<27:18:09,  8.11s/it]
 68%|██████▊   | 25837/37963 [62:01:27<26:48:10,  7.96s/it]
 68%|██████▊   | 25838/37963 [62:01:35<26:23:33,  7.84s/it]
 68%|██████▊   | 25839/37963 [62:01:43<26:11:15,  7.78s/it]
 68%|██████▊   | 25840/37963 [62:01:50<25:44:13,  7.64s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '1.546', 'learning_rate': '4.889e-06', 'epoch': '0.6807'}

 68%|██████▊   | 25840/37963 [62:01:50<25:44:13,  7.64s/it]
 68%|██████▊   | 25841/37963 [62:02:04<31:59:52,  9.50s/it]
 68%|██████▊   | 25842/37963 [62:02:11<30:01:30,  8.92s/it]
 68%|██████▊   | 25843/37963 [62:02:19<28:22:57,  8.43s/it]
 68%|██████▊   | 25844/37963 [62:02:26<27:16:42,  8.10s/it]
 68%|██████▊   | 25845/37963 [62:02:33<26:44:31,  7.94s/it]
 68%|██████▊   | 25846/37963 [62:02:41<26:12:48,  7.79s/it]
 68%|██████▊   | 25847/37963 [62:02:48<25:48:06,  7.67s/it]
 68%|██████▊   | 25848/37963 [62:02:56<25:36:09,  7.61s/it]
 68%|██████▊   | 25849/37963 [62:03:03<25:32:15,  7.59s/it]
 68%|██████▊   | 25850/37963 [62:03:11<25:32:40,  7.59s/it]
                                                           
{'loss': '0.1338', 'grad_norm': '1.95', 'learning_rate': '4.882e-06', 'epoch': '0.6809'}

 68%|██████▊   | 25850/37963 [62:03:11<25:32:40,  7.59s/it]
 68%|██████▊   | 25851/37963 [62:03:18<25:28:33,  7.57s/it]
 68%|██████▊   | 25852/37963 [62:03:26<25:23:16,  7.55s/it]
 68%|██████▊   | 25853/37963 [62:03:33<25:20:01,  7.53s/it]
 68%|██████▊   | 25854/37963 [62:03:47<31:49:20,  9.46s/it]
 68%|██████▊   | 25855/37963 [62:03:55<29:52:17,  8.88s/it]
 68%|██████▊   | 25856/37963 [62:04:03<28:40:26,  8.53s/it]
 68%|██████▊   | 25857/37963 [62:04:10<27:45:16,  8.25s/it]
 68%|██████▊   | 25858/37963 [62:04:18<26:58:16,  8.02s/it]
 68%|██████▊   | 25859/37963 [62:04:25<26:27:16,  7.87s/it]
 68%|██████▊   | 25860/37963 [62:04:33<26:06:11,  7.76s/it]
                                                           
{'loss': '0.1151', 'grad_norm': '1.764', 'learning_rate': '4.874e-06', 'epoch': '0.6812'}

 68%|██████▊   | 25860/37963 [62:04:33<26:06:11,  7.76s/it]
 68%|██████▊   | 25861/37963 [62:04:47<32:16:07,  9.60s/it]
 68%|██████▊   | 25862/37963 [62:04:54<30:20:43,  9.03s/it]
 68%|██████▊   | 25863/37963 [62:05:02<28:39:38,  8.53s/it]
 68%|██████▊   | 25864/37963 [62:05:09<27:40:46,  8.24s/it]
 68%|██████▊   | 25865/37963 [62:05:29<39:41:31, 11.81s/it]
 68%|██████▊   | 25866/37963 [62:05:37<35:14:17, 10.49s/it]
 68%|██████▊   | 25867/37963 [62:05:44<32:17:07,  9.61s/it]
 68%|██████▊   | 25868/37963 [62:05:52<30:16:30,  9.01s/it]
 68%|██████▊   | 25869/37963 [62:05:59<28:40:58,  8.54s/it]
 68%|██████▊   | 25870/37963 [62:06:07<27:40:48,  8.24s/it]
                                                           
{'loss': '0.1271', 'grad_norm': '1.355', 'learning_rate': '4.867e-06', 'epoch': '0.6815'}

 68%|██████▊   | 25870/37963 [62:06:07<27:40:48,  8.24s/it]
 68%|██████▊   | 25871/37963 [62:06:15<27:01:27,  8.05s/it]
 68%|██████▊   | 25872/37963 [62:06:22<26:31:15,  7.90s/it]
 68%|██████▊   | 25873/37963 [62:06:36<32:37:20,  9.71s/it]
 68%|██████▊   | 25874/37963 [62:06:50<37:04:34, 11.04s/it]
 68%|██████▊   | 25875/37963 [62:06:58<33:35:54, 10.01s/it]
 68%|██████▊   | 25876/37963 [62:07:05<30:58:30,  9.23s/it]
 68%|██████▊   | 25877/37963 [62:07:19<35:28:47, 10.57s/it]
 68%|██████▊   | 25878/37963 [62:07:26<32:22:49,  9.65s/it]
 68%|██████▊   | 25879/37963 [62:07:34<30:15:20,  9.01s/it]
 68%|██████▊   | 25880/37963 [62:07:41<28:41:29,  8.55s/it]
                                                           
{'loss': '0.1335', 'grad_norm': '2.108', 'learning_rate': '4.86e-06', 'epoch': '0.6817'}

 68%|██████▊   | 25880/37963 [62:07:41<28:41:29,  8.55s/it]
 68%|██████▊   | 25881/37963 [62:07:49<27:33:53,  8.21s/it]
 68%|██████▊   | 25882/37963 [62:07:56<26:51:45,  8.00s/it]
 68%|██████▊   | 25883/37963 [62:08:04<26:17:19,  7.83s/it]
 68%|██████▊   | 25884/37963 [62:08:11<25:58:29,  7.74s/it]
 68%|██████▊   | 25885/37963 [62:08:25<32:21:04,  9.64s/it]
 68%|██████▊   | 25886/37963 [62:08:33<30:08:37,  8.99s/it]
 68%|██████▊   | 25887/37963 [62:08:40<28:48:41,  8.59s/it]
 68%|██████▊   | 25888/37963 [62:08:48<28:01:53,  8.36s/it]
 68%|██████▊   | 25889/37963 [62:08:56<27:08:00,  8.09s/it]
 68%|██████▊   | 25890/37963 [62:09:03<26:34:36,  7.92s/it]
                                                           
{'loss': '0.1229', 'grad_norm': '1.902', 'learning_rate': '4.852e-06', 'epoch': '0.682'}

 68%|██████▊   | 25890/37963 [62:09:03<26:34:36,  7.92s/it]
 68%|██████▊   | 25891/37963 [62:09:11<26:15:42,  7.83s/it]
 68%|██████▊   | 25892/37963 [62:09:19<26:01:32,  7.76s/it]
 68%|██████▊   | 25893/37963 [62:09:26<25:48:57,  7.70s/it]
 68%|██████▊   | 25894/37963 [62:09:34<25:37:03,  7.64s/it]
 68%|██████▊   | 25895/37963 [62:09:41<25:36:08,  7.64s/it]
 68%|██████▊   | 25896/37963 [62:09:49<25:24:39,  7.58s/it]
 68%|██████▊   | 25897/37963 [62:09:56<25:00:35,  7.46s/it]
 68%|██████▊   | 25898/37963 [62:10:03<25:01:18,  7.47s/it]
 68%|██████▊   | 25899/37963 [62:10:10<24:43:06,  7.38s/it]
 68%|██████▊   | 25900/37963 [62:10:18<24:58:27,  7.45s/it]
                                                           
{'loss': '0.1139', 'grad_norm': '2.2', 'learning_rate': '4.845e-06', 'epoch': '0.6822'}

 68%|██████▊   | 25900/37963 [62:10:18<24:58:27,  7.45s/it]
 68%|██████▊   | 25901/37963 [62:10:26<24:56:33,  7.44s/it]
 68%|██████▊   | 25902/37963 [62:10:39<31:22:41,  9.37s/it]
 68%|██████▊   | 25903/37963 [62:10:47<29:36:51,  8.84s/it]
 68%|██████▊   | 25904/37963 [62:10:55<28:18:01,  8.45s/it]
 68%|██████▊   | 25905/37963 [62:11:02<27:22:07,  8.17s/it]
 68%|██████▊   | 25906/37963 [62:11:10<26:43:06,  7.98s/it]
 68%|██████▊   | 25907/37963 [62:11:17<26:07:02,  7.80s/it]
 68%|██████▊   | 25908/37963 [62:11:25<25:58:26,  7.76s/it]
 68%|██████▊   | 25909/37963 [62:11:39<32:17:50,  9.65s/it]
 68%|██████▊   | 25910/37963 [62:11:46<30:15:26,  9.04s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '1.613', 'learning_rate': '4.838e-06', 'epoch': '0.6825'}

 68%|██████▊   | 25910/37963 [62:11:46<30:15:26,  9.04s/it]
 68%|██████▊   | 25911/37963 [62:11:54<28:46:53,  8.60s/it]
 68%|██████▊   | 25912/37963 [62:12:01<27:48:29,  8.31s/it]
 68%|██████▊   | 25913/37963 [62:12:09<27:01:38,  8.07s/it]
 68%|██████▊   | 25914/37963 [62:12:16<26:15:50,  7.85s/it]
 68%|██████▊   | 25915/37963 [62:12:31<32:36:40,  9.74s/it]
 68%|██████▊   | 25916/37963 [62:12:38<30:11:51,  9.02s/it]
 68%|██████▊   | 25917/37963 [62:12:45<28:42:26,  8.58s/it]
 68%|██████▊   | 25918/37963 [62:13:00<34:17:24, 10.25s/it]
 68%|██████▊   | 25919/37963 [62:13:07<31:34:25,  9.44s/it]
 68%|██████▊   | 25920/37963 [62:13:14<29:32:33,  8.83s/it]
                                                           
{'loss': '0.1259', 'grad_norm': '3.033', 'learning_rate': '4.831e-06', 'epoch': '0.6828'}

 68%|██████▊   | 25920/37963 [62:13:14<29:32:33,  8.83s/it]
 68%|██████▊   | 25921/37963 [62:13:22<28:05:57,  8.40s/it]
 68%|██████▊   | 25922/37963 [62:13:30<27:21:11,  8.18s/it]
 68%|██████▊   | 25923/37963 [62:13:44<33:24:30,  9.99s/it]
 68%|██████▊   | 25924/37963 [62:13:51<30:52:13,  9.23s/it]
 68%|██████▊   | 25925/37963 [62:13:59<29:15:13,  8.75s/it]
 68%|██████▊   | 25926/37963 [62:14:06<28:03:56,  8.39s/it]
 68%|██████▊   | 25927/37963 [62:14:14<27:02:24,  8.09s/it]
 68%|██████▊   | 25928/37963 [62:14:21<26:33:38,  7.95s/it]
 68%|██████▊   | 25929/37963 [62:14:29<26:08:16,  7.82s/it]
 68%|██████▊   | 25930/37963 [62:14:36<25:50:29,  7.73s/it]
                                                           
{'loss': '0.1302', 'grad_norm': '1.627', 'learning_rate': '4.823e-06', 'epoch': '0.683'}

 68%|██████▊   | 25930/37963 [62:14:36<25:50:29,  7.73s/it]
 68%|██████▊   | 25931/37963 [62:14:44<25:28:24,  7.62s/it]
 68%|██████▊   | 25932/37963 [62:14:51<25:15:14,  7.56s/it]
 68%|██████▊   | 25933/37963 [62:15:05<31:39:00,  9.47s/it]
 68%|██████▊   | 25934/37963 [62:15:13<29:40:33,  8.88s/it]
 68%|██████▊   | 25935/37963 [62:15:20<28:19:54,  8.48s/it]
 68%|██████▊   | 25936/37963 [62:15:28<27:10:58,  8.14s/it]
 68%|██████▊   | 25937/37963 [62:15:35<26:33:06,  7.95s/it]
 68%|██████▊   | 25938/37963 [62:15:43<26:14:03,  7.85s/it]
 68%|██████▊   | 25939/37963 [62:15:50<25:48:32,  7.73s/it]
 68%|██████▊   | 25940/37963 [62:15:58<25:37:32,  7.67s/it]
                                                           
{'loss': '0.1198', 'grad_norm': '1.11', 'learning_rate': '4.816e-06', 'epoch': '0.6833'}

 68%|██████▊   | 25940/37963 [62:15:58<25:37:32,  7.67s/it]
 68%|██████▊   | 25941/37963 [62:16:05<25:23:05,  7.60s/it]
 68%|██████▊   | 25942/37963 [62:16:13<25:18:11,  7.58s/it]
 68%|██████▊   | 25943/37963 [62:16:20<25:16:57,  7.57s/it]
 68%|██████▊   | 25944/37963 [62:16:28<25:09:43,  7.54s/it]
 68%|██████▊   | 25945/37963 [62:16:35<25:02:25,  7.50s/it]
 68%|██████▊   | 25946/37963 [62:16:43<25:10:52,  7.54s/it]
 68%|██████▊   | 25947/37963 [62:16:50<25:13:54,  7.56s/it]
 68%|██████▊   | 25948/37963 [62:16:58<25:10:01,  7.54s/it]
 68%|██████▊   | 25949/37963 [62:17:05<25:08:14,  7.53s/it]
 68%|██████▊   | 25950/37963 [62:17:19<31:28:57,  9.43s/it]
                                                           
{'loss': '0.1195', 'grad_norm': '2.984', 'learning_rate': '4.809e-06', 'epoch': '0.6836'}

 68%|██████▊   | 25950/37963 [62:17:19<31:28:57,  9.43s/it]
 68%|██████▊   | 25951/37963 [62:17:27<29:43:03,  8.91s/it]
 68%|██████▊   | 25952/37963 [62:17:34<28:22:19,  8.50s/it]
 68%|██████▊   | 25953/37963 [62:17:42<27:36:45,  8.28s/it]
 68%|██████▊   | 25954/37963 [62:17:50<26:55:01,  8.07s/it]
 68%|██████▊   | 25955/37963 [62:17:57<26:24:23,  7.92s/it]
 68%|██████▊   | 25956/37963 [62:18:05<26:01:47,  7.80s/it]
 68%|██████▊   | 25957/37963 [62:18:12<25:43:16,  7.71s/it]
 68%|██████▊   | 25958/37963 [62:18:26<31:45:27,  9.52s/it]
 68%|██████▊   | 25959/37963 [62:18:34<29:39:02,  8.89s/it]
 68%|██████▊   | 25960/37963 [62:18:41<28:13:40,  8.47s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '1.226', 'learning_rate': '4.801e-06', 'epoch': '0.6838'}

 68%|██████▊   | 25960/37963 [62:18:41<28:13:40,  8.47s/it]
 68%|██████▊   | 25961/37963 [62:19:02<40:17:20, 12.08s/it]
 68%|██████▊   | 25962/37963 [62:19:09<35:44:26, 10.72s/it]
 68%|██████▊   | 25963/37963 [62:19:23<38:54:26, 11.67s/it]
 68%|██████▊   | 25964/37963 [62:19:37<40:55:57, 12.28s/it]
 68%|██████▊   | 25965/37963 [62:19:44<36:17:38, 10.89s/it]
 68%|██████▊   | 25966/37963 [62:19:52<32:57:45,  9.89s/it]
 68%|██████▊   | 25967/37963 [62:19:59<30:40:14,  9.20s/it]
 68%|██████▊   | 25968/37963 [62:20:07<28:52:02,  8.66s/it]
 68%|██████▊   | 25969/37963 [62:20:14<27:41:50,  8.31s/it]
 68%|██████▊   | 25970/37963 [62:20:22<26:41:20,  8.01s/it]
                                                           
{'loss': '0.1058', 'grad_norm': '2.199', 'learning_rate': '4.794e-06', 'epoch': '0.6841'}

 68%|██████▊   | 25970/37963 [62:20:22<26:41:20,  8.01s/it]
 68%|██████▊   | 25971/37963 [62:20:29<26:13:21,  7.87s/it]
 68%|██████▊   | 25972/37963 [62:20:43<32:27:23,  9.74s/it]
 68%|██████▊   | 25973/37963 [62:20:51<30:14:22,  9.08s/it]
 68%|██████▊   | 25974/37963 [62:20:58<28:27:20,  8.54s/it]
 68%|██████▊   | 25975/37963 [62:21:06<27:29:51,  8.26s/it]
 68%|██████▊   | 25976/37963 [62:21:13<26:44:13,  8.03s/it]
 68%|██████▊   | 25977/37963 [62:21:21<26:16:49,  7.89s/it]
 68%|██████▊   | 25978/37963 [62:21:28<25:55:23,  7.79s/it]
 68%|██████▊   | 25979/37963 [62:21:36<25:34:13,  7.68s/it]
 68%|██████▊   | 25980/37963 [62:21:43<25:29:33,  7.66s/it]
                                                           
{'loss': '0.136', 'grad_norm': '1.485', 'learning_rate': '4.787e-06', 'epoch': '0.6844'}

 68%|██████▊   | 25980/37963 [62:21:43<25:29:33,  7.66s/it]
 68%|██████▊   | 25981/37963 [62:21:58<31:57:20,  9.60s/it]
 68%|██████▊   | 25982/37963 [62:22:05<29:59:08,  9.01s/it]
 68%|██████▊   | 25983/37963 [62:22:13<28:23:05,  8.53s/it]
 68%|██████▊   | 25984/37963 [62:22:20<27:13:30,  8.18s/it]
 68%|██████▊   | 25985/37963 [62:22:27<26:32:28,  7.98s/it]
 68%|██████▊   | 25986/37963 [62:22:35<26:06:35,  7.85s/it]
 68%|██████▊   | 25987/37963 [62:22:43<25:53:23,  7.78s/it]
 68%|██████▊   | 25988/37963 [62:22:50<25:38:13,  7.71s/it]
 68%|██████▊   | 25989/37963 [62:22:58<25:32:03,  7.68s/it]
 68%|██████▊   | 25990/37963 [62:23:05<25:22:05,  7.63s/it]
                                                           
{'loss': '0.1327', 'grad_norm': '3.458', 'learning_rate': '4.78e-06', 'epoch': '0.6846'}

 68%|██████▊   | 25990/37963 [62:23:05<25:22:05,  7.63s/it]
 68%|██████▊   | 25991/37963 [62:23:13<25:20:46,  7.62s/it]
 68%|██████▊   | 25992/37963 [62:23:20<25:11:55,  7.58s/it]
 68%|██████▊   | 25993/37963 [62:23:28<25:03:10,  7.53s/it]
 68%|██████▊   | 25994/37963 [62:23:42<31:29:07,  9.47s/it]
 68%|██████▊   | 25995/37963 [62:23:49<29:32:38,  8.89s/it]
 68%|██████▊   | 25996/37963 [62:23:57<27:55:15,  8.40s/it]
 68%|██████▊   | 25997/37963 [62:24:04<26:46:36,  8.06s/it]
 68%|██████▊   | 25998/37963 [62:24:11<26:15:28,  7.90s/it]
 68%|██████▊   | 25999/37963 [62:24:19<25:59:29,  7.82s/it]
 68%|██████▊   | 26000/37963 [62:24:27<25:44:37,  7.75s/it]
                                                           
{'loss': '0.1202', 'grad_norm': '1.602', 'learning_rate': '4.772e-06', 'epoch': '0.6849'}

 68%|██████▊   | 26000/37963 [62:24:27<25:44:37,  7.75s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.96s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.96s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 68%|██████▊   | 26001/37963 [62:25:24<75:05:42, 22.60s/it]
 68%|██████▊   | 26002/37963 [62:25:31<60:06:47, 18.09s/it]
 68%|██████▊   | 26003/37963 [62:25:39<49:37:28, 14.94s/it]
 68%|██████▊   | 26004/37963 [62:25:46<42:13:25, 12.71s/it]
 69%|██████▊   | 26005/37963 [62:25:54<37:02:47, 11.15s/it]
 69%|██████▊   | 26006/37963 [62:26:02<33:28:00, 10.08s/it]
 69%|██████▊   | 26007/37963 [62:26:09<30:48:53,  9.28s/it]
 69%|██████▊   | 26008/37963 [62:26:17<29:13:47,  8.80s/it]
 69%|██████▊   | 26009/37963 [62:26:31<34:30:34, 10.39s/it]
 69%|██████▊   | 26010/37963 [62:26:45<37:50:25, 11.40s/it]
                                                           
{'loss': '0.1138', 'grad_norm': '1.699', 'learning_rate': '4.765e-06', 'epoch': '0.6851'}

 69%|██████▊   | 26010/37963 [62:26:45<37:50:25, 11.40s/it]
 69%|██████▊   | 26011/37963 [62:27:05<46:56:36, 14.14s/it]
 69%|██████▊   | 26012/37963 [62:27:13<40:26:11, 12.18s/it]
 69%|██████▊   | 26013/37963 [62:27:27<42:08:27, 12.70s/it]
 69%|██████▊   | 26014/37963 [62:27:34<37:12:21, 11.21s/it]
 69%|██████▊   | 26015/37963 [62:27:42<33:14:28, 10.02s/it]
 69%|██████▊   | 26016/37963 [62:27:49<30:48:37,  9.28s/it]
 69%|██████▊   | 26017/37963 [62:27:56<28:51:24,  8.70s/it]
 69%|██████▊   | 26018/37963 [62:28:04<27:44:48,  8.36s/it]
 69%|██████▊   | 26019/37963 [62:28:11<26:34:50,  8.01s/it]
 69%|██████▊   | 26020/37963 [62:28:19<26:09:15,  7.88s/it]
                                                           
{'loss': '0.1205', 'grad_norm': '1.504', 'learning_rate': '4.758e-06', 'epoch': '0.6854'}

 69%|██████▊   | 26020/37963 [62:28:19<26:09:15,  7.88s/it]
 69%|██████▊   | 26021/37963 [62:28:26<25:51:29,  7.80s/it]
 69%|██████▊   | 26022/37963 [62:28:34<25:40:52,  7.74s/it]
 69%|██████▊   | 26023/37963 [62:28:48<31:41:51,  9.56s/it]
 69%|██████▊   | 26024/37963 [62:28:55<29:39:08,  8.94s/it]
 69%|██████▊   | 26025/37963 [62:29:03<28:16:31,  8.53s/it]
 69%|██████▊   | 26026/37963 [62:29:11<27:27:32,  8.28s/it]
 69%|██████▊   | 26027/37963 [62:29:18<26:52:13,  8.10s/it]
 69%|██████▊   | 26028/37963 [62:29:26<26:20:19,  7.94s/it]
 69%|██████▊   | 26029/37963 [62:29:33<25:46:16,  7.77s/it]
 69%|██████▊   | 26030/37963 [62:29:41<25:32:37,  7.71s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '2.726', 'learning_rate': '4.75e-06', 'epoch': '0.6857'}

 69%|██████▊   | 26030/37963 [62:29:41<25:32:37,  7.71s/it]
 69%|██████▊   | 26031/37963 [62:29:54<31:31:09,  9.51s/it]
 69%|██████▊   | 26032/37963 [62:30:02<29:35:43,  8.93s/it]
 69%|██████▊   | 26033/37963 [62:30:10<28:23:10,  8.57s/it]
 69%|██████▊   | 26034/37963 [62:30:17<27:19:08,  8.24s/it]
 69%|██████▊   | 26035/37963 [62:30:25<26:47:19,  8.09s/it]
 69%|██████▊   | 26036/37963 [62:30:33<26:14:40,  7.92s/it]
 69%|██████▊   | 26037/37963 [62:30:40<25:52:58,  7.81s/it]
 69%|██████▊   | 26038/37963 [62:30:48<25:34:12,  7.72s/it]
 69%|██████▊   | 26039/37963 [62:30:55<25:22:09,  7.66s/it]
 69%|██████▊   | 26040/37963 [62:31:02<25:01:29,  7.56s/it]
                                                           
{'loss': '0.1422', 'grad_norm': '4.875', 'learning_rate': '4.743e-06', 'epoch': '0.6859'}

 69%|██████▊   | 26040/37963 [62:31:02<25:01:29,  7.56s/it]
 69%|██████▊   | 26041/37963 [62:31:10<25:00:55,  7.55s/it]
 69%|██████▊   | 26042/37963 [62:31:24<31:46:31,  9.60s/it]
 69%|██████▊   | 26043/37963 [62:31:32<29:41:50,  8.97s/it]
 69%|██████▊   | 26044/37963 [62:31:39<28:16:46,  8.54s/it]
 69%|██████▊   | 26045/37963 [62:31:47<27:11:12,  8.21s/it]
 69%|██████▊   | 26046/37963 [62:31:54<26:23:16,  7.97s/it]
 69%|██████▊   | 26047/37963 [62:32:02<25:58:25,  7.85s/it]
 69%|██████▊   | 26048/37963 [62:32:09<25:40:20,  7.76s/it]
 69%|██████▊   | 26049/37963 [62:32:17<25:28:47,  7.70s/it]
 69%|██████▊   | 26050/37963 [62:32:24<25:02:21,  7.57s/it]
                                                           
{'loss': '0.128', 'grad_norm': '2.334', 'learning_rate': '4.736e-06', 'epoch': '0.6862'}

 69%|██████▊   | 26050/37963 [62:32:24<25:02:21,  7.57s/it]
 69%|██████▊   | 26051/37963 [62:32:32<25:02:39,  7.57s/it]
 69%|██████▊   | 26052/37963 [62:32:39<25:00:46,  7.56s/it]
 69%|██████▊   | 26053/37963 [62:32:47<24:58:29,  7.55s/it]
 69%|██████▊   | 26054/37963 [62:32:54<25:01:37,  7.57s/it]
 69%|██████▊   | 26055/37963 [62:33:02<25:03:55,  7.58s/it]
 69%|██████▊   | 26056/37963 [62:33:10<25:01:14,  7.56s/it]
 69%|██████▊   | 26057/37963 [62:33:17<25:03:43,  7.58s/it]
 69%|██████▊   | 26058/37963 [62:33:31<31:13:06,  9.44s/it]
 69%|██████▊   | 26059/37963 [62:33:39<29:28:53,  8.92s/it]
 69%|██████▊   | 26060/37963 [62:33:52<33:59:09, 10.28s/it]
                                                           
{'loss': '0.1239', 'grad_norm': '1.745', 'learning_rate': '4.729e-06', 'epoch': '0.6865'}

 69%|██████▊   | 26060/37963 [62:33:52<33:59:09, 10.28s/it]
 69%|██████▊   | 26061/37963 [62:33:59<31:02:19,  9.39s/it]
 69%|██████▊   | 26062/37963 [62:34:19<41:35:16, 12.58s/it]
 69%|██████▊   | 26063/37963 [62:34:34<43:09:36, 13.06s/it]
 69%|██████▊   | 26064/37963 [62:34:41<37:50:21, 11.45s/it]
 69%|██████▊   | 26065/37963 [62:34:49<33:49:12, 10.23s/it]
 69%|██████▊   | 26066/37963 [62:34:56<31:11:08,  9.44s/it]
 69%|██████▊   | 26067/37963 [62:35:04<29:12:55,  8.84s/it]
 69%|██████▊   | 26068/37963 [62:35:11<27:53:13,  8.44s/it]
 69%|██████▊   | 26069/37963 [62:35:19<26:58:53,  8.17s/it]
 69%|██████▊   | 26070/37963 [62:35:33<32:57:31,  9.98s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '1.663', 'learning_rate': '4.721e-06', 'epoch': '0.6867'}

 69%|██████▊   | 26070/37963 [62:35:33<32:57:31,  9.98s/it]
 69%|██████▊   | 26071/37963 [62:35:41<30:36:35,  9.27s/it]
 69%|██████▊   | 26072/37963 [62:35:48<28:53:20,  8.75s/it]
 69%|██████▊   | 26073/37963 [62:35:56<27:42:19,  8.39s/it]
 69%|██████▊   | 26074/37963 [62:36:03<26:50:27,  8.13s/it]
 69%|██████▊   | 26075/37963 [62:36:11<26:17:23,  7.96s/it]
 69%|██████▊   | 26076/37963 [62:36:18<25:54:53,  7.85s/it]
 69%|██████▊   | 26077/37963 [62:36:26<25:42:19,  7.79s/it]
 69%|██████▊   | 26078/37963 [62:36:33<25:28:41,  7.72s/it]
 69%|██████▊   | 26079/37963 [62:36:41<25:19:39,  7.67s/it]
 69%|██████▊   | 26080/37963 [62:36:49<25:22:13,  7.69s/it]
                                                           
{'loss': '0.127', 'grad_norm': '1.242', 'learning_rate': '4.714e-06', 'epoch': '0.687'}

 69%|██████▊   | 26080/37963 [62:36:49<25:22:13,  7.69s/it]
 69%|██████▊   | 26081/37963 [62:36:56<24:52:32,  7.54s/it]
 69%|██████▊   | 26082/37963 [62:37:04<25:03:54,  7.59s/it]
 69%|██████▊   | 26083/37963 [62:37:11<25:04:33,  7.60s/it]
 69%|██████▊   | 26084/37963 [62:37:25<31:31:52,  9.56s/it]
 69%|██████▊   | 26085/37963 [62:37:33<29:33:39,  8.96s/it]
 69%|██████▊   | 26086/37963 [62:37:41<28:08:14,  8.53s/it]
 69%|██████▊   | 26087/37963 [62:37:48<27:09:19,  8.23s/it]
 69%|██████▊   | 26088/37963 [62:37:56<26:27:08,  8.02s/it]
 69%|██████▊   | 26089/37963 [62:38:09<32:17:05,  9.79s/it]
 69%|██████▊   | 26090/37963 [62:38:17<30:01:19,  9.10s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '2.171', 'learning_rate': '4.707e-06', 'epoch': '0.6873'}

 69%|██████▊   | 26090/37963 [62:38:17<30:01:19,  9.10s/it]
 69%|██████▊   | 26091/37963 [62:38:25<28:32:55,  8.66s/it]
 69%|██████▊   | 26092/37963 [62:38:32<27:15:17,  8.27s/it]
 69%|██████▊   | 26093/37963 [62:38:39<26:27:28,  8.02s/it]
 69%|██████▊   | 26094/37963 [62:38:47<25:56:36,  7.87s/it]
 69%|██████▊   | 26095/37963 [62:38:54<25:35:13,  7.76s/it]
 69%|██████▊   | 26096/37963 [62:39:02<25:29:32,  7.73s/it]
 69%|██████▊   | 26097/37963 [62:39:10<25:16:48,  7.67s/it]
 69%|██████▊   | 26098/37963 [62:39:17<25:11:04,  7.64s/it]
 69%|██████▊   | 26099/37963 [62:39:25<25:08:55,  7.63s/it]
 69%|██████▉   | 26100/37963 [62:39:32<25:05:55,  7.62s/it]
                                                           
{'loss': '0.1149', 'grad_norm': '2.425', 'learning_rate': '4.7e-06', 'epoch': '0.6875'}

 69%|██████▉   | 26100/37963 [62:39:32<25:05:55,  7.62s/it]
 69%|██████▉   | 26101/37963 [62:39:40<25:00:53,  7.59s/it]
 69%|██████▉   | 26102/37963 [62:39:47<24:34:23,  7.46s/it]
 69%|██████▉   | 26103/37963 [62:39:55<24:41:25,  7.49s/it]
 69%|██████▉   | 26104/37963 [62:40:08<30:50:42,  9.36s/it]
 69%|██████▉   | 26105/37963 [62:40:16<29:01:00,  8.81s/it]
 69%|██████▉   | 26106/37963 [62:40:23<27:48:36,  8.44s/it]
 69%|██████▉   | 26107/37963 [62:40:37<33:10:23, 10.07s/it]
 69%|██████▉   | 26108/37963 [62:40:45<30:31:34,  9.27s/it]
 69%|██████▉   | 26109/37963 [62:40:59<35:00:50, 10.63s/it]
 69%|██████▉   | 26110/37963 [62:41:06<31:54:10,  9.69s/it]
                                                           
{'loss': '0.1175', 'grad_norm': '2.259', 'learning_rate': '4.692e-06', 'epoch': '0.6878'}

 69%|██████▉   | 26110/37963 [62:41:06<31:54:10,  9.69s/it]
 69%|██████▉   | 26111/37963 [62:41:20<36:05:55, 10.96s/it]
 69%|██████▉   | 26112/37963 [62:41:28<32:40:37,  9.93s/it]
 69%|██████▉   | 26113/37963 [62:41:42<36:43:38, 11.16s/it]
 69%|██████▉   | 26114/37963 [62:41:49<33:15:16, 10.10s/it]
 69%|██████▉   | 26115/37963 [62:41:57<30:30:38,  9.27s/it]
 69%|██████▉   | 26116/37963 [62:42:04<28:46:41,  8.74s/it]
 69%|██████▉   | 26117/37963 [62:42:12<27:35:04,  8.38s/it]
 69%|██████▉   | 26118/37963 [62:42:26<33:09:56, 10.08s/it]
 69%|██████▉   | 26119/37963 [62:42:33<30:38:17,  9.31s/it]
 69%|██████▉   | 26120/37963 [62:42:41<28:53:45,  8.78s/it]
                                                           
{'loss': '0.1337', 'grad_norm': '2.401', 'learning_rate': '4.685e-06', 'epoch': '0.688'}

 69%|██████▉   | 26120/37963 [62:42:41<28:53:45,  8.78s/it]
 69%|██████▉   | 26121/37963 [62:42:48<27:38:11,  8.40s/it]
 69%|██████▉   | 26122/37963 [62:42:56<26:48:03,  8.15s/it]
 69%|██████▉   | 26123/37963 [62:43:03<26:08:56,  7.95s/it]
 69%|██████▉   | 26124/37963 [62:43:11<25:46:42,  7.84s/it]
 69%|██████▉   | 26125/37963 [62:43:18<25:27:33,  7.74s/it]
 69%|██████▉   | 26126/37963 [62:43:26<25:13:41,  7.67s/it]
 69%|██████▉   | 26127/37963 [62:43:33<25:08:05,  7.64s/it]
 69%|██████▉   | 26128/37963 [62:43:41<25:05:04,  7.63s/it]
 69%|██████▉   | 26129/37963 [62:43:49<25:03:05,  7.62s/it]
 69%|██████▉   | 26130/37963 [62:43:56<24:58:08,  7.60s/it]
                                                           
{'loss': '0.1275', 'grad_norm': '1.613', 'learning_rate': '4.678e-06', 'epoch': '0.6883'}

 69%|██████▉   | 26130/37963 [62:43:56<24:58:08,  7.60s/it]
 69%|██████▉   | 26131/37963 [62:44:04<24:54:17,  7.58s/it]
 69%|██████▉   | 26132/37963 [62:44:18<31:06:53,  9.47s/it]
 69%|██████▉   | 26133/37963 [62:44:25<29:14:35,  8.90s/it]
 69%|██████▉   | 26134/37963 [62:44:33<27:58:07,  8.51s/it]
 69%|██████▉   | 26135/37963 [62:44:40<26:58:04,  8.21s/it]
 69%|██████▉   | 26136/37963 [62:44:48<26:16:46,  8.00s/it]
 69%|██████▉   | 26137/37963 [62:44:55<25:55:10,  7.89s/it]
 69%|██████▉   | 26138/37963 [62:45:03<25:37:54,  7.80s/it]
 69%|██████▉   | 26139/37963 [62:45:11<25:22:12,  7.72s/it]
 69%|██████▉   | 26140/37963 [62:45:18<25:14:21,  7.69s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '1.743', 'learning_rate': '4.671e-06', 'epoch': '0.6886'}

 69%|██████▉   | 26140/37963 [62:45:18<25:14:21,  7.69s/it]
 69%|██████▉   | 26141/37963 [62:45:26<25:01:09,  7.62s/it]
 69%|██████▉   | 26142/37963 [62:45:33<25:01:38,  7.62s/it]
 69%|██████▉   | 26143/37963 [62:45:47<31:03:28,  9.46s/it]
 69%|██████▉   | 26144/37963 [62:45:55<29:09:57,  8.88s/it]
 69%|██████▉   | 26145/37963 [62:46:02<27:55:26,  8.51s/it]
 69%|██████▉   | 26146/37963 [62:46:10<27:07:24,  8.26s/it]
 69%|██████▉   | 26147/37963 [62:46:17<26:29:03,  8.07s/it]
 69%|██████▉   | 26148/37963 [62:46:25<25:56:43,  7.91s/it]
 69%|██████▉   | 26149/37963 [62:46:32<25:23:05,  7.74s/it]
 69%|██████▉   | 26150/37963 [62:46:40<25:19:09,  7.72s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '3.388', 'learning_rate': '4.664e-06', 'epoch': '0.6888'}

 69%|██████▉   | 26150/37963 [62:46:40<25:19:09,  7.72s/it]
 69%|██████▉   | 26151/37963 [62:46:56<33:32:38, 10.22s/it]
 69%|██████▉   | 26152/37963 [62:47:03<30:37:10,  9.33s/it]
 69%|██████▉   | 26153/37963 [62:47:11<28:52:00,  8.80s/it]
 69%|██████▉   | 26154/37963 [62:47:19<27:46:24,  8.47s/it]
 69%|██████▉   | 26155/37963 [62:47:32<33:08:24, 10.10s/it]
 69%|██████▉   | 26156/37963 [62:47:40<30:41:04,  9.36s/it]
 69%|██████▉   | 26157/37963 [62:47:54<35:12:05, 10.73s/it]
 69%|██████▉   | 26158/37963 [62:48:02<32:16:26,  9.84s/it]
 69%|██████▉   | 26159/37963 [62:48:09<30:04:52,  9.17s/it]
 69%|██████▉   | 26160/37963 [62:48:23<34:30:57, 10.53s/it]
                                                           
{'loss': '0.1086', 'grad_norm': '2.853', 'learning_rate': '4.656e-06', 'epoch': '0.6891'}

 69%|██████▉   | 26160/37963 [62:48:23<34:30:57, 10.53s/it]
 69%|██████▉   | 26161/37963 [62:48:37<38:01:07, 11.60s/it]
 69%|██████▉   | 26162/37963 [62:48:45<34:04:43, 10.40s/it]
 69%|██████▉   | 26163/37963 [62:48:53<31:28:08,  9.60s/it]
 69%|██████▉   | 26164/37963 [62:49:00<29:34:03,  9.02s/it]
 69%|██████▉   | 26165/37963 [62:49:08<28:04:56,  8.57s/it]
 69%|██████▉   | 26166/37963 [62:49:15<27:10:11,  8.29s/it]
 69%|██████▉   | 26167/37963 [62:49:23<26:31:19,  8.09s/it]
 69%|██████▉   | 26168/37963 [62:49:31<25:59:53,  7.93s/it]
 69%|██████▉   | 26169/37963 [62:49:38<25:31:22,  7.79s/it]
 69%|██████▉   | 26170/37963 [62:49:52<31:14:37,  9.54s/it]
                                                           
{'loss': '0.1314', 'grad_norm': '1.891', 'learning_rate': '4.649e-06', 'epoch': '0.6894'}

 69%|██████▉   | 26170/37963 [62:49:52<31:14:37,  9.54s/it]
 69%|██████▉   | 26171/37963 [62:49:59<29:26:24,  8.99s/it]
 69%|██████▉   | 26172/37963 [62:50:07<28:00:39,  8.55s/it]
 69%|██████▉   | 26173/37963 [62:50:14<27:02:32,  8.26s/it]
 69%|██████▉   | 26174/37963 [62:50:22<26:14:02,  8.01s/it]
 69%|██████▉   | 26175/37963 [62:50:29<25:33:48,  7.81s/it]
 69%|██████▉   | 26176/37963 [62:50:37<25:13:26,  7.70s/it]
 69%|██████▉   | 26177/37963 [62:50:44<24:56:05,  7.62s/it]
 69%|██████▉   | 26178/37963 [62:50:52<24:57:25,  7.62s/it]
 69%|██████▉   | 26179/37963 [62:50:59<24:54:10,  7.61s/it]
 69%|██████▉   | 26180/37963 [62:51:13<30:56:33,  9.45s/it]
                                                           
{'loss': '0.1202', 'grad_norm': '3.075', 'learning_rate': '4.642e-06', 'epoch': '0.6896'}

 69%|██████▉   | 26180/37963 [62:51:13<30:56:33,  9.45s/it]
 69%|██████▉   | 26181/37963 [62:51:20<28:49:12,  8.81s/it]
 69%|██████▉   | 26182/37963 [62:51:28<27:38:10,  8.45s/it]
 69%|██████▉   | 26183/37963 [62:51:36<26:48:30,  8.19s/it]
 69%|██████▉   | 26184/37963 [62:51:43<26:16:35,  8.03s/it]
 69%|██████▉   | 26185/37963 [62:51:51<25:52:17,  7.91s/it]
 69%|██████▉   | 26186/37963 [62:51:58<25:36:26,  7.83s/it]
 69%|██████▉   | 26187/37963 [62:52:12<31:33:27,  9.65s/it]
 69%|██████▉   | 26188/37963 [62:52:20<29:19:39,  8.97s/it]
 69%|██████▉   | 26189/37963 [62:52:27<27:54:35,  8.53s/it]
 69%|██████▉   | 26190/37963 [62:52:35<26:58:22,  8.25s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '2.346', 'learning_rate': '4.635e-06', 'epoch': '0.6899'}

 69%|██████▉   | 26190/37963 [62:52:35<26:58:22,  8.25s/it]
 69%|██████▉   | 26191/37963 [62:52:42<26:21:34,  8.06s/it]
 69%|██████▉   | 26192/37963 [62:52:50<25:37:55,  7.84s/it]
 69%|██████▉   | 26193/37963 [62:52:57<25:18:12,  7.74s/it]
 69%|██████▉   | 26194/37963 [62:53:05<25:00:00,  7.65s/it]
 69%|██████▉   | 26195/37963 [62:53:12<24:53:53,  7.62s/it]
 69%|██████▉   | 26196/37963 [62:53:20<24:41:54,  7.56s/it]
 69%|██████▉   | 26197/37963 [62:53:27<24:45:30,  7.58s/it]
 69%|██████▉   | 26198/37963 [62:53:44<33:28:54, 10.25s/it]
 69%|██████▉   | 26199/37963 [62:53:51<30:42:30,  9.40s/it]
 69%|██████▉   | 26200/37963 [62:53:59<28:53:28,  8.84s/it]
                                                           
{'loss': '0.1237', 'grad_norm': '1.685', 'learning_rate': '4.628e-06', 'epoch': '0.6901'}

 69%|██████▉   | 26200/37963 [62:53:59<28:53:28,  8.84s/it]
 69%|██████▉   | 26201/37963 [62:54:06<27:41:37,  8.48s/it]
 69%|██████▉   | 26202/37963 [62:54:21<33:14:54, 10.18s/it]
 69%|██████▉   | 26203/37963 [62:54:28<30:44:55,  9.41s/it]
 69%|██████▉   | 26204/37963 [62:54:36<28:47:18,  8.81s/it]
 69%|██████▉   | 26205/37963 [62:54:50<33:53:44, 10.38s/it]
 69%|██████▉   | 26206/37963 [62:55:04<37:21:58, 11.44s/it]
 69%|██████▉   | 26207/37963 [62:55:11<33:25:48, 10.24s/it]
 69%|██████▉   | 26208/37963 [62:55:18<30:46:19,  9.42s/it]
 69%|██████▉   | 26209/37963 [62:55:26<28:52:30,  8.84s/it]
 69%|██████▉   | 26210/37963 [62:55:40<33:55:49, 10.39s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '1.455', 'learning_rate': '4.62e-06', 'epoch': '0.6904'}

 69%|██████▉   | 26210/37963 [62:55:40<33:55:49, 10.39s/it]
 69%|██████▉   | 26211/37963 [62:55:48<31:07:47,  9.54s/it]
 69%|██████▉   | 26212/37963 [62:55:55<28:57:46,  8.87s/it]
 69%|██████▉   | 26213/37963 [62:56:02<27:19:08,  8.37s/it]
 69%|██████▉   | 26214/37963 [62:56:10<26:32:19,  8.13s/it]
 69%|██████▉   | 26215/37963 [62:56:17<25:55:15,  7.94s/it]
 69%|██████▉   | 26216/37963 [62:56:25<25:33:12,  7.83s/it]
 69%|██████▉   | 26217/37963 [62:56:32<25:14:27,  7.74s/it]
 69%|██████▉   | 26218/37963 [62:56:40<25:06:50,  7.70s/it]
 69%|██████▉   | 26219/37963 [62:56:54<31:36:16,  9.69s/it]
 69%|██████▉   | 26220/37963 [62:57:02<29:27:40,  9.03s/it]
                                                           
{'loss': '0.1052', 'grad_norm': '1.723', 'learning_rate': '4.613e-06', 'epoch': '0.6907'}

 69%|██████▉   | 26220/37963 [62:57:02<29:27:40,  9.03s/it]
 69%|██████▉   | 26221/37963 [62:57:09<27:57:20,  8.57s/it]
 69%|██████▉   | 26222/37963 [62:57:17<27:09:35,  8.33s/it]
 69%|██████▉   | 26223/37963 [62:57:24<26:26:29,  8.11s/it]
 69%|██████▉   | 26224/37963 [62:57:32<25:54:25,  7.94s/it]
 69%|██████▉   | 26225/37963 [62:57:46<31:51:51,  9.77s/it]
 69%|██████▉   | 26226/37963 [62:57:54<29:46:54,  9.13s/it]
 69%|██████▉   | 26227/37963 [62:58:01<28:06:10,  8.62s/it]
 69%|██████▉   | 26228/37963 [62:58:09<27:09:23,  8.33s/it]
 69%|██████▉   | 26229/37963 [62:58:16<26:24:05,  8.10s/it]
 69%|██████▉   | 26230/37963 [62:58:24<25:51:29,  7.93s/it]
                                                           
{'loss': '0.1233', 'grad_norm': '1.397', 'learning_rate': '4.606e-06', 'epoch': '0.6909'}

 69%|██████▉   | 26230/37963 [62:58:24<25:51:29,  7.93s/it]
 69%|██████▉   | 26231/37963 [62:58:38<31:52:57,  9.78s/it]
 69%|██████▉   | 26232/37963 [62:58:46<29:41:56,  9.11s/it]
 69%|██████▉   | 26233/37963 [62:58:53<28:01:22,  8.60s/it]
 69%|██████▉   | 26234/37963 [62:59:01<27:03:27,  8.30s/it]
 69%|██████▉   | 26235/37963 [62:59:08<26:20:18,  8.08s/it]
 69%|██████▉   | 26236/37963 [62:59:16<25:39:39,  7.88s/it]
 69%|██████▉   | 26237/37963 [62:59:23<25:10:01,  7.73s/it]
 69%|██████▉   | 26238/37963 [62:59:31<25:16:02,  7.76s/it]
 69%|██████▉   | 26239/37963 [62:59:38<25:06:15,  7.71s/it]
 69%|██████▉   | 26240/37963 [62:59:46<24:55:56,  7.66s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '2.63', 'learning_rate': '4.599e-06', 'epoch': '0.6912'}

 69%|██████▉   | 26240/37963 [62:59:46<24:55:56,  7.66s/it]
 69%|██████▉   | 26241/37963 [62:59:53<24:51:14,  7.63s/it]
 69%|██████▉   | 26242/37963 [63:00:01<24:54:07,  7.65s/it]
 69%|██████▉   | 26243/37963 [63:00:09<24:49:28,  7.63s/it]
 69%|██████▉   | 26244/37963 [63:00:16<24:39:21,  7.57s/it]
 69%|██████▉   | 26245/37963 [63:00:24<24:48:11,  7.62s/it]
 69%|██████▉   | 26246/37963 [63:00:41<34:03:42, 10.47s/it]
 69%|██████▉   | 26247/37963 [63:00:48<31:09:49,  9.58s/it]
 69%|██████▉   | 26248/37963 [63:00:56<29:10:13,  8.96s/it]
 69%|██████▉   | 26249/37963 [63:01:10<34:09:52, 10.50s/it]
 69%|██████▉   | 26250/37963 [63:01:24<37:34:37, 11.55s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '1.561', 'learning_rate': '4.592e-06', 'epoch': '0.6915'}

 69%|██████▉   | 26250/37963 [63:01:24<37:34:37, 11.55s/it]
 69%|██████▉   | 26251/37963 [63:01:32<33:44:37, 10.37s/it]
 69%|██████▉   | 26252/37963 [63:01:39<31:01:03,  9.53s/it]
 69%|██████▉   | 26253/37963 [63:01:53<35:18:42, 10.86s/it]
 69%|██████▉   | 26254/37963 [63:02:01<32:13:39,  9.91s/it]
 69%|██████▉   | 26255/37963 [63:02:09<29:57:21,  9.21s/it]
 69%|██████▉   | 26256/37963 [63:02:16<28:24:06,  8.73s/it]
 69%|██████▉   | 26257/37963 [63:02:24<27:14:01,  8.38s/it]
 69%|██████▉   | 26258/37963 [63:02:31<26:23:48,  8.12s/it]
 69%|██████▉   | 26259/37963 [63:02:39<25:53:50,  7.97s/it]
 69%|██████▉   | 26260/37963 [63:02:46<25:27:20,  7.83s/it]
                                                           
{'loss': '0.1289', 'grad_norm': '1.771', 'learning_rate': '4.584e-06', 'epoch': '0.6917'}

 69%|██████▉   | 26260/37963 [63:02:46<25:27:20,  7.83s/it]
 69%|██████▉   | 26261/37963 [63:02:54<25:11:53,  7.75s/it]
 69%|██████▉   | 26262/37963 [63:03:01<25:00:56,  7.70s/it]
 69%|██████▉   | 26263/37963 [63:03:09<24:44:10,  7.61s/it]
 69%|██████▉   | 26264/37963 [63:03:23<30:46:45,  9.47s/it]
 69%|██████▉   | 26265/37963 [63:03:30<28:56:32,  8.91s/it]
 69%|██████▉   | 26266/37963 [63:03:44<33:51:22, 10.42s/it]
 69%|██████▉   | 26267/37963 [63:03:52<31:06:06,  9.57s/it]
 69%|██████▉   | 26268/37963 [63:03:59<29:05:10,  8.95s/it]
 69%|██████▉   | 26269/37963 [63:04:07<27:44:20,  8.54s/it]
 69%|██████▉   | 26270/37963 [63:04:14<26:43:21,  8.23s/it]
                                                           
{'loss': '0.1167', 'grad_norm': '2.104', 'learning_rate': '4.577e-06', 'epoch': '0.692'}

 69%|██████▉   | 26270/37963 [63:04:14<26:43:21,  8.23s/it]
 69%|██████▉   | 26271/37963 [63:04:22<26:02:59,  8.02s/it]
 69%|██████▉   | 26272/37963 [63:04:29<25:19:10,  7.80s/it]
 69%|██████▉   | 26273/37963 [63:04:43<31:06:46,  9.58s/it]
 69%|██████▉   | 26274/37963 [63:04:50<29:03:15,  8.95s/it]
 69%|██████▉   | 26275/37963 [63:04:58<27:29:15,  8.47s/it]
 69%|██████▉   | 26276/37963 [63:05:05<26:12:49,  8.07s/it]
 69%|██████▉   | 26277/37963 [63:05:19<31:53:23,  9.82s/it]
 69%|██████▉   | 26278/37963 [63:05:27<29:47:19,  9.18s/it]
 69%|██████▉   | 26279/37963 [63:05:34<28:13:51,  8.70s/it]
 69%|██████▉   | 26280/37963 [63:05:42<27:11:05,  8.38s/it]
                                                           
{'loss': '0.1277', 'grad_norm': '1.676', 'learning_rate': '4.57e-06', 'epoch': '0.6923'}

 69%|██████▉   | 26280/37963 [63:05:42<27:11:05,  8.38s/it]
 69%|██████▉   | 26281/37963 [63:05:49<26:20:38,  8.12s/it]
 69%|██████▉   | 26282/37963 [63:05:57<25:49:51,  7.96s/it]
 69%|██████▉   | 26283/37963 [63:06:05<25:32:42,  7.87s/it]
 69%|██████▉   | 26284/37963 [63:06:12<25:17:16,  7.79s/it]
 69%|██████▉   | 26285/37963 [63:06:20<25:12:24,  7.77s/it]
 69%|██████▉   | 26286/37963 [63:06:27<25:05:46,  7.74s/it]
 69%|██████▉   | 26287/37963 [63:06:35<24:51:07,  7.66s/it]
 69%|██████▉   | 26288/37963 [63:06:43<24:53:28,  7.68s/it]
 69%|██████▉   | 26289/37963 [63:06:50<24:57:17,  7.70s/it]
 69%|██████▉   | 26290/37963 [63:06:58<24:45:20,  7.63s/it]
                                                           
{'loss': '0.1348', 'grad_norm': '1.432', 'learning_rate': '4.563e-06', 'epoch': '0.6925'}

 69%|██████▉   | 26290/37963 [63:06:58<24:45:20,  7.63s/it]
 69%|██████▉   | 26291/37963 [63:07:06<24:45:51,  7.64s/it]
 69%|██████▉   | 26292/37963 [63:07:13<24:46:14,  7.64s/it]
 69%|██████▉   | 26293/37963 [63:07:21<24:46:13,  7.64s/it]
 69%|██████▉   | 26294/37963 [63:07:28<24:40:50,  7.61s/it]
 69%|██████▉   | 26295/37963 [63:07:36<24:37:38,  7.60s/it]
 69%|██████▉   | 26296/37963 [63:07:50<30:56:43,  9.55s/it]
 69%|██████▉   | 26297/37963 [63:07:58<29:02:12,  8.96s/it]
 69%|██████▉   | 26298/37963 [63:08:05<27:40:35,  8.54s/it]
 69%|██████▉   | 26299/37963 [63:08:13<26:45:06,  8.26s/it]
 69%|██████▉   | 26300/37963 [63:08:21<26:12:46,  8.09s/it]
                                                           
{'loss': '0.1263', 'grad_norm': '2.992', 'learning_rate': '4.556e-06', 'epoch': '0.6928'}

 69%|██████▉   | 26300/37963 [63:08:21<26:12:46,  8.09s/it]
 69%|██████▉   | 26301/37963 [63:08:34<31:55:22,  9.85s/it]
 69%|██████▉   | 26302/37963 [63:08:42<29:38:02,  9.15s/it]
 69%|██████▉   | 26303/37963 [63:08:50<28:09:30,  8.69s/it]
 69%|██████▉   | 26304/37963 [63:09:04<33:13:56, 10.26s/it]
 69%|██████▉   | 26305/37963 [63:09:11<30:41:49,  9.48s/it]
 69%|██████▉   | 26306/37963 [63:09:25<35:07:14, 10.85s/it]
 69%|██████▉   | 26307/37963 [63:09:33<31:49:51,  9.83s/it]
 69%|██████▉   | 26308/37963 [63:09:40<29:37:43,  9.15s/it]
 69%|██████▉   | 26309/37963 [63:09:48<28:01:56,  8.66s/it]
 69%|██████▉   | 26310/37963 [63:10:02<33:24:47, 10.32s/it]
                                                           
{'loss': '0.122', 'grad_norm': '4.913', 'learning_rate': '4.549e-06', 'epoch': '0.693'}

 69%|██████▉   | 26310/37963 [63:10:02<33:24:47, 10.32s/it]
 69%|██████▉   | 26311/37963 [63:10:10<30:43:18,  9.49s/it]
 69%|██████▉   | 26312/37963 [63:10:17<28:49:40,  8.91s/it]
 69%|██████▉   | 26313/37963 [63:10:25<27:31:55,  8.51s/it]
 69%|██████▉   | 26314/37963 [63:10:32<26:34:47,  8.21s/it]
 69%|██████▉   | 26315/37963 [63:10:46<32:21:35, 10.00s/it]
 69%|██████▉   | 26316/37963 [63:10:54<30:04:41,  9.30s/it]
 69%|██████▉   | 26317/37963 [63:11:01<28:04:26,  8.68s/it]
 69%|██████▉   | 26318/37963 [63:11:15<32:57:52, 10.19s/it]
 69%|██████▉   | 26319/37963 [63:11:22<30:05:27,  9.30s/it]
 69%|██████▉   | 26320/37963 [63:11:29<28:07:41,  8.70s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '1.651', 'learning_rate': '4.541e-06', 'epoch': '0.6933'}

 69%|██████▉   | 26320/37963 [63:11:29<28:07:41,  8.70s/it]
 69%|██████▉   | 26321/37963 [63:11:37<27:05:03,  8.38s/it]
 69%|██████▉   | 26322/37963 [63:11:45<26:13:40,  8.11s/it]
 69%|██████▉   | 26323/37963 [63:11:52<25:41:09,  7.94s/it]
 69%|██████▉   | 26324/37963 [63:11:59<25:05:58,  7.76s/it]
 69%|██████▉   | 26325/37963 [63:12:07<24:51:54,  7.69s/it]
 69%|██████▉   | 26326/37963 [63:12:15<24:43:27,  7.65s/it]
 69%|██████▉   | 26327/37963 [63:12:22<24:41:47,  7.64s/it]
 69%|██████▉   | 26328/37963 [63:12:36<30:48:53,  9.53s/it]
 69%|██████▉   | 26329/37963 [63:12:44<28:58:55,  8.97s/it]
 69%|██████▉   | 26330/37963 [63:12:51<27:35:42,  8.54s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '2.662', 'learning_rate': '4.534e-06', 'epoch': '0.6936'}

 69%|██████▉   | 26330/37963 [63:12:51<27:35:42,  8.54s/it]
 69%|██████▉   | 26331/37963 [63:12:59<26:40:43,  8.26s/it]
 69%|██████▉   | 26332/37963 [63:13:06<25:47:25,  7.98s/it]
 69%|██████▉   | 26333/37963 [63:13:14<25:31:27,  7.90s/it]
 69%|██████▉   | 26334/37963 [63:13:21<24:56:21,  7.72s/it]
 69%|██████▉   | 26335/37963 [63:13:29<24:50:06,  7.69s/it]
 69%|██████▉   | 26336/37963 [63:13:36<24:40:11,  7.64s/it]
 69%|██████▉   | 26337/37963 [63:13:44<24:41:00,  7.64s/it]
 69%|██████▉   | 26338/37963 [63:13:52<24:30:59,  7.59s/it]
 69%|██████▉   | 26339/37963 [63:13:59<24:30:42,  7.59s/it]
 69%|██████▉   | 26340/37963 [63:14:07<24:34:56,  7.61s/it]
                                                           
{'loss': '0.1329', 'grad_norm': '2.244', 'learning_rate': '4.527e-06', 'epoch': '0.6938'}

 69%|██████▉   | 26340/37963 [63:14:07<24:34:56,  7.61s/it]
 69%|██████▉   | 26341/37963 [63:14:14<24:12:40,  7.50s/it]
 69%|██████▉   | 26342/37963 [63:14:22<24:25:29,  7.57s/it]
 69%|██████▉   | 26343/37963 [63:14:29<24:16:16,  7.52s/it]
 69%|██████▉   | 26344/37963 [63:14:37<24:22:56,  7.55s/it]
 69%|██████▉   | 26345/37963 [63:14:44<24:20:51,  7.54s/it]
 69%|██████▉   | 26346/37963 [63:14:52<24:23:38,  7.56s/it]
 69%|██████▉   | 26347/37963 [63:15:00<24:25:54,  7.57s/it]
 69%|██████▉   | 26348/37963 [63:15:07<24:28:18,  7.58s/it]
 69%|██████▉   | 26349/37963 [63:15:21<30:34:23,  9.48s/it]
 69%|██████▉   | 26350/37963 [63:15:35<34:52:58, 10.81s/it]
                                                           
{'loss': '0.1355', 'grad_norm': '2.765', 'learning_rate': '4.52e-06', 'epoch': '0.6941'}

 69%|██████▉   | 26350/37963 [63:15:35<34:52:58, 10.81s/it]
 69%|██████▉   | 26351/37963 [63:15:50<38:59:04, 12.09s/it]
 69%|██████▉   | 26352/37963 [63:15:57<34:29:26, 10.69s/it]
 69%|██████▉   | 26353/37963 [63:16:11<37:34:46, 11.65s/it]
 69%|██████▉   | 26354/37963 [63:16:19<33:30:42, 10.39s/it]
 69%|██████▉   | 26355/37963 [63:16:26<30:48:05,  9.55s/it]
 69%|██████▉   | 26356/37963 [63:16:34<28:51:05,  8.95s/it]
 69%|██████▉   | 26357/37963 [63:16:42<27:31:41,  8.54s/it]
 69%|██████▉   | 26358/37963 [63:16:49<26:38:42,  8.27s/it]
 69%|██████▉   | 26359/37963 [63:17:03<32:20:07, 10.03s/it]
 69%|██████▉   | 26360/37963 [63:17:11<29:52:14,  9.27s/it]
                                                           
{'loss': '0.1127', 'grad_norm': '1.701', 'learning_rate': '4.513e-06', 'epoch': '0.6944'}

 69%|██████▉   | 26360/37963 [63:17:11<29:52:14,  9.27s/it]
 69%|██████▉   | 26361/37963 [63:17:18<28:00:50,  8.69s/it]
 69%|██████▉   | 26362/37963 [63:17:38<38:56:33, 12.08s/it]
 69%|██████▉   | 26363/37963 [63:17:45<34:19:43, 10.65s/it]
 69%|██████▉   | 26364/37963 [63:17:53<31:18:13,  9.72s/it]
 69%|██████▉   | 26365/37963 [63:18:01<29:14:10,  9.07s/it]
 69%|██████▉   | 26366/37963 [63:18:08<27:32:56,  8.55s/it]
 69%|██████▉   | 26367/37963 [63:18:15<26:34:12,  8.25s/it]
 69%|██████▉   | 26368/37963 [63:18:23<25:52:45,  8.03s/it]
 69%|██████▉   | 26369/37963 [63:18:31<25:24:21,  7.89s/it]
 69%|██████▉   | 26370/37963 [63:18:38<25:05:52,  7.79s/it]
                                                           
{'loss': '0.1157', 'grad_norm': '1.456', 'learning_rate': '4.506e-06', 'epoch': '0.6946'}

 69%|██████▉   | 26370/37963 [63:18:38<25:05:52,  7.79s/it]
 69%|██████▉   | 26371/37963 [63:18:46<24:51:03,  7.72s/it]
 69%|██████▉   | 26372/37963 [63:18:53<24:36:28,  7.64s/it]
 69%|██████▉   | 26373/37963 [63:19:01<24:32:11,  7.62s/it]
 69%|██████▉   | 26374/37963 [63:19:08<24:17:49,  7.55s/it]
 69%|██████▉   | 26375/37963 [63:19:15<24:11:48,  7.52s/it]
 69%|██████▉   | 26376/37963 [63:19:23<24:10:45,  7.51s/it]
 69%|██████▉   | 26377/37963 [63:19:31<24:15:53,  7.54s/it]
 69%|██████▉   | 26378/37963 [63:19:38<24:20:15,  7.56s/it]
 69%|██████▉   | 26379/37963 [63:19:45<23:53:05,  7.42s/it]
 69%|██████▉   | 26380/37963 [63:19:53<24:06:36,  7.49s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '2.286', 'learning_rate': '4.499e-06', 'epoch': '0.6949'}

 69%|██████▉   | 26380/37963 [63:19:53<24:06:36,  7.49s/it]
 69%|██████▉   | 26381/37963 [63:20:00<24:08:27,  7.50s/it]
 69%|██████▉   | 26382/37963 [63:20:14<30:15:55,  9.41s/it]
 69%|██████▉   | 26383/37963 [63:20:22<28:15:01,  8.78s/it]
 69%|██████▉   | 26384/37963 [63:20:29<26:56:47,  8.38s/it]
 70%|██████▉   | 26385/37963 [63:20:37<26:17:35,  8.18s/it]
 70%|██████▉   | 26386/37963 [63:20:44<25:27:11,  7.91s/it]
 70%|██████▉   | 26387/37963 [63:20:51<24:48:07,  7.71s/it]
 70%|██████▉   | 26388/37963 [63:20:59<24:39:49,  7.67s/it]
 70%|██████▉   | 26389/37963 [63:21:06<24:32:52,  7.64s/it]
 70%|██████▉   | 26390/37963 [63:21:14<24:18:39,  7.56s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '1.919', 'learning_rate': '4.492e-06', 'epoch': '0.6952'}

 70%|██████▉   | 26390/37963 [63:21:14<24:18:39,  7.56s/it]
 70%|██████▉   | 26391/37963 [63:21:21<24:18:44,  7.56s/it]
 70%|██████▉   | 26392/37963 [63:21:29<24:19:49,  7.57s/it]
 70%|██████▉   | 26393/37963 [63:21:36<24:12:59,  7.53s/it]
 70%|██████▉   | 26394/37963 [63:21:51<30:32:51,  9.51s/it]
 70%|██████▉   | 26395/37963 [63:21:58<28:28:36,  8.86s/it]
 70%|██████▉   | 26396/37963 [63:22:05<27:12:54,  8.47s/it]
 70%|██████▉   | 26397/37963 [63:22:13<26:23:52,  8.22s/it]
 70%|██████▉   | 26398/37963 [63:22:27<31:58:58,  9.96s/it]
 70%|██████▉   | 26399/37963 [63:22:35<29:38:26,  9.23s/it]
 70%|██████▉   | 26400/37963 [63:22:42<27:54:53,  8.69s/it]
                                                           
{'loss': '0.1311', 'grad_norm': '1.715', 'learning_rate': '4.484e-06', 'epoch': '0.6954'}

 70%|██████▉   | 26400/37963 [63:22:42<27:54:53,  8.69s/it]
 70%|██████▉   | 26401/37963 [63:22:50<26:48:34,  8.35s/it]
 70%|██████▉   | 26402/37963 [63:23:04<32:22:31, 10.08s/it]
 70%|██████▉   | 26403/37963 [63:23:18<36:15:05, 11.29s/it]
 70%|██████▉   | 26404/37963 [63:23:26<32:45:17, 10.20s/it]
 70%|██████▉   | 26405/37963 [63:23:40<37:07:15, 11.56s/it]
 70%|██████▉   | 26406/37963 [63:23:48<33:16:10, 10.36s/it]
 70%|██████▉   | 26407/37963 [63:23:55<30:35:35,  9.53s/it]
 70%|██████▉   | 26408/37963 [63:24:03<28:41:28,  8.94s/it]
 70%|██████▉   | 26409/37963 [63:24:11<27:26:32,  8.55s/it]
 70%|██████▉   | 26410/37963 [63:24:18<26:27:07,  8.24s/it]
                                                           
{'loss': '0.1243', 'grad_norm': '1.322', 'learning_rate': '4.477e-06', 'epoch': '0.6957'}

 70%|██████▉   | 26410/37963 [63:24:18<26:27:07,  8.24s/it]
 70%|██████▉   | 26411/37963 [63:24:32<32:06:48, 10.01s/it]
 70%|██████▉   | 26412/37963 [63:24:40<29:55:24,  9.33s/it]
 70%|██████▉   | 26413/37963 [63:24:54<34:26:29, 10.73s/it]
 70%|██████▉   | 26414/37963 [63:25:02<31:26:41,  9.80s/it]
 70%|██████▉   | 26415/37963 [63:25:09<29:18:31,  9.14s/it]
 70%|██████▉   | 26416/37963 [63:25:17<27:32:11,  8.59s/it]
 70%|██████▉   | 26417/37963 [63:25:24<26:42:01,  8.33s/it]
 70%|██████▉   | 26418/37963 [63:25:32<25:53:17,  8.07s/it]
 70%|██████▉   | 26419/37963 [63:25:39<25:28:52,  7.95s/it]
 70%|██████▉   | 26420/37963 [63:25:47<25:05:57,  7.83s/it]
                                                           
{'loss': '0.1276', 'grad_norm': '1.126', 'learning_rate': '4.47e-06', 'epoch': '0.6959'}

 70%|██████▉   | 26420/37963 [63:25:47<25:05:57,  7.83s/it]
 70%|██████▉   | 26421/37963 [63:25:54<24:43:37,  7.71s/it]
 70%|██████▉   | 26422/37963 [63:26:02<24:39:42,  7.69s/it]
 70%|██████▉   | 26423/37963 [63:26:10<24:35:37,  7.67s/it]
 70%|██████▉   | 26424/37963 [63:26:17<24:18:22,  7.58s/it]
 70%|██████▉   | 26425/37963 [63:26:25<24:15:35,  7.57s/it]
 70%|██████▉   | 26426/37963 [63:26:32<24:25:45,  7.62s/it]
 70%|██████▉   | 26427/37963 [63:26:40<24:02:10,  7.50s/it]
 70%|██████▉   | 26428/37963 [63:26:47<24:03:16,  7.51s/it]
 70%|██████▉   | 26429/37963 [63:26:55<24:04:58,  7.52s/it]
 70%|██████▉   | 26430/37963 [63:27:02<24:04:50,  7.52s/it]
                                                           
{'loss': '0.119', 'grad_norm': '1.509', 'learning_rate': '4.463e-06', 'epoch': '0.6962'}

 70%|██████▉   | 26430/37963 [63:27:02<24:04:50,  7.52s/it]
 70%|██████▉   | 26431/37963 [63:27:10<24:05:54,  7.52s/it]
 70%|██████▉   | 26432/37963 [63:27:23<30:06:49,  9.40s/it]
 70%|██████▉   | 26433/37963 [63:27:31<28:17:57,  8.84s/it]
 70%|██████▉   | 26434/37963 [63:27:38<27:03:17,  8.45s/it]
 70%|██████▉   | 26435/37963 [63:27:46<26:06:51,  8.16s/it]
 70%|██████▉   | 26436/37963 [63:27:54<25:37:32,  8.00s/it]
 70%|██████▉   | 26437/37963 [63:28:01<25:06:34,  7.84s/it]
 70%|██████▉   | 26438/37963 [63:28:09<24:49:50,  7.76s/it]
 70%|██████▉   | 26439/37963 [63:28:16<24:38:15,  7.70s/it]
 70%|██████▉   | 26440/37963 [63:28:24<24:29:24,  7.65s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '1.884', 'learning_rate': '4.456e-06', 'epoch': '0.6965'}

 70%|██████▉   | 26440/37963 [63:28:24<24:29:24,  7.65s/it]
 70%|██████▉   | 26441/37963 [63:28:31<24:28:54,  7.65s/it]
 70%|██████▉   | 26442/37963 [63:28:39<24:23:32,  7.62s/it]
 70%|██████▉   | 26443/37963 [63:28:46<24:18:48,  7.60s/it]
 70%|██████▉   | 26444/37963 [63:29:00<30:21:37,  9.49s/it]
 70%|██████▉   | 26445/37963 [63:29:21<40:41:16, 12.72s/it]
 70%|██████▉   | 26446/37963 [63:29:28<35:57:47, 11.24s/it]
 70%|██████▉   | 26447/37963 [63:29:36<32:22:50, 10.12s/it]
 70%|██████▉   | 26448/37963 [63:29:43<29:51:50,  9.34s/it]
 70%|██████▉   | 26449/37963 [63:29:58<34:46:06, 10.87s/it]
 70%|██████▉   | 26450/37963 [63:30:06<31:42:52,  9.92s/it]
                                                           
{'loss': '0.1254', 'grad_norm': '2.435', 'learning_rate': '4.449e-06', 'epoch': '0.6967'}

 70%|██████▉   | 26450/37963 [63:30:06<31:42:52,  9.92s/it]
 70%|██████▉   | 26451/37963 [63:30:19<35:13:46, 11.02s/it]
 70%|██████▉   | 26452/37963 [63:30:27<31:53:28,  9.97s/it]
 70%|██████▉   | 26453/37963 [63:30:34<29:31:39,  9.24s/it]
 70%|██████▉   | 26454/37963 [63:30:42<27:54:45,  8.73s/it]
 70%|██████▉   | 26455/37963 [63:30:49<26:39:22,  8.34s/it]
 70%|██████▉   | 26456/37963 [63:30:56<25:38:01,  8.02s/it]
 70%|██████▉   | 26457/37963 [63:31:04<25:11:04,  7.88s/it]
 70%|██████▉   | 26458/37963 [63:31:12<24:57:10,  7.81s/it]
 70%|██████▉   | 26459/37963 [63:31:25<30:41:03,  9.60s/it]
 70%|██████▉   | 26460/37963 [63:31:33<28:31:44,  8.93s/it]
                                                           
{'loss': '0.1334', 'grad_norm': '2.344', 'learning_rate': '4.442e-06', 'epoch': '0.697'}

 70%|██████▉   | 26460/37963 [63:31:33<28:31:44,  8.93s/it]
 70%|██████▉   | 26461/37963 [63:31:40<26:57:35,  8.44s/it]
 70%|██████▉   | 26462/37963 [63:31:48<26:08:29,  8.18s/it]
 70%|██████▉   | 26463/37963 [63:31:55<25:12:22,  7.89s/it]
 70%|██████▉   | 26464/37963 [63:32:09<30:55:11,  9.68s/it]
 70%|██████▉   | 26465/37963 [63:32:16<28:51:32,  9.04s/it]
 70%|██████▉   | 26466/37963 [63:32:24<27:28:36,  8.60s/it]
 70%|██████▉   | 26467/37963 [63:32:31<26:29:14,  8.29s/it]
 70%|██████▉   | 26468/37963 [63:32:39<25:54:09,  8.11s/it]
 70%|██████▉   | 26469/37963 [63:32:47<25:18:45,  7.93s/it]
 70%|██████▉   | 26470/37963 [63:32:54<24:55:42,  7.81s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '1.482', 'learning_rate': '4.435e-06', 'epoch': '0.6973'}

 70%|██████▉   | 26470/37963 [63:32:54<24:55:42,  7.81s/it]
 70%|██████▉   | 26471/37963 [63:33:02<24:46:36,  7.76s/it]
 70%|██████▉   | 26472/37963 [63:33:09<24:33:16,  7.69s/it]
 70%|██████▉   | 26473/37963 [63:33:17<24:24:00,  7.64s/it]
 70%|██████▉   | 26474/37963 [63:33:24<24:10:14,  7.57s/it]
 70%|██████▉   | 26475/37963 [63:33:32<24:06:52,  7.56s/it]
 70%|██████▉   | 26476/37963 [63:33:40<24:18:02,  7.62s/it]
 70%|██████▉   | 26477/37963 [63:33:47<24:09:54,  7.57s/it]
 70%|██████▉   | 26478/37963 [63:33:55<24:15:14,  7.60s/it]
 70%|██████▉   | 26479/37963 [63:34:02<24:09:43,  7.57s/it]
 70%|██████▉   | 26480/37963 [63:34:10<24:14:10,  7.60s/it]
                                                           
{'loss': '0.1135', 'grad_norm': '2.731', 'learning_rate': '4.428e-06', 'epoch': '0.6975'}

 70%|██████▉   | 26480/37963 [63:34:10<24:14:10,  7.60s/it]
 70%|██████▉   | 26481/37963 [63:34:17<24:06:59,  7.56s/it]
 70%|██████▉   | 26482/37963 [63:34:25<24:05:02,  7.55s/it]
 70%|██████▉   | 26483/37963 [63:34:32<24:01:00,  7.53s/it]
 70%|██████▉   | 26484/37963 [63:34:46<30:11:25,  9.47s/it]
 70%|██████▉   | 26485/37963 [63:34:54<28:01:15,  8.79s/it]
 70%|██████▉   | 26486/37963 [63:35:01<26:42:41,  8.38s/it]
 70%|██████▉   | 26487/37963 [63:35:09<25:55:26,  8.13s/it]
 70%|██████▉   | 26488/37963 [63:35:16<25:09:47,  7.89s/it]
 70%|██████▉   | 26489/37963 [63:35:23<24:49:24,  7.79s/it]
 70%|██████▉   | 26490/37963 [63:35:38<30:55:29,  9.70s/it]
                                                           
{'loss': '0.123', 'grad_norm': '2.302', 'learning_rate': '4.421e-06', 'epoch': '0.6978'}

 70%|██████▉   | 26490/37963 [63:35:38<30:55:29,  9.70s/it]
 70%|██████▉   | 26491/37963 [63:35:45<28:51:00,  9.05s/it]
 70%|██████▉   | 26492/37963 [63:36:00<34:07:39, 10.71s/it]
 70%|██████▉   | 26493/37963 [63:36:14<37:15:28, 11.69s/it]
 70%|██████▉   | 26494/37963 [63:36:21<33:24:18, 10.49s/it]
 70%|██████▉   | 26495/37963 [63:36:35<36:41:05, 11.52s/it]
 70%|██████▉   | 26496/37963 [63:36:43<32:54:58, 10.33s/it]
 70%|██████▉   | 26497/37963 [63:36:50<30:17:26,  9.51s/it]
 70%|██████▉   | 26498/37963 [63:36:58<28:03:28,  8.81s/it]
 70%|██████▉   | 26499/37963 [63:37:11<32:48:09, 10.30s/it]
 70%|██████▉   | 26500/37963 [63:37:19<30:13:28,  9.49s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '3.199', 'learning_rate': '4.413e-06', 'epoch': '0.6981'}

 70%|██████▉   | 26500/37963 [63:37:19<30:13:28,  9.49s/it]
 70%|██████▉   | 26501/37963 [63:37:26<28:07:20,  8.83s/it]
 70%|██████▉   | 26502/37963 [63:37:34<26:52:02,  8.44s/it]
 70%|██████▉   | 26503/37963 [63:37:41<25:58:54,  8.16s/it]
 70%|██████▉   | 26504/37963 [63:37:49<25:24:10,  7.98s/it]
 70%|██████▉   | 26505/37963 [63:37:56<24:58:25,  7.85s/it]
 70%|██████▉   | 26506/37963 [63:38:04<24:42:52,  7.77s/it]
 70%|██████▉   | 26507/37963 [63:38:18<30:41:44,  9.65s/it]
 70%|██████▉   | 26508/37963 [63:38:32<34:55:55, 10.98s/it]
 70%|██████▉   | 26509/37963 [63:38:39<31:26:56,  9.88s/it]
 70%|██████▉   | 26510/37963 [63:38:47<29:10:37,  9.17s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '4.11', 'learning_rate': '4.406e-06', 'epoch': '0.6983'}

 70%|██████▉   | 26510/37963 [63:38:47<29:10:37,  9.17s/it]
 70%|██████▉   | 26511/37963 [63:38:54<27:36:34,  8.68s/it]
 70%|██████▉   | 26512/37963 [63:39:02<26:34:44,  8.36s/it]
 70%|██████▉   | 26513/37963 [63:39:10<25:51:33,  8.13s/it]
 70%|██████▉   | 26514/37963 [63:39:17<25:16:16,  7.95s/it]
 70%|██████▉   | 26515/37963 [63:39:25<24:49:10,  7.80s/it]
 70%|██████▉   | 26516/37963 [63:39:32<24:37:47,  7.75s/it]
 70%|██████▉   | 26517/37963 [63:39:40<24:30:22,  7.71s/it]
 70%|██████▉   | 26518/37963 [63:39:48<24:26:20,  7.69s/it]
 70%|██████▉   | 26519/37963 [63:39:55<24:29:35,  7.70s/it]
 70%|██████▉   | 26520/37963 [63:40:03<24:31:11,  7.71s/it]
                                                           
{'loss': '0.111', 'grad_norm': '1.261', 'learning_rate': '4.399e-06', 'epoch': '0.6986'}

 70%|██████▉   | 26520/37963 [63:40:03<24:31:11,  7.71s/it]
 70%|██████▉   | 26521/37963 [63:40:11<24:25:41,  7.69s/it]
 70%|██████▉   | 26522/37963 [63:40:18<24:08:59,  7.60s/it]
 70%|██████▉   | 26523/37963 [63:40:26<24:03:47,  7.57s/it]
 70%|██████▉   | 26524/37963 [63:40:33<24:02:33,  7.57s/it]
 70%|██████▉   | 26525/37963 [63:40:41<23:58:37,  7.55s/it]
 70%|██████▉   | 26526/37963 [63:40:48<24:09:32,  7.60s/it]
 70%|██████▉   | 26527/37963 [63:40:56<24:01:18,  7.56s/it]
 70%|██████▉   | 26528/37963 [63:41:03<24:02:22,  7.57s/it]
 70%|██████▉   | 26529/37963 [63:41:11<24:00:53,  7.56s/it]
 70%|██████▉   | 26530/37963 [63:41:19<24:07:32,  7.60s/it]
                                                           
{'loss': '0.1143', 'grad_norm': '2.885', 'learning_rate': '4.392e-06', 'epoch': '0.6988'}

 70%|██████▉   | 26530/37963 [63:41:19<24:07:32,  7.60s/it]
 70%|██████▉   | 26531/37963 [63:41:32<30:02:28,  9.46s/it]
 70%|██████▉   | 26532/37963 [63:41:40<28:17:54,  8.91s/it]
 70%|██████▉   | 26533/37963 [63:41:48<26:58:27,  8.50s/it]
 70%|██████▉   | 26534/37963 [63:41:55<26:03:30,  8.21s/it]
 70%|██████▉   | 26535/37963 [63:42:03<25:27:10,  8.02s/it]
 70%|██████▉   | 26536/37963 [63:42:17<31:01:05,  9.77s/it]
 70%|██████▉   | 26537/37963 [63:42:24<29:03:55,  9.16s/it]
 70%|██████▉   | 26538/37963 [63:42:32<27:30:52,  8.67s/it]
 70%|██████▉   | 26539/37963 [63:42:39<26:16:26,  8.28s/it]
 70%|██████▉   | 26540/37963 [63:42:54<32:09:41, 10.14s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '2.387', 'learning_rate': '4.385e-06', 'epoch': '0.6991'}

 70%|██████▉   | 26540/37963 [63:42:54<32:09:41, 10.14s/it]
 70%|██████▉   | 26541/37963 [63:43:01<29:52:15,  9.41s/it]
 70%|██████▉   | 26542/37963 [63:43:09<28:09:50,  8.88s/it]
 70%|██████▉   | 26543/37963 [63:43:23<32:54:38, 10.37s/it]
 70%|██████▉   | 26544/37963 [63:43:30<29:58:21,  9.45s/it]
 70%|██████▉   | 26545/37963 [63:43:38<28:02:32,  8.84s/it]
 70%|██████▉   | 26546/37963 [63:43:45<26:42:13,  8.42s/it]
 70%|██████▉   | 26547/37963 [63:43:59<32:02:59, 10.11s/it]
 70%|██████▉   | 26548/37963 [63:44:07<29:36:10,  9.34s/it]
 70%|██████▉   | 26549/37963 [63:44:14<27:57:07,  8.82s/it]
 70%|██████▉   | 26550/37963 [63:44:22<26:59:54,  8.52s/it]
                                                           
{'loss': '0.126', 'grad_norm': '3.483', 'learning_rate': '4.378e-06', 'epoch': '0.6994'}

 70%|██████▉   | 26550/37963 [63:44:22<26:59:54,  8.52s/it]
 70%|██████▉   | 26551/37963 [63:44:30<26:13:42,  8.27s/it]
 70%|██████▉   | 26552/37963 [63:44:37<25:39:25,  8.09s/it]
 70%|██████▉   | 26553/37963 [63:44:51<31:11:02,  9.84s/it]
 70%|██████▉   | 26554/37963 [63:44:59<29:11:37,  9.21s/it]
 70%|██████▉   | 26555/37963 [63:45:07<27:33:17,  8.70s/it]
 70%|██████▉   | 26556/37963 [63:45:21<32:33:40, 10.28s/it]
 70%|██████▉   | 26557/37963 [63:45:28<29:58:09,  9.46s/it]
 70%|██████▉   | 26558/37963 [63:45:42<34:23:35, 10.86s/it]
 70%|██████▉   | 26559/37963 [63:45:50<31:15:06,  9.87s/it]
 70%|██████▉   | 26560/37963 [63:45:57<29:02:22,  9.17s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '1.973', 'learning_rate': '4.371e-06', 'epoch': '0.6996'}

 70%|██████▉   | 26560/37963 [63:45:57<29:02:22,  9.17s/it]
 70%|██████▉   | 26561/37963 [63:46:05<27:22:56,  8.65s/it]
 70%|██████▉   | 26562/37963 [63:46:12<26:30:36,  8.37s/it]
 70%|██████▉   | 26563/37963 [63:46:20<25:47:47,  8.15s/it]
 70%|██████▉   | 26564/37963 [63:46:28<25:21:04,  8.01s/it]
 70%|██████▉   | 26565/37963 [63:46:35<24:53:31,  7.86s/it]
 70%|██████▉   | 26566/37963 [63:46:43<24:16:58,  7.67s/it]
 70%|██████▉   | 26567/37963 [63:46:50<24:18:49,  7.68s/it]
 70%|██████▉   | 26568/37963 [63:46:58<24:17:15,  7.67s/it]
 70%|██████▉   | 26569/37963 [63:47:05<24:10:46,  7.64s/it]
 70%|██████▉   | 26570/37963 [63:47:13<23:53:34,  7.55s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '2.056', 'learning_rate': '4.364e-06', 'epoch': '0.6999'}

 70%|██████▉   | 26570/37963 [63:47:13<23:53:34,  7.55s/it]
 70%|██████▉   | 26571/37963 [63:47:20<23:45:51,  7.51s/it]
 70%|██████▉   | 26572/37963 [63:47:28<23:53:47,  7.55s/it]
 70%|██████▉   | 26573/37963 [63:47:35<23:41:41,  7.49s/it]
 70%|██████▉   | 26574/37963 [63:47:43<23:47:30,  7.52s/it]
 70%|███████   | 26575/37963 [63:47:50<23:40:57,  7.49s/it]
 70%|███████   | 26576/37963 [63:47:58<23:41:25,  7.49s/it]
 70%|███████   | 26577/37963 [63:48:05<23:35:30,  7.46s/it]
 70%|███████   | 26578/37963 [63:48:13<23:39:36,  7.48s/it]
 70%|███████   | 26579/37963 [63:48:26<29:26:28,  9.31s/it]
 70%|███████   | 26580/37963 [63:48:41<34:20:32, 10.86s/it]
                                                           
{'loss': '0.1183', 'grad_norm': '2.342', 'learning_rate': '4.357e-06', 'epoch': '0.7002'}

 70%|███████   | 26580/37963 [63:48:41<34:20:32, 10.86s/it]
 70%|███████   | 26581/37963 [63:48:48<31:20:54,  9.92s/it]
 70%|███████   | 26582/37963 [63:48:56<28:52:53,  9.14s/it]
 70%|███████   | 26583/37963 [63:49:03<27:22:48,  8.66s/it]
 70%|███████   | 26584/37963 [63:49:18<33:04:05, 10.46s/it]
 70%|███████   | 26585/37963 [63:49:25<30:10:05,  9.55s/it]
 70%|███████   | 26586/37963 [63:49:33<28:14:20,  8.94s/it]
 70%|███████   | 26587/37963 [63:49:40<26:53:01,  8.51s/it]
 70%|███████   | 26588/37963 [63:49:48<25:52:55,  8.19s/it]
 70%|███████   | 26589/37963 [63:49:55<25:08:29,  7.96s/it]
 70%|███████   | 26590/37963 [63:50:03<24:49:23,  7.86s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '3.365', 'learning_rate': '4.35e-06', 'epoch': '0.7004'}

 70%|███████   | 26590/37963 [63:50:03<24:49:23,  7.86s/it]
 70%|███████   | 26591/37963 [63:50:10<24:23:37,  7.72s/it]
 70%|███████   | 26592/37963 [63:50:24<30:26:23,  9.64s/it]
 70%|███████   | 26593/37963 [63:50:32<28:19:58,  8.97s/it]
 70%|███████   | 26594/37963 [63:50:39<26:49:57,  8.50s/it]
 70%|███████   | 26595/37963 [63:50:47<25:53:47,  8.20s/it]
 70%|███████   | 26596/37963 [63:50:54<25:24:41,  8.05s/it]
 70%|███████   | 26597/37963 [63:51:08<31:02:03,  9.83s/it]
 70%|███████   | 26598/37963 [63:51:16<28:55:13,  9.16s/it]
 70%|███████   | 26599/37963 [63:51:24<27:29:38,  8.71s/it]
 70%|███████   | 26600/37963 [63:51:31<26:18:19,  8.33s/it]
                                                           
{'loss': '0.1205', 'grad_norm': '2.119', 'learning_rate': '4.343e-06', 'epoch': '0.7007'}

 70%|███████   | 26600/37963 [63:51:31<26:18:19,  8.33s/it]
 70%|███████   | 26601/37963 [63:51:38<25:26:40,  8.06s/it]
 70%|███████   | 26602/37963 [63:51:52<31:00:37,  9.83s/it]
 70%|███████   | 26603/37963 [63:52:06<34:51:44, 11.05s/it]
 70%|███████   | 26604/37963 [63:52:14<31:36:15, 10.02s/it]
 70%|███████   | 26605/37963 [63:52:21<29:16:15,  9.28s/it]
 70%|███████   | 26606/37963 [63:52:29<27:42:40,  8.78s/it]
 70%|███████   | 26607/37963 [63:52:37<26:28:50,  8.39s/it]
 70%|███████   | 26608/37963 [63:52:44<25:31:03,  8.09s/it]
 70%|███████   | 26609/37963 [63:52:52<25:01:44,  7.94s/it]
 70%|███████   | 26610/37963 [63:52:59<24:38:38,  7.81s/it]
                                                           
{'loss': '0.1146', 'grad_norm': '2.028', 'learning_rate': '4.336e-06', 'epoch': '0.7009'}

 70%|███████   | 26610/37963 [63:52:59<24:38:38,  7.81s/it]
 70%|███████   | 26611/37963 [63:53:13<30:32:22,  9.68s/it]
 70%|███████   | 26612/37963 [63:53:21<28:41:17,  9.10s/it]
 70%|███████   | 26613/37963 [63:53:28<27:17:15,  8.66s/it]
 70%|███████   | 26614/37963 [63:53:36<26:14:54,  8.33s/it]
 70%|███████   | 26615/37963 [63:53:44<25:32:24,  8.10s/it]
 70%|███████   | 26616/37963 [63:53:51<24:51:37,  7.89s/it]
 70%|███████   | 26617/37963 [63:53:59<24:33:43,  7.79s/it]
 70%|███████   | 26618/37963 [63:54:06<24:24:07,  7.74s/it]
 70%|███████   | 26619/37963 [63:54:14<24:13:16,  7.69s/it]
 70%|███████   | 26620/37963 [63:54:21<23:58:36,  7.61s/it]
                                                           
{'loss': '0.1111', 'grad_norm': '2.229', 'learning_rate': '4.329e-06', 'epoch': '0.7012'}

 70%|███████   | 26620/37963 [63:54:21<23:58:36,  7.61s/it]
 70%|███████   | 26621/37963 [63:54:29<23:57:36,  7.61s/it]
 70%|███████   | 26622/37963 [63:54:36<23:58:30,  7.61s/it]
 70%|███████   | 26623/37963 [63:54:50<30:03:29,  9.54s/it]
 70%|███████   | 26624/37963 [63:54:58<28:18:59,  8.99s/it]
 70%|███████   | 26625/37963 [63:55:06<26:56:29,  8.55s/it]
 70%|███████   | 26626/37963 [63:55:13<25:59:20,  8.25s/it]
 70%|███████   | 26627/37963 [63:55:21<25:03:02,  7.96s/it]
 70%|███████   | 26628/37963 [63:55:28<24:43:03,  7.85s/it]
 70%|███████   | 26629/37963 [63:55:36<24:25:36,  7.76s/it]
 70%|███████   | 26630/37963 [63:55:43<24:20:29,  7.73s/it]
                                                           
{'loss': '0.1183', 'grad_norm': '3.731', 'learning_rate': '4.322e-06', 'epoch': '0.7015'}

 70%|███████   | 26630/37963 [63:55:43<24:20:29,  7.73s/it]
 70%|███████   | 26631/37963 [63:55:51<24:08:03,  7.67s/it]
 70%|███████   | 26632/37963 [63:55:58<24:01:06,  7.63s/it]
 70%|███████   | 26633/37963 [63:56:12<29:56:47,  9.52s/it]
 70%|███████   | 26634/37963 [63:56:20<28:05:35,  8.93s/it]
 70%|███████   | 26635/37963 [63:56:27<26:52:30,  8.54s/it]
 70%|███████   | 26636/37963 [63:56:42<32:38:54, 10.38s/it]
 70%|███████   | 26637/37963 [63:56:50<29:57:07,  9.52s/it]
 70%|███████   | 26638/37963 [63:56:57<28:08:32,  8.95s/it]
 70%|███████   | 26639/37963 [63:57:05<26:46:36,  8.51s/it]
 70%|███████   | 26640/37963 [63:57:12<25:39:41,  8.16s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '1.482', 'learning_rate': '4.315e-06', 'epoch': '0.7017'}

 70%|███████   | 26640/37963 [63:57:12<25:39:41,  8.16s/it]
 70%|███████   | 26641/37963 [63:57:26<31:28:14, 10.01s/it]
 70%|███████   | 26642/37963 [63:57:34<29:06:50,  9.26s/it]
 70%|███████   | 26643/37963 [63:57:41<27:25:27,  8.72s/it]
 70%|███████   | 26644/37963 [63:57:49<26:15:42,  8.35s/it]
 70%|███████   | 26645/37963 [63:57:56<25:28:09,  8.10s/it]
 70%|███████   | 26646/37963 [63:58:04<24:55:50,  7.93s/it]
 70%|███████   | 26647/37963 [63:58:11<24:21:45,  7.75s/it]
 70%|███████   | 26648/37963 [63:58:19<24:11:45,  7.70s/it]
 70%|███████   | 26649/37963 [63:58:33<30:07:41,  9.59s/it]
 70%|███████   | 26650/37963 [63:58:40<27:58:18,  8.90s/it]
                                                           
{'loss': '0.1137', 'grad_norm': '2.173', 'learning_rate': '4.308e-06', 'epoch': '0.702'}

 70%|███████   | 26650/37963 [63:58:40<27:58:18,  8.90s/it]
 70%|███████   | 26651/37963 [63:58:54<32:50:59, 10.45s/it]
 70%|███████   | 26652/37963 [63:59:02<30:05:10,  9.58s/it]
 70%|███████   | 26653/37963 [63:59:09<28:02:50,  8.93s/it]
 70%|███████   | 26654/37963 [63:59:16<26:18:35,  8.38s/it]
 70%|███████   | 26655/37963 [63:59:30<31:34:15, 10.05s/it]
 70%|███████   | 26656/37963 [63:59:38<29:16:49,  9.32s/it]
 70%|███████   | 26657/37963 [63:59:46<27:42:53,  8.82s/it]
 70%|███████   | 26658/37963 [63:59:59<32:33:42, 10.37s/it]
 70%|███████   | 26659/37963 [64:00:07<29:52:21,  9.51s/it]
 70%|███████   | 26660/37963 [64:00:14<27:49:40,  8.86s/it]
                                                           
{'loss': '0.1113', 'grad_norm': '1.659', 'learning_rate': '4.301e-06', 'epoch': '0.7023'}

 70%|███████   | 26660/37963 [64:00:14<27:49:40,  8.86s/it]
 70%|███████   | 26661/37963 [64:00:22<26:30:53,  8.45s/it]
 70%|███████   | 26662/37963 [64:00:29<25:28:13,  8.11s/it]
 70%|███████   | 26663/37963 [64:00:36<24:43:48,  7.88s/it]
 70%|███████   | 26664/37963 [64:00:44<24:26:15,  7.79s/it]
 70%|███████   | 26665/37963 [64:00:52<24:12:51,  7.72s/it]
 70%|███████   | 26666/37963 [64:00:59<24:07:13,  7.69s/it]
 70%|███████   | 26667/37963 [64:01:07<24:08:18,  7.69s/it]
 70%|███████   | 26668/37963 [64:01:15<24:05:03,  7.68s/it]
 70%|███████   | 26669/37963 [64:01:22<23:56:58,  7.63s/it]
 70%|███████   | 26670/37963 [64:01:30<23:49:23,  7.59s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '2.788', 'learning_rate': '4.294e-06', 'epoch': '0.7025'}

 70%|███████   | 26670/37963 [64:01:30<23:49:23,  7.59s/it]
 70%|███████   | 26671/37963 [64:01:37<23:45:44,  7.58s/it]
 70%|███████   | 26672/37963 [64:01:44<23:31:06,  7.50s/it]
 70%|███████   | 26673/37963 [64:01:52<23:27:13,  7.48s/it]
 70%|███████   | 26674/37963 [64:02:00<23:36:16,  7.53s/it]
 70%|███████   | 26675/37963 [64:02:07<23:37:21,  7.53s/it]
 70%|███████   | 26676/37963 [64:02:15<23:32:14,  7.51s/it]
 70%|███████   | 26677/37963 [64:02:35<35:44:23, 11.40s/it]
 70%|███████   | 26678/37963 [64:02:42<32:01:07, 10.21s/it]
 70%|███████   | 26679/37963 [64:02:50<29:33:47,  9.43s/it]
 70%|███████   | 26680/37963 [64:02:58<27:53:13,  8.90s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '3.598', 'learning_rate': '4.287e-06', 'epoch': '0.7028'}

 70%|███████   | 26680/37963 [64:02:58<27:53:13,  8.90s/it]
 70%|███████   | 26681/37963 [64:03:05<26:42:39,  8.52s/it]
 70%|███████   | 26682/37963 [64:03:13<25:54:32,  8.27s/it]
 70%|███████   | 26683/37963 [64:03:21<25:11:09,  8.04s/it]
 70%|███████   | 26684/37963 [64:03:28<24:42:08,  7.88s/it]
 70%|███████   | 26685/37963 [64:03:36<24:21:19,  7.77s/it]
 70%|███████   | 26686/37963 [64:03:49<30:04:44,  9.60s/it]
 70%|███████   | 26687/37963 [64:03:57<28:15:46,  9.02s/it]
 70%|███████   | 26688/37963 [64:04:05<26:57:32,  8.61s/it]
 70%|███████   | 26689/37963 [64:04:12<25:59:49,  8.30s/it]
 70%|███████   | 26690/37963 [64:04:26<31:29:45, 10.06s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.12', 'learning_rate': '4.28e-06', 'epoch': '0.7031'}

 70%|███████   | 26690/37963 [64:04:26<31:29:45, 10.06s/it]
 70%|███████   | 26691/37963 [64:04:34<29:08:04,  9.30s/it]
 70%|███████   | 26692/37963 [64:04:42<27:37:02,  8.82s/it]
 70%|███████   | 26693/37963 [64:04:49<26:29:01,  8.46s/it]
 70%|███████   | 26694/37963 [64:05:03<31:47:38, 10.16s/it]
 70%|███████   | 26695/37963 [64:05:11<29:01:02,  9.27s/it]
 70%|███████   | 26696/37963 [64:05:18<27:01:00,  8.63s/it]
 70%|███████   | 26697/37963 [64:05:25<25:58:35,  8.30s/it]
 70%|███████   | 26698/37963 [64:05:33<25:20:15,  8.10s/it]
 70%|███████   | 26699/37963 [64:05:40<24:38:42,  7.88s/it]
 70%|███████   | 26700/37963 [64:05:48<24:16:56,  7.76s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '1.639', 'learning_rate': '4.273e-06', 'epoch': '0.7033'}

 70%|███████   | 26700/37963 [64:05:48<24:16:56,  7.76s/it]
 70%|███████   | 26701/37963 [64:05:55<24:06:14,  7.71s/it]
 70%|███████   | 26702/37963 [64:06:03<23:50:34,  7.62s/it]
 70%|███████   | 26703/37963 [64:06:17<29:54:54,  9.56s/it]
 70%|███████   | 26704/37963 [64:06:24<28:01:56,  8.96s/it]
 70%|███████   | 26705/37963 [64:06:39<32:52:38, 10.51s/it]
 70%|███████   | 26706/37963 [64:06:46<29:54:49,  9.57s/it]
 70%|███████   | 26707/37963 [64:07:00<34:04:49, 10.90s/it]
 70%|███████   | 26708/37963 [64:07:07<30:44:00,  9.83s/it]
 70%|███████   | 26709/37963 [64:07:15<28:23:52,  9.08s/it]
 70%|███████   | 26710/37963 [64:07:22<27:02:47,  8.65s/it]
                                                           
{'loss': '0.107', 'grad_norm': '1.769', 'learning_rate': '4.266e-06', 'epoch': '0.7036'}

 70%|███████   | 26710/37963 [64:07:22<27:02:47,  8.65s/it]
 70%|███████   | 26711/37963 [64:07:30<25:58:48,  8.31s/it]
 70%|███████   | 26712/37963 [64:07:37<25:12:54,  8.07s/it]
 70%|███████   | 26713/37963 [64:07:45<24:41:41,  7.90s/it]
 70%|███████   | 26714/37963 [64:07:52<24:17:40,  7.78s/it]
 70%|███████   | 26715/37963 [64:08:00<23:55:29,  7.66s/it]
 70%|███████   | 26716/37963 [64:08:07<23:48:29,  7.62s/it]
 70%|███████   | 26717/37963 [64:08:15<23:56:11,  7.66s/it]
 70%|███████   | 26718/37963 [64:08:22<23:46:21,  7.61s/it]
 70%|███████   | 26719/37963 [64:08:30<23:42:34,  7.59s/it]
 70%|███████   | 26720/37963 [64:08:37<23:30:10,  7.53s/it]
                                                           
{'loss': '0.1266', 'grad_norm': '1.756', 'learning_rate': '4.259e-06', 'epoch': '0.7038'}

 70%|███████   | 26720/37963 [64:08:37<23:30:10,  7.53s/it]
 70%|███████   | 26721/37963 [64:08:45<23:30:01,  7.53s/it]
 70%|███████   | 26722/37963 [64:08:53<23:38:55,  7.57s/it]
 70%|███████   | 26723/37963 [64:09:07<29:50:44,  9.56s/it]
 70%|███████   | 26724/37963 [64:09:14<27:58:08,  8.96s/it]
 70%|███████   | 26725/37963 [64:09:22<26:47:37,  8.58s/it]
 70%|███████   | 26726/37963 [64:09:30<25:44:54,  8.25s/it]
 70%|███████   | 26727/37963 [64:09:43<30:56:28,  9.91s/it]
 70%|███████   | 26728/37963 [64:09:51<28:23:29,  9.10s/it]
 70%|███████   | 26729/37963 [64:09:58<26:54:36,  8.62s/it]
 70%|███████   | 26730/37963 [64:10:06<25:56:04,  8.31s/it]
                                                           
{'loss': '0.1286', 'grad_norm': '3.086', 'learning_rate': '4.252e-06', 'epoch': '0.7041'}

 70%|███████   | 26730/37963 [64:10:06<25:56:04,  8.31s/it]
 70%|███████   | 26731/37963 [64:10:13<25:12:03,  8.08s/it]
 70%|███████   | 26732/37963 [64:10:21<24:32:52,  7.87s/it]
 70%|███████   | 26733/37963 [64:10:28<24:14:30,  7.77s/it]
 70%|███████   | 26734/37963 [64:10:42<30:08:08,  9.66s/it]
 70%|███████   | 26735/37963 [64:10:56<34:14:56, 10.98s/it]
 70%|███████   | 26736/37963 [64:11:04<31:08:46,  9.99s/it]
 70%|███████   | 26737/37963 [64:11:11<28:49:48,  9.25s/it]
 70%|███████   | 26738/37963 [64:11:19<27:13:16,  8.73s/it]
 70%|███████   | 26739/37963 [64:11:26<26:07:15,  8.38s/it]
 70%|███████   | 26740/37963 [64:11:34<25:22:50,  8.14s/it]
                                                           
{'loss': '0.1245', 'grad_norm': '2.018', 'learning_rate': '4.245e-06', 'epoch': '0.7044'}

 70%|███████   | 26740/37963 [64:11:34<25:22:50,  8.14s/it]
 70%|███████   | 26741/37963 [64:11:42<24:50:34,  7.97s/it]
 70%|███████   | 26742/37963 [64:11:56<30:28:01,  9.77s/it]
 70%|███████   | 26743/37963 [64:12:03<28:29:26,  9.14s/it]
 70%|███████   | 26744/37963 [64:12:11<26:54:19,  8.63s/it]
 70%|███████   | 26745/37963 [64:12:18<26:03:13,  8.36s/it]
 70%|███████   | 26746/37963 [64:12:26<25:20:37,  8.13s/it]
 70%|███████   | 26747/37963 [64:12:34<24:50:30,  7.97s/it]
 70%|███████   | 26748/37963 [64:12:41<24:25:24,  7.84s/it]
 70%|███████   | 26749/37963 [64:12:49<24:07:21,  7.74s/it]
 70%|███████   | 26750/37963 [64:13:03<29:56:26,  9.61s/it]
                                                           
{'loss': '0.1245', 'grad_norm': '2.068', 'learning_rate': '4.238e-06', 'epoch': '0.7046'}

 70%|███████   | 26750/37963 [64:13:03<29:56:26,  9.61s/it]
 70%|███████   | 26751/37963 [64:13:17<34:06:34, 10.95s/it]
 70%|███████   | 26752/37963 [64:13:24<31:00:41,  9.96s/it]
 70%|███████   | 26753/37963 [64:13:32<28:46:54,  9.24s/it]
 70%|███████   | 26754/37963 [64:13:40<27:18:40,  8.77s/it]
 70%|███████   | 26755/37963 [64:13:54<32:05:52, 10.31s/it]
 70%|███████   | 26756/37963 [64:14:01<29:31:15,  9.48s/it]
 70%|███████   | 26757/37963 [64:14:09<27:45:32,  8.92s/it]
 70%|███████   | 26758/37963 [64:14:16<26:15:52,  8.44s/it]
 70%|███████   | 26759/37963 [64:14:23<25:15:59,  8.12s/it]
 70%|███████   | 26760/37963 [64:14:31<24:28:15,  7.86s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '1.632', 'learning_rate': '4.231e-06', 'epoch': '0.7049'}

 70%|███████   | 26760/37963 [64:14:31<24:28:15,  7.86s/it]
 70%|███████   | 26761/37963 [64:14:38<24:17:02,  7.80s/it]
 70%|███████   | 26762/37963 [64:14:46<24:05:01,  7.74s/it]
 70%|███████   | 26763/37963 [64:14:54<23:56:38,  7.70s/it]
 71%|███████   | 26764/37963 [64:15:01<23:51:39,  7.67s/it]
 71%|███████   | 26765/37963 [64:15:09<23:35:35,  7.58s/it]
 71%|███████   | 26766/37963 [64:15:16<23:38:41,  7.60s/it]
 71%|███████   | 26767/37963 [64:15:24<23:35:28,  7.59s/it]
 71%|███████   | 26768/37963 [64:15:37<29:11:15,  9.39s/it]
 71%|███████   | 26769/37963 [64:15:45<27:27:25,  8.83s/it]
 71%|███████   | 26770/37963 [64:15:52<26:15:30,  8.45s/it]
                                                           
{'loss': '0.1083', 'grad_norm': '1.927', 'learning_rate': '4.224e-06', 'epoch': '0.7052'}

 71%|███████   | 26770/37963 [64:15:52<26:15:30,  8.45s/it]
 71%|███████   | 26771/37963 [64:16:00<25:34:44,  8.23s/it]
 71%|███████   | 26772/37963 [64:16:08<24:56:33,  8.02s/it]
 71%|███████   | 26773/37963 [64:16:15<24:14:07,  7.80s/it]
 71%|███████   | 26774/37963 [64:16:22<23:47:15,  7.65s/it]
 71%|███████   | 26775/37963 [64:16:36<29:20:57,  9.44s/it]
 71%|███████   | 26776/37963 [64:16:43<27:38:31,  8.90s/it]
 71%|███████   | 26777/37963 [64:16:51<26:26:59,  8.51s/it]
 71%|███████   | 26778/37963 [64:16:58<25:19:06,  8.15s/it]
 71%|███████   | 26779/37963 [64:17:06<24:47:01,  7.98s/it]
 71%|███████   | 26780/37963 [64:17:21<31:07:39, 10.02s/it]
                                                           
{'loss': '0.1326', 'grad_norm': '1.833', 'learning_rate': '4.217e-06', 'epoch': '0.7054'}

 71%|███████   | 26780/37963 [64:17:21<31:07:39, 10.02s/it]
 71%|███████   | 26781/37963 [64:17:35<34:48:44, 11.21s/it]
 71%|███████   | 26782/37963 [64:17:42<31:28:08, 10.13s/it]
 71%|███████   | 26783/37963 [64:17:50<29:06:50,  9.37s/it]
 71%|███████   | 26784/37963 [64:17:58<27:25:08,  8.83s/it]
 71%|███████   | 26785/37963 [64:18:05<26:09:13,  8.42s/it]
 71%|███████   | 26786/37963 [64:18:12<25:01:28,  8.06s/it]
 71%|███████   | 26787/37963 [64:18:20<24:33:16,  7.91s/it]
 71%|███████   | 26788/37963 [64:18:27<24:18:08,  7.83s/it]
 71%|███████   | 26789/37963 [64:18:35<23:59:45,  7.73s/it]
 71%|███████   | 26790/37963 [64:18:42<23:39:14,  7.62s/it]
                                                           
{'loss': '0.1216', 'grad_norm': '1.736', 'learning_rate': '4.21e-06', 'epoch': '0.7057'}

 71%|███████   | 26790/37963 [64:18:42<23:39:14,  7.62s/it]
 71%|███████   | 26791/37963 [64:18:56<29:36:56,  9.54s/it]
 71%|███████   | 26792/37963 [64:19:04<27:47:20,  8.96s/it]
 71%|███████   | 26793/37963 [64:19:11<26:29:37,  8.54s/it]
 71%|███████   | 26794/37963 [64:19:19<25:35:45,  8.25s/it]
 71%|███████   | 26795/37963 [64:19:27<24:55:30,  8.03s/it]
 71%|███████   | 26796/37963 [64:19:40<30:19:39,  9.78s/it]
 71%|███████   | 26797/37963 [64:19:48<28:23:31,  9.15s/it]
 71%|███████   | 26798/37963 [64:19:56<26:49:07,  8.65s/it]
 71%|███████   | 26799/37963 [64:20:03<25:50:25,  8.33s/it]
 71%|███████   | 26800/37963 [64:20:11<25:02:59,  8.08s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '2.36', 'learning_rate': '4.203e-06', 'epoch': '0.706'}

 71%|███████   | 26800/37963 [64:20:11<25:02:59,  8.08s/it]
 71%|███████   | 26801/37963 [64:20:18<24:36:46,  7.94s/it]
 71%|███████   | 26802/37963 [64:20:32<30:19:25,  9.78s/it]
 71%|███████   | 26803/37963 [64:20:40<28:16:48,  9.12s/it]
 71%|███████   | 26804/37963 [64:20:48<26:50:56,  8.66s/it]
 71%|███████   | 26805/37963 [64:21:01<31:45:28, 10.25s/it]
 71%|███████   | 26806/37963 [64:21:09<29:22:53,  9.48s/it]
 71%|███████   | 26807/37963 [64:21:17<27:31:57,  8.88s/it]
 71%|███████   | 26808/37963 [64:21:24<26:22:12,  8.51s/it]
 71%|███████   | 26809/37963 [64:21:32<25:27:52,  8.22s/it]
 71%|███████   | 26810/37963 [64:21:39<24:52:17,  8.03s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.425', 'learning_rate': '4.196e-06', 'epoch': '0.7062'}

 71%|███████   | 26810/37963 [64:21:39<24:52:17,  8.03s/it]
 71%|███████   | 26811/37963 [64:21:47<24:26:01,  7.89s/it]
 71%|███████   | 26812/37963 [64:21:55<24:09:24,  7.80s/it]
 71%|███████   | 26813/37963 [64:22:02<23:54:41,  7.72s/it]
 71%|███████   | 26814/37963 [64:22:10<23:49:37,  7.69s/it]
 71%|███████   | 26815/37963 [64:22:17<23:45:47,  7.67s/it]
 71%|███████   | 26816/37963 [64:22:25<23:42:29,  7.66s/it]
 71%|███████   | 26817/37963 [64:22:33<23:42:12,  7.66s/it]
 71%|███████   | 26818/37963 [64:22:46<29:14:19,  9.44s/it]
 71%|███████   | 26819/37963 [64:23:00<33:28:24, 10.81s/it]
 71%|███████   | 26820/37963 [64:23:08<30:31:10,  9.86s/it]
                                                           
{'loss': '0.1297', 'grad_norm': '1.855', 'learning_rate': '4.189e-06', 'epoch': '0.7065'}

 71%|███████   | 26820/37963 [64:23:08<30:31:10,  9.86s/it]
 71%|███████   | 26821/37963 [64:23:15<28:23:57,  9.18s/it]
 71%|███████   | 26822/37963 [64:23:23<26:46:30,  8.65s/it]
 71%|███████   | 26823/37963 [64:23:37<32:03:48, 10.36s/it]
 71%|███████   | 26824/37963 [64:23:45<29:26:57,  9.52s/it]
 71%|███████   | 26825/37963 [64:23:52<27:29:33,  8.89s/it]
 71%|███████   | 26826/37963 [64:24:06<32:02:33, 10.36s/it]
 71%|███████   | 26827/37963 [64:24:13<29:21:35,  9.49s/it]
 71%|███████   | 26828/37963 [64:24:21<27:39:29,  8.94s/it]
 71%|███████   | 26829/37963 [64:24:29<26:18:23,  8.51s/it]
 71%|███████   | 26830/37963 [64:24:36<25:28:58,  8.24s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '2.248', 'learning_rate': '4.182e-06', 'epoch': '0.7067'}

 71%|███████   | 26830/37963 [64:24:36<25:28:58,  8.24s/it]
 71%|███████   | 26831/37963 [64:24:44<24:45:21,  8.01s/it]
 71%|███████   | 26832/37963 [64:24:51<24:19:57,  7.87s/it]
 71%|███████   | 26833/37963 [64:24:59<24:03:08,  7.78s/it]
 71%|███████   | 26834/37963 [64:25:06<23:47:15,  7.69s/it]
 71%|███████   | 26835/37963 [64:25:14<23:33:01,  7.62s/it]
 71%|███████   | 26836/37963 [64:25:21<23:30:58,  7.61s/it]
 71%|███████   | 26837/37963 [64:25:29<23:28:19,  7.59s/it]
 71%|███████   | 26838/37963 [64:25:36<23:19:33,  7.55s/it]
 71%|███████   | 26839/37963 [64:25:44<23:13:33,  7.52s/it]
 71%|███████   | 26840/37963 [64:25:58<29:18:25,  9.49s/it]
                                                           
{'loss': '0.1189', 'grad_norm': '1.373', 'learning_rate': '4.175e-06', 'epoch': '0.707'}

 71%|███████   | 26840/37963 [64:25:58<29:18:25,  9.49s/it]
 71%|███████   | 26841/37963 [64:26:05<27:28:14,  8.89s/it]
 71%|███████   | 26842/37963 [64:26:13<26:11:33,  8.48s/it]
 71%|███████   | 26843/37963 [64:26:27<31:21:20, 10.15s/it]
 71%|███████   | 26844/37963 [64:26:35<28:59:47,  9.39s/it]
 71%|███████   | 26845/37963 [64:26:42<27:23:11,  8.87s/it]
 71%|███████   | 26846/37963 [64:26:50<26:02:08,  8.43s/it]
 71%|███████   | 26847/37963 [64:26:57<25:18:48,  8.20s/it]
 71%|███████   | 26848/37963 [64:27:05<24:39:12,  7.98s/it]
 71%|███████   | 26849/37963 [64:27:12<24:14:37,  7.85s/it]
 71%|███████   | 26850/37963 [64:27:26<29:57:59,  9.71s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '2.004', 'learning_rate': '4.168e-06', 'epoch': '0.7073'}

 71%|███████   | 26850/37963 [64:27:26<29:57:59,  9.71s/it]
 71%|███████   | 26851/37963 [64:27:34<28:02:48,  9.09s/it]
 71%|███████   | 26852/37963 [64:27:41<26:36:18,  8.62s/it]
 71%|███████   | 26853/37963 [64:27:49<25:36:25,  8.30s/it]
 71%|███████   | 26854/37963 [64:28:03<30:47:46,  9.98s/it]
 71%|███████   | 26855/37963 [64:28:11<28:36:12,  9.27s/it]
 71%|███████   | 26856/37963 [64:28:18<26:47:09,  8.68s/it]
 71%|███████   | 26857/37963 [64:28:25<25:30:55,  8.27s/it]
 71%|███████   | 26858/37963 [64:28:33<24:48:03,  8.04s/it]
 71%|███████   | 26859/37963 [64:28:40<24:22:14,  7.90s/it]
 71%|███████   | 26860/37963 [64:28:48<24:00:37,  7.79s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '2.268', 'learning_rate': '4.161e-06', 'epoch': '0.7075'}

 71%|███████   | 26860/37963 [64:28:48<24:00:37,  7.79s/it]
 71%|███████   | 26861/37963 [64:28:55<23:42:33,  7.69s/it]
 71%|███████   | 26862/37963 [64:29:03<23:38:22,  7.67s/it]
 71%|███████   | 26863/37963 [64:29:10<23:36:19,  7.66s/it]
 71%|███████   | 26864/37963 [64:29:18<23:35:16,  7.65s/it]
 71%|███████   | 26865/37963 [64:29:26<23:36:50,  7.66s/it]
 71%|███████   | 26866/37963 [64:29:33<23:28:48,  7.62s/it]
 71%|███████   | 26867/37963 [64:29:47<29:13:16,  9.48s/it]
 71%|███████   | 26868/37963 [64:29:55<27:23:03,  8.89s/it]
 71%|███████   | 26869/37963 [64:30:02<26:08:48,  8.48s/it]
 71%|███████   | 26870/37963 [64:30:10<25:18:56,  8.22s/it]
                                                           
{'loss': '0.1223', 'grad_norm': '3.859', 'learning_rate': '4.154e-06', 'epoch': '0.7078'}

 71%|███████   | 26870/37963 [64:30:10<25:18:56,  8.22s/it]
 71%|███████   | 26871/37963 [64:30:24<30:36:59,  9.94s/it]
 71%|███████   | 26872/37963 [64:30:39<35:17:09, 11.45s/it]
 71%|███████   | 26873/37963 [64:30:46<31:25:27, 10.20s/it]
 71%|███████   | 26874/37963 [64:30:54<29:01:31,  9.42s/it]
 71%|███████   | 26875/37963 [64:31:01<27:23:33,  8.89s/it]
 71%|███████   | 26876/37963 [64:31:15<32:13:40, 10.46s/it]
 71%|███████   | 26877/37963 [64:31:23<29:32:08,  9.59s/it]
 71%|███████   | 26878/37963 [64:31:30<27:32:39,  8.95s/it]
 71%|███████   | 26879/37963 [64:31:38<26:22:33,  8.57s/it]
 71%|███████   | 26880/37963 [64:31:45<25:08:00,  8.16s/it]
                                                           
{'loss': '0.1176', 'grad_norm': '2.485', 'learning_rate': '4.148e-06', 'epoch': '0.7081'}

 71%|███████   | 26880/37963 [64:31:45<25:08:00,  8.16s/it]
 71%|███████   | 26881/37963 [64:31:53<24:51:45,  8.08s/it]
 71%|███████   | 26882/37963 [64:32:01<24:24:01,  7.93s/it]
 71%|███████   | 26883/37963 [64:32:08<24:10:46,  7.86s/it]
 71%|███████   | 26884/37963 [64:32:22<29:51:34,  9.70s/it]
 71%|███████   | 26885/37963 [64:32:30<27:47:58,  9.03s/it]
 71%|███████   | 26886/37963 [64:32:37<26:20:18,  8.56s/it]
 71%|███████   | 26887/37963 [64:32:45<25:27:32,  8.27s/it]
 71%|███████   | 26888/37963 [64:32:53<24:45:41,  8.05s/it]
 71%|███████   | 26889/37963 [64:33:00<24:24:21,  7.93s/it]
 71%|███████   | 26890/37963 [64:33:07<23:45:33,  7.72s/it]
                                                           
{'loss': '0.109', 'grad_norm': '1.618', 'learning_rate': '4.141e-06', 'epoch': '0.7083'}

 71%|███████   | 26890/37963 [64:33:07<23:45:33,  7.72s/it]
 71%|███████   | 26891/37963 [64:33:15<23:39:57,  7.69s/it]
 71%|███████   | 26892/37963 [64:33:23<23:32:23,  7.65s/it]
 71%|███████   | 26893/37963 [64:33:30<23:30:05,  7.64s/it]
 71%|███████   | 26894/37963 [64:33:44<29:22:13,  9.55s/it]
 71%|███████   | 26895/37963 [64:33:52<27:39:54,  9.00s/it]
 71%|███████   | 26896/37963 [64:33:59<26:07:51,  8.50s/it]
 71%|███████   | 26897/37963 [64:34:07<25:16:04,  8.22s/it]
 71%|███████   | 26898/37963 [64:34:14<24:38:39,  8.02s/it]
 71%|███████   | 26899/37963 [64:34:22<24:13:54,  7.88s/it]
 71%|███████   | 26900/37963 [64:34:36<29:54:40,  9.73s/it]
                                                           
{'loss': '0.1129', 'grad_norm': '3.163', 'learning_rate': '4.134e-06', 'epoch': '0.7086'}

 71%|███████   | 26900/37963 [64:34:36<29:54:40,  9.73s/it]
 71%|███████   | 26901/37963 [64:34:43<27:43:42,  9.02s/it]
 71%|███████   | 26902/37963 [64:34:51<26:30:25,  8.63s/it]
 71%|███████   | 26903/37963 [64:34:59<25:36:25,  8.34s/it]
 71%|███████   | 26904/37963 [64:35:06<24:49:29,  8.08s/it]
 71%|███████   | 26905/37963 [64:35:14<24:15:37,  7.90s/it]
 71%|███████   | 26906/37963 [64:35:21<23:58:22,  7.81s/it]
 71%|███████   | 26907/37963 [64:35:35<29:42:42,  9.67s/it]
 71%|███████   | 26908/37963 [64:35:42<27:24:01,  8.92s/it]
 71%|███████   | 26909/37963 [64:35:50<26:16:10,  8.56s/it]
 71%|███████   | 26910/37963 [64:35:58<25:22:27,  8.26s/it]
                                                           
{'loss': '0.1142', 'grad_norm': '1.546', 'learning_rate': '4.127e-06', 'epoch': '0.7089'}

 71%|███████   | 26910/37963 [64:35:58<25:22:27,  8.26s/it]
 71%|███████   | 26911/37963 [64:36:12<30:44:39, 10.01s/it]
 71%|███████   | 26912/37963 [64:36:19<28:21:59,  9.24s/it]
 71%|███████   | 26913/37963 [64:36:27<26:34:22,  8.66s/it]
 71%|███████   | 26914/37963 [64:36:34<25:41:08,  8.37s/it]
 71%|███████   | 26915/37963 [64:36:42<24:48:02,  8.08s/it]
 71%|███████   | 26916/37963 [64:36:49<24:05:00,  7.85s/it]
 71%|███████   | 26917/37963 [64:36:57<23:48:59,  7.76s/it]
 71%|███████   | 26918/37963 [64:37:04<23:29:10,  7.66s/it]
 71%|███████   | 26919/37963 [64:37:11<23:11:44,  7.56s/it]
 71%|███████   | 26920/37963 [64:37:26<29:22:45,  9.58s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '3.078', 'learning_rate': '4.12e-06', 'epoch': '0.7091'}

 71%|███████   | 26920/37963 [64:37:26<29:22:45,  9.58s/it]
 71%|███████   | 26921/37963 [64:37:33<27:30:23,  8.97s/it]
 71%|███████   | 26922/37963 [64:37:47<31:52:10, 10.39s/it]
 71%|███████   | 26923/37963 [64:38:01<35:01:24, 11.42s/it]
 71%|███████   | 26924/37963 [64:38:08<31:31:17, 10.28s/it]
 71%|███████   | 26925/37963 [64:38:16<29:01:00,  9.46s/it]
 71%|███████   | 26926/37963 [64:38:23<27:08:02,  8.85s/it]
 71%|███████   | 26927/37963 [64:38:31<25:57:14,  8.47s/it]
 71%|███████   | 26928/37963 [64:38:38<25:06:20,  8.19s/it]
 71%|███████   | 26929/37963 [64:38:46<24:34:39,  8.02s/it]
 71%|███████   | 26930/37963 [64:38:54<24:13:46,  7.91s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.116', 'learning_rate': '4.113e-06', 'epoch': '0.7094'}

 71%|███████   | 26930/37963 [64:38:54<24:13:46,  7.91s/it]
 71%|███████   | 26931/37963 [64:39:01<23:53:42,  7.80s/it]
 71%|███████   | 26932/37963 [64:39:15<29:36:51,  9.66s/it]
 71%|███████   | 26933/37963 [64:39:23<27:40:21,  9.03s/it]
 71%|███████   | 26934/37963 [64:39:30<26:17:23,  8.58s/it]
 71%|███████   | 26935/37963 [64:39:38<25:25:43,  8.30s/it]
 71%|███████   | 26936/37963 [64:39:45<24:41:33,  8.06s/it]
 71%|███████   | 26937/37963 [64:39:53<24:18:32,  7.94s/it]
 71%|███████   | 26938/37963 [64:40:01<23:56:56,  7.82s/it]
 71%|███████   | 26939/37963 [64:40:08<23:52:47,  7.80s/it]
 71%|███████   | 26940/37963 [64:40:16<23:37:32,  7.72s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.443', 'learning_rate': '4.106e-06', 'epoch': '0.7096'}

 71%|███████   | 26940/37963 [64:40:16<23:37:32,  7.72s/it]
 71%|███████   | 26941/37963 [64:40:24<23:35:10,  7.70s/it]
 71%|███████   | 26942/37963 [64:40:31<23:07:08,  7.55s/it]
 71%|███████   | 26943/37963 [64:40:45<29:03:00,  9.49s/it]
 71%|███████   | 26944/37963 [64:40:52<27:16:50,  8.91s/it]
 71%|███████   | 26945/37963 [64:41:00<26:01:18,  8.50s/it]
 71%|███████   | 26946/37963 [64:41:08<25:18:50,  8.27s/it]
 71%|███████   | 26947/37963 [64:41:15<24:42:09,  8.07s/it]
 71%|███████   | 26948/37963 [64:41:29<29:57:25,  9.79s/it]
 71%|███████   | 26949/37963 [64:41:37<27:57:13,  9.14s/it]
 71%|███████   | 26950/37963 [64:41:44<26:27:12,  8.65s/it]
                                                           
{'loss': '0.1127', 'grad_norm': '1.302', 'learning_rate': '4.099e-06', 'epoch': '0.7099'}

 71%|███████   | 26950/37963 [64:41:44<26:27:12,  8.65s/it]
 71%|███████   | 26951/37963 [64:41:52<25:19:48,  8.28s/it]
 71%|███████   | 26952/37963 [64:41:59<24:24:06,  7.98s/it]
 71%|███████   | 26953/37963 [64:42:06<23:56:41,  7.83s/it]
 71%|███████   | 26954/37963 [64:42:14<23:42:16,  7.75s/it]
 71%|███████   | 26955/37963 [64:42:21<23:10:29,  7.58s/it]
 71%|███████   | 26956/37963 [64:42:29<23:13:07,  7.59s/it]
 71%|███████   | 26957/37963 [64:42:36<23:04:37,  7.55s/it]
 71%|███████   | 26958/37963 [64:42:44<22:59:18,  7.52s/it]
 71%|███████   | 26959/37963 [64:42:57<28:45:55,  9.41s/it]
 71%|███████   | 26960/37963 [64:43:05<27:00:12,  8.84s/it]
                                                           
{'loss': '0.1202', 'grad_norm': '2.06', 'learning_rate': '4.092e-06', 'epoch': '0.7102'}

 71%|███████   | 26960/37963 [64:43:05<27:00:12,  8.84s/it]
 71%|███████   | 26961/37963 [64:43:19<31:49:18, 10.41s/it]
 71%|███████   | 26962/37963 [64:43:27<29:11:43,  9.55s/it]
 71%|███████   | 26963/37963 [64:43:34<27:17:09,  8.93s/it]
 71%|███████   | 26964/37963 [64:43:49<32:27:26, 10.62s/it]
 71%|███████   | 26965/37963 [64:43:56<29:37:11,  9.70s/it]
 71%|███████   | 26966/37963 [64:44:04<27:36:24,  9.04s/it]
 71%|███████   | 26967/37963 [64:44:11<26:19:06,  8.62s/it]
 71%|███████   | 26968/37963 [64:44:25<31:09:50, 10.20s/it]
 71%|███████   | 26969/37963 [64:44:39<34:41:50, 11.36s/it]
 71%|███████   | 26970/37963 [64:44:47<31:21:03, 10.27s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '2.125', 'learning_rate': '4.085e-06', 'epoch': '0.7104'}

 71%|███████   | 26970/37963 [64:44:47<31:21:03, 10.27s/it]
 71%|███████   | 26971/37963 [64:44:55<28:56:22,  9.48s/it]
 71%|███████   | 26972/37963 [64:45:02<26:52:36,  8.80s/it]
 71%|███████   | 26973/37963 [64:45:09<25:44:59,  8.43s/it]
 71%|███████   | 26974/37963 [64:45:17<25:02:23,  8.20s/it]
 71%|███████   | 26975/37963 [64:45:25<24:27:16,  8.01s/it]
 71%|███████   | 26976/37963 [64:45:32<24:01:20,  7.87s/it]
 71%|███████   | 26977/37963 [64:45:40<23:36:04,  7.73s/it]
 71%|███████   | 26978/37963 [64:45:47<23:13:28,  7.61s/it]
 71%|███████   | 26979/37963 [64:45:55<23:11:41,  7.60s/it]
 71%|███████   | 26980/37963 [64:46:02<23:09:44,  7.59s/it]
                                                           
{'loss': '0.1273', 'grad_norm': '1.759', 'learning_rate': '4.079e-06', 'epoch': '0.7107'}

 71%|███████   | 26980/37963 [64:46:02<23:09:44,  7.59s/it]
 71%|███████   | 26981/37963 [64:46:10<23:07:22,  7.58s/it]
 71%|███████   | 26982/37963 [64:46:17<23:04:26,  7.56s/it]
 71%|███████   | 26983/37963 [64:46:25<22:59:14,  7.54s/it]
 71%|███████   | 26984/37963 [64:46:32<22:56:55,  7.52s/it]
 71%|███████   | 26985/37963 [64:46:40<22:55:19,  7.52s/it]
 71%|███████   | 26986/37963 [64:46:53<28:43:16,  9.42s/it]
 71%|███████   | 26987/37963 [64:47:08<32:55:48, 10.80s/it]
 71%|███████   | 26988/37963 [64:47:15<29:50:20,  9.79s/it]
 71%|███████   | 26989/37963 [64:47:23<27:48:53,  9.12s/it]
 71%|███████   | 26990/37963 [64:47:30<26:26:00,  8.67s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '3.865', 'learning_rate': '4.072e-06', 'epoch': '0.711'}

 71%|███████   | 26990/37963 [64:47:30<26:26:00,  8.67s/it]
 71%|███████   | 26991/37963 [64:47:38<25:28:51,  8.36s/it]
 71%|███████   | 26992/37963 [64:47:45<24:52:01,  8.16s/it]
 71%|███████   | 26993/37963 [64:47:53<24:23:44,  8.01s/it]
 71%|███████   | 26994/37963 [64:48:01<23:54:51,  7.85s/it]
 71%|███████   | 26995/37963 [64:48:08<23:41:28,  7.78s/it]
 71%|███████   | 26996/37963 [64:48:16<23:27:02,  7.70s/it]
 71%|███████   | 26997/37963 [64:48:29<28:47:47,  9.45s/it]
 71%|███████   | 26998/37963 [64:48:37<26:49:31,  8.81s/it]
 71%|███████   | 26999/37963 [64:48:44<25:32:57,  8.39s/it]
 71%|███████   | 27000/37963 [64:48:51<24:31:40,  8.05s/it]
                                                           
{'loss': '0.1172', 'grad_norm': '3.308', 'learning_rate': '4.065e-06', 'epoch': '0.7112'}

 71%|███████   | 27000/37963 [64:48:51<24:31:40,  8.05s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 71%|███████   | 27001/37963 [64:49:49<70:12:39, 23.06s/it]
 71%|███████   | 27002/37963 [64:49:58<57:24:13, 18.85s/it]
 71%|███████   | 27003/37963 [64:50:06<47:15:55, 15.53s/it]
 71%|███████   | 27004/37963 [64:50:14<40:07:24, 13.18s/it]
 71%|███████   | 27005/37963 [64:50:21<35:02:57, 11.51s/it]
 71%|███████   | 27006/37963 [64:50:29<31:14:12, 10.26s/it]
 71%|███████   | 27007/37963 [64:50:36<28:49:58,  9.47s/it]
 71%|███████   | 27008/37963 [64:50:44<27:09:31,  8.92s/it]
 71%|███████   | 27009/37963 [64:50:52<25:58:01,  8.53s/it]
 71%|███████   | 27010/37963 [64:51:06<30:54:22, 10.16s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '2.42', 'learning_rate': '4.058e-06', 'epoch': '0.7115'}

 71%|███████   | 27010/37963 [64:51:06<30:54:22, 10.16s/it]
 71%|███████   | 27011/37963 [64:51:20<34:33:06, 11.36s/it]
 71%|███████   | 27012/37963 [64:51:35<38:02:25, 12.51s/it]
 71%|███████   | 27013/37963 [64:51:42<33:26:12, 10.99s/it]
 71%|███████   | 27014/37963 [64:51:50<30:27:00, 10.01s/it]
 71%|███████   | 27015/37963 [64:51:58<28:13:32,  9.28s/it]
 71%|███████   | 27016/37963 [64:52:05<26:37:40,  8.76s/it]
 71%|███████   | 27017/37963 [64:52:13<25:31:29,  8.39s/it]
 71%|███████   | 27018/37963 [64:52:20<24:38:09,  8.10s/it]
 71%|███████   | 27019/37963 [64:52:34<29:55:50,  9.85s/it]
 71%|███████   | 27020/37963 [64:52:48<33:44:36, 11.10s/it]
                                                           
{'loss': '0.1196', 'grad_norm': '1.726', 'learning_rate': '4.051e-06', 'epoch': '0.7117'}

 71%|███████   | 27020/37963 [64:52:48<33:44:36, 11.10s/it]
 71%|███████   | 27021/37963 [64:52:56<30:30:35, 10.04s/it]
 71%|███████   | 27022/37963 [64:53:03<28:15:03,  9.30s/it]
 71%|███████   | 27023/37963 [64:53:11<26:43:22,  8.79s/it]
 71%|███████   | 27024/37963 [64:53:19<25:40:53,  8.45s/it]
 71%|███████   | 27025/37963 [64:53:26<24:45:59,  8.15s/it]
 71%|███████   | 27026/37963 [64:53:34<24:19:26,  8.01s/it]
 71%|███████   | 27027/37963 [64:53:41<23:54:15,  7.87s/it]
 71%|███████   | 27028/37963 [64:53:49<23:22:25,  7.70s/it]
 71%|███████   | 27029/37963 [64:53:56<23:15:44,  7.66s/it]
 71%|███████   | 27030/37963 [64:54:04<23:08:10,  7.62s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '1.865', 'learning_rate': '4.044e-06', 'epoch': '0.712'}

 71%|███████   | 27030/37963 [64:54:04<23:08:10,  7.62s/it]
 71%|███████   | 27031/37963 [64:54:11<23:00:30,  7.58s/it]
 71%|███████   | 27032/37963 [64:54:25<28:27:48,  9.37s/it]
 71%|███████   | 27033/37963 [64:54:32<26:51:16,  8.85s/it]
 71%|███████   | 27034/37963 [64:54:40<25:51:23,  8.52s/it]
 71%|███████   | 27035/37963 [64:54:48<24:56:16,  8.22s/it]
 71%|███████   | 27036/37963 [64:55:02<30:09:30,  9.94s/it]
 71%|███████   | 27037/37963 [64:55:09<27:54:17,  9.19s/it]
 71%|███████   | 27038/37963 [64:55:17<26:26:37,  8.71s/it]
 71%|███████   | 27039/37963 [64:55:24<25:23:22,  8.37s/it]
 71%|███████   | 27040/37963 [64:55:32<24:37:13,  8.11s/it]
                                                           
{'loss': '0.1214', 'grad_norm': '2.676', 'learning_rate': '4.037e-06', 'epoch': '0.7123'}

 71%|███████   | 27040/37963 [64:55:32<24:37:13,  8.11s/it]
 71%|███████   | 27041/37963 [64:55:46<30:05:11,  9.92s/it]
 71%|███████   | 27042/37963 [64:55:53<27:54:31,  9.20s/it]
 71%|███████   | 27043/37963 [64:56:01<26:27:30,  8.72s/it]
 71%|███████   | 27044/37963 [64:56:09<25:30:25,  8.41s/it]
 71%|███████   | 27045/37963 [64:56:16<24:46:12,  8.17s/it]
 71%|███████   | 27046/37963 [64:56:24<24:12:59,  7.99s/it]
 71%|███████   | 27047/37963 [64:56:31<23:48:40,  7.85s/it]
 71%|███████   | 27048/37963 [64:56:39<23:30:20,  7.75s/it]
 71%|███████▏  | 27049/37963 [64:56:46<23:23:10,  7.71s/it]
 71%|███████▏  | 27050/37963 [64:56:54<22:56:03,  7.57s/it]
                                                           
{'loss': '0.1404', 'grad_norm': '2.86', 'learning_rate': '4.031e-06', 'epoch': '0.7125'}

 71%|███████▏  | 27050/37963 [64:56:54<22:56:03,  7.57s/it]
 71%|███████▏  | 27051/37963 [64:57:01<23:04:57,  7.62s/it]
 71%|███████▏  | 27052/37963 [64:57:09<23:00:32,  7.59s/it]
 71%|███████▏  | 27053/37963 [64:57:17<23:03:42,  7.61s/it]
 71%|███████▏  | 27054/37963 [64:57:24<22:59:13,  7.59s/it]
 71%|███████▏  | 27055/37963 [64:57:32<22:58:34,  7.58s/it]
 71%|███████▏  | 27056/37963 [64:57:45<28:30:54,  9.41s/it]
 71%|███████▏  | 27057/37963 [64:57:53<26:48:06,  8.85s/it]
 71%|███████▏  | 27058/37963 [64:58:00<25:21:36,  8.37s/it]
 71%|███████▏  | 27059/37963 [64:58:08<24:37:47,  8.13s/it]
 71%|███████▏  | 27060/37963 [64:58:22<30:05:00,  9.93s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '2.313', 'learning_rate': '4.024e-06', 'epoch': '0.7128'}

 71%|███████▏  | 27060/37963 [64:58:22<30:05:00,  9.93s/it]
 71%|███████▏  | 27061/37963 [64:58:36<34:10:08, 11.28s/it]
 71%|███████▏  | 27062/37963 [64:58:44<30:45:32, 10.16s/it]
 71%|███████▏  | 27063/37963 [64:58:52<28:33:07,  9.43s/it]
 71%|███████▏  | 27064/37963 [64:59:06<32:47:30, 10.83s/it]
 71%|███████▏  | 27065/37963 [64:59:13<29:34:52,  9.77s/it]
 71%|███████▏  | 27066/37963 [64:59:20<27:31:41,  9.09s/it]
 71%|███████▏  | 27067/37963 [64:59:34<31:49:00, 10.51s/it]
 71%|███████▏  | 27068/37963 [64:59:42<29:12:22,  9.65s/it]
 71%|███████▏  | 27069/37963 [64:59:50<27:19:29,  9.03s/it]
 71%|███████▏  | 27070/37963 [64:59:57<25:41:25,  8.49s/it]
                                                           
{'loss': '0.104', 'grad_norm': '1.379', 'learning_rate': '4.017e-06', 'epoch': '0.7131'}

 71%|███████▏  | 27070/37963 [64:59:57<25:41:25,  8.49s/it]
 71%|███████▏  | 27071/37963 [65:00:04<24:34:10,  8.12s/it]
 71%|███████▏  | 27072/37963 [65:00:11<23:41:54,  7.83s/it]
 71%|███████▏  | 27073/37963 [65:00:18<23:03:34,  7.62s/it]
 71%|███████▏  | 27074/37963 [65:00:26<22:59:43,  7.60s/it]
 71%|███████▏  | 27075/37963 [65:00:33<22:56:06,  7.58s/it]
 71%|███████▏  | 27076/37963 [65:00:41<22:54:11,  7.57s/it]
 71%|███████▏  | 27077/37963 [65:00:49<22:56:12,  7.59s/it]
 71%|███████▏  | 27078/37963 [65:00:56<23:02:02,  7.62s/it]
 71%|███████▏  | 27079/37963 [65:01:04<23:11:44,  7.67s/it]
 71%|███████▏  | 27080/37963 [65:01:18<29:02:44,  9.61s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '1.816', 'learning_rate': '4.01e-06', 'epoch': '0.7133'}

 71%|███████▏  | 27080/37963 [65:01:18<29:02:44,  9.61s/it]
 71%|███████▏  | 27081/37963 [65:01:26<27:10:11,  8.99s/it]
 71%|███████▏  | 27082/37963 [65:01:33<25:56:54,  8.59s/it]
 71%|███████▏  | 27083/37963 [65:01:41<25:00:43,  8.28s/it]
 71%|███████▏  | 27084/37963 [65:01:48<24:18:17,  8.04s/it]
 71%|███████▏  | 27085/37963 [65:01:56<23:52:33,  7.90s/it]
 71%|███████▏  | 27086/37963 [65:02:10<29:21:10,  9.72s/it]
 71%|███████▏  | 27087/37963 [65:02:24<33:20:02, 11.03s/it]
 71%|███████▏  | 27088/37963 [65:02:32<30:10:57,  9.99s/it]
 71%|███████▏  | 27089/37963 [65:02:39<27:59:45,  9.27s/it]
 71%|███████▏  | 27090/37963 [65:02:46<26:12:06,  8.68s/it]
                                                           
{'loss': '0.1295', 'grad_norm': '1.406', 'learning_rate': '4.003e-06', 'epoch': '0.7136'}

 71%|███████▏  | 27090/37963 [65:02:46<26:12:06,  8.68s/it]
 71%|███████▏  | 27091/37963 [65:02:54<25:08:26,  8.32s/it]
 71%|███████▏  | 27092/37963 [65:03:02<24:28:07,  8.10s/it]
 71%|███████▏  | 27093/37963 [65:03:09<23:58:31,  7.94s/it]
 71%|███████▏  | 27094/37963 [65:03:17<23:37:36,  7.83s/it]
 71%|███████▏  | 27095/37963 [65:03:24<23:18:37,  7.72s/it]
 71%|███████▏  | 27096/37963 [65:03:32<23:05:01,  7.65s/it]
 71%|███████▏  | 27097/37963 [65:03:39<22:59:11,  7.62s/it]
 71%|███████▏  | 27098/37963 [65:03:47<22:55:54,  7.60s/it]
 71%|███████▏  | 27099/37963 [65:03:54<22:57:23,  7.61s/it]
 71%|███████▏  | 27100/37963 [65:04:02<22:54:17,  7.59s/it]
                                                           
{'loss': '0.1268', 'grad_norm': '2.374', 'learning_rate': '3.996e-06', 'epoch': '0.7139'}

 71%|███████▏  | 27100/37963 [65:04:02<22:54:17,  7.59s/it]
 71%|███████▏  | 27101/37963 [65:04:09<22:43:39,  7.53s/it]
 71%|███████▏  | 27102/37963 [65:04:23<28:22:41,  9.41s/it]
 71%|███████▏  | 27103/37963 [65:04:31<26:38:27,  8.83s/it]
 71%|███████▏  | 27104/37963 [65:04:38<25:30:13,  8.46s/it]
 71%|███████▏  | 27105/37963 [65:04:46<24:40:56,  8.18s/it]
 71%|███████▏  | 27106/37963 [65:04:53<24:05:28,  7.99s/it]
 71%|███████▏  | 27107/37963 [65:05:01<23:42:35,  7.86s/it]
 71%|███████▏  | 27108/37963 [65:05:09<23:34:10,  7.82s/it]
 71%|███████▏  | 27109/37963 [65:05:29<35:01:10, 11.62s/it]
 71%|███████▏  | 27110/37963 [65:05:37<31:21:05, 10.40s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.185', 'learning_rate': '3.99e-06', 'epoch': '0.7141'}

 71%|███████▏  | 27110/37963 [65:05:37<31:21:05, 10.40s/it]
 71%|███████▏  | 27111/37963 [65:05:44<28:46:04,  9.54s/it]
 71%|███████▏  | 27112/37963 [65:05:51<26:44:06,  8.87s/it]
 71%|███████▏  | 27113/37963 [65:06:05<31:14:04, 10.36s/it]
 71%|███████▏  | 27114/37963 [65:06:13<28:40:23,  9.51s/it]
 71%|███████▏  | 27115/37963 [65:06:20<26:41:35,  8.86s/it]
 71%|███████▏  | 27116/37963 [65:06:27<25:21:52,  8.42s/it]
 71%|███████▏  | 27117/37963 [65:06:35<24:36:44,  8.17s/it]
 71%|███████▏  | 27118/37963 [65:06:43<23:59:21,  7.96s/it]
 71%|███████▏  | 27119/37963 [65:06:50<23:35:14,  7.83s/it]
 71%|███████▏  | 27120/37963 [65:07:04<29:11:04,  9.69s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '1.719', 'learning_rate': '3.983e-06', 'epoch': '0.7144'}

 71%|███████▏  | 27120/37963 [65:07:04<29:11:04,  9.69s/it]
 71%|███████▏  | 27121/37963 [65:07:12<27:12:34,  9.03s/it]
 71%|███████▏  | 27122/37963 [65:07:19<25:52:55,  8.59s/it]
 71%|███████▏  | 27123/37963 [65:07:27<25:02:07,  8.31s/it]
 71%|███████▏  | 27124/37963 [65:07:34<24:21:32,  8.09s/it]
 71%|███████▏  | 27125/37963 [65:07:42<23:52:45,  7.93s/it]
 71%|███████▏  | 27126/37963 [65:07:50<23:40:59,  7.87s/it]
 71%|███████▏  | 27127/37963 [65:07:57<23:20:51,  7.76s/it]
 71%|███████▏  | 27128/37963 [65:08:05<23:06:50,  7.68s/it]
 71%|███████▏  | 27129/37963 [65:08:12<23:06:33,  7.68s/it]
 71%|███████▏  | 27130/37963 [65:08:20<23:01:27,  7.65s/it]
                                                           
{'loss': '0.1238', 'grad_norm': '2.109', 'learning_rate': '3.976e-06', 'epoch': '0.7146'}

 71%|███████▏  | 27130/37963 [65:08:20<23:01:27,  7.65s/it]
 71%|███████▏  | 27131/37963 [65:08:28<23:08:28,  7.69s/it]
 71%|███████▏  | 27132/37963 [65:08:42<28:39:00,  9.52s/it]
 71%|███████▏  | 27133/37963 [65:08:49<26:46:19,  8.90s/it]
 71%|███████▏  | 27134/37963 [65:08:56<25:30:45,  8.48s/it]
 71%|███████▏  | 27135/37963 [65:09:04<24:50:50,  8.26s/it]
 71%|███████▏  | 27136/37963 [65:09:18<29:33:05,  9.83s/it]
 71%|███████▏  | 27137/37963 [65:09:25<27:31:09,  9.15s/it]
 71%|███████▏  | 27138/37963 [65:09:33<26:02:25,  8.66s/it]
 71%|███████▏  | 27139/37963 [65:09:40<25:05:33,  8.35s/it]
 71%|███████▏  | 27140/37963 [65:09:48<24:15:21,  8.07s/it]
                                                           
{'loss': '0.1307', 'grad_norm': '1.78', 'learning_rate': '3.969e-06', 'epoch': '0.7149'}

 71%|███████▏  | 27140/37963 [65:09:48<24:15:21,  8.07s/it]
 71%|███████▏  | 27141/37963 [65:09:55<23:46:04,  7.91s/it]
 71%|███████▏  | 27142/37963 [65:10:09<29:11:33,  9.71s/it]
 71%|███████▏  | 27143/37963 [65:10:17<27:27:09,  9.13s/it]
 72%|███████▏  | 27144/37963 [65:10:25<26:09:41,  8.71s/it]
 72%|███████▏  | 27145/37963 [65:10:32<24:44:27,  8.23s/it]
 72%|███████▏  | 27146/37963 [65:10:39<24:06:14,  8.02s/it]
 72%|███████▏  | 27147/37963 [65:10:47<23:38:35,  7.87s/it]
 72%|███████▏  | 27148/37963 [65:11:01<29:21:33,  9.77s/it]
 72%|███████▏  | 27149/37963 [65:11:08<27:00:39,  8.99s/it]
 72%|███████▏  | 27150/37963 [65:11:16<25:41:05,  8.55s/it]
                                                           
{'loss': '0.1262', 'grad_norm': '1.904', 'learning_rate': '3.962e-06', 'epoch': '0.7152'}

 72%|███████▏  | 27150/37963 [65:11:16<25:41:05,  8.55s/it]
 72%|███████▏  | 27151/37963 [65:11:24<24:51:50,  8.28s/it]
 72%|███████▏  | 27152/37963 [65:11:31<23:54:21,  7.96s/it]
 72%|███████▏  | 27153/37963 [65:11:38<23:32:58,  7.84s/it]
 72%|███████▏  | 27154/37963 [65:11:46<23:17:54,  7.76s/it]
 72%|███████▏  | 27155/37963 [65:11:53<23:04:32,  7.69s/it]
 72%|███████▏  | 27156/37963 [65:12:01<23:02:47,  7.68s/it]
 72%|███████▏  | 27157/37963 [65:12:21<34:25:51, 11.47s/it]
 72%|███████▏  | 27158/37963 [65:12:29<31:06:36, 10.37s/it]
 72%|███████▏  | 27159/37963 [65:12:36<28:23:07,  9.46s/it]
 72%|███████▏  | 27160/37963 [65:12:44<26:43:32,  8.91s/it]
                                                           
{'loss': '0.1172', 'grad_norm': '1.838', 'learning_rate': '3.956e-06', 'epoch': '0.7154'}

 72%|███████▏  | 27160/37963 [65:12:44<26:43:32,  8.91s/it]
 72%|███████▏  | 27161/37963 [65:12:52<25:25:38,  8.47s/it]
 72%|███████▏  | 27162/37963 [65:12:59<24:35:55,  8.20s/it]
 72%|███████▏  | 27163/37963 [65:13:13<29:41:25,  9.90s/it]
 72%|███████▏  | 27164/37963 [65:13:21<27:36:07,  9.20s/it]
 72%|███████▏  | 27165/37963 [65:13:28<26:11:06,  8.73s/it]
 72%|███████▏  | 27166/37963 [65:13:35<24:51:35,  8.29s/it]
 72%|███████▏  | 27167/37963 [65:13:43<24:11:37,  8.07s/it]
 72%|███████▏  | 27168/37963 [65:13:57<29:39:26,  9.89s/it]
 72%|███████▏  | 27169/37963 [65:14:05<27:35:24,  9.20s/it]
 72%|███████▏  | 27170/37963 [65:14:12<26:10:52,  8.73s/it]
                                                           
{'loss': '0.1116', 'grad_norm': '2.012', 'learning_rate': '3.949e-06', 'epoch': '0.7157'}

 72%|███████▏  | 27170/37963 [65:14:12<26:10:52,  8.73s/it]
 72%|███████▏  | 27171/37963 [65:14:20<25:04:34,  8.36s/it]
 72%|███████▏  | 27172/37963 [65:14:27<24:17:30,  8.10s/it]
 72%|███████▏  | 27173/37963 [65:14:35<23:51:30,  7.96s/it]
 72%|███████▏  | 27174/37963 [65:14:43<23:27:42,  7.83s/it]
 72%|███████▏  | 27175/37963 [65:14:50<23:10:33,  7.73s/it]
 72%|███████▏  | 27176/37963 [65:14:58<23:05:18,  7.71s/it]
 72%|███████▏  | 27177/37963 [65:15:05<22:54:30,  7.65s/it]
 72%|███████▏  | 27178/37963 [65:15:13<22:53:36,  7.64s/it]
 72%|███████▏  | 27179/37963 [65:15:27<28:41:41,  9.58s/it]
 72%|███████▏  | 27180/37963 [65:15:34<26:49:59,  8.96s/it]
                                                           
{'loss': '0.115', 'grad_norm': '2.293', 'learning_rate': '3.942e-06', 'epoch': '0.716'}

 72%|███████▏  | 27180/37963 [65:15:34<26:49:59,  8.96s/it]
 72%|███████▏  | 27181/37963 [65:15:42<25:34:47,  8.54s/it]
 72%|███████▏  | 27182/37963 [65:15:50<24:43:56,  8.26s/it]
 72%|███████▏  | 27183/37963 [65:15:57<23:57:02,  8.00s/it]
 72%|███████▏  | 27184/37963 [65:16:11<29:36:03,  9.89s/it]
 72%|███████▏  | 27185/37963 [65:16:19<27:30:42,  9.19s/it]
 72%|███████▏  | 27186/37963 [65:16:26<26:01:16,  8.69s/it]
 72%|███████▏  | 27187/37963 [65:16:34<24:58:01,  8.34s/it]
 72%|███████▏  | 27188/37963 [65:16:41<24:15:36,  8.11s/it]
 72%|███████▏  | 27189/37963 [65:16:49<23:54:09,  7.99s/it]
 72%|███████▏  | 27190/37963 [65:16:57<23:37:09,  7.89s/it]
                                                           
{'loss': '0.1144', 'grad_norm': '2.395', 'learning_rate': '3.935e-06', 'epoch': '0.7162'}

 72%|███████▏  | 27190/37963 [65:16:57<23:37:09,  7.89s/it]
 72%|███████▏  | 27191/37963 [65:17:05<23:28:58,  7.85s/it]
 72%|███████▏  | 27192/37963 [65:17:12<22:59:31,  7.68s/it]
 72%|███████▏  | 27193/37963 [65:17:19<22:53:57,  7.65s/it]
 72%|███████▏  | 27194/37963 [65:17:27<22:45:28,  7.61s/it]
 72%|███████▏  | 27195/37963 [65:17:41<28:36:20,  9.56s/it]
 72%|███████▏  | 27196/37963 [65:17:55<32:40:49, 10.93s/it]
 72%|███████▏  | 27197/37963 [65:18:03<29:47:08,  9.96s/it]
 72%|███████▏  | 27198/37963 [65:18:10<27:38:27,  9.24s/it]
 72%|███████▏  | 27199/37963 [65:18:18<25:58:20,  8.69s/it]
 72%|███████▏  | 27200/37963 [65:18:25<24:51:04,  8.31s/it]
                                                           
{'loss': '0.1149', 'grad_norm': '1.314', 'learning_rate': '3.928e-06', 'epoch': '0.7165'}

 72%|███████▏  | 27200/37963 [65:18:25<24:51:04,  8.31s/it]
 72%|███████▏  | 27201/37963 [65:18:33<24:13:30,  8.10s/it]
 72%|███████▏  | 27202/37963 [65:18:41<23:52:47,  7.99s/it]
 72%|███████▏  | 27203/37963 [65:18:48<23:32:15,  7.88s/it]
 72%|███████▏  | 27204/37963 [65:19:03<29:15:48,  9.79s/it]
 72%|███████▏  | 27205/37963 [65:19:16<32:54:56, 11.01s/it]
 72%|███████▏  | 27206/37963 [65:19:24<29:44:55,  9.96s/it]
 72%|███████▏  | 27207/37963 [65:19:31<27:33:05,  9.22s/it]
 72%|███████▏  | 27208/37963 [65:19:39<26:01:49,  8.71s/it]
 72%|███████▏  | 27209/37963 [65:19:46<24:59:04,  8.36s/it]
 72%|███████▏  | 27210/37963 [65:19:54<24:11:55,  8.10s/it]
                                                           
{'loss': '0.1256', 'grad_norm': '1.861', 'learning_rate': '3.922e-06', 'epoch': '0.7168'}

 72%|███████▏  | 27210/37963 [65:19:54<24:11:55,  8.10s/it]
 72%|███████▏  | 27211/37963 [65:20:01<23:40:36,  7.93s/it]
 72%|███████▏  | 27212/37963 [65:20:09<23:12:19,  7.77s/it]
 72%|███████▏  | 27213/37963 [65:20:16<22:57:38,  7.69s/it]
 72%|███████▏  | 27214/37963 [65:20:24<22:52:44,  7.66s/it]
 72%|███████▏  | 27215/37963 [65:20:31<22:37:52,  7.58s/it]
 72%|███████▏  | 27216/37963 [65:20:45<28:23:52,  9.51s/it]
 72%|███████▏  | 27217/37963 [65:20:59<32:23:51, 10.85s/it]
 72%|███████▏  | 27218/37963 [65:21:07<29:24:17,  9.85s/it]
 72%|███████▏  | 27219/37963 [65:21:14<27:20:09,  9.16s/it]
 72%|███████▏  | 27220/37963 [65:21:22<25:53:22,  8.68s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '1.374', 'learning_rate': '3.915e-06', 'epoch': '0.717'}

 72%|███████▏  | 27220/37963 [65:21:22<25:53:22,  8.68s/it]
 72%|███████▏  | 27221/37963 [65:21:29<24:50:38,  8.33s/it]
 72%|███████▏  | 27222/37963 [65:21:37<24:12:15,  8.11s/it]
 72%|███████▏  | 27223/37963 [65:21:45<23:38:09,  7.92s/it]
 72%|███████▏  | 27224/37963 [65:21:52<23:18:54,  7.82s/it]
 72%|███████▏  | 27225/37963 [65:22:00<23:08:51,  7.76s/it]
 72%|███████▏  | 27226/37963 [65:22:07<23:04:57,  7.74s/it]
 72%|███████▏  | 27227/37963 [65:22:21<28:39:47,  9.61s/it]
 72%|███████▏  | 27228/37963 [65:22:29<26:43:09,  8.96s/it]
 72%|███████▏  | 27229/37963 [65:22:36<25:25:43,  8.53s/it]
 72%|███████▏  | 27230/37963 [65:22:44<24:28:25,  8.21s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '2.313', 'learning_rate': '3.908e-06', 'epoch': '0.7173'}

 72%|███████▏  | 27230/37963 [65:22:44<24:28:25,  8.21s/it]
 72%|███████▏  | 27231/37963 [65:22:51<23:50:56,  8.00s/it]
 72%|███████▏  | 27232/37963 [65:22:59<23:21:08,  7.83s/it]
 72%|███████▏  | 27233/37963 [65:23:06<23:05:31,  7.75s/it]
 72%|███████▏  | 27234/37963 [65:23:14<22:55:17,  7.69s/it]
 72%|███████▏  | 27235/37963 [65:23:22<22:51:04,  7.67s/it]
 72%|███████▏  | 27236/37963 [65:23:36<28:32:23,  9.58s/it]
 72%|███████▏  | 27237/37963 [65:23:43<26:40:39,  8.95s/it]
 72%|███████▏  | 27238/37963 [65:23:51<25:21:47,  8.51s/it]
 72%|███████▏  | 27239/37963 [65:23:58<24:27:03,  8.21s/it]
 72%|███████▏  | 27240/37963 [65:24:05<23:34:18,  7.91s/it]
                                                           
{'loss': '0.113', 'grad_norm': '2.816', 'learning_rate': '3.901e-06', 'epoch': '0.7175'}

 72%|███████▏  | 27240/37963 [65:24:05<23:34:18,  7.91s/it]
 72%|███████▏  | 27241/37963 [65:24:13<23:13:37,  7.80s/it]
 72%|███████▏  | 27242/37963 [65:24:27<28:45:07,  9.65s/it]
 72%|███████▏  | 27243/37963 [65:24:34<26:54:05,  9.03s/it]
 72%|███████▏  | 27244/37963 [65:24:42<25:39:16,  8.62s/it]
 72%|███████▏  | 27245/37963 [65:24:50<24:43:51,  8.31s/it]
 72%|███████▏  | 27246/37963 [65:24:57<24:10:02,  8.12s/it]
 72%|███████▏  | 27247/37963 [65:25:05<23:43:04,  7.97s/it]
 72%|███████▏  | 27248/37963 [65:25:13<23:30:38,  7.90s/it]
 72%|███████▏  | 27249/37963 [65:25:20<23:12:44,  7.80s/it]
 72%|███████▏  | 27250/37963 [65:25:34<29:00:11,  9.75s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '2.367', 'learning_rate': '3.895e-06', 'epoch': '0.7178'}

 72%|███████▏  | 27250/37963 [65:25:34<29:00:11,  9.75s/it]
 72%|███████▏  | 27251/37963 [65:25:49<32:51:35, 11.04s/it]
 72%|███████▏  | 27252/37963 [65:25:56<29:47:51, 10.02s/it]
 72%|███████▏  | 27253/37963 [65:26:03<27:14:18,  9.16s/it]
 72%|███████▏  | 27254/37963 [65:26:11<25:50:46,  8.69s/it]
 72%|███████▏  | 27255/37963 [65:26:18<24:50:47,  8.35s/it]
 72%|███████▏  | 27256/37963 [65:26:26<24:06:07,  8.10s/it]
 72%|███████▏  | 27257/37963 [65:26:34<23:37:12,  7.94s/it]
 72%|███████▏  | 27258/37963 [65:26:48<29:10:16,  9.81s/it]
 72%|███████▏  | 27259/37963 [65:26:55<27:10:28,  9.14s/it]
 72%|███████▏  | 27260/37963 [65:27:03<25:48:15,  8.68s/it]
                                                           
{'loss': '0.1222', 'grad_norm': '1.441', 'learning_rate': '3.888e-06', 'epoch': '0.7181'}

 72%|███████▏  | 27260/37963 [65:27:03<25:48:15,  8.68s/it]
 72%|███████▏  | 27261/37963 [65:27:10<24:42:57,  8.31s/it]
 72%|███████▏  | 27262/37963 [65:27:24<29:51:45, 10.05s/it]
 72%|███████▏  | 27263/37963 [65:27:32<27:39:04,  9.30s/it]
 72%|███████▏  | 27264/37963 [65:27:40<26:00:01,  8.75s/it]
 72%|███████▏  | 27265/37963 [65:27:53<30:36:47, 10.30s/it]
 72%|███████▏  | 27266/37963 [65:28:01<28:02:11,  9.44s/it]
 72%|███████▏  | 27267/37963 [65:28:08<26:22:49,  8.88s/it]
 72%|███████▏  | 27268/37963 [65:28:16<25:09:55,  8.47s/it]
 72%|███████▏  | 27269/37963 [65:28:23<24:16:19,  8.17s/it]
 72%|███████▏  | 27270/37963 [65:28:31<23:25:22,  7.89s/it]
                                                           
{'loss': '0.1154', 'grad_norm': '1.146', 'learning_rate': '3.881e-06', 'epoch': '0.7183'}

 72%|███████▏  | 27270/37963 [65:28:31<23:25:22,  7.89s/it]
 72%|███████▏  | 27271/37963 [65:28:38<22:52:14,  7.70s/it]
 72%|███████▏  | 27272/37963 [65:28:45<22:42:55,  7.65s/it]
 72%|███████▏  | 27273/37963 [65:28:53<22:34:29,  7.60s/it]
 72%|███████▏  | 27274/37963 [65:29:00<22:30:57,  7.58s/it]
 72%|███████▏  | 27275/37963 [65:29:14<28:09:40,  9.49s/it]
 72%|███████▏  | 27276/37963 [65:29:22<26:18:06,  8.86s/it]
 72%|███████▏  | 27277/37963 [65:29:29<24:59:28,  8.42s/it]
 72%|███████▏  | 27278/37963 [65:29:37<24:10:51,  8.15s/it]
 72%|███████▏  | 27279/37963 [65:29:44<23:35:37,  7.95s/it]
 72%|███████▏  | 27280/37963 [65:29:51<22:56:25,  7.73s/it]
                                                           
{'loss': '0.118', 'grad_norm': '1.589', 'learning_rate': '3.874e-06', 'epoch': '0.7186'}

 72%|███████▏  | 27280/37963 [65:29:51<22:56:25,  7.73s/it]
 72%|███████▏  | 27281/37963 [65:29:59<22:49:37,  7.69s/it]
 72%|███████▏  | 27282/37963 [65:30:07<22:46:06,  7.67s/it]
 72%|███████▏  | 27283/37963 [65:30:14<22:23:02,  7.55s/it]
 72%|███████▏  | 27284/37963 [65:30:21<22:20:34,  7.53s/it]
 72%|███████▏  | 27285/37963 [65:30:35<28:05:24,  9.47s/it]
 72%|███████▏  | 27286/37963 [65:30:43<26:19:15,  8.87s/it]
 72%|███████▏  | 27287/37963 [65:30:50<25:01:34,  8.44s/it]
 72%|███████▏  | 27288/37963 [65:30:58<24:11:58,  8.16s/it]
 72%|███████▏  | 27289/37963 [65:31:11<28:59:22,  9.78s/it]
 72%|███████▏  | 27290/37963 [65:31:19<27:02:51,  9.12s/it]
                                                           
{'loss': '0.1165', 'grad_norm': '2.611', 'learning_rate': '3.868e-06', 'epoch': '0.7189'}

 72%|███████▏  | 27290/37963 [65:31:19<27:02:51,  9.12s/it]
 72%|███████▏  | 27291/37963 [65:31:27<25:39:25,  8.65s/it]
 72%|███████▏  | 27292/37963 [65:31:34<24:39:09,  8.32s/it]
 72%|███████▏  | 27293/37963 [65:31:42<23:57:21,  8.08s/it]
 72%|███████▏  | 27294/37963 [65:31:49<23:24:15,  7.90s/it]
 72%|███████▏  | 27295/37963 [65:31:56<23:01:00,  7.77s/it]
 72%|███████▏  | 27296/37963 [65:32:04<22:53:04,  7.72s/it]
 72%|███████▏  | 27297/37963 [65:32:12<22:36:40,  7.63s/it]
 72%|███████▏  | 27298/37963 [65:32:19<22:29:29,  7.59s/it]
 72%|███████▏  | 27299/37963 [65:32:27<22:25:59,  7.57s/it]
 72%|███████▏  | 27300/37963 [65:32:34<22:24:33,  7.57s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '1.278', 'learning_rate': '3.861e-06', 'epoch': '0.7191'}

 72%|███████▏  | 27300/37963 [65:32:34<22:24:33,  7.57s/it]
 72%|███████▏  | 27301/37963 [65:32:42<22:22:43,  7.56s/it]
 72%|███████▏  | 27302/37963 [65:32:49<22:25:37,  7.57s/it]
 72%|███████▏  | 27303/37963 [65:32:57<22:10:04,  7.49s/it]
 72%|███████▏  | 27304/37963 [65:33:10<27:53:05,  9.42s/it]
 72%|███████▏  | 27305/37963 [65:33:24<31:53:31, 10.77s/it]
 72%|███████▏  | 27306/37963 [65:33:38<34:15:37, 11.57s/it]
 72%|███████▏  | 27307/37963 [65:33:45<30:42:17, 10.37s/it]
 72%|███████▏  | 27308/37963 [65:33:59<33:51:52, 11.44s/it]
 72%|███████▏  | 27309/37963 [65:34:07<30:14:19, 10.22s/it]
 72%|███████▏  | 27310/37963 [65:34:14<27:55:56,  9.44s/it]
                                                           
{'loss': '0.12', 'grad_norm': '2.107', 'learning_rate': '3.854e-06', 'epoch': '0.7194'}

 72%|███████▏  | 27310/37963 [65:34:14<27:55:56,  9.44s/it]
 72%|███████▏  | 27311/37963 [65:34:22<26:10:24,  8.85s/it]
 72%|███████▏  | 27312/37963 [65:34:29<25:02:55,  8.47s/it]
 72%|███████▏  | 27313/37963 [65:34:37<23:58:49,  8.11s/it]
 72%|███████▏  | 27314/37963 [65:34:50<28:55:40,  9.78s/it]
 72%|███████▏  | 27315/37963 [65:34:58<26:57:27,  9.11s/it]
 72%|███████▏  | 27316/37963 [65:35:05<25:36:01,  8.66s/it]
 72%|███████▏  | 27317/37963 [65:35:13<24:25:24,  8.26s/it]
 72%|███████▏  | 27318/37963 [65:35:20<23:50:14,  8.06s/it]
 72%|███████▏  | 27319/37963 [65:35:28<23:14:09,  7.86s/it]
 72%|███████▏  | 27320/37963 [65:35:35<22:54:56,  7.75s/it]
                                                           
{'loss': '0.1178', 'grad_norm': '1.471', 'learning_rate': '3.847e-06', 'epoch': '0.7197'}

 72%|███████▏  | 27320/37963 [65:35:35<22:54:56,  7.75s/it]
 72%|███████▏  | 27321/37963 [65:35:43<22:52:04,  7.74s/it]
 72%|███████▏  | 27322/37963 [65:35:57<28:23:38,  9.61s/it]
 72%|███████▏  | 27323/37963 [65:36:05<26:33:29,  8.99s/it]
 72%|███████▏  | 27324/37963 [65:36:12<25:18:47,  8.57s/it]
 72%|███████▏  | 27325/37963 [65:36:20<24:18:06,  8.22s/it]
 72%|███████▏  | 27326/37963 [65:36:27<23:40:49,  8.01s/it]
 72%|███████▏  | 27327/37963 [65:36:35<23:25:00,  7.93s/it]
 72%|███████▏  | 27328/37963 [65:36:42<23:02:31,  7.80s/it]
 72%|███████▏  | 27329/37963 [65:36:50<22:50:53,  7.73s/it]
 72%|███████▏  | 27330/37963 [65:36:57<22:42:29,  7.69s/it]
                                                           
{'loss': '0.1109', 'grad_norm': '2.301', 'learning_rate': '3.841e-06', 'epoch': '0.7199'}

 72%|███████▏  | 27330/37963 [65:36:57<22:42:29,  7.69s/it]
 72%|███████▏  | 27331/37963 [65:37:05<22:25:53,  7.60s/it]
 72%|███████▏  | 27332/37963 [65:37:12<22:16:27,  7.54s/it]
 72%|███████▏  | 27333/37963 [65:37:20<22:23:21,  7.58s/it]
 72%|███████▏  | 27334/37963 [65:37:28<22:24:17,  7.59s/it]
 72%|███████▏  | 27335/37963 [65:37:35<22:25:52,  7.60s/it]
 72%|███████▏  | 27336/37963 [65:37:43<22:25:52,  7.60s/it]
 72%|███████▏  | 27337/37963 [65:37:57<27:58:56,  9.48s/it]
 72%|███████▏  | 27338/37963 [65:38:04<26:20:54,  8.93s/it]
 72%|███████▏  | 27339/37963 [65:38:18<30:38:59, 10.39s/it]
 72%|███████▏  | 27340/37963 [65:38:26<28:11:16,  9.55s/it]
                                                           
{'loss': '0.1156', 'grad_norm': '2.519', 'learning_rate': '3.834e-06', 'epoch': '0.7202'}

 72%|███████▏  | 27340/37963 [65:38:26<28:11:16,  9.55s/it]
 72%|███████▏  | 27341/37963 [65:38:33<26:18:33,  8.92s/it]
 72%|███████▏  | 27342/37963 [65:38:41<25:09:17,  8.53s/it]
 72%|███████▏  | 27343/37963 [65:38:48<24:09:39,  8.19s/it]
 72%|███████▏  | 27344/37963 [65:38:56<23:31:20,  7.97s/it]
 72%|███████▏  | 27345/37963 [65:39:03<23:11:54,  7.87s/it]
 72%|███████▏  | 27346/37963 [65:39:10<22:40:08,  7.69s/it]
 72%|███████▏  | 27347/37963 [65:39:18<22:23:07,  7.59s/it]
 72%|███████▏  | 27348/37963 [65:39:25<22:22:52,  7.59s/it]
 72%|███████▏  | 27349/37963 [65:39:33<22:13:50,  7.54s/it]
 72%|███████▏  | 27350/37963 [65:39:40<22:10:36,  7.52s/it]
                                                           
{'loss': '0.1333', 'grad_norm': '2.527', 'learning_rate': '3.827e-06', 'epoch': '0.7204'}

 72%|███████▏  | 27350/37963 [65:39:40<22:10:36,  7.52s/it]
 72%|███████▏  | 27351/37963 [65:39:54<27:27:56,  9.32s/it]
 72%|███████▏  | 27352/37963 [65:40:08<31:40:16, 10.75s/it]
 72%|███████▏  | 27353/37963 [65:40:15<28:47:58,  9.77s/it]
 72%|███████▏  | 27354/37963 [65:40:23<26:49:11,  9.10s/it]
 72%|███████▏  | 27355/37963 [65:40:31<25:32:31,  8.67s/it]
 72%|███████▏  | 27356/37963 [65:40:38<24:36:50,  8.35s/it]
 72%|███████▏  | 27357/37963 [65:40:46<23:53:57,  8.11s/it]
 72%|███████▏  | 27358/37963 [65:41:00<29:03:53,  9.87s/it]
 72%|███████▏  | 27359/37963 [65:41:07<26:57:48,  9.15s/it]
 72%|███████▏  | 27360/37963 [65:41:21<30:49:22, 10.47s/it]
                                                           
{'loss': '0.1236', 'grad_norm': '2.876', 'learning_rate': '3.821e-06', 'epoch': '0.7207'}

 72%|███████▏  | 27360/37963 [65:41:21<30:49:22, 10.47s/it]
 72%|███████▏  | 27361/37963 [65:41:34<33:35:39, 11.41s/it]
 72%|███████▏  | 27362/37963 [65:41:42<29:56:46, 10.17s/it]
 72%|███████▏  | 27363/37963 [65:41:49<27:37:33,  9.38s/it]
 72%|███████▏  | 27364/37963 [65:41:57<26:04:13,  8.85s/it]
 72%|███████▏  | 27365/37963 [65:42:04<24:43:47,  8.40s/it]
 72%|███████▏  | 27366/37963 [65:42:12<24:01:14,  8.16s/it]
 72%|███████▏  | 27367/37963 [65:42:26<29:03:12,  9.87s/it]
 72%|███████▏  | 27368/37963 [65:42:33<27:06:56,  9.21s/it]
 72%|███████▏  | 27369/37963 [65:42:41<25:35:01,  8.69s/it]
 72%|███████▏  | 27370/37963 [65:42:48<24:34:57,  8.35s/it]
                                                           
{'loss': '0.1106', 'grad_norm': '2.089', 'learning_rate': '3.814e-06', 'epoch': '0.721'}

 72%|███████▏  | 27370/37963 [65:42:48<24:34:57,  8.35s/it]
 72%|███████▏  | 27371/37963 [65:42:56<23:54:23,  8.13s/it]
 72%|███████▏  | 27372/37963 [65:43:03<23:09:19,  7.87s/it]
 72%|███████▏  | 27373/37963 [65:43:11<22:48:48,  7.76s/it]
 72%|███████▏  | 27374/37963 [65:43:18<22:37:42,  7.69s/it]
 72%|███████▏  | 27375/37963 [65:43:26<22:31:49,  7.66s/it]
 72%|███████▏  | 27376/37963 [65:43:33<22:28:51,  7.64s/it]
 72%|███████▏  | 27377/37963 [65:43:41<22:27:06,  7.64s/it]
 72%|███████▏  | 27378/37963 [65:43:49<22:23:27,  7.62s/it]
 72%|███████▏  | 27379/37963 [65:43:56<22:26:12,  7.63s/it]
 72%|███████▏  | 27380/37963 [65:44:04<22:14:11,  7.56s/it]
                                                           
{'loss': '0.1272', 'grad_norm': '2.723', 'learning_rate': '3.807e-06', 'epoch': '0.7212'}

 72%|███████▏  | 27380/37963 [65:44:04<22:14:11,  7.56s/it]
 72%|███████▏  | 27381/37963 [65:44:11<22:15:05,  7.57s/it]
 72%|███████▏  | 27382/37963 [65:44:19<22:03:07,  7.50s/it]
 72%|███████▏  | 27383/37963 [65:44:26<22:08:34,  7.53s/it]
 72%|███████▏  | 27384/37963 [65:44:34<22:14:22,  7.57s/it]
 72%|███████▏  | 27385/37963 [65:44:41<22:00:38,  7.49s/it]
 72%|███████▏  | 27386/37963 [65:44:49<22:01:49,  7.50s/it]
 72%|███████▏  | 27387/37963 [65:45:03<27:41:28,  9.43s/it]
 72%|███████▏  | 27388/37963 [65:45:10<26:12:00,  8.92s/it]
 72%|███████▏  | 27389/37963 [65:45:18<24:57:40,  8.50s/it]
 72%|███████▏  | 27390/37963 [65:45:25<24:08:13,  8.22s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '2.916', 'learning_rate': '3.8e-06', 'epoch': '0.7215'}

 72%|███████▏  | 27390/37963 [65:45:25<24:08:13,  8.22s/it]
 72%|███████▏  | 27391/37963 [65:45:33<23:30:41,  8.01s/it]
 72%|███████▏  | 27392/37963 [65:45:40<22:53:27,  7.80s/it]
 72%|███████▏  | 27393/37963 [65:45:54<28:17:18,  9.63s/it]
 72%|███████▏  | 27394/37963 [65:46:02<26:17:08,  8.95s/it]
 72%|███████▏  | 27395/37963 [65:46:09<24:50:50,  8.46s/it]
 72%|███████▏  | 27396/37963 [65:46:16<23:58:47,  8.17s/it]
 72%|███████▏  | 27397/37963 [65:46:24<23:28:48,  8.00s/it]
 72%|███████▏  | 27398/37963 [65:46:32<23:09:38,  7.89s/it]
 72%|███████▏  | 27399/37963 [65:46:45<28:02:09,  9.55s/it]
 72%|███████▏  | 27400/37963 [65:46:53<26:17:06,  8.96s/it]
                                                           
{'loss': '0.1048', 'grad_norm': '1.669', 'learning_rate': '3.794e-06', 'epoch': '0.7218'}

 72%|███████▏  | 27400/37963 [65:46:53<26:17:06,  8.96s/it]
 72%|███████▏  | 27401/37963 [65:47:00<25:04:26,  8.55s/it]
 72%|███████▏  | 27402/37963 [65:47:14<29:49:59, 10.17s/it]
 72%|███████▏  | 27403/37963 [65:47:22<27:44:22,  9.46s/it]
 72%|███████▏  | 27404/37963 [65:47:29<25:41:00,  8.76s/it]
 72%|███████▏  | 27405/37963 [65:47:43<30:27:58, 10.39s/it]
 72%|███████▏  | 27406/37963 [65:47:51<27:54:11,  9.52s/it]
 72%|███████▏  | 27407/37963 [65:47:58<25:57:16,  8.85s/it]
 72%|███████▏  | 27408/37963 [65:48:12<30:35:30, 10.43s/it]
 72%|███████▏  | 27409/37963 [65:48:20<28:02:32,  9.57s/it]
 72%|███████▏  | 27410/37963 [65:48:27<25:59:26,  8.87s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '1.691', 'learning_rate': '3.787e-06', 'epoch': '0.722'}

 72%|███████▏  | 27410/37963 [65:48:27<25:59:26,  8.87s/it]
 72%|███████▏  | 27411/37963 [65:48:41<30:26:57, 10.39s/it]
 72%|███████▏  | 27412/37963 [65:48:49<28:03:09,  9.57s/it]
 72%|███████▏  | 27413/37963 [65:48:56<26:08:52,  8.92s/it]
 72%|███████▏  | 27414/37963 [65:49:03<24:55:56,  8.51s/it]
 72%|███████▏  | 27415/37963 [65:49:11<24:08:07,  8.24s/it]
 72%|███████▏  | 27416/37963 [65:49:19<23:29:13,  8.02s/it]
 72%|███████▏  | 27417/37963 [65:49:26<23:01:04,  7.86s/it]
 72%|███████▏  | 27418/37963 [65:49:34<22:46:59,  7.78s/it]
 72%|███████▏  | 27419/37963 [65:49:41<22:40:54,  7.74s/it]
 72%|███████▏  | 27420/37963 [65:49:49<22:29:06,  7.68s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '1.229', 'learning_rate': '3.78e-06', 'epoch': '0.7223'}

 72%|███████▏  | 27420/37963 [65:49:49<22:29:06,  7.68s/it]
 72%|███████▏  | 27421/37963 [65:49:56<22:09:46,  7.57s/it]
 72%|███████▏  | 27422/37963 [65:50:04<22:15:27,  7.60s/it]
 72%|███████▏  | 27423/37963 [65:50:11<22:12:57,  7.59s/it]
 72%|███████▏  | 27424/37963 [65:50:18<21:48:10,  7.45s/it]
 72%|███████▏  | 27425/37963 [65:50:26<21:51:08,  7.47s/it]
 72%|███████▏  | 27426/37963 [65:50:34<21:58:52,  7.51s/it]
 72%|███████▏  | 27427/37963 [65:50:41<21:42:36,  7.42s/it]
 72%|███████▏  | 27428/37963 [65:50:48<21:46:23,  7.44s/it]
 72%|███████▏  | 27429/37963 [65:50:56<21:57:50,  7.51s/it]
 72%|███████▏  | 27430/37963 [65:51:03<21:56:29,  7.50s/it]
                                                           
{'loss': '0.1168', 'grad_norm': '2.087', 'learning_rate': '3.774e-06', 'epoch': '0.7225'}

 72%|███████▏  | 27430/37963 [65:51:03<21:56:29,  7.50s/it]
 72%|███████▏  | 27431/37963 [65:51:11<22:07:07,  7.56s/it]
 72%|███████▏  | 27432/37963 [65:51:25<27:49:50,  9.51s/it]
 72%|███████▏  | 27433/37963 [65:51:33<26:08:41,  8.94s/it]
 72%|███████▏  | 27434/37963 [65:51:40<24:56:37,  8.53s/it]
 72%|███████▏  | 27435/37963 [65:51:48<23:47:56,  8.14s/it]
 72%|███████▏  | 27436/37963 [65:51:55<23:03:26,  7.89s/it]
 72%|███████▏  | 27437/37963 [65:52:02<22:46:48,  7.79s/it]
 72%|███████▏  | 27438/37963 [65:52:10<22:34:15,  7.72s/it]
 72%|███████▏  | 27439/37963 [65:52:18<22:22:38,  7.65s/it]
 72%|███████▏  | 27440/37963 [65:52:31<27:33:23,  9.43s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '1.989', 'learning_rate': '3.767e-06', 'epoch': '0.7228'}

 72%|███████▏  | 27440/37963 [65:52:31<27:33:23,  9.43s/it]
 72%|███████▏  | 27441/37963 [65:52:39<25:58:39,  8.89s/it]
 72%|███████▏  | 27442/37963 [65:52:46<24:45:47,  8.47s/it]
 72%|███████▏  | 27443/37963 [65:52:54<23:54:49,  8.18s/it]
 72%|███████▏  | 27444/37963 [65:53:01<23:10:09,  7.93s/it]
 72%|███████▏  | 27445/37963 [65:53:08<22:39:58,  7.76s/it]
 72%|███████▏  | 27446/37963 [65:53:22<28:05:03,  9.61s/it]
 72%|███████▏  | 27447/37963 [65:53:30<26:15:38,  8.99s/it]
 72%|███████▏  | 27448/37963 [65:53:37<24:57:42,  8.55s/it]
 72%|███████▏  | 27449/37963 [65:54:04<40:48:59, 13.98s/it]
 72%|███████▏  | 27450/37963 [65:54:12<35:06:29, 12.02s/it]
                                                           
{'loss': '0.11', 'grad_norm': '2.808', 'learning_rate': '3.76e-06', 'epoch': '0.7231'}

 72%|███████▏  | 27450/37963 [65:54:12<35:06:29, 12.02s/it]
 72%|███████▏  | 27451/37963 [65:54:19<31:12:23, 10.69s/it]
 72%|███████▏  | 27452/37963 [65:54:27<28:26:19,  9.74s/it]
 72%|███████▏  | 27453/37963 [65:54:34<26:30:05,  9.08s/it]
 72%|███████▏  | 27454/37963 [65:54:42<25:09:19,  8.62s/it]
 72%|███████▏  | 27455/37963 [65:54:56<29:51:44, 10.23s/it]
 72%|███████▏  | 27456/37963 [65:55:03<27:37:27,  9.46s/it]
 72%|███████▏  | 27457/37963 [65:55:11<25:57:17,  8.89s/it]
 72%|███████▏  | 27458/37963 [65:55:18<24:43:03,  8.47s/it]
 72%|███████▏  | 27459/37963 [65:55:33<29:37:30, 10.15s/it]
 72%|███████▏  | 27460/37963 [65:55:40<27:17:50,  9.36s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.847', 'learning_rate': '3.754e-06', 'epoch': '0.7233'}

 72%|███████▏  | 27460/37963 [65:55:40<27:17:50,  9.36s/it]
 72%|███████▏  | 27461/37963 [65:55:47<25:23:19,  8.70s/it]
 72%|███████▏  | 27462/37963 [65:55:55<24:23:51,  8.36s/it]
 72%|███████▏  | 27463/37963 [65:56:02<23:41:46,  8.12s/it]
 72%|███████▏  | 27464/37963 [65:56:10<23:10:26,  7.95s/it]
 72%|███████▏  | 27465/37963 [65:56:17<22:47:10,  7.81s/it]
 72%|███████▏  | 27466/37963 [65:56:25<22:28:20,  7.71s/it]
 72%|███████▏  | 27467/37963 [65:56:32<22:17:15,  7.64s/it]
 72%|███████▏  | 27468/37963 [65:56:40<22:15:51,  7.64s/it]
 72%|███████▏  | 27469/37963 [65:56:47<22:09:35,  7.60s/it]
 72%|███████▏  | 27470/37963 [65:56:55<22:03:52,  7.57s/it]
                                                           
{'loss': '0.111', 'grad_norm': '3.661', 'learning_rate': '3.747e-06', 'epoch': '0.7236'}

 72%|███████▏  | 27470/37963 [65:56:55<22:03:52,  7.57s/it]
 72%|███████▏  | 27471/37963 [65:57:03<22:02:11,  7.56s/it]
 72%|███████▏  | 27472/37963 [65:57:10<22:12:18,  7.62s/it]
 72%|███████▏  | 27473/37963 [65:57:18<22:04:06,  7.57s/it]
 72%|███████▏  | 27474/37963 [65:57:25<22:02:06,  7.56s/it]
 72%|███████▏  | 27475/37963 [65:57:33<21:59:40,  7.55s/it]
 72%|███████▏  | 27476/37963 [65:57:40<21:57:37,  7.54s/it]
 72%|███████▏  | 27477/37963 [65:57:48<21:54:44,  7.52s/it]
 72%|███████▏  | 27478/37963 [65:57:55<21:58:55,  7.55s/it]
 72%|███████▏  | 27479/37963 [65:58:03<21:57:56,  7.54s/it]
 72%|███████▏  | 27480/37963 [65:58:17<27:30:11,  9.45s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '2.083', 'learning_rate': '3.74e-06', 'epoch': '0.7239'}

 72%|███████▏  | 27480/37963 [65:58:17<27:30:11,  9.45s/it]
 72%|███████▏  | 27481/37963 [65:58:24<25:48:26,  8.86s/it]
 72%|███████▏  | 27482/37963 [65:58:32<24:38:53,  8.47s/it]
 72%|███████▏  | 27483/37963 [65:58:40<23:59:08,  8.24s/it]
 72%|███████▏  | 27484/37963 [65:58:47<23:23:30,  8.04s/it]
 72%|███████▏  | 27485/37963 [65:58:54<22:47:33,  7.83s/it]
 72%|███████▏  | 27486/37963 [65:59:02<22:29:51,  7.73s/it]
 72%|███████▏  | 27487/37963 [65:59:09<22:10:44,  7.62s/it]
 72%|███████▏  | 27488/37963 [65:59:17<22:03:12,  7.58s/it]
 72%|███████▏  | 27489/37963 [65:59:24<22:00:21,  7.56s/it]
 72%|███████▏  | 27490/37963 [65:59:39<27:52:21,  9.58s/it]
                                                           
{'loss': '0.1112', 'grad_norm': '1.866', 'learning_rate': '3.734e-06', 'epoch': '0.7241'}

 72%|███████▏  | 27490/37963 [65:59:39<27:52:21,  9.58s/it]
 72%|███████▏  | 27491/37963 [65:59:46<26:09:53,  8.99s/it]
 72%|███████▏  | 27492/37963 [65:59:53<24:36:05,  8.46s/it]
 72%|███████▏  | 27493/37963 [66:00:01<23:45:36,  8.17s/it]
 72%|███████▏  | 27494/37963 [66:00:14<28:25:09,  9.77s/it]
 72%|███████▏  | 27495/37963 [66:00:28<32:02:27, 11.02s/it]
 72%|███████▏  | 27496/37963 [66:00:36<28:59:11,  9.97s/it]
 72%|███████▏  | 27497/37963 [66:00:50<32:17:45, 11.11s/it]
 72%|███████▏  | 27498/37963 [66:01:04<34:55:20, 12.01s/it]
 72%|███████▏  | 27499/37963 [66:01:11<30:54:32, 10.63s/it]
 72%|███████▏  | 27500/37963 [66:01:19<28:13:16,  9.71s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '2.326', 'learning_rate': '3.727e-06', 'epoch': '0.7244'}

 72%|███████▏  | 27500/37963 [66:01:19<28:13:16,  9.71s/it]
 72%|███████▏  | 27501/37963 [66:01:26<26:15:33,  9.04s/it]
 72%|███████▏  | 27502/37963 [66:01:33<24:42:02,  8.50s/it]
 72%|███████▏  | 27503/37963 [66:01:48<29:39:58, 10.21s/it]
 72%|███████▏  | 27504/37963 [66:01:55<27:20:12,  9.41s/it]
 72%|███████▏  | 27505/37963 [66:02:03<25:30:19,  8.78s/it]
 72%|███████▏  | 27506/37963 [66:02:17<30:05:48, 10.36s/it]
 72%|███████▏  | 27507/37963 [66:02:24<27:37:05,  9.51s/it]
 72%|███████▏  | 27508/37963 [66:02:32<25:53:48,  8.92s/it]
 72%|███████▏  | 27509/37963 [66:02:39<24:36:36,  8.47s/it]
 72%|███████▏  | 27510/37963 [66:02:47<23:46:08,  8.19s/it]
                                                           
{'loss': '0.1066', 'grad_norm': '1.939', 'learning_rate': '3.72e-06', 'epoch': '0.7247'}

 72%|███████▏  | 27510/37963 [66:02:47<23:46:08,  8.19s/it]
 72%|███████▏  | 27511/37963 [66:02:54<23:10:35,  7.98s/it]
 72%|███████▏  | 27512/37963 [66:03:01<22:38:19,  7.80s/it]
 72%|███████▏  | 27513/37963 [66:03:09<22:14:18,  7.66s/it]
 72%|███████▏  | 27514/37963 [66:03:16<22:06:22,  7.62s/it]
 72%|███████▏  | 27515/37963 [66:03:24<22:01:05,  7.59s/it]
 72%|███████▏  | 27516/37963 [66:03:31<21:51:25,  7.53s/it]
 72%|███████▏  | 27517/37963 [66:03:39<21:54:21,  7.55s/it]
 72%|███████▏  | 27518/37963 [66:03:46<21:54:53,  7.55s/it]
 72%|███████▏  | 27519/37963 [66:03:54<21:53:22,  7.55s/it]
 72%|███████▏  | 27520/37963 [66:04:01<21:48:16,  7.52s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '2.148', 'learning_rate': '3.714e-06', 'epoch': '0.7249'}

 72%|███████▏  | 27520/37963 [66:04:01<21:48:16,  7.52s/it]
 72%|███████▏  | 27521/37963 [66:04:09<21:47:11,  7.51s/it]
 72%|███████▏  | 27522/37963 [66:04:16<21:50:21,  7.53s/it]
 72%|███████▏  | 27523/37963 [66:04:24<21:49:30,  7.53s/it]
 73%|███████▎  | 27524/37963 [66:04:32<21:49:41,  7.53s/it]
 73%|███████▎  | 27525/37963 [66:04:39<21:50:49,  7.53s/it]
 73%|███████▎  | 27526/37963 [66:04:47<21:48:32,  7.52s/it]
 73%|███████▎  | 27527/37963 [66:04:54<21:45:46,  7.51s/it]
 73%|███████▎  | 27528/37963 [66:05:08<27:14:42,  9.40s/it]
 73%|███████▎  | 27529/37963 [66:05:15<25:28:09,  8.79s/it]
 73%|███████▎  | 27530/37963 [66:05:23<24:21:36,  8.41s/it]
                                                           
{'loss': '0.1185', 'grad_norm': '1.749', 'learning_rate': '3.707e-06', 'epoch': '0.7252'}

 73%|███████▎  | 27530/37963 [66:05:23<24:21:36,  8.41s/it]
 73%|███████▎  | 27531/37963 [66:05:30<23:34:18,  8.13s/it]
 73%|███████▎  | 27532/37963 [66:05:38<23:10:09,  8.00s/it]
 73%|███████▎  | 27533/37963 [66:05:45<22:42:07,  7.84s/it]
 73%|███████▎  | 27534/37963 [66:05:53<22:34:17,  7.79s/it]
 73%|███████▎  | 27535/37963 [66:06:00<22:10:40,  7.66s/it]
 73%|███████▎  | 27536/37963 [66:06:08<22:03:11,  7.61s/it]
 73%|███████▎  | 27537/37963 [66:06:15<21:56:19,  7.58s/it]
 73%|███████▎  | 27538/37963 [66:06:23<21:51:10,  7.55s/it]
 73%|███████▎  | 27539/37963 [66:06:30<21:47:20,  7.52s/it]
 73%|███████▎  | 27540/37963 [66:06:38<21:45:28,  7.51s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '1.964', 'learning_rate': '3.701e-06', 'epoch': '0.7254'}

 73%|███████▎  | 27540/37963 [66:06:38<21:45:28,  7.51s/it]
 73%|███████▎  | 27541/37963 [66:06:45<21:49:49,  7.54s/it]
 73%|███████▎  | 27542/37963 [66:07:06<33:06:36, 11.44s/it]
 73%|███████▎  | 27543/37963 [66:07:14<29:44:18, 10.27s/it]
 73%|███████▎  | 27544/37963 [66:07:27<32:52:24, 11.36s/it]
 73%|███████▎  | 27545/37963 [66:07:35<29:26:39, 10.17s/it]
 73%|███████▎  | 27546/37963 [66:07:55<37:59:51, 13.13s/it]
 73%|███████▎  | 27547/37963 [66:08:02<33:05:43, 11.44s/it]
 73%|███████▎  | 27548/37963 [66:08:10<29:45:57, 10.29s/it]
 73%|███████▎  | 27549/37963 [66:08:17<27:23:18,  9.47s/it]
 73%|███████▎  | 27550/37963 [66:08:31<31:17:55, 10.82s/it]
                                                           
{'loss': '0.1132', 'grad_norm': '2.855', 'learning_rate': '3.694e-06', 'epoch': '0.7257'}

 73%|███████▎  | 27550/37963 [66:08:31<31:17:55, 10.82s/it]
 73%|███████▎  | 27551/37963 [66:08:39<28:30:39,  9.86s/it]
 73%|███████▎  | 27552/37963 [66:08:47<26:29:49,  9.16s/it]
 73%|███████▎  | 27553/37963 [66:08:54<24:48:40,  8.58s/it]
 73%|███████▎  | 27554/37963 [66:09:08<29:22:34, 10.16s/it]
 73%|███████▎  | 27555/37963 [66:09:15<27:02:31,  9.35s/it]
 73%|███████▎  | 27556/37963 [66:09:23<25:26:07,  8.80s/it]
 73%|███████▎  | 27557/37963 [66:09:30<24:21:48,  8.43s/it]
 73%|███████▎  | 27558/37963 [66:09:38<23:36:59,  8.17s/it]
 73%|███████▎  | 27559/37963 [66:09:45<23:00:49,  7.96s/it]
 73%|███████▎  | 27560/37963 [66:09:53<22:39:02,  7.84s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '2.073', 'learning_rate': '3.687e-06', 'epoch': '0.726'}

 73%|███████▎  | 27560/37963 [66:09:53<22:39:02,  7.84s/it]
 73%|███████▎  | 27561/37963 [66:10:00<22:23:34,  7.75s/it]
 73%|███████▎  | 27562/37963 [66:10:08<22:10:39,  7.68s/it]
 73%|███████▎  | 27563/37963 [66:10:15<22:02:57,  7.63s/it]
 73%|███████▎  | 27564/37963 [66:10:23<22:03:38,  7.64s/it]
 73%|███████▎  | 27565/37963 [66:10:31<22:00:48,  7.62s/it]
 73%|███████▎  | 27566/37963 [66:10:38<22:07:20,  7.66s/it]
 73%|███████▎  | 27567/37963 [66:10:46<21:50:40,  7.56s/it]
 73%|███████▎  | 27568/37963 [66:10:53<21:49:27,  7.56s/it]
 73%|███████▎  | 27569/37963 [66:11:01<21:52:21,  7.58s/it]
 73%|███████▎  | 27570/37963 [66:11:08<21:45:25,  7.54s/it]
                                                           
{'loss': '0.1137', 'grad_norm': '1.713', 'learning_rate': '3.681e-06', 'epoch': '0.7262'}

 73%|███████▎  | 27570/37963 [66:11:08<21:45:25,  7.54s/it]
 73%|███████▎  | 27571/37963 [66:11:16<21:37:51,  7.49s/it]
 73%|███████▎  | 27572/37963 [66:11:23<21:43:01,  7.52s/it]
 73%|███████▎  | 27573/37963 [66:11:31<21:48:59,  7.56s/it]
 73%|███████▎  | 27574/37963 [66:11:38<21:36:55,  7.49s/it]
 73%|███████▎  | 27575/37963 [66:11:46<21:48:05,  7.56s/it]
 73%|███████▎  | 27576/37963 [66:11:53<21:44:10,  7.53s/it]
 73%|███████▎  | 27577/37963 [66:12:08<27:36:15,  9.57s/it]
 73%|███████▎  | 27578/37963 [66:12:15<25:42:07,  8.91s/it]
 73%|███████▎  | 27579/37963 [66:12:23<24:32:09,  8.51s/it]
 73%|███████▎  | 27580/37963 [66:12:30<23:49:25,  8.26s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '1.832', 'learning_rate': '3.674e-06', 'epoch': '0.7265'}

 73%|███████▎  | 27580/37963 [66:12:30<23:49:25,  8.26s/it]
 73%|███████▎  | 27581/37963 [66:12:38<23:21:23,  8.10s/it]
 73%|███████▎  | 27582/37963 [66:12:46<22:56:08,  7.95s/it]
 73%|███████▎  | 27583/37963 [66:12:53<22:23:19,  7.76s/it]
 73%|███████▎  | 27584/37963 [66:13:01<22:10:51,  7.69s/it]
 73%|███████▎  | 27585/37963 [66:13:08<22:04:06,  7.66s/it]
 73%|███████▎  | 27586/37963 [66:13:16<21:57:42,  7.62s/it]
 73%|███████▎  | 27587/37963 [66:13:23<21:56:13,  7.61s/it]
 73%|███████▎  | 27588/37963 [66:13:31<21:51:58,  7.59s/it]
 73%|███████▎  | 27589/37963 [66:13:45<27:36:56,  9.58s/it]
 73%|███████▎  | 27590/37963 [66:13:53<25:52:05,  8.98s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '1.753', 'learning_rate': '3.667e-06', 'epoch': '0.7268'}

 73%|███████▎  | 27590/37963 [66:13:53<25:52:05,  8.98s/it]
 73%|███████▎  | 27591/37963 [66:14:07<30:18:26, 10.52s/it]
 73%|███████▎  | 27592/37963 [66:14:21<33:17:25, 11.56s/it]
 73%|███████▎  | 27593/37963 [66:14:35<35:48:15, 12.43s/it]
 73%|███████▎  | 27594/37963 [66:14:43<31:39:48, 10.99s/it]
 73%|███████▎  | 27595/37963 [66:14:50<28:41:16,  9.96s/it]
 73%|███████▎  | 27596/37963 [66:14:58<26:36:52,  9.24s/it]
 73%|███████▎  | 27597/37963 [66:15:06<25:10:10,  8.74s/it]
 73%|███████▎  | 27598/37963 [66:15:19<29:37:37, 10.29s/it]
 73%|███████▎  | 27599/37963 [66:15:27<27:05:34,  9.41s/it]
 73%|███████▎  | 27600/37963 [66:15:35<25:39:29,  8.91s/it]
                                                           
{'loss': '0.1194', 'grad_norm': '2.005', 'learning_rate': '3.661e-06', 'epoch': '0.727'}

 73%|███████▎  | 27600/37963 [66:15:35<25:39:29,  8.91s/it]
 73%|███████▎  | 27601/37963 [66:15:42<24:10:21,  8.40s/it]
 73%|███████▎  | 27602/37963 [66:15:56<28:49:19, 10.01s/it]
 73%|███████▎  | 27603/37963 [66:16:03<26:29:19,  9.20s/it]
 73%|███████▎  | 27604/37963 [66:16:17<30:37:39, 10.64s/it]
 73%|███████▎  | 27605/37963 [66:16:24<27:58:34,  9.72s/it]
 73%|███████▎  | 27606/37963 [66:16:32<25:58:46,  9.03s/it]
 73%|███████▎  | 27607/37963 [66:16:40<24:48:52,  8.63s/it]
 73%|███████▎  | 27608/37963 [66:16:47<23:47:19,  8.27s/it]
 73%|███████▎  | 27609/37963 [66:16:55<23:10:55,  8.06s/it]
 73%|███████▎  | 27610/37963 [66:17:02<22:41:02,  7.89s/it]
                                                           
{'loss': '0.09598', 'grad_norm': '2.794', 'learning_rate': '3.654e-06', 'epoch': '0.7273'}

 73%|███████▎  | 27610/37963 [66:17:02<22:41:02,  7.89s/it]
 73%|███████▎  | 27611/37963 [66:17:09<22:13:58,  7.73s/it]
 73%|███████▎  | 27612/37963 [66:17:17<22:01:39,  7.66s/it]
 73%|███████▎  | 27613/37963 [66:17:24<21:48:26,  7.59s/it]
 73%|███████▎  | 27614/37963 [66:17:32<21:50:40,  7.60s/it]
 73%|███████▎  | 27615/37963 [66:17:39<21:30:42,  7.48s/it]
 73%|███████▎  | 27616/37963 [66:17:47<21:28:40,  7.47s/it]
 73%|███████▎  | 27617/37963 [66:17:54<21:33:46,  7.50s/it]
 73%|███████▎  | 27618/37963 [66:18:02<21:35:07,  7.51s/it]
 73%|███████▎  | 27619/37963 [66:18:09<21:39:45,  7.54s/it]
 73%|███████▎  | 27620/37963 [66:18:17<21:24:24,  7.45s/it]
                                                           
{'loss': '0.1156', 'grad_norm': '2.396', 'learning_rate': '3.648e-06', 'epoch': '0.7276'}

 73%|███████▎  | 27620/37963 [66:18:17<21:24:24,  7.45s/it]
 73%|███████▎  | 27621/37963 [66:18:24<21:31:42,  7.49s/it]
 73%|███████▎  | 27622/37963 [66:18:32<21:33:42,  7.51s/it]
 73%|███████▎  | 27623/37963 [66:18:39<21:16:28,  7.41s/it]
 73%|███████▎  | 27624/37963 [66:18:46<21:27:08,  7.47s/it]
 73%|███████▎  | 27625/37963 [66:19:00<27:05:09,  9.43s/it]
 73%|███████▎  | 27626/37963 [66:19:08<25:27:40,  8.87s/it]
 73%|███████▎  | 27627/37963 [66:19:16<24:16:38,  8.46s/it]
 73%|███████▎  | 27628/37963 [66:19:23<23:21:26,  8.14s/it]
 73%|███████▎  | 27629/37963 [66:19:30<22:51:33,  7.96s/it]
 73%|███████▎  | 27630/37963 [66:19:38<22:28:38,  7.83s/it]
                                                           
{'loss': '0.1269', 'grad_norm': '2.29', 'learning_rate': '3.641e-06', 'epoch': '0.7278'}

 73%|███████▎  | 27630/37963 [66:19:38<22:28:38,  7.83s/it]
 73%|███████▎  | 27631/37963 [66:19:46<22:13:49,  7.75s/it]
 73%|███████▎  | 27632/37963 [66:19:53<22:01:45,  7.68s/it]
 73%|███████▎  | 27633/37963 [66:20:01<21:57:53,  7.65s/it]
 73%|███████▎  | 27634/37963 [66:20:15<27:29:42,  9.58s/it]
 73%|███████▎  | 27635/37963 [66:20:22<25:36:50,  8.93s/it]
 73%|███████▎  | 27636/37963 [66:20:30<24:25:02,  8.51s/it]
 73%|███████▎  | 27637/37963 [66:20:37<23:37:28,  8.24s/it]
 73%|███████▎  | 27638/37963 [66:20:45<23:04:25,  8.05s/it]
 73%|███████▎  | 27639/37963 [66:20:52<22:36:43,  7.88s/it]
 73%|███████▎  | 27640/37963 [66:21:00<22:20:42,  7.79s/it]
                                                           
{'loss': '0.126', 'grad_norm': '1.555', 'learning_rate': '3.634e-06', 'epoch': '0.7281'}

 73%|███████▎  | 27640/37963 [66:21:00<22:20:42,  7.79s/it]
 73%|███████▎  | 27641/37963 [66:21:14<27:49:07,  9.70s/it]
 73%|███████▎  | 27642/37963 [66:21:22<25:59:32,  9.07s/it]
 73%|███████▎  | 27643/37963 [66:21:36<30:16:54, 10.56s/it]
 73%|███████▎  | 27644/37963 [66:21:50<33:01:09, 11.52s/it]
 73%|███████▎  | 27645/37963 [66:21:57<29:37:44, 10.34s/it]
 73%|███████▎  | 27646/37963 [66:22:05<27:19:07,  9.53s/it]
 73%|███████▎  | 27647/37963 [66:22:19<31:01:40, 10.83s/it]
 73%|███████▎  | 27648/37963 [66:22:26<28:10:20,  9.83s/it]
 73%|███████▎  | 27649/37963 [66:22:34<26:13:34,  9.15s/it]
 73%|███████▎  | 27650/37963 [66:22:48<30:18:48, 10.58s/it]
                                                           
{'loss': '0.1213', 'grad_norm': '2.594', 'learning_rate': '3.628e-06', 'epoch': '0.7283'}

 73%|███████▎  | 27650/37963 [66:22:48<30:18:48, 10.58s/it]
 73%|███████▎  | 27651/37963 [66:22:55<27:46:59,  9.70s/it]
 73%|███████▎  | 27652/37963 [66:23:03<25:49:53,  9.02s/it]
 73%|███████▎  | 27653/37963 [66:23:10<24:22:32,  8.51s/it]
 73%|███████▎  | 27654/37963 [66:23:24<28:53:48, 10.09s/it]
 73%|███████▎  | 27655/37963 [66:23:31<26:43:48,  9.34s/it]
 73%|███████▎  | 27656/37963 [66:23:39<25:09:17,  8.79s/it]
 73%|███████▎  | 27657/37963 [66:23:46<23:59:07,  8.38s/it]
 73%|███████▎  | 27658/37963 [66:23:54<23:16:49,  8.13s/it]
 73%|███████▎  | 27659/37963 [66:24:01<22:52:09,  7.99s/it]
 73%|███████▎  | 27660/37963 [66:24:09<22:25:54,  7.84s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '3.359', 'learning_rate': '3.621e-06', 'epoch': '0.7286'}

 73%|███████▎  | 27660/37963 [66:24:09<22:25:54,  7.84s/it]
 73%|███████▎  | 27661/37963 [66:24:16<22:07:09,  7.73s/it]
 73%|███████▎  | 27662/37963 [66:24:24<21:51:53,  7.64s/it]
 73%|███████▎  | 27663/37963 [66:24:31<21:26:41,  7.50s/it]
 73%|███████▎  | 27664/37963 [66:24:39<21:30:45,  7.52s/it]
 73%|███████▎  | 27665/37963 [66:24:46<21:42:10,  7.59s/it]
 73%|███████▎  | 27666/37963 [66:24:54<21:41:23,  7.58s/it]
 73%|███████▎  | 27667/37963 [66:25:01<21:39:30,  7.57s/it]
 73%|███████▎  | 27668/37963 [66:25:09<21:39:14,  7.57s/it]
 73%|███████▎  | 27669/37963 [66:25:16<21:28:18,  7.51s/it]
 73%|███████▎  | 27670/37963 [66:25:24<21:31:05,  7.53s/it]
                                                           
{'loss': '0.1207', 'grad_norm': '1.709', 'learning_rate': '3.615e-06', 'epoch': '0.7289'}

 73%|███████▎  | 27670/37963 [66:25:24<21:31:05,  7.53s/it]
 73%|███████▎  | 27671/37963 [66:25:32<21:44:33,  7.61s/it]
 73%|███████▎  | 27672/37963 [66:25:39<21:46:23,  7.62s/it]
 73%|███████▎  | 27673/37963 [66:25:47<21:43:00,  7.60s/it]
 73%|███████▎  | 27674/37963 [66:25:55<21:41:07,  7.59s/it]
 73%|███████▎  | 27675/37963 [66:26:02<21:47:57,  7.63s/it]
 73%|███████▎  | 27676/37963 [66:26:10<21:42:09,  7.59s/it]
 73%|███████▎  | 27677/37963 [66:26:17<21:38:59,  7.58s/it]
 73%|███████▎  | 27678/37963 [66:26:31<27:02:37,  9.47s/it]
 73%|███████▎  | 27679/37963 [66:26:45<30:48:57, 10.79s/it]
 73%|███████▎  | 27680/37963 [66:26:53<28:03:52,  9.83s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '2.568', 'learning_rate': '3.608e-06', 'epoch': '0.7291'}

 73%|███████▎  | 27680/37963 [66:26:53<28:03:52,  9.83s/it]
 73%|███████▎  | 27681/37963 [66:27:00<25:52:52,  9.06s/it]
 73%|███████▎  | 27682/37963 [66:27:07<24:20:40,  8.52s/it]
 73%|███████▎  | 27683/37963 [66:27:15<23:21:59,  8.18s/it]
 73%|███████▎  | 27684/37963 [66:27:22<22:45:13,  7.97s/it]
 73%|███████▎  | 27685/37963 [66:27:30<22:22:55,  7.84s/it]
 73%|███████▎  | 27686/37963 [66:27:37<22:11:44,  7.78s/it]
 73%|███████▎  | 27687/37963 [66:27:51<27:24:45,  9.60s/it]
 73%|███████▎  | 27688/37963 [66:27:59<25:35:56,  8.97s/it]
 73%|███████▎  | 27689/37963 [66:28:06<24:27:41,  8.57s/it]
 73%|███████▎  | 27690/37963 [66:28:14<23:39:36,  8.29s/it]
                                                           
{'loss': '0.1087', 'grad_norm': '1.984', 'learning_rate': '3.602e-06', 'epoch': '0.7294'}

 73%|███████▎  | 27690/37963 [66:28:14<23:39:36,  8.29s/it]
 73%|███████▎  | 27691/37963 [66:28:21<23:07:02,  8.10s/it]
 73%|███████▎  | 27692/37963 [66:28:35<28:08:34,  9.86s/it]
 73%|███████▎  | 27693/37963 [66:28:43<26:16:35,  9.21s/it]
 73%|███████▎  | 27694/37963 [66:28:51<24:57:18,  8.75s/it]
 73%|███████▎  | 27695/37963 [66:29:05<29:22:32, 10.30s/it]
 73%|███████▎  | 27696/37963 [66:29:19<32:24:12, 11.36s/it]
 73%|███████▎  | 27697/37963 [66:29:26<29:10:18, 10.23s/it]
 73%|███████▎  | 27698/37963 [66:29:41<32:42:36, 11.47s/it]
 73%|███████▎  | 27699/37963 [66:29:48<29:21:15, 10.30s/it]
 73%|███████▎  | 27700/37963 [66:29:56<27:03:49,  9.49s/it]
                                                           
{'loss': '0.122', 'grad_norm': '1.913', 'learning_rate': '3.595e-06', 'epoch': '0.7297'}

 73%|███████▎  | 27700/37963 [66:29:56<27:03:49,  9.49s/it]
 73%|███████▎  | 27701/37963 [66:30:03<25:26:11,  8.92s/it]
 73%|███████▎  | 27702/37963 [66:30:11<24:09:52,  8.48s/it]
 73%|███████▎  | 27703/37963 [66:30:18<23:12:12,  8.14s/it]
 73%|███████▎  | 27704/37963 [66:30:26<22:41:57,  7.97s/it]
 73%|███████▎  | 27705/37963 [66:30:33<22:23:48,  7.86s/it]
 73%|███████▎  | 27706/37963 [66:30:47<27:40:22,  9.71s/it]
 73%|███████▎  | 27707/37963 [66:30:55<25:55:42,  9.10s/it]
 73%|███████▎  | 27708/37963 [66:31:02<24:32:40,  8.62s/it]
 73%|███████▎  | 27709/37963 [66:31:10<23:38:28,  8.30s/it]
 73%|███████▎  | 27710/37963 [66:31:18<22:59:51,  8.07s/it]
                                                           
{'loss': '0.1012', 'grad_norm': '1.528', 'learning_rate': '3.589e-06', 'epoch': '0.7299'}

 73%|███████▎  | 27710/37963 [66:31:18<22:59:51,  8.07s/it]
 73%|███████▎  | 27711/37963 [66:31:25<22:26:04,  7.88s/it]
 73%|███████▎  | 27712/37963 [66:31:32<22:04:55,  7.75s/it]
 73%|███████▎  | 27713/37963 [66:31:40<21:55:54,  7.70s/it]
 73%|███████▎  | 27714/37963 [66:31:48<21:47:32,  7.65s/it]
 73%|███████▎  | 27715/37963 [66:31:55<21:40:27,  7.61s/it]
 73%|███████▎  | 27716/37963 [66:32:02<21:15:09,  7.47s/it]
 73%|███████▎  | 27717/37963 [66:32:10<21:16:29,  7.48s/it]
 73%|███████▎  | 27718/37963 [66:32:17<21:20:37,  7.50s/it]
 73%|███████▎  | 27719/37963 [66:32:24<21:06:00,  7.42s/it]
 73%|███████▎  | 27720/37963 [66:32:32<21:17:36,  7.48s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '2.606', 'learning_rate': '3.582e-06', 'epoch': '0.7302'}

 73%|███████▎  | 27720/37963 [66:32:32<21:17:36,  7.48s/it]
 73%|███████▎  | 27721/37963 [66:32:40<21:21:31,  7.51s/it]
 73%|███████▎  | 27722/37963 [66:32:47<21:23:54,  7.52s/it]
 73%|███████▎  | 27723/37963 [66:32:55<21:16:02,  7.48s/it]
 73%|███████▎  | 27724/37963 [66:33:02<21:22:50,  7.52s/it]
 73%|███████▎  | 27725/37963 [66:33:10<21:27:42,  7.55s/it]
 73%|███████▎  | 27726/37963 [66:33:24<26:50:30,  9.44s/it]
 73%|███████▎  | 27727/37963 [66:33:31<25:15:24,  8.88s/it]
 73%|███████▎  | 27728/37963 [66:33:39<24:04:52,  8.47s/it]
 73%|███████▎  | 27729/37963 [66:33:53<28:48:02, 10.13s/it]
 73%|███████▎  | 27730/37963 [66:34:00<26:32:14,  9.34s/it]
                                                           
{'loss': '0.1227', 'grad_norm': '3.821', 'learning_rate': '3.575e-06', 'epoch': '0.7305'}

 73%|███████▎  | 27730/37963 [66:34:00<26:32:14,  9.34s/it]
 73%|███████▎  | 27731/37963 [66:34:08<25:01:31,  8.80s/it]
 73%|███████▎  | 27732/37963 [66:34:15<23:57:35,  8.43s/it]
 73%|███████▎  | 27733/37963 [66:34:29<28:43:01, 10.11s/it]
 73%|███████▎  | 27734/37963 [66:34:37<26:36:02,  9.36s/it]
 73%|███████▎  | 27735/37963 [66:34:45<24:59:25,  8.80s/it]
 73%|███████▎  | 27736/37963 [66:34:52<23:57:20,  8.43s/it]
 73%|███████▎  | 27737/37963 [66:34:59<22:59:52,  8.10s/it]
 73%|███████▎  | 27738/37963 [66:35:07<22:31:15,  7.93s/it]
 73%|███████▎  | 27739/37963 [66:35:20<27:11:19,  9.57s/it]
 73%|███████▎  | 27740/37963 [66:35:28<25:36:10,  9.02s/it]
                                                           
{'loss': '0.1336', 'grad_norm': '3.906', 'learning_rate': '3.569e-06', 'epoch': '0.7307'}

 73%|███████▎  | 27740/37963 [66:35:28<25:36:10,  9.02s/it]
 73%|███████▎  | 27741/37963 [66:35:35<24:11:26,  8.52s/it]
 73%|███████▎  | 27742/37963 [66:35:43<23:09:54,  8.16s/it]
 73%|███████▎  | 27743/37963 [66:35:57<28:20:06,  9.98s/it]
 73%|███████▎  | 27744/37963 [66:36:11<31:33:38, 11.12s/it]
 73%|███████▎  | 27745/37963 [66:36:18<28:32:53, 10.06s/it]
 73%|███████▎  | 27746/37963 [66:36:26<26:14:11,  9.24s/it]
 73%|███████▎  | 27747/37963 [66:36:33<24:45:36,  8.73s/it]
 73%|███████▎  | 27748/37963 [66:36:41<23:47:46,  8.39s/it]
 73%|███████▎  | 27749/37963 [66:36:48<22:58:31,  8.10s/it]
 73%|███████▎  | 27750/37963 [66:37:02<28:08:08,  9.92s/it]
                                                           
{'loss': '0.1193', 'grad_norm': '3.51', 'learning_rate': '3.562e-06', 'epoch': '0.731'}

 73%|███████▎  | 27750/37963 [66:37:02<28:08:08,  9.92s/it]
 73%|███████▎  | 27751/37963 [66:37:10<26:11:10,  9.23s/it]
 73%|███████▎  | 27752/37963 [66:37:17<24:35:36,  8.67s/it]
 73%|███████▎  | 27753/37963 [66:37:25<23:29:13,  8.28s/it]
 73%|███████▎  | 27754/37963 [66:37:32<22:49:07,  8.05s/it]
 73%|███████▎  | 27755/37963 [66:37:46<27:43:52,  9.78s/it]
 73%|███████▎  | 27756/37963 [66:37:54<25:46:26,  9.09s/it]
 73%|███████▎  | 27757/37963 [66:38:01<24:25:16,  8.61s/it]
 73%|███████▎  | 27758/37963 [66:38:09<23:30:24,  8.29s/it]
 73%|███████▎  | 27759/37963 [66:38:16<22:51:25,  8.06s/it]
 73%|███████▎  | 27760/37963 [66:38:24<22:22:27,  7.89s/it]
                                                           
{'loss': '0.1083', 'grad_norm': '1.702', 'learning_rate': '3.556e-06', 'epoch': '0.7312'}

 73%|███████▎  | 27760/37963 [66:38:24<22:22:27,  7.89s/it]
 73%|███████▎  | 27761/37963 [66:38:31<21:46:31,  7.68s/it]
 73%|███████▎  | 27762/37963 [66:38:38<21:42:19,  7.66s/it]
 73%|███████▎  | 27763/37963 [66:38:46<21:35:05,  7.62s/it]
 73%|███████▎  | 27764/37963 [66:38:54<21:31:23,  7.60s/it]
 73%|███████▎  | 27765/37963 [66:39:01<21:29:06,  7.58s/it]
 73%|███████▎  | 27766/37963 [66:39:09<21:27:58,  7.58s/it]
 73%|███████▎  | 27767/37963 [66:39:16<21:11:14,  7.48s/it]
 73%|███████▎  | 27768/37963 [66:39:23<21:15:23,  7.51s/it]
 73%|███████▎  | 27769/37963 [66:39:31<21:17:15,  7.52s/it]
 73%|███████▎  | 27770/37963 [66:39:38<21:11:40,  7.49s/it]
                                                           
{'loss': '0.1051', 'grad_norm': '1.845', 'learning_rate': '3.549e-06', 'epoch': '0.7315'}

 73%|███████▎  | 27770/37963 [66:39:38<21:11:40,  7.49s/it]
 73%|███████▎  | 27771/37963 [66:39:46<21:07:52,  7.46s/it]
 73%|███████▎  | 27772/37963 [66:39:53<21:17:21,  7.52s/it]
 73%|███████▎  | 27773/37963 [66:40:01<21:24:12,  7.56s/it]
 73%|███████▎  | 27774/37963 [66:40:15<26:58:03,  9.53s/it]
 73%|███████▎  | 27775/37963 [66:40:23<25:20:07,  8.95s/it]
 73%|███████▎  | 27776/37963 [66:40:30<24:10:35,  8.54s/it]
 73%|███████▎  | 27777/37963 [66:40:44<28:42:45, 10.15s/it]
 73%|███████▎  | 27778/37963 [66:40:52<26:33:12,  9.39s/it]
 73%|███████▎  | 27779/37963 [66:41:00<25:04:56,  8.87s/it]
 73%|███████▎  | 27780/37963 [66:41:14<29:27:08, 10.41s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '2.771', 'learning_rate': '3.543e-06', 'epoch': '0.7318'}

 73%|███████▎  | 27780/37963 [66:41:14<29:27:08, 10.41s/it]
 73%|███████▎  | 27781/37963 [66:41:21<27:05:44,  9.58s/it]
 73%|███████▎  | 27782/37963 [66:41:28<25:03:19,  8.86s/it]
 73%|███████▎  | 27783/37963 [66:41:42<29:25:02, 10.40s/it]
 73%|███████▎  | 27784/37963 [66:41:50<27:03:10,  9.57s/it]
 73%|███████▎  | 27785/37963 [66:41:58<25:22:30,  8.98s/it]
 73%|███████▎  | 27786/37963 [66:42:05<24:10:50,  8.55s/it]
 73%|███████▎  | 27787/37963 [66:42:13<23:22:05,  8.27s/it]
 73%|███████▎  | 27788/37963 [66:42:20<22:49:03,  8.07s/it]
 73%|███████▎  | 27789/37963 [66:42:28<22:19:38,  7.90s/it]
 73%|███████▎  | 27790/37963 [66:42:36<22:03:22,  7.81s/it]
                                                           
{'loss': '0.1188', 'grad_norm': '2.3', 'learning_rate': '3.536e-06', 'epoch': '0.732'}

 73%|███████▎  | 27790/37963 [66:42:36<22:03:22,  7.81s/it]
 73%|███████▎  | 27791/37963 [66:42:43<21:48:25,  7.72s/it]
 73%|███████▎  | 27792/37963 [66:42:50<21:27:18,  7.59s/it]
 73%|███████▎  | 27793/37963 [66:43:04<26:51:25,  9.51s/it]
 73%|███████▎  | 27794/37963 [66:43:12<25:14:37,  8.94s/it]
 73%|███████▎  | 27795/37963 [66:43:26<29:37:32, 10.49s/it]
 73%|███████▎  | 27796/37963 [66:43:34<27:09:07,  9.61s/it]
 73%|███████▎  | 27797/37963 [66:43:41<25:24:23,  9.00s/it]
 73%|███████▎  | 27798/37963 [66:43:56<29:56:26, 10.60s/it]
 73%|███████▎  | 27799/37963 [66:44:03<27:23:55,  9.70s/it]
 73%|███████▎  | 27800/37963 [66:44:11<25:31:50,  9.04s/it]
                                                           
{'loss': '0.1176', 'grad_norm': '2.472', 'learning_rate': '3.53e-06', 'epoch': '0.7323'}

 73%|███████▎  | 27800/37963 [66:44:11<25:31:50,  9.04s/it]
 73%|███████▎  | 27801/37963 [66:44:18<24:17:17,  8.60s/it]
 73%|███████▎  | 27802/37963 [66:44:26<23:19:42,  8.27s/it]
 73%|███████▎  | 27803/37963 [66:44:33<22:44:45,  8.06s/it]
 73%|███████▎  | 27804/37963 [66:44:41<22:17:44,  7.90s/it]
 73%|███████▎  | 27805/37963 [66:44:54<27:07:38,  9.61s/it]
 73%|███████▎  | 27806/37963 [66:45:02<25:24:59,  9.01s/it]
 73%|███████▎  | 27807/37963 [66:45:10<24:09:22,  8.56s/it]
 73%|███████▎  | 27808/37963 [66:45:17<23:05:06,  8.18s/it]
 73%|███████▎  | 27809/37963 [66:45:24<22:31:34,  7.99s/it]
 73%|███████▎  | 27810/37963 [66:45:32<22:09:28,  7.86s/it]
                                                           
{'loss': '0.1257', 'grad_norm': '1.991', 'learning_rate': '3.523e-06', 'epoch': '0.7326'}

 73%|███████▎  | 27810/37963 [66:45:32<22:09:28,  7.86s/it]
 73%|███████▎  | 27811/37963 [66:45:39<21:52:52,  7.76s/it]
 73%|███████▎  | 27812/37963 [66:45:47<21:39:58,  7.68s/it]
 73%|███████▎  | 27813/37963 [66:45:54<21:33:04,  7.64s/it]
 73%|███████▎  | 27814/37963 [66:46:02<21:26:19,  7.60s/it]
 73%|███████▎  | 27815/37963 [66:46:09<21:08:43,  7.50s/it]
 73%|███████▎  | 27816/37963 [66:46:17<21:15:28,  7.54s/it]
 73%|███████▎  | 27817/37963 [66:46:24<21:15:19,  7.54s/it]
 73%|███████▎  | 27818/37963 [66:46:32<21:18:46,  7.56s/it]
 73%|███████▎  | 27819/37963 [66:46:39<21:04:56,  7.48s/it]
 73%|███████▎  | 27820/37963 [66:46:47<21:10:09,  7.51s/it]
                                                           
{'loss': '0.1141', 'grad_norm': '1.845', 'learning_rate': '3.517e-06', 'epoch': '0.7328'}

 73%|███████▎  | 27820/37963 [66:46:47<21:10:09,  7.51s/it]
 73%|███████▎  | 27821/37963 [66:46:54<21:10:11,  7.51s/it]
 73%|███████▎  | 27822/37963 [66:47:02<21:10:06,  7.51s/it]
 73%|███████▎  | 27823/37963 [66:47:09<21:03:57,  7.48s/it]
 73%|███████▎  | 27824/37963 [66:47:17<21:12:37,  7.53s/it]
 73%|███████▎  | 27825/37963 [66:47:31<26:35:41,  9.44s/it]
 73%|███████▎  | 27826/37963 [66:47:38<24:59:43,  8.88s/it]
 73%|███████▎  | 27827/37963 [66:47:53<29:29:02, 10.47s/it]
 73%|███████▎  | 27828/37963 [66:48:07<32:32:55, 11.56s/it]
 73%|███████▎  | 27829/37963 [66:48:14<29:10:54, 10.37s/it]
 73%|███████▎  | 27830/37963 [66:48:22<26:51:24,  9.54s/it]
                                                           
{'loss': '0.1144', 'grad_norm': '2.712', 'learning_rate': '3.51e-06', 'epoch': '0.7331'}

 73%|███████▎  | 27830/37963 [66:48:22<26:51:24,  9.54s/it]
 73%|███████▎  | 27831/37963 [66:48:29<24:52:43,  8.84s/it]
 73%|███████▎  | 27832/37963 [66:48:37<23:43:56,  8.43s/it]
 73%|███████▎  | 27833/37963 [66:48:44<22:57:19,  8.16s/it]
 73%|███████▎  | 27834/37963 [66:48:52<22:18:42,  7.93s/it]
 73%|███████▎  | 27835/37963 [66:48:59<21:58:25,  7.81s/it]
 73%|███████▎  | 27836/37963 [66:49:07<21:42:44,  7.72s/it]
 73%|███████▎  | 27837/37963 [66:49:20<26:46:27,  9.52s/it]
 73%|███████▎  | 27838/37963 [66:49:28<25:04:55,  8.92s/it]
 73%|███████▎  | 27839/37963 [66:49:42<29:35:48, 10.52s/it]
 73%|███████▎  | 27840/37963 [66:49:50<27:06:18,  9.64s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '1.629', 'learning_rate': '3.504e-06', 'epoch': '0.7333'}

 73%|███████▎  | 27840/37963 [66:49:50<27:06:18,  9.64s/it]
 73%|███████▎  | 27841/37963 [66:49:57<25:19:19,  9.01s/it]
 73%|███████▎  | 27842/37963 [66:50:11<29:08:12, 10.36s/it]
 73%|███████▎  | 27843/37963 [66:50:18<26:44:12,  9.51s/it]
 73%|███████▎  | 27844/37963 [66:50:26<25:04:46,  8.92s/it]
 73%|███████▎  | 27845/37963 [66:50:33<23:50:33,  8.48s/it]
 73%|███████▎  | 27846/37963 [66:50:41<23:11:40,  8.25s/it]
 73%|███████▎  | 27847/37963 [66:50:48<22:26:20,  7.99s/it]
 73%|███████▎  | 27848/37963 [66:51:03<27:41:43,  9.86s/it]
 73%|███████▎  | 27849/37963 [66:51:10<25:47:51,  9.18s/it]
 73%|███████▎  | 27850/37963 [66:51:18<24:19:29,  8.66s/it]
                                                           
{'loss': '0.1126', 'grad_norm': '2.15', 'learning_rate': '3.497e-06', 'epoch': '0.7336'}

 73%|███████▎  | 27850/37963 [66:51:18<24:19:29,  8.66s/it]
 73%|███████▎  | 27851/37963 [66:51:25<23:10:18,  8.25s/it]
 73%|███████▎  | 27852/37963 [66:51:32<22:31:49,  8.02s/it]
 73%|███████▎  | 27853/37963 [66:51:40<22:08:13,  7.88s/it]
 73%|███████▎  | 27854/37963 [66:51:48<21:51:13,  7.78s/it]
 73%|███████▎  | 27855/37963 [66:51:55<21:38:45,  7.71s/it]
 73%|███████▎  | 27856/37963 [66:52:02<21:21:58,  7.61s/it]
 73%|███████▎  | 27857/37963 [66:52:10<21:16:22,  7.58s/it]
 73%|███████▎  | 27858/37963 [66:52:18<21:16:44,  7.58s/it]
 73%|███████▎  | 27859/37963 [66:52:25<21:20:56,  7.61s/it]
 73%|███████▎  | 27860/37963 [66:52:39<26:51:39,  9.57s/it]
                                                           
{'loss': '0.1161', 'grad_norm': '1.77', 'learning_rate': '3.491e-06', 'epoch': '0.7339'}

 73%|███████▎  | 27860/37963 [66:52:39<26:51:39,  9.57s/it]
 73%|███████▎  | 27861/37963 [66:52:47<25:14:39,  9.00s/it]
 73%|███████▎  | 27862/37963 [66:52:55<24:07:14,  8.60s/it]
 73%|███████▎  | 27863/37963 [66:53:02<23:03:11,  8.22s/it]
 73%|███████▎  | 27864/37963 [66:53:10<22:32:53,  8.04s/it]
 73%|███████▎  | 27865/37963 [66:53:17<22:01:36,  7.85s/it]
 73%|███████▎  | 27866/37963 [66:53:25<21:48:03,  7.77s/it]
 73%|███████▎  | 27867/37963 [66:53:32<21:35:17,  7.70s/it]
 73%|███████▎  | 27868/37963 [66:53:40<21:29:49,  7.67s/it]
 73%|███████▎  | 27869/37963 [66:53:47<21:22:06,  7.62s/it]
 73%|███████▎  | 27870/37963 [66:53:55<21:17:16,  7.59s/it]
                                                           
{'loss': '0.1203', 'grad_norm': '1.942', 'learning_rate': '3.484e-06', 'epoch': '0.7341'}

 73%|███████▎  | 27870/37963 [66:53:55<21:17:16,  7.59s/it]
 73%|███████▎  | 27871/37963 [66:54:02<21:12:15,  7.56s/it]
 73%|███████▎  | 27872/37963 [66:54:10<21:03:15,  7.51s/it]
 73%|███████▎  | 27873/37963 [66:54:17<21:01:47,  7.50s/it]
 73%|███████▎  | 27874/37963 [66:54:38<32:06:11, 11.46s/it]
 73%|███████▎  | 27875/37963 [66:54:45<28:43:57, 10.25s/it]
 73%|███████▎  | 27876/37963 [66:54:53<26:24:44,  9.43s/it]
 73%|███████▎  | 27877/37963 [66:55:07<30:11:03, 10.77s/it]
 73%|███████▎  | 27878/37963 [66:55:14<27:32:39,  9.83s/it]
 73%|███████▎  | 27879/37963 [66:55:22<25:30:37,  9.11s/it]
 73%|███████▎  | 27880/37963 [66:55:29<24:13:57,  8.65s/it]
                                                           
{'loss': '0.123', 'grad_norm': '2.38', 'learning_rate': '3.478e-06', 'epoch': '0.7344'}

 73%|███████▎  | 27880/37963 [66:55:29<24:13:57,  8.65s/it]
 73%|███████▎  | 27881/37963 [66:55:37<23:19:56,  8.33s/it]
 73%|███████▎  | 27882/37963 [66:55:44<22:18:09,  7.96s/it]
 73%|███████▎  | 27883/37963 [66:55:52<21:55:53,  7.83s/it]
 73%|███████▎  | 27884/37963 [66:55:59<21:38:54,  7.73s/it]
 73%|███████▎  | 27885/37963 [66:56:13<27:09:08,  9.70s/it]
 73%|███████▎  | 27886/37963 [66:56:27<30:52:36, 11.03s/it]
 73%|███████▎  | 27887/37963 [66:56:35<28:01:12, 10.01s/it]
 73%|███████▎  | 27888/37963 [66:56:43<25:53:07,  9.25s/it]
 73%|███████▎  | 27889/37963 [66:56:50<24:28:29,  8.75s/it]
 73%|███████▎  | 27890/37963 [66:56:58<23:24:19,  8.36s/it]
                                                           
{'loss': '0.1278', 'grad_norm': '3.735', 'learning_rate': '3.471e-06', 'epoch': '0.7347'}

 73%|███████▎  | 27890/37963 [66:56:58<23:24:19,  8.36s/it]
 73%|███████▎  | 27891/37963 [66:57:05<22:36:30,  8.08s/it]
 73%|███████▎  | 27892/37963 [66:57:19<27:30:24,  9.83s/it]
 73%|███████▎  | 27893/37963 [66:57:27<25:40:37,  9.18s/it]
 73%|███████▎  | 27894/37963 [66:57:34<24:24:07,  8.72s/it]
 73%|███████▎  | 27895/37963 [66:57:42<23:22:44,  8.36s/it]
 73%|███████▎  | 27896/37963 [66:57:49<22:39:00,  8.10s/it]
 73%|███████▎  | 27897/37963 [66:57:57<22:09:09,  7.92s/it]
 73%|███████▎  | 27898/37963 [66:58:11<27:29:15,  9.83s/it]
 73%|███████▎  | 27899/37963 [66:58:19<25:34:10,  9.15s/it]
 73%|███████▎  | 27900/37963 [66:58:26<24:15:12,  8.68s/it]
                                                           
{'loss': '0.1221', 'grad_norm': '2.695', 'learning_rate': '3.465e-06', 'epoch': '0.7349'}

 73%|███████▎  | 27900/37963 [66:58:26<24:15:12,  8.68s/it]
 73%|███████▎  | 27901/37963 [66:58:34<23:08:00,  8.28s/it]
 73%|███████▎  | 27902/37963 [66:58:41<22:24:53,  8.02s/it]
 74%|███████▎  | 27903/37963 [66:58:48<21:59:10,  7.87s/it]
 74%|███████▎  | 27904/37963 [66:58:56<21:23:14,  7.65s/it]
 74%|███████▎  | 27905/37963 [66:59:03<21:16:11,  7.61s/it]
 74%|███████▎  | 27906/37963 [66:59:11<21:16:30,  7.62s/it]
 74%|███████▎  | 27907/37963 [66:59:18<21:11:21,  7.59s/it]
 74%|███████▎  | 27908/37963 [66:59:26<21:11:25,  7.59s/it]
 74%|███████▎  | 27909/37963 [66:59:33<21:03:14,  7.54s/it]
 74%|███████▎  | 27910/37963 [66:59:47<26:24:05,  9.45s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.163', 'learning_rate': '3.459e-06', 'epoch': '0.7352'}

 74%|███████▎  | 27910/37963 [66:59:47<26:24:05,  9.45s/it]
 74%|███████▎  | 27911/37963 [66:59:55<24:47:53,  8.88s/it]
 74%|███████▎  | 27912/37963 [67:00:02<23:43:20,  8.50s/it]
 74%|███████▎  | 27913/37963 [67:00:10<22:59:20,  8.23s/it]
 74%|███████▎  | 27914/37963 [67:00:18<22:24:17,  8.03s/it]
 74%|███████▎  | 27915/37963 [67:00:25<21:58:23,  7.87s/it]
 74%|███████▎  | 27916/37963 [67:00:33<21:44:35,  7.79s/it]
 74%|███████▎  | 27917/37963 [67:00:40<21:22:55,  7.66s/it]
 74%|███████▎  | 27918/37963 [67:00:48<21:14:54,  7.62s/it]
 74%|███████▎  | 27919/37963 [67:00:55<21:08:33,  7.58s/it]
 74%|███████▎  | 27920/37963 [67:01:02<20:56:06,  7.50s/it]
                                                           
{'loss': '0.1117', 'grad_norm': '2.701', 'learning_rate': '3.452e-06', 'epoch': '0.7355'}

 74%|███████▎  | 27920/37963 [67:01:02<20:56:06,  7.50s/it]
 74%|███████▎  | 27921/37963 [67:01:16<26:12:24,  9.39s/it]
 74%|███████▎  | 27922/37963 [67:01:24<24:44:42,  8.87s/it]
 74%|███████▎  | 27923/37963 [67:01:38<29:03:46, 10.42s/it]
 74%|███████▎  | 27924/37963 [67:01:45<26:43:20,  9.58s/it]
 74%|███████▎  | 27925/37963 [67:01:53<24:51:40,  8.92s/it]
 74%|███████▎  | 27926/37963 [67:02:07<29:02:29, 10.42s/it]
 74%|███████▎  | 27927/37963 [67:02:14<26:27:21,  9.49s/it]
 74%|███████▎  | 27928/37963 [67:02:22<24:45:04,  8.88s/it]
 74%|███████▎  | 27929/37963 [67:02:29<23:36:24,  8.47s/it]
 74%|███████▎  | 27930/37963 [67:02:37<22:49:41,  8.19s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.192', 'learning_rate': '3.446e-06', 'epoch': '0.7357'}

 74%|███████▎  | 27930/37963 [67:02:37<22:49:41,  8.19s/it]
 74%|███████▎  | 27931/37963 [67:02:44<22:25:05,  8.04s/it]
 74%|███████▎  | 27932/37963 [67:02:52<22:02:37,  7.91s/it]
 74%|███████▎  | 27933/37963 [67:03:06<27:05:07,  9.72s/it]
 74%|███████▎  | 27934/37963 [67:03:13<25:16:23,  9.07s/it]
 74%|███████▎  | 27935/37963 [67:03:27<29:19:49, 10.53s/it]
 74%|███████▎  | 27936/37963 [67:03:35<26:51:51,  9.65s/it]
 74%|███████▎  | 27937/37963 [67:03:49<30:34:24, 10.98s/it]
 74%|███████▎  | 27938/37963 [67:03:56<27:39:09,  9.93s/it]
 74%|███████▎  | 27939/37963 [67:04:04<25:38:33,  9.21s/it]
 74%|███████▎  | 27940/37963 [67:04:11<24:11:18,  8.69s/it]
                                                           
{'loss': '0.1315', 'grad_norm': '2.606', 'learning_rate': '3.439e-06', 'epoch': '0.736'}

 74%|███████▎  | 27940/37963 [67:04:11<24:11:18,  8.69s/it]
 74%|███████▎  | 27941/37963 [67:04:19<23:08:52,  8.31s/it]
 74%|███████▎  | 27942/37963 [67:04:26<22:24:58,  8.05s/it]
 74%|███████▎  | 27943/37963 [67:04:34<22:01:02,  7.91s/it]
 74%|███████▎  | 27944/37963 [67:04:41<21:43:16,  7.80s/it]
 74%|███████▎  | 27945/37963 [67:04:49<21:27:33,  7.71s/it]
 74%|███████▎  | 27946/37963 [67:04:57<21:24:19,  7.69s/it]
 74%|███████▎  | 27947/37963 [67:05:04<21:25:52,  7.70s/it]
 74%|███████▎  | 27948/37963 [67:05:12<21:21:04,  7.67s/it]
 74%|███████▎  | 27949/37963 [67:05:26<26:44:02,  9.61s/it]
 74%|███████▎  | 27950/37963 [67:05:34<25:05:51,  9.02s/it]
                                                           
{'loss': '0.119', 'grad_norm': '2.27', 'learning_rate': '3.433e-06', 'epoch': '0.7362'}

 74%|███████▎  | 27950/37963 [67:05:34<25:05:51,  9.02s/it]
 74%|███████▎  | 27951/37963 [67:05:41<23:45:32,  8.54s/it]
 74%|███████▎  | 27952/37963 [67:05:49<22:58:26,  8.26s/it]
 74%|███████▎  | 27953/37963 [67:05:56<22:16:50,  8.01s/it]
 74%|███████▎  | 27954/37963 [67:06:04<22:00:44,  7.92s/it]
 74%|███████▎  | 27955/37963 [67:06:11<21:30:10,  7.73s/it]
 74%|███████▎  | 27956/37963 [67:06:25<26:49:12,  9.65s/it]
 74%|███████▎  | 27957/37963 [67:06:33<25:04:48,  9.02s/it]
 74%|███████▎  | 27958/37963 [67:06:40<23:53:59,  8.60s/it]
 74%|███████▎  | 27959/37963 [67:06:48<23:09:40,  8.33s/it]
 74%|███████▎  | 27960/37963 [67:06:56<22:20:16,  8.04s/it]
                                                           
{'loss': '0.1212', 'grad_norm': '2.349', 'learning_rate': '3.426e-06', 'epoch': '0.7365'}

 74%|███████▎  | 27960/37963 [67:06:56<22:20:16,  8.04s/it]
 74%|███████▎  | 27961/37963 [67:07:03<21:41:23,  7.81s/it]
 74%|███████▎  | 27962/37963 [67:07:10<21:30:36,  7.74s/it]
 74%|███████▎  | 27963/37963 [67:07:18<21:17:40,  7.67s/it]
 74%|███████▎  | 27964/37963 [67:07:25<21:12:05,  7.63s/it]
 74%|███████▎  | 27965/37963 [67:07:33<21:05:54,  7.60s/it]
 74%|███████▎  | 27966/37963 [67:07:41<21:06:23,  7.60s/it]
 74%|███████▎  | 27967/37963 [67:07:48<20:57:23,  7.55s/it]
 74%|███████▎  | 27968/37963 [67:07:56<20:58:19,  7.55s/it]
 74%|███████▎  | 27969/37963 [67:08:03<20:58:29,  7.56s/it]
 74%|███████▎  | 27970/37963 [67:08:11<20:55:57,  7.54s/it]
                                                           
{'loss': '0.1101', 'grad_norm': '2.152', 'learning_rate': '3.42e-06', 'epoch': '0.7368'}

 74%|███████▎  | 27970/37963 [67:08:11<20:55:57,  7.54s/it]
 74%|███████▎  | 27971/37963 [67:08:18<20:51:27,  7.51s/it]
 74%|███████▎  | 27972/37963 [67:08:32<25:53:30,  9.33s/it]
 74%|███████▎  | 27973/37963 [67:08:46<29:53:32, 10.77s/it]
 74%|███████▎  | 27974/37963 [67:09:00<32:35:20, 11.74s/it]
 74%|███████▎  | 27975/37963 [67:09:07<29:05:21, 10.48s/it]
 74%|███████▎  | 27976/37963 [67:09:15<26:39:29,  9.61s/it]
 74%|███████▎  | 27977/37963 [67:09:22<24:57:33,  9.00s/it]
 74%|███████▎  | 27978/37963 [67:09:37<29:18:08, 10.56s/it]
 74%|███████▎  | 27979/37963 [67:09:44<26:46:42,  9.66s/it]
 74%|███████▎  | 27980/37963 [67:09:52<25:02:40,  9.03s/it]
                                                           
{'loss': '0.1224', 'grad_norm': '2.061', 'learning_rate': '3.413e-06', 'epoch': '0.737'}

 74%|███████▎  | 27980/37963 [67:09:52<25:02:40,  9.03s/it]
 74%|███████▎  | 27981/37963 [67:09:59<23:49:36,  8.59s/it]
 74%|███████▎  | 27982/37963 [67:10:07<22:59:26,  8.29s/it]
 74%|███████▎  | 27983/37963 [67:10:21<27:45:16, 10.01s/it]
 74%|███████▎  | 27984/37963 [67:10:28<25:33:22,  9.22s/it]
 74%|███████▎  | 27985/37963 [67:10:43<29:55:44, 10.80s/it]
 74%|███████▎  | 27986/37963 [67:10:50<27:10:17,  9.80s/it]
 74%|███████▎  | 27987/37963 [67:10:58<25:16:06,  9.12s/it]
 74%|███████▎  | 27988/37963 [67:11:05<23:41:01,  8.55s/it]
 74%|███████▎  | 27989/37963 [67:11:12<22:33:30,  8.14s/it]
 74%|███████▎  | 27990/37963 [67:11:20<22:04:18,  7.97s/it]
                                                           
{'loss': '0.1054', 'grad_norm': '1.944', 'learning_rate': '3.407e-06', 'epoch': '0.7373'}

 74%|███████▎  | 27990/37963 [67:11:20<22:04:18,  7.97s/it]
 74%|███████▎  | 27991/37963 [67:11:27<21:34:50,  7.79s/it]
 74%|███████▎  | 27992/37963 [67:11:35<21:26:58,  7.74s/it]
 74%|███████▎  | 27993/37963 [67:11:42<21:11:45,  7.65s/it]
 74%|███████▎  | 27994/37963 [67:11:50<21:05:29,  7.62s/it]
 74%|███████▎  | 27995/37963 [67:11:58<21:10:19,  7.65s/it]
 74%|███████▎  | 27996/37963 [67:12:11<26:04:41,  9.42s/it]
 74%|███████▎  | 27997/37963 [67:12:19<24:31:32,  8.86s/it]
 74%|███████▍  | 27998/37963 [67:12:26<23:12:12,  8.38s/it]
 74%|███████▍  | 27999/37963 [67:12:40<27:54:06, 10.08s/it]
 74%|███████▍  | 28000/37963 [67:12:48<26:02:22,  9.41s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '1.789', 'learning_rate': '3.401e-06', 'epoch': '0.7376'}

 74%|███████▍  | 28000/37963 [67:12:48<26:02:22,  9.41s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.05s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.05s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 74%|███████▍  | 28001/37963 [67:13:46<66:51:41, 24.16s/it]
 74%|███████▍  | 28002/37963 [67:13:54<53:13:25, 19.24s/it]
 74%|███████▍  | 28003/37963 [67:14:01<43:19:34, 15.66s/it]
 74%|███████▍  | 28004/37963 [67:14:09<36:35:49, 13.23s/it]
 74%|███████▍  | 28005/37963 [67:14:16<31:47:46, 11.49s/it]
 74%|███████▍  | 28006/37963 [67:14:24<28:27:19, 10.29s/it]
 74%|███████▍  | 28007/37963 [67:14:32<26:15:36,  9.50s/it]
 74%|███████▍  | 28008/37963 [67:14:39<24:41:12,  8.93s/it]
 74%|███████▍  | 28009/37963 [67:14:47<23:37:38,  8.55s/it]
 74%|███████▍  | 28010/37963 [67:14:54<22:47:26,  8.24s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.625', 'learning_rate': '3.394e-06', 'epoch': '0.7378'}

 74%|███████▍  | 28010/37963 [67:14:54<22:47:26,  8.24s/it]
 74%|███████▍  | 28011/37963 [67:15:02<22:10:30,  8.02s/it]
 74%|███████▍  | 28012/37963 [67:15:09<21:38:06,  7.83s/it]
 74%|███████▍  | 28013/37963 [67:15:17<21:30:09,  7.78s/it]
 74%|███████▍  | 28014/37963 [67:15:24<21:17:07,  7.70s/it]
 74%|███████▍  | 28015/37963 [67:15:32<21:02:58,  7.62s/it]
 74%|███████▍  | 28016/37963 [67:15:39<21:00:29,  7.60s/it]
 74%|███████▍  | 28017/37963 [67:15:47<20:54:54,  7.57s/it]
 74%|███████▍  | 28018/37963 [67:15:54<20:51:21,  7.55s/it]
 74%|███████▍  | 28019/37963 [67:16:02<20:44:48,  7.51s/it]
 74%|███████▍  | 28020/37963 [67:16:22<31:28:36, 11.40s/it]
                                                           
{'loss': '0.1048', 'grad_norm': '1.722', 'learning_rate': '3.388e-06', 'epoch': '0.7381'}

 74%|███████▍  | 28020/37963 [67:16:22<31:28:36, 11.40s/it]
 74%|███████▍  | 28021/37963 [67:16:30<28:16:40, 10.24s/it]
 74%|███████▍  | 28022/37963 [67:16:44<31:37:57, 11.46s/it]
 74%|███████▍  | 28023/37963 [67:16:58<33:40:52, 12.20s/it]
 74%|███████▍  | 28024/37963 [67:17:06<29:51:17, 10.81s/it]
 74%|███████▍  | 28025/37963 [67:17:13<27:01:52,  9.79s/it]
 74%|███████▍  | 28026/37963 [67:17:21<25:10:38,  9.12s/it]
 74%|███████▍  | 28027/37963 [67:17:28<23:47:35,  8.62s/it]
 74%|███████▍  | 28028/37963 [67:17:36<22:53:52,  8.30s/it]
 74%|███████▍  | 28029/37963 [67:17:50<27:35:38, 10.00s/it]
 74%|███████▍  | 28030/37963 [67:18:04<30:50:25, 11.18s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '1.407', 'learning_rate': '3.381e-06', 'epoch': '0.7384'}

 74%|███████▍  | 28030/37963 [67:18:04<30:50:25, 11.18s/it]
 74%|███████▍  | 28031/37963 [67:18:11<27:55:34, 10.12s/it]
 74%|███████▍  | 28032/37963 [67:18:19<25:46:28,  9.34s/it]
 74%|███████▍  | 28033/37963 [67:18:26<24:17:25,  8.81s/it]
 74%|███████▍  | 28034/37963 [67:18:34<23:12:57,  8.42s/it]
 74%|███████▍  | 28035/37963 [67:18:41<22:13:49,  8.06s/it]
 74%|███████▍  | 28036/37963 [67:18:49<21:57:11,  7.96s/it]
 74%|███████▍  | 28037/37963 [67:18:56<21:37:51,  7.85s/it]
 74%|███████▍  | 28038/37963 [67:19:04<21:21:00,  7.74s/it]
 74%|███████▍  | 28039/37963 [67:19:11<21:11:42,  7.69s/it]
 74%|███████▍  | 28040/37963 [67:19:19<21:08:24,  7.67s/it]
                                                           
{'loss': '0.1143', 'grad_norm': '2.152', 'learning_rate': '3.375e-06', 'epoch': '0.7386'}

 74%|███████▍  | 28040/37963 [67:19:19<21:08:24,  7.67s/it]
 74%|███████▍  | 28041/37963 [67:19:26<20:54:19,  7.59s/it]
 74%|███████▍  | 28042/37963 [67:19:34<20:42:20,  7.51s/it]
 74%|███████▍  | 28043/37963 [67:19:47<25:45:39,  9.35s/it]
 74%|███████▍  | 28044/37963 [67:19:55<23:57:58,  8.70s/it]
 74%|███████▍  | 28045/37963 [67:20:02<23:01:52,  8.36s/it]
 74%|███████▍  | 28046/37963 [67:20:16<27:42:48, 10.06s/it]
 74%|███████▍  | 28047/37963 [67:20:24<25:41:44,  9.33s/it]
 74%|███████▍  | 28048/37963 [67:20:31<24:11:45,  8.79s/it]
 74%|███████▍  | 28049/37963 [67:20:39<23:14:07,  8.44s/it]
 74%|███████▍  | 28050/37963 [67:20:46<22:16:58,  8.09s/it]
                                                           
{'loss': '0.119', 'grad_norm': '1.521', 'learning_rate': '3.369e-06', 'epoch': '0.7389'}

 74%|███████▍  | 28050/37963 [67:20:46<22:16:58,  8.09s/it]
 74%|███████▍  | 28051/37963 [67:20:54<21:39:08,  7.86s/it]
 74%|███████▍  | 28052/37963 [67:21:01<21:25:32,  7.78s/it]
 74%|███████▍  | 28053/37963 [67:21:09<21:23:13,  7.77s/it]
 74%|███████▍  | 28054/37963 [67:21:16<21:12:07,  7.70s/it]
 74%|███████▍  | 28055/37963 [67:21:24<21:01:57,  7.64s/it]
 74%|███████▍  | 28056/37963 [67:21:31<20:44:28,  7.54s/it]
 74%|███████▍  | 28057/37963 [67:21:39<20:46:05,  7.55s/it]
 74%|███████▍  | 28058/37963 [67:21:46<20:47:43,  7.56s/it]
 74%|███████▍  | 28059/37963 [67:21:54<20:40:24,  7.51s/it]
 74%|███████▍  | 28060/37963 [67:22:01<20:40:27,  7.52s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '3.008', 'learning_rate': '3.362e-06', 'epoch': '0.7391'}

 74%|███████▍  | 28060/37963 [67:22:01<20:40:27,  7.52s/it]
 74%|███████▍  | 28061/37963 [67:22:09<20:39:15,  7.51s/it]
 74%|███████▍  | 28062/37963 [67:22:16<20:41:29,  7.52s/it]
 74%|███████▍  | 28063/37963 [67:22:24<20:46:39,  7.56s/it]
 74%|███████▍  | 28064/37963 [67:22:31<20:46:13,  7.55s/it]
 74%|███████▍  | 28065/37963 [67:22:39<20:44:24,  7.54s/it]
 74%|███████▍  | 28066/37963 [67:22:47<20:43:59,  7.54s/it]
 74%|███████▍  | 28067/37963 [67:22:54<20:42:08,  7.53s/it]
 74%|███████▍  | 28068/37963 [67:23:02<20:39:48,  7.52s/it]
 74%|███████▍  | 28069/37963 [67:23:09<20:32:19,  7.47s/it]
 74%|███████▍  | 28070/37963 [67:23:16<20:35:09,  7.49s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '1.669', 'learning_rate': '3.356e-06', 'epoch': '0.7394'}

 74%|███████▍  | 28070/37963 [67:23:16<20:35:09,  7.49s/it]
 74%|███████▍  | 28071/37963 [67:23:43<36:07:08, 13.14s/it]
 74%|███████▍  | 28072/37963 [67:23:57<36:40:37, 13.35s/it]
 74%|███████▍  | 28073/37963 [67:24:04<31:53:18, 11.61s/it]
 74%|███████▍  | 28074/37963 [67:24:12<28:28:27, 10.37s/it]
 74%|███████▍  | 28075/37963 [67:24:19<26:07:40,  9.51s/it]
 74%|███████▍  | 28076/37963 [67:24:27<24:23:01,  8.88s/it]
 74%|███████▍  | 28077/37963 [67:24:34<23:22:02,  8.51s/it]
 74%|███████▍  | 28078/37963 [67:24:42<22:34:20,  8.22s/it]
 74%|███████▍  | 28079/37963 [67:24:49<22:00:52,  8.02s/it]
 74%|███████▍  | 28080/37963 [67:24:57<21:35:43,  7.87s/it]
                                                           
{'loss': '0.1096', 'grad_norm': '2.337', 'learning_rate': '3.35e-06', 'epoch': '0.7397'}

 74%|███████▍  | 28080/37963 [67:24:57<21:35:43,  7.87s/it]
 74%|███████▍  | 28081/37963 [67:25:11<26:37:28,  9.70s/it]
 74%|███████▍  | 28082/37963 [67:25:18<24:49:48,  9.05s/it]
 74%|███████▍  | 28083/37963 [67:25:26<23:26:58,  8.54s/it]
 74%|███████▍  | 28084/37963 [67:25:40<28:03:03, 10.22s/it]
 74%|███████▍  | 28085/37963 [67:25:47<25:44:58,  9.38s/it]
 74%|███████▍  | 28086/37963 [67:25:55<24:13:24,  8.83s/it]
 74%|███████▍  | 28087/37963 [67:26:02<23:03:10,  8.40s/it]
 74%|███████▍  | 28088/37963 [67:26:10<22:10:27,  8.08s/it]
 74%|███████▍  | 28089/37963 [67:26:17<21:49:25,  7.96s/it]
 74%|███████▍  | 28090/37963 [67:26:32<27:04:25,  9.87s/it]
                                                           
{'loss': '0.1157', 'grad_norm': '1.57', 'learning_rate': '3.343e-06', 'epoch': '0.7399'}

 74%|███████▍  | 28090/37963 [67:26:32<27:04:25,  9.87s/it]
 74%|███████▍  | 28091/37963 [67:26:46<30:40:04, 11.18s/it]
 74%|███████▍  | 28092/37963 [67:26:53<27:41:19, 10.10s/it]
 74%|███████▍  | 28093/37963 [67:27:01<25:23:57,  9.26s/it]
 74%|███████▍  | 28094/37963 [67:27:08<23:58:14,  8.74s/it]
 74%|███████▍  | 28095/37963 [67:27:16<23:06:19,  8.43s/it]
 74%|███████▍  | 28096/37963 [67:27:23<22:21:20,  8.16s/it]
 74%|███████▍  | 28097/37963 [67:27:31<21:55:58,  8.00s/it]
 74%|███████▍  | 28098/37963 [67:27:39<21:32:30,  7.86s/it]
 74%|███████▍  | 28099/37963 [67:27:46<21:18:19,  7.78s/it]
 74%|███████▍  | 28100/37963 [67:27:54<21:04:35,  7.69s/it]
                                                           
{'loss': '0.1105', 'grad_norm': '2.38', 'learning_rate': '3.337e-06', 'epoch': '0.7402'}

 74%|███████▍  | 28100/37963 [67:27:54<21:04:35,  7.69s/it]
 74%|███████▍  | 28101/37963 [67:28:01<21:03:16,  7.69s/it]
 74%|███████▍  | 28102/37963 [67:28:09<20:53:16,  7.63s/it]
 74%|███████▍  | 28103/37963 [67:28:16<20:40:28,  7.55s/it]
 74%|███████▍  | 28104/37963 [67:28:24<20:33:42,  7.51s/it]
 74%|███████▍  | 28105/37963 [67:28:31<20:36:31,  7.53s/it]
 74%|███████▍  | 28106/37963 [67:28:39<20:34:11,  7.51s/it]
 74%|███████▍  | 28107/37963 [67:28:46<20:34:06,  7.51s/it]
 74%|███████▍  | 28108/37963 [67:28:54<20:37:18,  7.53s/it]
 74%|███████▍  | 28109/37963 [67:29:01<20:34:50,  7.52s/it]
 74%|███████▍  | 28110/37963 [67:29:09<20:30:37,  7.49s/it]
                                                           
{'loss': '0.12', 'grad_norm': '1.683', 'learning_rate': '3.33e-06', 'epoch': '0.7405'}

 74%|███████▍  | 28110/37963 [67:29:09<20:30:37,  7.49s/it]
 74%|███████▍  | 28111/37963 [67:29:16<20:35:32,  7.52s/it]
 74%|███████▍  | 28112/37963 [67:29:24<20:38:38,  7.54s/it]
 74%|███████▍  | 28113/37963 [67:29:31<20:28:09,  7.48s/it]
 74%|███████▍  | 28114/37963 [67:29:39<20:36:16,  7.53s/it]
 74%|███████▍  | 28115/37963 [67:29:53<26:03:30,  9.53s/it]
 74%|███████▍  | 28116/37963 [67:30:00<24:24:05,  8.92s/it]
 74%|███████▍  | 28117/37963 [67:30:08<23:15:44,  8.51s/it]
 74%|███████▍  | 28118/37963 [67:30:22<27:35:27, 10.09s/it]
 74%|███████▍  | 28119/37963 [67:30:29<25:29:56,  9.33s/it]
 74%|███████▍  | 28120/37963 [67:30:37<24:03:36,  8.80s/it]
                                                           
{'loss': '0.1147', 'grad_norm': '1.82', 'learning_rate': '3.324e-06', 'epoch': '0.7407'}

 74%|███████▍  | 28120/37963 [67:30:37<24:03:36,  8.80s/it]
 74%|███████▍  | 28121/37963 [67:30:57<33:38:10, 12.30s/it]
 74%|███████▍  | 28122/37963 [67:31:05<29:47:19, 10.90s/it]
 74%|███████▍  | 28123/37963 [67:31:13<27:04:36,  9.91s/it]
 74%|███████▍  | 28124/37963 [67:31:20<25:06:52,  9.19s/it]
 74%|███████▍  | 28125/37963 [67:31:28<23:42:05,  8.67s/it]
 74%|███████▍  | 28126/37963 [67:31:35<22:45:48,  8.33s/it]
 74%|███████▍  | 28127/37963 [67:31:43<22:07:27,  8.10s/it]
 74%|███████▍  | 28128/37963 [67:31:50<21:38:45,  7.92s/it]
 74%|███████▍  | 28129/37963 [67:31:58<21:21:39,  7.82s/it]
 74%|███████▍  | 28130/37963 [67:32:05<21:07:51,  7.74s/it]
                                                           
{'loss': '0.11', 'grad_norm': '1.144', 'learning_rate': '3.318e-06', 'epoch': '0.741'}

 74%|███████▍  | 28130/37963 [67:32:05<21:07:51,  7.74s/it]
 74%|███████▍  | 28131/37963 [67:32:13<20:42:56,  7.59s/it]
 74%|███████▍  | 28132/37963 [67:32:20<20:43:31,  7.59s/it]
 74%|███████▍  | 28133/37963 [67:32:40<31:07:57, 11.40s/it]
 74%|███████▍  | 28134/37963 [67:32:48<27:58:56, 10.25s/it]
 74%|███████▍  | 28135/37963 [67:32:56<25:50:19,  9.46s/it]
 74%|███████▍  | 28136/37963 [67:33:03<24:16:13,  8.89s/it]
 74%|███████▍  | 28137/37963 [67:33:17<28:26:11, 10.42s/it]
 74%|███████▍  | 28138/37963 [67:33:31<31:23:57, 11.51s/it]
 74%|███████▍  | 28139/37963 [67:33:39<28:09:03, 10.32s/it]
 74%|███████▍  | 28140/37963 [67:33:46<25:50:17,  9.47s/it]
                                                           
{'loss': '0.1113', 'grad_norm': '1.915', 'learning_rate': '3.311e-06', 'epoch': '0.7413'}

 74%|███████▍  | 28140/37963 [67:33:46<25:50:17,  9.47s/it]
 74%|███████▍  | 28141/37963 [67:33:54<24:02:22,  8.81s/it]
 74%|███████▍  | 28142/37963 [67:34:01<23:04:14,  8.46s/it]
 74%|███████▍  | 28143/37963 [67:34:08<22:03:47,  8.09s/it]
 74%|███████▍  | 28144/37963 [67:34:16<21:30:31,  7.89s/it]
 74%|███████▍  | 28145/37963 [67:34:23<21:11:13,  7.77s/it]
 74%|███████▍  | 28146/37963 [67:34:31<21:02:44,  7.72s/it]
 74%|███████▍  | 28147/37963 [67:34:38<20:52:56,  7.66s/it]
 74%|███████▍  | 28148/37963 [67:34:46<20:51:42,  7.65s/it]
 74%|███████▍  | 28149/37963 [67:34:54<20:43:04,  7.60s/it]
 74%|███████▍  | 28150/37963 [67:35:01<20:41:12,  7.59s/it]
                                                           
{'loss': '0.106', 'grad_norm': '3.282', 'learning_rate': '3.305e-06', 'epoch': '0.7415'}

 74%|███████▍  | 28150/37963 [67:35:01<20:41:12,  7.59s/it]
 74%|███████▍  | 28151/37963 [67:35:09<20:45:44,  7.62s/it]
 74%|███████▍  | 28152/37963 [67:35:16<20:33:40,  7.54s/it]
 74%|███████▍  | 28153/37963 [67:35:24<20:33:12,  7.54s/it]
 74%|███████▍  | 28154/37963 [67:35:31<20:30:12,  7.53s/it]
 74%|███████▍  | 28155/37963 [67:35:39<20:29:39,  7.52s/it]
 74%|███████▍  | 28156/37963 [67:35:46<20:31:46,  7.54s/it]
 74%|███████▍  | 28157/37963 [67:35:53<20:16:44,  7.44s/it]
 74%|███████▍  | 28158/37963 [67:36:01<20:27:45,  7.51s/it]
 74%|███████▍  | 28159/37963 [67:36:09<20:27:05,  7.51s/it]
 74%|███████▍  | 28160/37963 [67:36:16<20:25:06,  7.50s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '2.01', 'learning_rate': '3.299e-06', 'epoch': '0.7418'}

 74%|███████▍  | 28160/37963 [67:36:16<20:25:06,  7.50s/it]
 74%|███████▍  | 28161/37963 [67:36:30<25:41:58,  9.44s/it]
 74%|███████▍  | 28162/37963 [67:36:38<24:06:08,  8.85s/it]
 74%|███████▍  | 28163/37963 [67:36:45<23:10:19,  8.51s/it]
 74%|███████▍  | 28164/37963 [67:36:53<22:21:26,  8.21s/it]
 74%|███████▍  | 28165/37963 [67:37:00<21:41:46,  7.97s/it]
 74%|███████▍  | 28166/37963 [67:37:15<26:56:32,  9.90s/it]
 74%|███████▍  | 28167/37963 [67:37:29<30:21:08, 11.15s/it]
 74%|███████▍  | 28168/37963 [67:37:36<27:32:52, 10.12s/it]
 74%|███████▍  | 28169/37963 [67:37:51<30:52:57, 11.35s/it]
 74%|███████▍  | 28170/37963 [67:37:58<27:54:50, 10.26s/it]
                                                           
{'loss': '0.1206', 'grad_norm': '3.602', 'learning_rate': '3.292e-06', 'epoch': '0.742'}

 74%|███████▍  | 28170/37963 [67:37:58<27:54:50, 10.26s/it]
 74%|███████▍  | 28171/37963 [67:38:06<25:36:27,  9.41s/it]
 74%|███████▍  | 28172/37963 [67:38:13<24:01:18,  8.83s/it]
 74%|███████▍  | 28173/37963 [67:38:21<22:50:31,  8.40s/it]
 74%|███████▍  | 28174/37963 [67:38:28<22:06:26,  8.13s/it]
 74%|███████▍  | 28175/37963 [67:38:36<21:36:16,  7.95s/it]
 74%|███████▍  | 28176/37963 [67:38:43<21:12:16,  7.80s/it]
 74%|███████▍  | 28177/37963 [67:38:51<21:04:08,  7.75s/it]
 74%|███████▍  | 28178/37963 [67:38:58<20:52:20,  7.68s/it]
 74%|███████▍  | 28179/37963 [67:39:06<20:52:09,  7.68s/it]
 74%|███████▍  | 28180/37963 [67:39:13<20:38:46,  7.60s/it]
                                                           
{'loss': '0.1169', 'grad_norm': '2.458', 'learning_rate': '3.286e-06', 'epoch': '0.7423'}

 74%|███████▍  | 28180/37963 [67:39:13<20:38:46,  7.60s/it]
 74%|███████▍  | 28181/37963 [67:39:27<25:33:51,  9.41s/it]
 74%|███████▍  | 28182/37963 [67:39:35<24:02:51,  8.85s/it]
 74%|███████▍  | 28183/37963 [67:39:42<22:59:42,  8.46s/it]
 74%|███████▍  | 28184/37963 [67:39:50<22:12:59,  8.18s/it]
 74%|███████▍  | 28185/37963 [67:40:04<26:55:38,  9.91s/it]
 74%|███████▍  | 28186/37963 [67:40:11<24:56:29,  9.18s/it]
 74%|███████▍  | 28187/37963 [67:40:25<28:39:17, 10.55s/it]
 74%|███████▍  | 28188/37963 [67:40:38<31:05:16, 11.45s/it]
 74%|███████▍  | 28189/37963 [67:40:46<27:50:52, 10.26s/it]
 74%|███████▍  | 28190/37963 [67:40:53<25:36:51,  9.44s/it]
                                                           
{'loss': '0.1128', 'grad_norm': '2.385', 'learning_rate': '3.28e-06', 'epoch': '0.7426'}

 74%|███████▍  | 28190/37963 [67:40:53<25:36:51,  9.44s/it]
 74%|███████▍  | 28191/37963 [67:41:01<23:56:01,  8.82s/it]
 74%|███████▍  | 28192/37963 [67:41:08<22:54:03,  8.44s/it]
 74%|███████▍  | 28193/37963 [67:41:16<22:01:03,  8.11s/it]
 74%|███████▍  | 28194/37963 [67:41:23<21:08:44,  7.79s/it]
 74%|███████▍  | 28195/37963 [67:41:30<21:02:40,  7.76s/it]
 74%|███████▍  | 28196/37963 [67:41:38<20:54:06,  7.70s/it]
 74%|███████▍  | 28197/37963 [67:41:46<20:55:01,  7.71s/it]
 74%|███████▍  | 28198/37963 [67:41:53<20:46:57,  7.66s/it]
 74%|███████▍  | 28199/37963 [67:42:01<20:40:06,  7.62s/it]
 74%|███████▍  | 28200/37963 [67:42:08<20:38:34,  7.61s/it]
                                                           
{'loss': '0.1076', 'grad_norm': '1.825', 'learning_rate': '3.273e-06', 'epoch': '0.7428'}

 74%|███████▍  | 28200/37963 [67:42:08<20:38:34,  7.61s/it]
 74%|███████▍  | 28201/37963 [67:42:16<20:29:31,  7.56s/it]
 74%|███████▍  | 28202/37963 [67:42:23<20:31:28,  7.57s/it]
 74%|███████▍  | 28203/37963 [67:42:31<20:35:41,  7.60s/it]
 74%|███████▍  | 28204/37963 [67:42:38<20:29:23,  7.56s/it]
 74%|███████▍  | 28205/37963 [67:42:53<25:50:58,  9.54s/it]
 74%|███████▍  | 28206/37963 [67:43:00<24:13:42,  8.94s/it]
 74%|███████▍  | 28207/37963 [67:43:08<23:12:44,  8.57s/it]
 74%|███████▍  | 28208/37963 [67:43:15<22:20:27,  8.24s/it]
 74%|███████▍  | 28209/37963 [67:43:23<21:45:27,  8.03s/it]
 74%|███████▍  | 28210/37963 [67:43:30<21:21:59,  7.89s/it]
                                                           
{'loss': '0.1218', 'grad_norm': '2.049', 'learning_rate': '3.267e-06', 'epoch': '0.7431'}

 74%|███████▍  | 28210/37963 [67:43:30<21:21:59,  7.89s/it]
 74%|███████▍  | 28211/37963 [67:43:38<21:13:13,  7.83s/it]
 74%|███████▍  | 28212/37963 [67:43:46<20:59:45,  7.75s/it]
 74%|███████▍  | 28213/37963 [67:44:00<26:15:52,  9.70s/it]
 74%|███████▍  | 28214/37963 [67:44:14<29:50:00, 11.02s/it]
 74%|███████▍  | 28215/37963 [67:44:22<27:01:44,  9.98s/it]
 74%|███████▍  | 28216/37963 [67:44:29<25:05:01,  9.26s/it]
 74%|███████▍  | 28217/37963 [67:44:43<29:04:27, 10.74s/it]
 74%|███████▍  | 28218/37963 [67:44:51<26:16:22,  9.71s/it]
 74%|███████▍  | 28219/37963 [67:44:58<24:29:59,  9.05s/it]
 74%|███████▍  | 28220/37963 [67:45:06<23:07:30,  8.54s/it]
                                                           
{'loss': '0.1033', 'grad_norm': '1.821', 'learning_rate': '3.261e-06', 'epoch': '0.7434'}

 74%|███████▍  | 28220/37963 [67:45:06<23:07:30,  8.54s/it]
 74%|███████▍  | 28221/37963 [67:45:13<22:17:13,  8.24s/it]
 74%|███████▍  | 28222/37963 [67:45:21<21:48:15,  8.06s/it]
 74%|███████▍  | 28223/37963 [67:45:28<21:21:18,  7.89s/it]
 74%|███████▍  | 28224/37963 [67:45:36<21:03:53,  7.79s/it]
 74%|███████▍  | 28225/37963 [67:45:43<20:47:09,  7.68s/it]
 74%|███████▍  | 28226/37963 [67:45:51<20:38:03,  7.63s/it]
 74%|███████▍  | 28227/37963 [67:45:58<20:36:18,  7.62s/it]
 74%|███████▍  | 28228/37963 [67:46:06<20:34:02,  7.61s/it]
 74%|███████▍  | 28229/37963 [67:46:20<25:49:01,  9.55s/it]
 74%|███████▍  | 28230/37963 [67:46:28<24:16:06,  8.98s/it]
                                                           
{'loss': '0.1186', 'grad_norm': '2.175', 'learning_rate': '3.255e-06', 'epoch': '0.7436'}

 74%|███████▍  | 28230/37963 [67:46:28<24:16:06,  8.98s/it]
 74%|███████▍  | 28231/37963 [67:46:35<23:05:24,  8.54s/it]
 74%|███████▍  | 28232/37963 [67:46:43<22:16:39,  8.24s/it]
 74%|███████▍  | 28233/37963 [67:46:57<26:50:06,  9.93s/it]
 74%|███████▍  | 28234/37963 [67:47:04<24:53:12,  9.21s/it]
 74%|███████▍  | 28235/37963 [67:47:12<23:33:29,  8.72s/it]
 74%|███████▍  | 28236/37963 [67:47:26<27:51:19, 10.31s/it]
 74%|███████▍  | 28237/37963 [67:47:40<30:47:22, 11.40s/it]
 74%|███████▍  | 28238/37963 [67:47:47<27:47:15, 10.29s/it]
 74%|███████▍  | 28239/37963 [67:47:55<25:23:26,  9.40s/it]
 74%|███████▍  | 28240/37963 [67:48:02<23:56:28,  8.86s/it]
                                                           
{'loss': '0.09835', 'grad_norm': '1.934', 'learning_rate': '3.248e-06', 'epoch': '0.7439'}

 74%|███████▍  | 28240/37963 [67:48:02<23:56:28,  8.86s/it]
 74%|███████▍  | 28241/37963 [67:48:10<22:55:53,  8.49s/it]
 74%|███████▍  | 28242/37963 [67:48:18<22:14:16,  8.24s/it]
 74%|███████▍  | 28243/37963 [67:48:25<21:25:05,  7.93s/it]
 74%|███████▍  | 28244/37963 [67:48:32<21:07:27,  7.82s/it]
 74%|███████▍  | 28245/37963 [67:48:40<21:02:42,  7.80s/it]
 74%|███████▍  | 28246/37963 [67:48:48<20:54:16,  7.74s/it]
 74%|███████▍  | 28247/37963 [67:48:55<20:36:44,  7.64s/it]
 74%|███████▍  | 28248/37963 [67:49:03<20:31:44,  7.61s/it]
 74%|███████▍  | 28249/37963 [67:49:10<20:10:28,  7.48s/it]
 74%|███████▍  | 28250/37963 [67:49:17<20:12:34,  7.49s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '1.845', 'learning_rate': '3.242e-06', 'epoch': '0.7441'}

 74%|███████▍  | 28250/37963 [67:49:17<20:12:34,  7.49s/it]
 74%|███████▍  | 28251/37963 [67:49:25<20:17:53,  7.52s/it]
 74%|███████▍  | 28252/37963 [67:49:32<20:16:41,  7.52s/it]
 74%|███████▍  | 28253/37963 [67:49:40<20:19:32,  7.54s/it]
 74%|███████▍  | 28254/37963 [67:49:48<20:21:04,  7.55s/it]
 74%|███████▍  | 28255/37963 [67:49:55<20:18:21,  7.53s/it]
 74%|███████▍  | 28256/37963 [67:50:02<20:00:57,  7.42s/it]
 74%|███████▍  | 28257/37963 [67:50:16<25:20:22,  9.40s/it]
 74%|███████▍  | 28258/37963 [67:50:30<29:03:07, 10.78s/it]
 74%|███████▍  | 28259/37963 [67:50:38<26:30:59,  9.84s/it]
 74%|███████▍  | 28260/37963 [67:50:45<24:32:32,  9.11s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '2.391', 'learning_rate': '3.236e-06', 'epoch': '0.7444'}

 74%|███████▍  | 28260/37963 [67:50:45<24:32:32,  9.11s/it]
 74%|███████▍  | 28261/37963 [67:50:53<23:22:37,  8.67s/it]
 74%|███████▍  | 28262/37963 [67:51:07<27:37:41, 10.25s/it]
 74%|███████▍  | 28263/37963 [67:51:14<25:23:38,  9.42s/it]
 74%|███████▍  | 28264/37963 [67:51:22<23:49:44,  8.84s/it]
 74%|███████▍  | 28265/37963 [67:51:29<22:45:53,  8.45s/it]
 74%|███████▍  | 28266/37963 [67:51:43<27:13:43, 10.11s/it]
 74%|███████▍  | 28267/37963 [67:51:51<25:19:00,  9.40s/it]
 74%|███████▍  | 28268/37963 [67:51:59<23:49:18,  8.85s/it]
 74%|███████▍  | 28269/37963 [67:52:06<22:37:28,  8.40s/it]
 74%|███████▍  | 28270/37963 [67:52:13<21:52:23,  8.12s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '1.82', 'learning_rate': '3.229e-06', 'epoch': '0.7447'}

 74%|███████▍  | 28270/37963 [67:52:14<21:52:23,  8.12s/it]
 74%|███████▍  | 28271/37963 [67:52:21<21:26:39,  7.97s/it]
 74%|███████▍  | 28272/37963 [67:52:29<21:13:15,  7.88s/it]
 74%|███████▍  | 28273/37963 [67:52:36<20:56:09,  7.78s/it]
 74%|███████▍  | 28274/37963 [67:52:44<20:44:02,  7.70s/it]
 74%|███████▍  | 28275/37963 [67:52:51<20:35:43,  7.65s/it]
 74%|███████▍  | 28276/37963 [67:52:59<20:26:16,  7.60s/it]
 74%|███████▍  | 28277/37963 [67:53:06<20:24:32,  7.59s/it]
 74%|███████▍  | 28278/37963 [67:53:14<20:23:32,  7.58s/it]
 74%|███████▍  | 28279/37963 [67:53:21<20:20:02,  7.56s/it]
 74%|███████▍  | 28280/37963 [67:53:29<20:12:57,  7.52s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '1.686', 'learning_rate': '3.223e-06', 'epoch': '0.7449'}

 74%|███████▍  | 28280/37963 [67:53:29<20:12:57,  7.52s/it]
 74%|███████▍  | 28281/37963 [67:53:36<19:47:47,  7.36s/it]
 74%|███████▍  | 28282/37963 [67:53:44<20:03:10,  7.46s/it]
 75%|███████▍  | 28283/37963 [67:54:04<30:27:44, 11.33s/it]
 75%|███████▍  | 28284/37963 [67:54:11<27:22:51, 10.18s/it]
 75%|███████▍  | 28285/37963 [67:54:32<35:48:13, 13.32s/it]
 75%|███████▍  | 28286/37963 [67:54:40<31:08:23, 11.58s/it]
 75%|███████▍  | 28287/37963 [67:54:47<27:50:16, 10.36s/it]
 75%|███████▍  | 28288/37963 [67:54:55<25:43:01,  9.57s/it]
 75%|███████▍  | 28289/37963 [67:55:02<23:34:57,  8.78s/it]
 75%|███████▍  | 28290/37963 [67:55:09<22:16:57,  8.29s/it]
                                                           
{'loss': '0.1124', 'grad_norm': '3.011', 'learning_rate': '3.217e-06', 'epoch': '0.7452'}

 75%|███████▍  | 28290/37963 [67:55:09<22:16:57,  8.29s/it]
 75%|███████▍  | 28291/37963 [67:55:16<21:26:29,  7.98s/it]
 75%|███████▍  | 28292/37963 [67:55:24<21:05:45,  7.85s/it]
 75%|███████▍  | 28293/37963 [67:55:31<20:50:26,  7.76s/it]
 75%|███████▍  | 28294/37963 [67:55:39<20:34:55,  7.66s/it]
 75%|███████▍  | 28295/37963 [67:55:46<20:37:19,  7.68s/it]
 75%|███████▍  | 28296/37963 [67:55:54<20:27:59,  7.62s/it]
 75%|███████▍  | 28297/37963 [67:56:02<20:25:47,  7.61s/it]
 75%|███████▍  | 28298/37963 [67:56:09<20:25:40,  7.61s/it]
 75%|███████▍  | 28299/37963 [67:56:16<20:08:51,  7.51s/it]
 75%|███████▍  | 28300/37963 [67:56:24<19:57:59,  7.44s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '4.366', 'learning_rate': '3.211e-06', 'epoch': '0.7455'}

 75%|███████▍  | 28300/37963 [67:56:24<19:57:59,  7.44s/it]
 75%|███████▍  | 28301/37963 [67:56:31<20:02:30,  7.47s/it]
 75%|███████▍  | 28302/37963 [67:56:39<20:11:35,  7.52s/it]
 75%|███████▍  | 28303/37963 [67:56:53<25:26:32,  9.48s/it]
 75%|███████▍  | 28304/37963 [67:57:00<23:39:10,  8.82s/it]
 75%|███████▍  | 28305/37963 [67:57:08<22:41:00,  8.46s/it]
 75%|███████▍  | 28306/37963 [67:57:15<22:00:52,  8.21s/it]
 75%|███████▍  | 28307/37963 [67:57:23<21:27:25,  8.00s/it]
 75%|███████▍  | 28308/37963 [67:57:30<21:03:49,  7.85s/it]
 75%|███████▍  | 28309/37963 [67:57:44<25:57:55,  9.68s/it]
 75%|███████▍  | 28310/37963 [67:57:58<29:18:36, 10.93s/it]
                                                           
{'loss': '0.1187', 'grad_norm': '1.946', 'learning_rate': '3.204e-06', 'epoch': '0.7457'}

 75%|███████▍  | 28310/37963 [67:57:58<29:18:36, 10.93s/it]
 75%|███████▍  | 28311/37963 [67:58:06<26:31:56,  9.90s/it]
 75%|███████▍  | 28312/37963 [67:58:13<24:36:22,  9.18s/it]
 75%|███████▍  | 28313/37963 [67:58:27<28:24:15, 10.60s/it]
 75%|███████▍  | 28314/37963 [67:58:35<26:01:20,  9.71s/it]
 75%|███████▍  | 28315/37963 [67:58:42<24:18:39,  9.07s/it]
 75%|███████▍  | 28316/37963 [67:58:50<23:04:35,  8.61s/it]
 75%|███████▍  | 28317/37963 [67:58:57<22:11:50,  8.28s/it]
 75%|███████▍  | 28318/37963 [67:59:05<21:35:18,  8.06s/it]
 75%|███████▍  | 28319/37963 [67:59:12<21:02:34,  7.86s/it]
 75%|███████▍  | 28320/37963 [67:59:20<20:44:58,  7.75s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '2.419', 'learning_rate': '3.198e-06', 'epoch': '0.746'}

 75%|███████▍  | 28320/37963 [67:59:20<20:44:58,  7.75s/it]
 75%|███████▍  | 28321/37963 [67:59:27<20:34:12,  7.68s/it]
 75%|███████▍  | 28322/37963 [67:59:35<20:26:49,  7.64s/it]
 75%|███████▍  | 28323/37963 [67:59:42<20:13:19,  7.55s/it]
 75%|███████▍  | 28324/37963 [67:59:50<20:16:19,  7.57s/it]
 75%|███████▍  | 28325/37963 [67:59:57<20:08:44,  7.52s/it]
 75%|███████▍  | 28326/37963 [68:00:05<20:15:42,  7.57s/it]
 75%|███████▍  | 28327/37963 [68:00:12<20:02:39,  7.49s/it]
 75%|███████▍  | 28328/37963 [68:00:20<19:57:10,  7.46s/it]
 75%|███████▍  | 28329/37963 [68:00:27<20:05:01,  7.50s/it]
 75%|███████▍  | 28330/37963 [68:00:35<20:01:03,  7.48s/it]
                                                           
{'loss': '0.1191', 'grad_norm': '1.883', 'learning_rate': '3.192e-06', 'epoch': '0.7463'}

 75%|███████▍  | 28330/37963 [68:00:35<20:01:03,  7.48s/it]
 75%|███████▍  | 28331/37963 [68:00:42<20:04:58,  7.51s/it]
 75%|███████▍  | 28332/37963 [68:01:02<30:19:50, 11.34s/it]
 75%|███████▍  | 28333/37963 [68:01:10<27:16:28, 10.20s/it]
 75%|███████▍  | 28334/37963 [68:01:18<25:06:54,  9.39s/it]
 75%|███████▍  | 28335/37963 [68:01:25<23:37:00,  8.83s/it]
 75%|███████▍  | 28336/37963 [68:01:32<22:21:37,  8.36s/it]
 75%|███████▍  | 28337/37963 [68:01:46<26:59:48, 10.10s/it]
 75%|███████▍  | 28338/37963 [68:01:54<24:54:07,  9.31s/it]
 75%|███████▍  | 28339/37963 [68:02:08<28:50:09, 10.79s/it]
 75%|███████▍  | 28340/37963 [68:02:16<26:11:24,  9.80s/it]
                                                           
{'loss': '0.1204', 'grad_norm': '2.089', 'learning_rate': '3.186e-06', 'epoch': '0.7465'}

 75%|███████▍  | 28340/37963 [68:02:16<26:11:24,  9.80s/it]
 75%|███████▍  | 28341/37963 [68:02:23<24:26:54,  9.15s/it]
 75%|███████▍  | 28342/37963 [68:02:31<23:12:43,  8.69s/it]
 75%|███████▍  | 28343/37963 [68:02:38<22:12:03,  8.31s/it]
 75%|███████▍  | 28344/37963 [68:02:46<21:19:01,  7.98s/it]
 75%|███████▍  | 28345/37963 [68:02:53<20:56:36,  7.84s/it]
 75%|███████▍  | 28346/37963 [68:03:01<20:43:18,  7.76s/it]
 75%|███████▍  | 28347/37963 [68:03:08<20:35:22,  7.71s/it]
 75%|███████▍  | 28348/37963 [68:03:16<20:30:17,  7.68s/it]
 75%|███████▍  | 28349/37963 [68:03:23<20:25:46,  7.65s/it]
 75%|███████▍  | 28350/37963 [68:03:31<20:24:24,  7.64s/it]
                                                           
{'loss': '0.1163', 'grad_norm': '2.305', 'learning_rate': '3.179e-06', 'epoch': '0.7468'}

 75%|███████▍  | 28350/37963 [68:03:31<20:24:24,  7.64s/it]
 75%|███████▍  | 28351/37963 [68:03:45<25:24:05,  9.51s/it]
 75%|███████▍  | 28352/37963 [68:03:53<23:54:00,  8.95s/it]
 75%|███████▍  | 28353/37963 [68:04:00<22:43:39,  8.51s/it]
 75%|███████▍  | 28354/37963 [68:04:08<21:59:17,  8.24s/it]
 75%|███████▍  | 28355/37963 [68:04:15<21:31:55,  8.07s/it]
 75%|███████▍  | 28356/37963 [68:04:23<21:10:33,  7.94s/it]
 75%|███████▍  | 28357/37963 [68:04:30<20:34:20,  7.71s/it]
 75%|███████▍  | 28358/37963 [68:04:38<20:36:18,  7.72s/it]
 75%|███████▍  | 28359/37963 [68:04:45<20:26:45,  7.66s/it]
 75%|███████▍  | 28360/37963 [68:04:53<20:24:26,  7.65s/it]
                                                           
{'loss': '0.1099', 'grad_norm': '2.287', 'learning_rate': '3.173e-06', 'epoch': '0.747'}

 75%|███████▍  | 28360/37963 [68:04:53<20:24:26,  7.65s/it]
 75%|███████▍  | 28361/37963 [68:05:07<25:20:36,  9.50s/it]
 75%|███████▍  | 28362/37963 [68:05:21<28:57:50, 10.86s/it]
 75%|███████▍  | 28363/37963 [68:05:28<26:15:00,  9.84s/it]
 75%|███████▍  | 28364/37963 [68:05:36<24:30:31,  9.19s/it]
 75%|███████▍  | 28365/37963 [68:05:44<23:12:57,  8.71s/it]
 75%|███████▍  | 28366/37963 [68:05:58<27:26:02, 10.29s/it]
 75%|███████▍  | 28367/37963 [68:06:05<25:22:24,  9.52s/it]
 75%|███████▍  | 28368/37963 [68:06:13<23:44:30,  8.91s/it]
 75%|███████▍  | 28369/37963 [68:06:20<22:23:38,  8.40s/it]
 75%|███████▍  | 28370/37963 [68:06:28<21:42:38,  8.15s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '1.8', 'learning_rate': '3.167e-06', 'epoch': '0.7473'}

 75%|███████▍  | 28370/37963 [68:06:28<21:42:38,  8.15s/it]
 75%|███████▍  | 28371/37963 [68:06:35<21:16:47,  7.99s/it]
 75%|███████▍  | 28372/37963 [68:06:43<20:47:14,  7.80s/it]
 75%|███████▍  | 28373/37963 [68:06:50<20:26:40,  7.67s/it]
 75%|███████▍  | 28374/37963 [68:06:57<20:05:50,  7.55s/it]
 75%|███████▍  | 28375/37963 [68:07:05<20:06:12,  7.55s/it]
 75%|███████▍  | 28376/37963 [68:07:19<25:16:26,  9.49s/it]
 75%|███████▍  | 28377/37963 [68:07:26<23:42:27,  8.90s/it]
 75%|███████▍  | 28378/37963 [68:07:34<22:39:23,  8.51s/it]
 75%|███████▍  | 28379/37963 [68:07:41<21:55:20,  8.23s/it]
 75%|███████▍  | 28380/37963 [68:07:49<21:18:11,  8.00s/it]
                                                           
{'loss': '0.1122', 'grad_norm': '1.53', 'learning_rate': '3.161e-06', 'epoch': '0.7476'}

 75%|███████▍  | 28380/37963 [68:07:49<21:18:11,  8.00s/it]
 75%|███████▍  | 28381/37963 [68:07:57<21:01:29,  7.90s/it]
 75%|███████▍  | 28382/37963 [68:08:04<20:45:51,  7.80s/it]
 75%|███████▍  | 28383/37963 [68:08:18<25:37:02,  9.63s/it]
 75%|███████▍  | 28384/37963 [68:08:32<28:55:40, 10.87s/it]
 75%|███████▍  | 28385/37963 [68:08:46<31:26:20, 11.82s/it]
 75%|███████▍  | 28386/37963 [68:08:53<27:55:43, 10.50s/it]
 75%|███████▍  | 28387/37963 [68:09:01<25:31:49,  9.60s/it]
 75%|███████▍  | 28388/37963 [68:09:08<23:46:34,  8.94s/it]
 75%|███████▍  | 28389/37963 [68:09:16<22:36:38,  8.50s/it]
 75%|███████▍  | 28390/37963 [68:09:23<21:48:48,  8.20s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '2.31', 'learning_rate': '3.154e-06', 'epoch': '0.7478'}

 75%|███████▍  | 28390/37963 [68:09:23<21:48:48,  8.20s/it]
 75%|███████▍  | 28391/37963 [68:09:31<21:17:03,  8.00s/it]
 75%|███████▍  | 28392/37963 [68:09:38<21:03:30,  7.92s/it]
 75%|███████▍  | 28393/37963 [68:09:46<20:46:02,  7.81s/it]
 75%|███████▍  | 28394/37963 [68:09:54<20:36:26,  7.75s/it]
 75%|███████▍  | 28395/37963 [68:10:01<20:23:38,  7.67s/it]
 75%|███████▍  | 28396/37963 [68:10:09<20:18:19,  7.64s/it]
 75%|███████▍  | 28397/37963 [68:10:16<20:10:27,  7.59s/it]
 75%|███████▍  | 28398/37963 [68:10:24<20:06:49,  7.57s/it]
 75%|███████▍  | 28399/37963 [68:10:31<20:06:08,  7.57s/it]
 75%|███████▍  | 28400/37963 [68:10:38<19:53:24,  7.49s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.918', 'learning_rate': '3.148e-06', 'epoch': '0.7481'}

 75%|███████▍  | 28400/37963 [68:10:38<19:53:24,  7.49s/it]
 75%|███████▍  | 28401/37963 [68:10:46<19:48:41,  7.46s/it]
 75%|███████▍  | 28402/37963 [68:10:53<19:46:40,  7.45s/it]
 75%|███████▍  | 28403/37963 [68:11:01<19:49:34,  7.47s/it]
 75%|███████▍  | 28404/37963 [68:11:08<19:56:53,  7.51s/it]
 75%|███████▍  | 28405/37963 [68:11:23<25:18:52,  9.53s/it]
 75%|███████▍  | 28406/37963 [68:11:30<23:49:23,  8.97s/it]
 75%|███████▍  | 28407/37963 [68:11:38<22:34:50,  8.51s/it]
 75%|███████▍  | 28408/37963 [68:11:45<21:51:46,  8.24s/it]
 75%|███████▍  | 28409/37963 [68:12:00<26:36:22, 10.03s/it]
 75%|███████▍  | 28410/37963 [68:12:13<29:35:16, 11.15s/it]
                                                           
{'loss': '0.1081', 'grad_norm': '3.064', 'learning_rate': '3.142e-06', 'epoch': '0.7484'}

 75%|███████▍  | 28410/37963 [68:12:13<29:35:16, 11.15s/it]
 75%|███████▍  | 28411/37963 [68:12:27<31:47:17, 11.98s/it]
 75%|███████▍  | 28412/37963 [68:12:35<28:13:26, 10.64s/it]
 75%|███████▍  | 28413/37963 [68:12:42<25:50:21,  9.74s/it]
 75%|███████▍  | 28414/37963 [68:12:50<24:01:35,  9.06s/it]
 75%|███████▍  | 28415/37963 [68:12:57<22:49:40,  8.61s/it]
 75%|███████▍  | 28416/37963 [68:13:05<21:58:35,  8.29s/it]
 75%|███████▍  | 28417/37963 [68:13:13<21:27:22,  8.09s/it]
 75%|███████▍  | 28418/37963 [68:13:20<20:58:56,  7.91s/it]
 75%|███████▍  | 28419/37963 [68:13:28<20:40:56,  7.80s/it]
 75%|███████▍  | 28420/37963 [68:13:35<20:21:57,  7.68s/it]
                                                           
{'loss': '0.1142', 'grad_norm': '1.749', 'learning_rate': '3.136e-06', 'epoch': '0.7486'}

 75%|███████▍  | 28420/37963 [68:13:35<20:21:57,  7.68s/it]
 75%|███████▍  | 28421/37963 [68:13:43<20:13:10,  7.63s/it]
 75%|███████▍  | 28422/37963 [68:13:56<25:02:58,  9.45s/it]
 75%|███████▍  | 28423/37963 [68:14:04<23:34:10,  8.89s/it]
 75%|███████▍  | 28424/37963 [68:14:11<22:19:42,  8.43s/it]
 75%|███████▍  | 28425/37963 [68:14:19<21:36:10,  8.15s/it]
 75%|███████▍  | 28426/37963 [68:14:26<20:54:43,  7.89s/it]
 75%|███████▍  | 28427/37963 [68:14:34<20:41:00,  7.81s/it]
 75%|███████▍  | 28428/37963 [68:14:41<20:38:13,  7.79s/it]
 75%|███████▍  | 28429/37963 [68:14:49<20:25:58,  7.72s/it]
 75%|███████▍  | 28430/37963 [68:15:03<25:13:11,  9.52s/it]
                                                           
{'loss': '0.1197', 'grad_norm': '2.629', 'learning_rate': '3.13e-06', 'epoch': '0.7489'}

 75%|███████▍  | 28430/37963 [68:15:03<25:13:11,  9.52s/it]
 75%|███████▍  | 28431/37963 [68:15:16<28:29:04, 10.76s/it]
 75%|███████▍  | 28432/37963 [68:15:24<25:45:00,  9.73s/it]
 75%|███████▍  | 28433/37963 [68:15:31<23:53:22,  9.02s/it]
 75%|███████▍  | 28434/37963 [68:15:45<27:59:09, 10.57s/it]
 75%|███████▍  | 28435/37963 [68:15:53<25:41:11,  9.71s/it]
 75%|███████▍  | 28436/37963 [68:16:00<23:49:58,  9.01s/it]
 75%|███████▍  | 28437/37963 [68:16:08<22:41:56,  8.58s/it]
 75%|███████▍  | 28438/37963 [68:16:15<21:53:15,  8.27s/it]
 75%|███████▍  | 28439/37963 [68:16:23<21:18:27,  8.05s/it]
 75%|███████▍  | 28440/37963 [68:16:30<20:54:48,  7.91s/it]
                                                           
{'loss': '0.1122', 'grad_norm': '5.94', 'learning_rate': '3.123e-06', 'epoch': '0.7492'}

 75%|███████▍  | 28440/37963 [68:16:30<20:54:48,  7.91s/it]
 75%|███████▍  | 28441/37963 [68:16:38<20:35:55,  7.79s/it]
 75%|███████▍  | 28442/37963 [68:16:46<20:23:25,  7.71s/it]
 75%|███████▍  | 28443/37963 [68:16:53<20:15:55,  7.66s/it]
 75%|███████▍  | 28444/37963 [68:17:01<20:09:17,  7.62s/it]
 75%|███████▍  | 28445/37963 [68:17:08<20:05:12,  7.60s/it]
 75%|███████▍  | 28446/37963 [68:17:16<20:02:44,  7.58s/it]
 75%|███████▍  | 28447/37963 [68:17:23<19:58:03,  7.55s/it]
 75%|███████▍  | 28448/37963 [68:17:31<19:59:03,  7.56s/it]
 75%|███████▍  | 28449/37963 [68:17:38<19:48:48,  7.50s/it]
 75%|███████▍  | 28450/37963 [68:17:46<19:52:56,  7.52s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '3.034', 'learning_rate': '3.117e-06', 'epoch': '0.7494'}

 75%|███████▍  | 28450/37963 [68:17:46<19:52:56,  7.52s/it]
 75%|███████▍  | 28451/37963 [68:17:53<19:53:13,  7.53s/it]
 75%|███████▍  | 28452/37963 [68:18:01<19:59:42,  7.57s/it]
 75%|███████▍  | 28453/37963 [68:18:15<25:01:36,  9.47s/it]
 75%|███████▍  | 28454/37963 [68:18:22<23:27:51,  8.88s/it]
 75%|███████▍  | 28455/37963 [68:18:36<27:28:52, 10.41s/it]
 75%|███████▍  | 28456/37963 [68:18:44<25:13:47,  9.55s/it]
 75%|███████▍  | 28457/37963 [68:18:52<23:45:53,  9.00s/it]
 75%|███████▍  | 28458/37963 [68:19:05<27:41:28, 10.49s/it]
 75%|███████▍  | 28459/37963 [68:19:20<30:31:37, 11.56s/it]
 75%|███████▍  | 28460/37963 [68:19:27<27:19:33, 10.35s/it]
                                                           
{'loss': '0.08895', 'grad_norm': '2.191', 'learning_rate': '3.111e-06', 'epoch': '0.7497'}

 75%|███████▍  | 28460/37963 [68:19:27<27:19:33, 10.35s/it]
 75%|███████▍  | 28461/37963 [68:19:35<25:08:32,  9.53s/it]
 75%|███████▍  | 28462/37963 [68:19:42<23:35:31,  8.94s/it]
 75%|███████▍  | 28463/37963 [68:19:50<22:31:20,  8.53s/it]
 75%|███████▍  | 28464/37963 [68:19:57<21:45:42,  8.25s/it]
 75%|███████▍  | 28465/37963 [68:20:05<21:13:14,  8.04s/it]
 75%|███████▍  | 28466/37963 [68:20:12<20:42:09,  7.85s/it]
 75%|███████▍  | 28467/37963 [68:20:20<20:26:25,  7.75s/it]
 75%|███████▍  | 28468/37963 [68:20:27<20:07:05,  7.63s/it]
 75%|███████▍  | 28469/37963 [68:20:35<20:00:50,  7.59s/it]
 75%|███████▍  | 28470/37963 [68:20:42<19:42:32,  7.47s/it]
                                                           
{'loss': '0.1249', 'grad_norm': '1.93', 'learning_rate': '3.105e-06', 'epoch': '0.7499'}

 75%|███████▍  | 28470/37963 [68:20:42<19:42:32,  7.47s/it]
 75%|███████▍  | 28471/37963 [68:20:49<19:36:12,  7.43s/it]
 75%|███████▍  | 28472/37963 [68:20:57<19:40:21,  7.46s/it]
 75%|███████▌  | 28473/37963 [68:21:04<19:45:44,  7.50s/it]
 75%|███████▌  | 28474/37963 [68:21:18<24:55:32,  9.46s/it]
 75%|███████▌  | 28475/37963 [68:21:26<23:27:40,  8.90s/it]
 75%|███████▌  | 28476/37963 [68:21:33<22:12:09,  8.43s/it]
 75%|███████▌  | 28477/37963 [68:21:41<21:13:15,  8.05s/it]
 75%|███████▌  | 28478/37963 [68:21:54<25:46:20,  9.78s/it]
 75%|███████▌  | 28479/37963 [68:22:02<23:57:25,  9.09s/it]
 75%|███████▌  | 28480/37963 [68:22:09<22:48:43,  8.66s/it]
                                                           
{'loss': '0.1166', 'grad_norm': '2.077', 'learning_rate': '3.099e-06', 'epoch': '0.7502'}

 75%|███████▌  | 28480/37963 [68:22:09<22:48:43,  8.66s/it]
 75%|███████▌  | 28481/37963 [68:22:17<21:44:50,  8.26s/it]
 75%|███████▌  | 28482/37963 [68:22:24<21:11:31,  8.05s/it]
 75%|███████▌  | 28483/37963 [68:22:32<20:46:02,  7.89s/it]
 75%|███████▌  | 28484/37963 [68:22:46<25:34:33,  9.71s/it]
 75%|███████▌  | 28485/37963 [68:22:53<23:52:20,  9.07s/it]
 75%|███████▌  | 28486/37963 [68:23:01<22:38:45,  8.60s/it]
 75%|███████▌  | 28487/37963 [68:23:09<21:50:17,  8.30s/it]
 75%|███████▌  | 28488/37963 [68:23:16<21:14:49,  8.07s/it]
 75%|███████▌  | 28489/37963 [68:23:24<20:50:38,  7.92s/it]
 75%|███████▌  | 28490/37963 [68:23:31<20:26:55,  7.77s/it]
                                                           
{'loss': '0.1252', 'grad_norm': '2.453', 'learning_rate': '3.092e-06', 'epoch': '0.7505'}

 75%|███████▌  | 28490/37963 [68:23:31<20:26:55,  7.77s/it]
 75%|███████▌  | 28491/37963 [68:23:39<20:20:21,  7.73s/it]
 75%|███████▌  | 28492/37963 [68:23:46<20:14:18,  7.69s/it]
 75%|███████▌  | 28493/37963 [68:23:54<20:12:20,  7.68s/it]
 75%|███████▌  | 28494/37963 [68:24:02<20:10:05,  7.67s/it]
 75%|███████▌  | 28495/37963 [68:24:09<20:13:55,  7.69s/it]
 75%|███████▌  | 28496/37963 [68:24:17<20:00:17,  7.61s/it]
 75%|███████▌  | 28497/37963 [68:24:24<19:56:52,  7.59s/it]
 75%|███████▌  | 28498/37963 [68:24:32<19:50:54,  7.55s/it]
 75%|███████▌  | 28499/37963 [68:24:45<24:44:04,  9.41s/it]
 75%|███████▌  | 28500/37963 [68:24:53<23:13:25,  8.83s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '2.031', 'learning_rate': '3.086e-06', 'epoch': '0.7507'}

 75%|███████▌  | 28500/37963 [68:24:53<23:13:25,  8.83s/it]
 75%|███████▌  | 28501/37963 [68:25:01<22:12:32,  8.45s/it]
 75%|███████▌  | 28502/37963 [68:25:08<21:28:15,  8.17s/it]
 75%|███████▌  | 28503/37963 [68:25:29<31:10:10, 11.86s/it]
 75%|███████▌  | 28504/37963 [68:25:36<27:40:12, 10.53s/it]
 75%|███████▌  | 28505/37963 [68:25:43<25:17:34,  9.63s/it]
 75%|███████▌  | 28506/37963 [68:25:51<23:34:07,  8.97s/it]
 75%|███████▌  | 28507/37963 [68:26:05<27:20:50, 10.41s/it]
 75%|███████▌  | 28508/37963 [68:26:12<25:02:36,  9.54s/it]
 75%|███████▌  | 28509/37963 [68:26:20<23:34:55,  8.98s/it]
 75%|███████▌  | 28510/37963 [68:26:27<22:21:59,  8.52s/it]
                                                           
{'loss': '0.1241', 'grad_norm': '2.051', 'learning_rate': '3.08e-06', 'epoch': '0.751'}

 75%|███████▌  | 28510/37963 [68:26:27<22:21:59,  8.52s/it]
 75%|███████▌  | 28511/37963 [68:26:35<21:35:44,  8.23s/it]
 75%|███████▌  | 28512/37963 [68:26:42<21:02:16,  8.01s/it]
 75%|███████▌  | 28513/37963 [68:26:50<20:39:13,  7.87s/it]
 75%|███████▌  | 28514/37963 [68:26:57<20:25:12,  7.78s/it]
 75%|███████▌  | 28515/37963 [68:27:05<20:03:14,  7.64s/it]
 75%|███████▌  | 28516/37963 [68:27:12<19:58:16,  7.61s/it]
 75%|███████▌  | 28517/37963 [68:27:20<19:52:26,  7.57s/it]
 75%|███████▌  | 28518/37963 [68:27:27<19:51:28,  7.57s/it]
 75%|███████▌  | 28519/37963 [68:27:35<19:46:03,  7.54s/it]
 75%|███████▌  | 28520/37963 [68:27:49<24:46:35,  9.45s/it]
                                                           
{'loss': '0.09444', 'grad_norm': '2.437', 'learning_rate': '3.074e-06', 'epoch': '0.7513'}

 75%|███████▌  | 28520/37963 [68:27:49<24:46:35,  9.45s/it]
 75%|███████▌  | 28521/37963 [68:27:56<23:14:57,  8.86s/it]
 75%|███████▌  | 28522/37963 [68:28:04<22:10:58,  8.46s/it]
 75%|███████▌  | 28523/37963 [68:28:11<21:25:16,  8.17s/it]
 75%|███████▌  | 28524/37963 [68:28:19<20:55:06,  7.98s/it]
 75%|███████▌  | 28525/37963 [68:28:26<20:27:10,  7.80s/it]
 75%|███████▌  | 28526/37963 [68:28:34<20:10:41,  7.70s/it]
 75%|███████▌  | 28527/37963 [68:28:41<20:11:45,  7.71s/it]
 75%|███████▌  | 28528/37963 [68:28:55<25:10:20,  9.60s/it]
 75%|███████▌  | 28529/37963 [68:29:03<23:26:31,  8.95s/it]
 75%|███████▌  | 28530/37963 [68:29:10<22:07:00,  8.44s/it]
                                                           
{'loss': '0.1168', 'grad_norm': '2.715', 'learning_rate': '3.068e-06', 'epoch': '0.7515'}

 75%|███████▌  | 28530/37963 [68:29:10<22:07:00,  8.44s/it]
 75%|███████▌  | 28531/37963 [68:29:18<21:20:24,  8.15s/it]
 75%|███████▌  | 28532/37963 [68:29:31<25:51:48,  9.87s/it]
 75%|███████▌  | 28533/37963 [68:29:39<24:01:03,  9.17s/it]
 75%|███████▌  | 28534/37963 [68:29:47<22:45:28,  8.69s/it]
 75%|███████▌  | 28535/37963 [68:29:54<21:54:34,  8.37s/it]
 75%|███████▌  | 28536/37963 [68:30:02<21:17:51,  8.13s/it]
 75%|███████▌  | 28537/37963 [68:30:09<20:49:37,  7.95s/it]
 75%|███████▌  | 28538/37963 [68:30:17<20:30:55,  7.84s/it]
 75%|███████▌  | 28539/37963 [68:30:31<25:19:41,  9.68s/it]
 75%|███████▌  | 28540/37963 [68:30:38<23:40:46,  9.05s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '2.656', 'learning_rate': '3.062e-06', 'epoch': '0.7518'}

 75%|███████▌  | 28540/37963 [68:30:38<23:40:46,  9.05s/it]
 75%|███████▌  | 28541/37963 [68:30:46<22:25:32,  8.57s/it]
 75%|███████▌  | 28542/37963 [68:30:54<21:47:27,  8.33s/it]
 75%|███████▌  | 28543/37963 [68:31:01<21:17:55,  8.14s/it]
 75%|███████▌  | 28544/37963 [68:31:09<20:44:26,  7.93s/it]
 75%|███████▌  | 28545/37963 [68:31:23<25:29:46,  9.75s/it]
 75%|███████▌  | 28546/37963 [68:31:30<23:34:30,  9.01s/it]
 75%|███████▌  | 28547/37963 [68:31:37<22:22:18,  8.55s/it]
 75%|███████▌  | 28548/37963 [68:31:45<21:36:27,  8.26s/it]
 75%|███████▌  | 28549/37963 [68:32:05<30:50:42, 11.80s/it]
 75%|███████▌  | 28550/37963 [68:32:13<27:36:57, 10.56s/it]
                                                           
{'loss': '0.1102', 'grad_norm': '1.486', 'learning_rate': '3.056e-06', 'epoch': '0.7521'}

 75%|███████▌  | 28550/37963 [68:32:13<27:36:57, 10.56s/it]
 75%|███████▌  | 28551/37963 [68:32:27<30:28:31, 11.66s/it]
 75%|███████▌  | 28552/37963 [68:32:35<27:21:09, 10.46s/it]
 75%|███████▌  | 28553/37963 [68:32:42<25:01:10,  9.57s/it]
 75%|███████▌  | 28554/37963 [68:32:50<23:25:10,  8.96s/it]
 75%|███████▌  | 28555/37963 [68:32:57<22:13:19,  8.50s/it]
 75%|███████▌  | 28556/37963 [68:33:04<21:09:58,  8.10s/it]
 75%|███████▌  | 28557/37963 [68:33:12<20:51:17,  7.98s/it]
 75%|███████▌  | 28558/37963 [68:33:20<20:42:23,  7.93s/it]
 75%|███████▌  | 28559/37963 [68:33:27<20:27:32,  7.83s/it]
 75%|███████▌  | 28560/37963 [68:33:35<20:16:32,  7.76s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '4.04', 'learning_rate': '3.049e-06', 'epoch': '0.7523'}

 75%|███████▌  | 28560/37963 [68:33:35<20:16:32,  7.76s/it]
 75%|███████▌  | 28561/37963 [68:33:42<19:49:55,  7.59s/it]
 75%|███████▌  | 28562/37963 [68:33:50<19:50:00,  7.60s/it]
 75%|███████▌  | 28563/37963 [68:33:57<19:43:51,  7.56s/it]
 75%|███████▌  | 28564/37963 [68:34:05<19:46:15,  7.57s/it]
 75%|███████▌  | 28565/37963 [68:34:12<19:36:29,  7.51s/it]
 75%|███████▌  | 28566/37963 [68:34:20<19:37:11,  7.52s/it]
 75%|███████▌  | 28567/37963 [68:34:34<24:45:06,  9.48s/it]
 75%|███████▌  | 28568/37963 [68:34:41<23:15:11,  8.91s/it]
 75%|███████▌  | 28569/37963 [68:34:49<22:16:06,  8.53s/it]
 75%|███████▌  | 28570/37963 [68:34:57<21:28:00,  8.23s/it]
                                                           
{'loss': '0.1114', 'grad_norm': '3.673', 'learning_rate': '3.043e-06', 'epoch': '0.7526'}

 75%|███████▌  | 28570/37963 [68:34:57<21:28:00,  8.23s/it]
 75%|███████▌  | 28571/37963 [68:35:04<20:54:57,  8.02s/it]
 75%|███████▌  | 28572/37963 [68:35:12<20:30:30,  7.86s/it]
 75%|███████▌  | 28573/37963 [68:35:19<20:09:48,  7.73s/it]
 75%|███████▌  | 28574/37963 [68:35:26<19:55:51,  7.64s/it]
 75%|███████▌  | 28575/37963 [68:35:34<19:53:53,  7.63s/it]
 75%|███████▌  | 28576/37963 [68:35:42<19:51:32,  7.62s/it]
 75%|███████▌  | 28577/37963 [68:35:49<19:52:36,  7.62s/it]
 75%|███████▌  | 28578/37963 [68:35:57<19:49:04,  7.60s/it]
 75%|███████▌  | 28579/37963 [68:36:11<24:50:07,  9.53s/it]
 75%|███████▌  | 28580/37963 [68:36:19<23:25:24,  8.99s/it]
                                                           
{'loss': '0.1063', 'grad_norm': '2.963', 'learning_rate': '3.037e-06', 'epoch': '0.7528'}

 75%|███████▌  | 28580/37963 [68:36:19<23:25:24,  8.99s/it]
 75%|███████▌  | 28581/37963 [68:36:33<27:35:31, 10.59s/it]
 75%|███████▌  | 28582/37963 [68:36:40<25:05:53,  9.63s/it]
 75%|███████▌  | 28583/37963 [68:36:54<28:33:06, 10.96s/it]
 75%|███████▌  | 28584/37963 [68:37:02<25:52:05,  9.93s/it]
 75%|███████▌  | 28585/37963 [68:37:10<24:06:14,  9.25s/it]
 75%|███████▌  | 28586/37963 [68:37:17<22:42:40,  8.72s/it]
 75%|███████▌  | 28587/37963 [68:37:25<21:47:01,  8.36s/it]
 75%|███████▌  | 28588/37963 [68:37:32<21:08:06,  8.12s/it]
 75%|███████▌  | 28589/37963 [68:37:40<20:39:19,  7.93s/it]
 75%|███████▌  | 28590/37963 [68:37:47<20:17:40,  7.79s/it]
                                                           
{'loss': '0.115', 'grad_norm': '3.408', 'learning_rate': '3.031e-06', 'epoch': '0.7531'}

 75%|███████▌  | 28590/37963 [68:37:47<20:17:40,  7.79s/it]
 75%|███████▌  | 28591/37963 [68:37:55<20:02:30,  7.70s/it]
 75%|███████▌  | 28592/37963 [68:38:02<19:54:42,  7.65s/it]
 75%|███████▌  | 28593/37963 [68:38:10<19:48:43,  7.61s/it]
 75%|███████▌  | 28594/37963 [68:38:17<19:32:49,  7.51s/it]
 75%|███████▌  | 28595/37963 [68:38:31<24:34:18,  9.44s/it]
 75%|███████▌  | 28596/37963 [68:38:38<23:05:55,  8.88s/it]
 75%|███████▌  | 28597/37963 [68:38:46<21:53:50,  8.42s/it]
 75%|███████▌  | 28598/37963 [68:39:00<26:03:36, 10.02s/it]
 75%|███████▌  | 28599/37963 [68:39:14<29:13:25, 11.24s/it]
 75%|███████▌  | 28600/37963 [68:39:28<31:23:24, 12.07s/it]
                                                           
{'loss': '0.115', 'grad_norm': '2.427', 'learning_rate': '3.025e-06', 'epoch': '0.7534'}

 75%|███████▌  | 28600/37963 [68:39:28<31:23:24, 12.07s/it]
 75%|███████▌  | 28601/37963 [68:39:35<27:46:19, 10.68s/it]
 75%|███████▌  | 28602/37963 [68:39:43<25:15:39,  9.71s/it]
 75%|███████▌  | 28603/37963 [68:39:50<23:40:09,  9.10s/it]
 75%|███████▌  | 28604/37963 [68:39:58<22:32:26,  8.67s/it]
 75%|███████▌  | 28605/37963 [68:40:05<21:38:51,  8.33s/it]
 75%|███████▌  | 28606/37963 [68:40:13<21:03:13,  8.10s/it]
 75%|███████▌  | 28607/37963 [68:40:20<20:35:17,  7.92s/it]
 75%|███████▌  | 28608/37963 [68:40:28<20:20:54,  7.83s/it]
 75%|███████▌  | 28609/37963 [68:40:35<19:53:44,  7.66s/it]
 75%|███████▌  | 28610/37963 [68:40:43<19:38:30,  7.56s/it]
                                                           
{'loss': '0.0947', 'grad_norm': '1.939', 'learning_rate': '3.019e-06', 'epoch': '0.7536'}

 75%|███████▌  | 28610/37963 [68:40:43<19:38:30,  7.56s/it]
 75%|███████▌  | 28611/37963 [68:40:50<19:36:07,  7.55s/it]
 75%|███████▌  | 28612/37963 [68:40:58<19:35:56,  7.55s/it]
 75%|███████▌  | 28613/37963 [68:41:05<19:39:59,  7.57s/it]
 75%|███████▌  | 28614/37963 [68:41:13<19:41:50,  7.58s/it]
 75%|███████▌  | 28615/37963 [68:41:20<19:31:51,  7.52s/it]
 75%|███████▌  | 28616/37963 [68:41:28<19:29:55,  7.51s/it]
 75%|███████▌  | 28617/37963 [68:41:42<24:39:46,  9.50s/it]
 75%|███████▌  | 28618/37963 [68:41:50<23:09:11,  8.92s/it]
 75%|███████▌  | 28619/37963 [68:41:57<22:06:29,  8.52s/it]
 75%|███████▌  | 28620/37963 [68:42:05<21:19:39,  8.22s/it]
                                                           
{'loss': '0.1071', 'grad_norm': '3.461', 'learning_rate': '3.013e-06', 'epoch': '0.7539'}

 75%|███████▌  | 28620/37963 [68:42:05<21:19:39,  8.22s/it]
 75%|███████▌  | 28621/37963 [68:42:12<20:46:36,  8.01s/it]
 75%|███████▌  | 28622/37963 [68:42:20<20:28:37,  7.89s/it]
 75%|███████▌  | 28623/37963 [68:42:27<20:11:21,  7.78s/it]
 75%|███████▌  | 28624/37963 [68:42:35<20:00:02,  7.71s/it]
 75%|███████▌  | 28625/37963 [68:42:49<24:41:59,  9.52s/it]
 75%|███████▌  | 28626/37963 [68:43:02<28:06:35, 10.84s/it]
 75%|███████▌  | 28627/37963 [68:43:17<30:44:14, 11.85s/it]
 75%|███████▌  | 28628/37963 [68:43:24<27:21:27, 10.55s/it]
 75%|███████▌  | 28629/37963 [68:43:32<24:58:35,  9.63s/it]
 75%|███████▌  | 28630/37963 [68:43:39<23:27:56,  9.05s/it]
                                                           
{'loss': '0.1093', 'grad_norm': '2.78', 'learning_rate': '3.007e-06', 'epoch': '0.7542'}

 75%|███████▌  | 28630/37963 [68:43:39<23:27:56,  9.05s/it]
 75%|███████▌  | 28631/37963 [68:43:47<22:03:35,  8.51s/it]
 75%|███████▌  | 28632/37963 [68:43:54<21:20:08,  8.23s/it]
 75%|███████▌  | 28633/37963 [68:44:02<20:56:10,  8.08s/it]
 75%|███████▌  | 28634/37963 [68:44:09<20:28:54,  7.90s/it]
 75%|███████▌  | 28635/37963 [68:44:17<20:18:38,  7.84s/it]
 75%|███████▌  | 28636/37963 [68:44:25<19:57:28,  7.70s/it]
 75%|███████▌  | 28637/37963 [68:44:32<19:50:58,  7.66s/it]
 75%|███████▌  | 28638/37963 [68:44:40<19:44:35,  7.62s/it]
 75%|███████▌  | 28639/37963 [68:44:47<19:26:10,  7.50s/it]
 75%|███████▌  | 28640/37963 [68:44:54<19:28:23,  7.52s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '2.96', 'learning_rate': '3e-06', 'epoch': '0.7544'}

 75%|███████▌  | 28640/37963 [68:44:54<19:28:23,  7.52s/it]
 75%|███████▌  | 28641/37963 [68:45:02<19:32:17,  7.55s/it]
 75%|███████▌  | 28642/37963 [68:45:10<19:29:36,  7.53s/it]
 75%|███████▌  | 28643/37963 [68:45:17<19:28:21,  7.52s/it]
 75%|███████▌  | 28644/37963 [68:45:24<19:25:05,  7.50s/it]
 75%|███████▌  | 28645/37963 [68:45:38<24:25:28,  9.44s/it]
 75%|███████▌  | 28646/37963 [68:45:52<27:53:50, 10.78s/it]
 75%|███████▌  | 28647/37963 [68:46:00<25:27:21,  9.84s/it]
 75%|███████▌  | 28648/37963 [68:46:08<23:40:52,  9.15s/it]
 75%|███████▌  | 28649/37963 [68:46:15<22:12:33,  8.58s/it]
 75%|███████▌  | 28650/37963 [68:46:22<21:24:19,  8.27s/it]
                                                           
{'loss': '0.126', 'grad_norm': '2.113', 'learning_rate': '2.994e-06', 'epoch': '0.7547'}

 75%|███████▌  | 28650/37963 [68:46:22<21:24:19,  8.27s/it]
 75%|███████▌  | 28651/37963 [68:46:30<20:56:52,  8.10s/it]
 75%|███████▌  | 28652/37963 [68:46:44<25:25:04,  9.83s/it]
 75%|███████▌  | 28653/37963 [68:46:58<28:37:49, 11.07s/it]
 75%|███████▌  | 28654/37963 [68:47:05<25:51:13, 10.00s/it]
 75%|███████▌  | 28655/37963 [68:47:13<23:53:19,  9.24s/it]
 75%|███████▌  | 28656/37963 [68:47:20<22:23:38,  8.66s/it]
 75%|███████▌  | 28657/37963 [68:47:28<21:31:36,  8.33s/it]
 75%|███████▌  | 28658/37963 [68:47:35<20:53:38,  8.08s/it]
 75%|███████▌  | 28659/37963 [68:47:43<20:29:43,  7.93s/it]
 75%|███████▌  | 28660/37963 [68:47:50<20:11:03,  7.81s/it]
                                                           
{'loss': '0.1052', 'grad_norm': '2.12', 'learning_rate': '2.988e-06', 'epoch': '0.7549'}

 75%|███████▌  | 28660/37963 [68:47:50<20:11:03,  7.81s/it]
 75%|███████▌  | 28661/37963 [68:47:58<20:00:36,  7.74s/it]
 75%|███████▌  | 28662/37963 [68:48:05<19:47:19,  7.66s/it]
 76%|███████▌  | 28663/37963 [68:48:19<24:23:49,  9.44s/it]
 76%|███████▌  | 28664/37963 [68:48:26<22:52:27,  8.86s/it]
 76%|███████▌  | 28665/37963 [68:48:34<21:51:37,  8.46s/it]
 76%|███████▌  | 28666/37963 [68:48:42<21:15:22,  8.23s/it]
 76%|███████▌  | 28667/37963 [68:48:49<20:44:08,  8.03s/it]
 76%|███████▌  | 28668/37963 [68:48:57<20:22:11,  7.89s/it]
 76%|███████▌  | 28669/37963 [68:49:04<20:06:53,  7.79s/it]
 76%|███████▌  | 28670/37963 [68:49:18<25:00:55,  9.69s/it]
                                                           
{'loss': '0.108', 'grad_norm': '2.45', 'learning_rate': '2.982e-06', 'epoch': '0.7552'}

 76%|███████▌  | 28670/37963 [68:49:18<25:00:55,  9.69s/it]
 76%|███████▌  | 28671/37963 [68:49:26<23:21:02,  9.05s/it]
 76%|███████▌  | 28672/37963 [68:49:33<21:59:07,  8.52s/it]
 76%|███████▌  | 28673/37963 [68:49:47<26:21:27, 10.21s/it]
 76%|███████▌  | 28674/37963 [68:49:55<24:04:15,  9.33s/it]
 76%|███████▌  | 28675/37963 [68:50:09<27:44:59, 10.76s/it]
 76%|███████▌  | 28676/37963 [68:50:16<25:13:27,  9.78s/it]
 76%|███████▌  | 28677/37963 [68:50:24<23:17:16,  9.03s/it]
 76%|███████▌  | 28678/37963 [68:50:31<22:12:01,  8.61s/it]
 76%|███████▌  | 28679/37963 [68:50:39<21:18:09,  8.26s/it]
 76%|███████▌  | 28680/37963 [68:50:46<20:45:14,  8.05s/it]
                                                           
{'loss': '0.1047', 'grad_norm': '2.306', 'learning_rate': '2.976e-06', 'epoch': '0.7555'}

 76%|███████▌  | 28680/37963 [68:50:46<20:45:14,  8.05s/it]
 76%|███████▌  | 28681/37963 [68:50:54<20:19:12,  7.88s/it]
 76%|███████▌  | 28682/37963 [68:51:01<20:01:10,  7.77s/it]
 76%|███████▌  | 28683/37963 [68:51:09<19:51:58,  7.71s/it]
 76%|███████▌  | 28684/37963 [68:51:16<19:50:03,  7.70s/it]
 76%|███████▌  | 28685/37963 [68:51:24<19:26:22,  7.54s/it]
 76%|███████▌  | 28686/37963 [68:51:31<19:24:38,  7.53s/it]
 76%|███████▌  | 28687/37963 [68:51:39<19:28:12,  7.56s/it]
 76%|███████▌  | 28688/37963 [68:51:46<19:22:57,  7.52s/it]
 76%|███████▌  | 28689/37963 [68:51:54<19:19:21,  7.50s/it]
 76%|███████▌  | 28690/37963 [68:52:01<19:20:41,  7.51s/it]
                                                           
{'loss': '0.09777', 'grad_norm': '2.481', 'learning_rate': '2.97e-06', 'epoch': '0.7557'}

 76%|███████▌  | 28690/37963 [68:52:01<19:20:41,  7.51s/it]
 76%|███████▌  | 28691/37963 [68:52:09<19:17:30,  7.49s/it]
 76%|███████▌  | 28692/37963 [68:52:16<19:19:40,  7.51s/it]
 76%|███████▌  | 28693/37963 [68:52:30<24:16:23,  9.43s/it]
 76%|███████▌  | 28694/37963 [68:52:38<22:50:35,  8.87s/it]
 76%|███████▌  | 28695/37963 [68:52:45<21:47:00,  8.46s/it]
 76%|███████▌  | 28696/37963 [68:52:53<21:02:10,  8.17s/it]
 76%|███████▌  | 28697/37963 [68:53:00<20:31:13,  7.97s/it]
 76%|███████▌  | 28698/37963 [68:53:08<20:09:26,  7.83s/it]
 76%|███████▌  | 28699/37963 [68:53:28<29:46:20, 11.57s/it]
 76%|███████▌  | 28700/37963 [68:53:36<26:45:49, 10.40s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '2.939', 'learning_rate': '2.964e-06', 'epoch': '0.756'}

 76%|███████▌  | 28700/37963 [68:53:36<26:45:49, 10.40s/it]
 76%|███████▌  | 28701/37963 [68:53:50<29:28:46, 11.46s/it]
 76%|███████▌  | 28702/37963 [68:53:57<26:27:58, 10.29s/it]
 76%|███████▌  | 28703/37963 [68:54:05<24:19:24,  9.46s/it]
 76%|███████▌  | 28704/37963 [68:54:12<22:51:15,  8.89s/it]
 76%|███████▌  | 28705/37963 [68:54:20<21:46:49,  8.47s/it]
 76%|███████▌  | 28706/37963 [68:54:27<21:04:26,  8.20s/it]
 76%|███████▌  | 28707/37963 [68:54:35<20:35:19,  8.01s/it]
 76%|███████▌  | 28708/37963 [68:54:49<25:10:35,  9.79s/it]
 76%|███████▌  | 28709/37963 [68:54:56<23:33:22,  9.16s/it]
 76%|███████▌  | 28710/37963 [68:55:04<22:23:58,  8.71s/it]
                                                           
{'loss': '0.1117', 'grad_norm': '2.941', 'learning_rate': '2.958e-06', 'epoch': '0.7563'}

 76%|███████▌  | 28710/37963 [68:55:04<22:23:58,  8.71s/it]
 76%|███████▌  | 28711/37963 [68:55:12<21:21:57,  8.31s/it]
 76%|███████▌  | 28712/37963 [68:55:19<20:47:09,  8.09s/it]
 76%|███████▌  | 28713/37963 [68:55:26<20:13:10,  7.87s/it]
 76%|███████▌  | 28714/37963 [68:55:34<19:53:09,  7.74s/it]
 76%|███████▌  | 28715/37963 [68:55:41<19:33:40,  7.61s/it]
 76%|███████▌  | 28716/37963 [68:55:49<19:29:45,  7.59s/it]
 76%|███████▌  | 28717/37963 [68:56:03<24:37:48,  9.59s/it]
 76%|███████▌  | 28718/37963 [68:56:11<23:07:14,  9.00s/it]
 76%|███████▌  | 28719/37963 [68:56:24<26:44:41, 10.42s/it]
 76%|███████▌  | 28720/37963 [68:56:32<24:32:10,  9.56s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '2.208', 'learning_rate': '2.952e-06', 'epoch': '0.7565'}

 76%|███████▌  | 28720/37963 [68:56:32<24:32:10,  9.56s/it]
 76%|███████▌  | 28721/37963 [68:56:39<22:58:45,  8.95s/it]
 76%|███████▌  | 28722/37963 [68:56:47<21:58:16,  8.56s/it]
 76%|███████▌  | 28723/37963 [68:56:54<20:57:56,  8.17s/it]
 76%|███████▌  | 28724/37963 [68:57:02<20:33:03,  8.01s/it]
 76%|███████▌  | 28725/37963 [68:57:16<25:02:10,  9.76s/it]
 76%|███████▌  | 28726/37963 [68:57:23<23:21:01,  9.10s/it]
 76%|███████▌  | 28727/37963 [68:57:31<22:12:02,  8.65s/it]
 76%|███████▌  | 28728/37963 [68:57:38<21:19:23,  8.31s/it]
 76%|███████▌  | 28729/37963 [68:57:46<20:35:01,  8.02s/it]
 76%|███████▌  | 28730/37963 [68:57:53<20:06:01,  7.84s/it]
                                                           
{'loss': '0.1164', 'grad_norm': '1.169', 'learning_rate': '2.946e-06', 'epoch': '0.7568'}

 76%|███████▌  | 28730/37963 [68:57:53<20:06:01,  7.84s/it]
 76%|███████▌  | 28731/37963 [68:58:01<19:55:43,  7.77s/it]
 76%|███████▌  | 28732/37963 [68:58:08<19:27:06,  7.59s/it]
 76%|███████▌  | 28733/37963 [68:58:16<19:22:48,  7.56s/it]
 76%|███████▌  | 28734/37963 [68:58:23<19:19:26,  7.54s/it]
 76%|███████▌  | 28735/37963 [68:58:31<19:23:40,  7.57s/it]
 76%|███████▌  | 28736/37963 [68:58:38<19:22:54,  7.56s/it]
 76%|███████▌  | 28737/37963 [68:58:45<19:05:32,  7.45s/it]
 76%|███████▌  | 28738/37963 [68:58:53<19:14:09,  7.51s/it]
 76%|███████▌  | 28739/37963 [68:59:01<19:16:47,  7.52s/it]
 76%|███████▌  | 28740/37963 [68:59:08<19:23:21,  7.57s/it]
                                                           
{'loss': '0.1201', 'grad_norm': '2.003', 'learning_rate': '2.94e-06', 'epoch': '0.7571'}

 76%|███████▌  | 28740/37963 [68:59:08<19:23:21,  7.57s/it]
 76%|███████▌  | 28741/37963 [68:59:22<24:11:22,  9.44s/it]
 76%|███████▌  | 28742/37963 [68:59:30<22:49:20,  8.91s/it]
 76%|███████▌  | 28743/37963 [68:59:37<21:41:41,  8.47s/it]
 76%|███████▌  | 28744/37963 [68:59:45<20:58:47,  8.19s/it]
 76%|███████▌  | 28745/37963 [68:59:52<20:30:05,  8.01s/it]
 76%|███████▌  | 28746/37963 [69:00:00<20:03:18,  7.83s/it]
 76%|███████▌  | 28747/37963 [69:00:14<24:41:49,  9.65s/it]
 76%|███████▌  | 28748/37963 [69:00:21<22:59:19,  8.98s/it]
 76%|███████▌  | 28749/37963 [69:00:35<26:47:17, 10.47s/it]
 76%|███████▌  | 28750/37963 [69:00:43<24:33:04,  9.59s/it]
                                                           
{'loss': '0.1091', 'grad_norm': '2.526', 'learning_rate': '2.934e-06', 'epoch': '0.7573'}

 76%|███████▌  | 28750/37963 [69:00:43<24:33:04,  9.59s/it]
 76%|███████▌  | 28751/37963 [69:00:56<27:38:17, 10.80s/it]
 76%|███████▌  | 28752/37963 [69:01:10<29:47:53, 11.65s/it]
 76%|███████▌  | 28753/37963 [69:01:17<26:43:43, 10.45s/it]
 76%|███████▌  | 28754/37963 [69:01:25<24:29:15,  9.57s/it]
 76%|███████▌  | 28755/37963 [69:01:32<22:55:44,  8.96s/it]
 76%|███████▌  | 28756/37963 [69:01:40<21:47:15,  8.52s/it]
 76%|███████▌  | 28757/37963 [69:01:47<21:00:00,  8.21s/it]
 76%|███████▌  | 28758/37963 [69:01:55<20:35:32,  8.05s/it]
 76%|███████▌  | 28759/37963 [69:02:03<20:03:38,  7.85s/it]
 76%|███████▌  | 28760/37963 [69:02:10<19:50:27,  7.76s/it]
                                                           
{'loss': '0.1159', 'grad_norm': '1.861', 'learning_rate': '2.928e-06', 'epoch': '0.7576'}

 76%|███████▌  | 28760/37963 [69:02:10<19:50:27,  7.76s/it]
 76%|███████▌  | 28761/37963 [69:02:17<19:27:45,  7.61s/it]
 76%|███████▌  | 28762/37963 [69:02:25<19:22:08,  7.58s/it]
 76%|███████▌  | 28763/37963 [69:02:32<19:19:54,  7.56s/it]
 76%|███████▌  | 28764/37963 [69:02:40<19:07:07,  7.48s/it]
 76%|███████▌  | 28765/37963 [69:02:47<19:07:53,  7.49s/it]
 76%|███████▌  | 28766/37963 [69:03:01<24:05:26,  9.43s/it]
 76%|███████▌  | 28767/37963 [69:03:09<22:40:42,  8.88s/it]
 76%|███████▌  | 28768/37963 [69:03:16<21:42:35,  8.50s/it]
 76%|███████▌  | 28769/37963 [69:03:37<30:45:36, 12.04s/it]
 76%|███████▌  | 28770/37963 [69:03:44<27:21:34, 10.71s/it]
                                                           
{'loss': '0.103', 'grad_norm': '1.86', 'learning_rate': '2.922e-06', 'epoch': '0.7578'}

 76%|███████▌  | 28770/37963 [69:03:44<27:21:34, 10.71s/it]
 76%|███████▌  | 28771/37963 [69:03:52<25:01:58,  9.80s/it]
 76%|███████▌  | 28772/37963 [69:03:59<23:05:05,  9.04s/it]
 76%|███████▌  | 28773/37963 [69:04:07<21:58:42,  8.61s/it]
 76%|███████▌  | 28774/37963 [69:04:14<21:05:26,  8.26s/it]
 76%|███████▌  | 28775/37963 [69:04:22<20:32:00,  8.05s/it]
 76%|███████▌  | 28776/37963 [69:04:29<19:54:22,  7.80s/it]
 76%|███████▌  | 28777/37963 [69:04:37<19:40:07,  7.71s/it]
 76%|███████▌  | 28778/37963 [69:04:44<19:29:26,  7.64s/it]
 76%|███████▌  | 28779/37963 [69:04:52<19:33:27,  7.67s/it]
 76%|███████▌  | 28780/37963 [69:04:59<19:25:28,  7.61s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '2.585', 'learning_rate': '2.916e-06', 'epoch': '0.7581'}

 76%|███████▌  | 28780/37963 [69:04:59<19:25:28,  7.61s/it]
 76%|███████▌  | 28781/37963 [69:05:07<19:21:06,  7.59s/it]
 76%|███████▌  | 28782/37963 [69:05:14<19:17:24,  7.56s/it]
 76%|███████▌  | 28783/37963 [69:05:22<19:10:11,  7.52s/it]
 76%|███████▌  | 28784/37963 [69:05:29<19:14:18,  7.55s/it]
 76%|███████▌  | 28785/37963 [69:05:37<19:01:47,  7.46s/it]
 76%|███████▌  | 28786/37963 [69:05:44<19:06:57,  7.50s/it]
 76%|███████▌  | 28787/37963 [69:05:52<19:10:12,  7.52s/it]
 76%|███████▌  | 28788/37963 [69:05:59<18:59:33,  7.45s/it]
 76%|███████▌  | 28789/37963 [69:06:06<18:52:32,  7.41s/it]
 76%|███████▌  | 28790/37963 [69:06:14<19:00:58,  7.46s/it]
                                                           
{'loss': '0.1136', 'grad_norm': '1.995', 'learning_rate': '2.91e-06', 'epoch': '0.7584'}

 76%|███████▌  | 28790/37963 [69:06:14<19:00:58,  7.46s/it]
 76%|███████▌  | 28791/37963 [69:06:21<19:03:01,  7.48s/it]
 76%|███████▌  | 28792/37963 [69:06:29<19:05:32,  7.49s/it]
 76%|███████▌  | 28793/37963 [69:06:36<19:06:16,  7.50s/it]
 76%|███████▌  | 28794/37963 [69:06:51<24:16:33,  9.53s/it]
 76%|███████▌  | 28795/37963 [69:07:05<27:40:42, 10.87s/it]
 76%|███████▌  | 28796/37963 [69:07:19<29:58:38, 11.77s/it]
 76%|███████▌  | 28797/37963 [69:07:26<26:32:16, 10.42s/it]
 76%|███████▌  | 28798/37963 [69:07:33<24:18:12,  9.55s/it]
 76%|███████▌  | 28799/37963 [69:07:48<27:55:54, 10.97s/it]
 76%|███████▌  | 28800/37963 [69:07:55<25:22:30,  9.97s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '1.901', 'learning_rate': '2.904e-06', 'epoch': '0.7586'}

 76%|███████▌  | 28800/37963 [69:07:55<25:22:30,  9.97s/it]
 76%|███████▌  | 28801/37963 [69:08:03<23:23:17,  9.19s/it]
 76%|███████▌  | 28802/37963 [69:08:10<22:06:40,  8.69s/it]
 76%|███████▌  | 28803/37963 [69:08:17<21:02:41,  8.27s/it]
 76%|███████▌  | 28804/37963 [69:08:25<20:30:03,  8.06s/it]
 76%|███████▌  | 28805/37963 [69:08:39<25:21:01,  9.97s/it]
 76%|███████▌  | 28806/37963 [69:08:47<23:28:25,  9.23s/it]
 76%|███████▌  | 28807/37963 [69:08:54<22:05:41,  8.69s/it]
 76%|███████▌  | 28808/37963 [69:09:02<21:14:33,  8.35s/it]
 76%|███████▌  | 28809/37963 [69:09:09<20:36:12,  8.10s/it]
 76%|███████▌  | 28810/37963 [69:09:17<20:09:45,  7.93s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.084', 'learning_rate': '2.898e-06', 'epoch': '0.7589'}

 76%|███████▌  | 28810/37963 [69:09:17<20:09:45,  7.93s/it]
 76%|███████▌  | 28811/37963 [69:09:24<19:46:47,  7.78s/it]
 76%|███████▌  | 28812/37963 [69:09:32<19:34:36,  7.70s/it]
 76%|███████▌  | 28813/37963 [69:09:46<24:08:28,  9.50s/it]
 76%|███████▌  | 28814/37963 [69:09:53<22:42:02,  8.93s/it]
 76%|███████▌  | 28815/37963 [69:10:07<26:29:30, 10.43s/it]
 76%|███████▌  | 28816/37963 [69:10:15<24:15:09,  9.55s/it]
 76%|███████▌  | 28817/37963 [69:10:22<22:37:44,  8.91s/it]
 76%|███████▌  | 28818/37963 [69:10:30<21:32:57,  8.48s/it]
 76%|███████▌  | 28819/37963 [69:10:37<20:53:55,  8.23s/it]
 76%|███████▌  | 28820/37963 [69:10:45<20:16:06,  7.98s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '2.782', 'learning_rate': '2.892e-06', 'epoch': '0.7592'}

 76%|███████▌  | 28820/37963 [69:10:45<20:16:06,  7.98s/it]
 76%|███████▌  | 28821/37963 [69:10:52<19:58:40,  7.87s/it]
 76%|███████▌  | 28822/37963 [69:11:06<24:44:47,  9.75s/it]
 76%|███████▌  | 28823/37963 [69:11:14<23:06:23,  9.10s/it]
 76%|███████▌  | 28824/37963 [69:11:21<21:54:08,  8.63s/it]
 76%|███████▌  | 28825/37963 [69:11:29<21:02:29,  8.29s/it]
 76%|███████▌  | 28826/37963 [69:11:37<20:29:44,  8.08s/it]
 76%|███████▌  | 28827/37963 [69:11:44<20:03:07,  7.90s/it]
 76%|███████▌  | 28828/37963 [69:11:52<19:46:43,  7.79s/it]
 76%|███████▌  | 28829/37963 [69:11:59<19:36:40,  7.73s/it]
 76%|███████▌  | 28830/37963 [69:12:07<19:34:27,  7.72s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '2.655', 'learning_rate': '2.886e-06', 'epoch': '0.7594'}

 76%|███████▌  | 28830/37963 [69:12:07<19:34:27,  7.72s/it]
 76%|███████▌  | 28831/37963 [69:12:14<19:23:22,  7.64s/it]
 76%|███████▌  | 28832/37963 [69:12:22<19:19:19,  7.62s/it]
 76%|███████▌  | 28833/37963 [69:12:29<19:15:21,  7.59s/it]
 76%|███████▌  | 28834/37963 [69:12:37<19:13:52,  7.58s/it]
 76%|███████▌  | 28835/37963 [69:12:44<19:05:32,  7.53s/it]
 76%|███████▌  | 28836/37963 [69:12:52<19:04:05,  7.52s/it]
 76%|███████▌  | 28837/37963 [69:12:59<18:52:34,  7.45s/it]
 76%|███████▌  | 28838/37963 [69:13:07<18:56:48,  7.47s/it]
 76%|███████▌  | 28839/37963 [69:13:14<19:06:56,  7.54s/it]
 76%|███████▌  | 28840/37963 [69:13:22<19:01:32,  7.51s/it]
                                                           
{'loss': '0.1132', 'grad_norm': '2.396', 'learning_rate': '2.88e-06', 'epoch': '0.7597'}

 76%|███████▌  | 28840/37963 [69:13:22<19:01:32,  7.51s/it]
 76%|███████▌  | 28841/37963 [69:13:29<19:02:40,  7.52s/it]
 76%|███████▌  | 28842/37963 [69:13:43<23:56:10,  9.45s/it]
 76%|███████▌  | 28843/37963 [69:13:57<27:28:05, 10.84s/it]
 76%|███████▌  | 28844/37963 [69:14:11<29:53:50, 11.80s/it]
 76%|███████▌  | 28845/37963 [69:14:19<26:33:10, 10.48s/it]
 76%|███████▌  | 28846/37963 [69:14:26<24:20:12,  9.61s/it]
 76%|███████▌  | 28847/37963 [69:14:34<22:46:23,  8.99s/it]
 76%|███████▌  | 28848/37963 [69:14:42<21:41:29,  8.57s/it]
 76%|███████▌  | 28849/37963 [69:14:49<20:58:39,  8.29s/it]
 76%|███████▌  | 28850/37963 [69:14:57<20:23:11,  8.05s/it]
                                                           
{'loss': '0.1106', 'grad_norm': '2.04', 'learning_rate': '2.874e-06', 'epoch': '0.76'}

 76%|███████▌  | 28850/37963 [69:14:57<20:23:11,  8.05s/it]
 76%|███████▌  | 28851/37963 [69:15:04<19:51:09,  7.84s/it]
 76%|███████▌  | 28852/37963 [69:15:18<24:31:06,  9.69s/it]
 76%|███████▌  | 28853/37963 [69:15:26<22:53:59,  9.05s/it]
 76%|███████▌  | 28854/37963 [69:15:40<26:38:54, 10.53s/it]
 76%|███████▌  | 28855/37963 [69:15:47<24:23:59,  9.64s/it]
 76%|███████▌  | 28856/37963 [69:15:55<22:45:52,  9.00s/it]
 76%|███████▌  | 28857/37963 [69:16:09<26:32:48, 10.50s/it]
 76%|███████▌  | 28858/37963 [69:16:16<24:17:44,  9.61s/it]
 76%|███████▌  | 28859/37963 [69:16:23<22:33:30,  8.92s/it]
 76%|███████▌  | 28860/37963 [69:16:31<21:29:55,  8.50s/it]
                                                           
{'loss': '0.1118', 'grad_norm': '2.106', 'learning_rate': '2.868e-06', 'epoch': '0.7602'}

 76%|███████▌  | 28860/37963 [69:16:31<21:29:55,  8.50s/it]
 76%|███████▌  | 28861/37963 [69:16:38<20:30:56,  8.11s/it]
 76%|███████▌  | 28862/37963 [69:16:46<20:02:03,  7.92s/it]
 76%|███████▌  | 28863/37963 [69:16:53<19:30:34,  7.72s/it]
 76%|███████▌  | 28864/37963 [69:17:00<19:14:19,  7.61s/it]
 76%|███████▌  | 28865/37963 [69:17:08<19:09:04,  7.58s/it]
 76%|███████▌  | 28866/37963 [69:17:15<19:05:25,  7.55s/it]
 76%|███████▌  | 28867/37963 [69:17:23<19:03:59,  7.55s/it]
 76%|███████▌  | 28868/37963 [69:17:30<18:48:43,  7.45s/it]
 76%|███████▌  | 28869/37963 [69:17:50<28:15:52, 11.19s/it]
 76%|███████▌  | 28870/37963 [69:17:57<25:29:01, 10.09s/it]
                                                           
{'loss': '0.1096', 'grad_norm': '1.802', 'learning_rate': '2.862e-06', 'epoch': '0.7605'}

 76%|███████▌  | 28870/37963 [69:17:57<25:29:01, 10.09s/it]
 76%|███████▌  | 28871/37963 [69:18:05<23:37:17,  9.35s/it]
 76%|███████▌  | 28872/37963 [69:18:13<22:13:53,  8.80s/it]
 76%|███████▌  | 28873/37963 [69:18:20<21:05:57,  8.36s/it]
 76%|███████▌  | 28874/37963 [69:18:27<20:28:10,  8.11s/it]
 76%|███████▌  | 28875/37963 [69:18:35<20:02:45,  7.94s/it]
 76%|███████▌  | 28876/37963 [69:18:43<19:44:12,  7.82s/it]
 76%|███████▌  | 28877/37963 [69:18:50<19:29:47,  7.72s/it]
 76%|███████▌  | 28878/37963 [69:18:58<19:20:33,  7.66s/it]
 76%|███████▌  | 28879/37963 [69:19:05<19:13:45,  7.62s/it]
 76%|███████▌  | 28880/37963 [69:19:13<19:14:09,  7.62s/it]
                                                           
{'loss': '0.09886', 'grad_norm': '2.13', 'learning_rate': '2.856e-06', 'epoch': '0.7607'}

 76%|███████▌  | 28880/37963 [69:19:13<19:14:09,  7.62s/it]
 76%|███████▌  | 28881/37963 [69:19:20<19:08:41,  7.59s/it]
 76%|███████▌  | 28882/37963 [69:19:27<18:50:58,  7.47s/it]
 76%|███████▌  | 28883/37963 [69:19:35<18:54:40,  7.50s/it]
 76%|███████▌  | 28884/37963 [69:19:43<18:58:45,  7.53s/it]
 76%|███████▌  | 28885/37963 [69:19:50<19:01:01,  7.54s/it]
 76%|███████▌  | 28886/37963 [69:19:58<18:54:40,  7.50s/it]
 76%|███████▌  | 28887/37963 [69:20:05<18:58:06,  7.52s/it]
 76%|███████▌  | 28888/37963 [69:20:13<18:57:09,  7.52s/it]
 76%|███████▌  | 28889/37963 [69:20:20<18:56:04,  7.51s/it]
 76%|███████▌  | 28890/37963 [69:20:28<18:56:48,  7.52s/it]
                                                           
{'loss': '0.09919', 'grad_norm': '2.161', 'learning_rate': '2.85e-06', 'epoch': '0.761'}

 76%|███████▌  | 28890/37963 [69:20:28<18:56:48,  7.52s/it]
 76%|███████▌  | 28891/37963 [69:20:35<19:02:48,  7.56s/it]
 76%|███████▌  | 28892/37963 [69:20:43<18:57:11,  7.52s/it]
 76%|███████▌  | 28893/37963 [69:20:50<18:50:23,  7.48s/it]
 76%|███████▌  | 28894/37963 [69:20:57<18:38:56,  7.40s/it]
 76%|███████▌  | 28895/37963 [69:21:12<23:43:26,  9.42s/it]
 76%|███████▌  | 28896/37963 [69:21:32<32:14:25, 12.80s/it]
 76%|███████▌  | 28897/37963 [69:21:46<33:03:52, 13.13s/it]
 76%|███████▌  | 28898/37963 [69:21:54<28:58:56, 11.51s/it]
 76%|███████▌  | 28899/37963 [69:22:08<30:46:33, 12.22s/it]
 76%|███████▌  | 28900/37963 [69:22:15<27:13:26, 10.81s/it]
                                                           
{'loss': '0.1033', 'grad_norm': '2.108', 'learning_rate': '2.844e-06', 'epoch': '0.7613'}

 76%|███████▌  | 28900/37963 [69:22:15<27:13:26, 10.81s/it]
 76%|███████▌  | 28901/37963 [69:22:29<29:32:25, 11.74s/it]
 76%|███████▌  | 28902/37963 [69:22:37<26:26:04, 10.50s/it]
 76%|███████▌  | 28903/37963 [69:22:44<24:10:12,  9.60s/it]
 76%|███████▌  | 28904/37963 [69:22:52<22:29:34,  8.94s/it]
 76%|███████▌  | 28905/37963 [69:22:59<21:25:35,  8.52s/it]
 76%|███████▌  | 28906/37963 [69:23:07<20:41:53,  8.23s/it]
 76%|███████▌  | 28907/37963 [69:23:14<20:11:11,  8.02s/it]
 76%|███████▌  | 28908/37963 [69:23:22<19:41:52,  7.83s/it]
 76%|███████▌  | 28909/37963 [69:23:29<19:26:58,  7.73s/it]
 76%|███████▌  | 28910/37963 [69:23:37<19:12:32,  7.64s/it]
                                                           
{'loss': '0.09789', 'grad_norm': '1.662', 'learning_rate': '2.838e-06', 'epoch': '0.7615'}

 76%|███████▌  | 28910/37963 [69:23:37<19:12:32,  7.64s/it]
 76%|███████▌  | 28911/37963 [69:23:44<19:10:58,  7.63s/it]
 76%|███████▌  | 28912/37963 [69:23:51<18:47:36,  7.48s/it]
 76%|███████▌  | 28913/37963 [69:23:59<18:58:46,  7.55s/it]
 76%|███████▌  | 28914/37963 [69:24:06<18:43:46,  7.45s/it]
 76%|███████▌  | 28915/37963 [69:24:13<18:34:08,  7.39s/it]
 76%|███████▌  | 28916/37963 [69:24:21<18:48:51,  7.49s/it]
 76%|███████▌  | 28917/37963 [69:24:29<18:52:39,  7.51s/it]
 76%|███████▌  | 28918/37963 [69:24:36<18:53:47,  7.52s/it]
 76%|███████▌  | 28919/37963 [69:24:57<28:48:38, 11.47s/it]
 76%|███████▌  | 28920/37963 [69:25:04<25:45:25, 10.25s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '2.064', 'learning_rate': '2.832e-06', 'epoch': '0.7618'}

 76%|███████▌  | 28920/37963 [69:25:04<25:45:25, 10.25s/it]
 76%|███████▌  | 28921/37963 [69:25:12<23:38:25,  9.41s/it]
 76%|███████▌  | 28922/37963 [69:25:19<22:04:25,  8.79s/it]
 76%|███████▌  | 28923/37963 [69:25:27<21:09:58,  8.43s/it]
 76%|███████▌  | 28924/37963 [69:25:34<20:16:24,  8.07s/it]
 76%|███████▌  | 28925/37963 [69:25:42<19:50:30,  7.90s/it]
 76%|███████▌  | 28926/37963 [69:25:49<19:31:24,  7.78s/it]
 76%|███████▌  | 28927/37963 [69:25:56<19:05:20,  7.61s/it]
 76%|███████▌  | 28928/37963 [69:26:04<18:52:52,  7.52s/it]
 76%|███████▌  | 28929/37963 [69:26:11<18:54:31,  7.54s/it]
 76%|███████▌  | 28930/37963 [69:26:19<18:54:29,  7.54s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '2.709', 'learning_rate': '2.826e-06', 'epoch': '0.7621'}

 76%|███████▌  | 28930/37963 [69:26:19<18:54:29,  7.54s/it]
 76%|███████▌  | 28931/37963 [69:26:26<18:49:10,  7.50s/it]
 76%|███████▌  | 28932/37963 [69:26:34<18:52:38,  7.53s/it]
 76%|███████▌  | 28933/37963 [69:26:41<18:56:32,  7.55s/it]
 76%|███████▌  | 28934/37963 [69:26:49<18:59:08,  7.57s/it]
 76%|███████▌  | 28935/37963 [69:26:56<19:00:27,  7.58s/it]
 76%|███████▌  | 28936/37963 [69:27:04<18:57:16,  7.56s/it]
 76%|███████▌  | 28937/37963 [69:27:12<18:57:10,  7.56s/it]
 76%|███████▌  | 28938/37963 [69:27:19<18:59:52,  7.58s/it]
 76%|███████▌  | 28939/37963 [69:27:27<18:54:08,  7.54s/it]
 76%|███████▌  | 28940/37963 [69:27:34<18:58:19,  7.57s/it]
                                                           
{'loss': '0.1125', 'grad_norm': '2.259', 'learning_rate': '2.82e-06', 'epoch': '0.7623'}

 76%|███████▌  | 28940/37963 [69:27:34<18:58:19,  7.57s/it]
 76%|███████▌  | 28941/37963 [69:27:48<23:42:46,  9.46s/it]
 76%|███████▌  | 28942/37963 [69:27:56<22:10:21,  8.85s/it]
 76%|███████▌  | 28943/37963 [69:28:09<25:43:30, 10.27s/it]
 76%|███████▌  | 28944/37963 [69:28:23<28:35:12, 11.41s/it]
 76%|███████▌  | 28945/37963 [69:28:37<30:09:45, 12.04s/it]
 76%|███████▌  | 28946/37963 [69:28:51<31:43:52, 12.67s/it]
 76%|███████▋  | 28947/37963 [69:29:05<32:31:01, 12.98s/it]
 76%|███████▋  | 28948/37963 [69:29:12<28:25:39, 11.35s/it]
 76%|███████▋  | 28949/37963 [69:29:20<25:31:37, 10.19s/it]
 76%|███████▋  | 28950/37963 [69:29:27<23:27:47,  9.37s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '3.798', 'learning_rate': '2.814e-06', 'epoch': '0.7626'}

 76%|███████▋  | 28950/37963 [69:29:27<23:27:47,  9.37s/it]
 76%|███████▋  | 28951/37963 [69:29:35<22:02:53,  8.81s/it]
 76%|███████▋  | 28952/37963 [69:29:42<21:08:53,  8.45s/it]
 76%|███████▋  | 28953/37963 [69:29:50<20:26:51,  8.17s/it]
 76%|███████▋  | 28954/37963 [69:29:57<19:57:57,  7.98s/it]
 76%|███████▋  | 28955/37963 [69:30:04<19:22:28,  7.74s/it]
 76%|███████▋  | 28956/37963 [69:30:12<19:12:46,  7.68s/it]
 76%|███████▋  | 28957/37963 [69:30:19<18:53:13,  7.55s/it]
 76%|███████▋  | 28958/37963 [69:30:27<18:46:12,  7.50s/it]
 76%|███████▋  | 28959/37963 [69:30:34<18:33:21,  7.42s/it]
 76%|███████▋  | 28960/37963 [69:30:41<18:24:44,  7.36s/it]
                                                           
{'loss': '0.1075', 'grad_norm': '2.802', 'learning_rate': '2.808e-06', 'epoch': '0.7629'}

 76%|███████▋  | 28960/37963 [69:30:41<18:24:44,  7.36s/it]
 76%|███████▋  | 28961/37963 [69:30:48<18:18:25,  7.32s/it]
 76%|███████▋  | 28962/37963 [69:30:56<18:27:39,  7.38s/it]
 76%|███████▋  | 28963/37963 [69:31:10<23:22:25,  9.35s/it]
 76%|███████▋  | 28964/37963 [69:31:17<21:59:36,  8.80s/it]
 76%|███████▋  | 28965/37963 [69:31:25<20:53:54,  8.36s/it]
 76%|███████▋  | 28966/37963 [69:31:32<20:16:57,  8.12s/it]
 76%|███████▋  | 28967/37963 [69:31:40<19:51:03,  7.94s/it]
 76%|███████▋  | 28968/37963 [69:31:54<24:23:37,  9.76s/it]
 76%|███████▋  | 28969/37963 [69:32:01<22:29:32,  9.00s/it]
 76%|███████▋  | 28970/37963 [69:32:08<21:24:57,  8.57s/it]
                                                           
{'loss': '0.09552', 'grad_norm': '2.327', 'learning_rate': '2.802e-06', 'epoch': '0.7631'}

 76%|███████▋  | 28970/37963 [69:32:08<21:24:57,  8.57s/it]
 76%|███████▋  | 28971/37963 [69:32:16<20:38:18,  8.26s/it]
 76%|███████▋  | 28972/37963 [69:32:24<20:11:30,  8.08s/it]
 76%|███████▋  | 28973/37963 [69:32:31<19:38:24,  7.86s/it]
 76%|███████▋  | 28974/37963 [69:32:39<19:23:43,  7.77s/it]
 76%|███████▋  | 28975/37963 [69:32:46<19:13:30,  7.70s/it]
 76%|███████▋  | 28976/37963 [69:32:54<19:04:21,  7.64s/it]
 76%|███████▋  | 28977/37963 [69:33:01<19:00:52,  7.62s/it]
 76%|███████▋  | 28978/37963 [69:33:09<18:55:17,  7.58s/it]
 76%|███████▋  | 28979/37963 [69:33:16<18:53:56,  7.57s/it]
 76%|███████▋  | 28980/37963 [69:33:24<18:51:53,  7.56s/it]
                                                           
{'loss': '0.1219', 'grad_norm': '2.687', 'learning_rate': '2.796e-06', 'epoch': '0.7634'}

 76%|███████▋  | 28980/37963 [69:33:24<18:51:53,  7.56s/it]
 76%|███████▋  | 28981/37963 [69:33:31<18:48:00,  7.54s/it]
 76%|███████▋  | 28982/37963 [69:33:39<18:48:13,  7.54s/it]
 76%|███████▋  | 28983/37963 [69:33:46<18:48:05,  7.54s/it]
 76%|███████▋  | 28984/37963 [69:33:54<18:48:23,  7.54s/it]
 76%|███████▋  | 28985/37963 [69:34:01<18:48:20,  7.54s/it]
 76%|███████▋  | 28986/37963 [69:34:09<18:40:28,  7.49s/it]
 76%|███████▋  | 28987/37963 [69:34:16<18:42:02,  7.50s/it]
 76%|███████▋  | 28988/37963 [69:34:24<18:44:55,  7.52s/it]
 76%|███████▋  | 28989/37963 [69:34:38<23:37:19,  9.48s/it]
 76%|███████▋  | 28990/37963 [69:34:46<22:23:01,  8.98s/it]
                                                           
{'loss': '0.09953', 'grad_norm': '1.947', 'learning_rate': '2.79e-06', 'epoch': '0.7636'}

 76%|███████▋  | 28990/37963 [69:34:46<22:23:01,  8.98s/it]
 76%|███████▋  | 28991/37963 [69:34:53<21:13:20,  8.52s/it]
 76%|███████▋  | 28992/37963 [69:35:07<25:17:27, 10.15s/it]
 76%|███████▋  | 28993/37963 [69:35:21<28:11:15, 11.31s/it]
 76%|███████▋  | 28994/37963 [69:35:29<25:21:51, 10.18s/it]
 76%|███████▋  | 28995/37963 [69:35:49<33:11:17, 13.32s/it]
 76%|███████▋  | 28996/37963 [69:35:57<29:00:04, 11.64s/it]
 76%|███████▋  | 28997/37963 [69:36:05<25:59:10, 10.43s/it]
 76%|███████▋  | 28998/37963 [69:36:12<23:56:02,  9.61s/it]
 76%|███████▋  | 28999/37963 [69:36:20<22:21:11,  8.98s/it]
 76%|███████▋  | 29000/37963 [69:36:27<21:16:16,  8.54s/it]
                                                           
{'loss': '0.1008', 'grad_norm': '3.264', 'learning_rate': '2.784e-06', 'epoch': '0.7639'}

 76%|███████▋  | 29000/37963 [69:36:27<21:16:16,  8.54s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.79s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.79s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 76%|███████▋  | 29001/37963 [69:37:26<58:34:48, 23.53s/it]
 76%|███████▋  | 29002/37963 [69:37:33<46:36:29, 18.72s/it]
 76%|███████▋  | 29003/37963 [69:37:41<38:14:42, 15.37s/it]
 76%|███████▋  | 29004/37963 [69:37:49<32:27:21, 13.04s/it]
 76%|███████▋  | 29005/37963 [69:37:56<28:19:44, 11.38s/it]
 76%|███████▋  | 29006/37963 [69:38:04<25:25:59, 10.22s/it]
 76%|███████▋  | 29007/37963 [69:38:11<23:24:48,  9.41s/it]
 76%|███████▋  | 29008/37963 [69:38:18<21:51:17,  8.79s/it]
 76%|███████▋  | 29009/37963 [69:38:26<20:55:44,  8.41s/it]
 76%|███████▋  | 29010/37963 [69:38:33<20:12:46,  8.13s/it]
                                                           
{'loss': '0.1152', 'grad_norm': '2.276', 'learning_rate': '2.779e-06', 'epoch': '0.7642'}

 76%|███████▋  | 29010/37963 [69:38:33<20:12:46,  8.13s/it]
 76%|███████▋  | 29011/37963 [69:38:41<19:50:35,  7.98s/it]
 76%|███████▋  | 29012/37963 [69:38:49<19:30:18,  7.84s/it]
 76%|███████▋  | 29013/37963 [69:38:56<19:16:16,  7.75s/it]
 76%|███████▋  | 29014/37963 [69:39:10<23:49:23,  9.58s/it]
 76%|███████▋  | 29015/37963 [69:39:18<22:17:28,  8.97s/it]
 76%|███████▋  | 29016/37963 [69:39:31<25:51:17, 10.40s/it]
 76%|███████▋  | 29017/37963 [69:39:39<23:40:19,  9.53s/it]
 76%|███████▋  | 29018/37963 [69:39:46<22:09:17,  8.92s/it]
 76%|███████▋  | 29019/37963 [69:39:54<21:07:36,  8.50s/it]
 76%|███████▋  | 29020/37963 [69:40:01<20:23:39,  8.21s/it]
                                                           
{'loss': '0.1123', 'grad_norm': '2.749', 'learning_rate': '2.773e-06', 'epoch': '0.7644'}

 76%|███████▋  | 29020/37963 [69:40:01<20:23:39,  8.21s/it]
 76%|███████▋  | 29021/37963 [69:40:09<19:52:29,  8.00s/it]
 76%|███████▋  | 29022/37963 [69:40:16<19:29:07,  7.85s/it]
 76%|███████▋  | 29023/37963 [69:40:24<19:14:36,  7.75s/it]
 76%|███████▋  | 29024/37963 [69:40:31<19:03:46,  7.68s/it]
 76%|███████▋  | 29025/37963 [69:40:39<19:01:27,  7.66s/it]
 76%|███████▋  | 29026/37963 [69:40:46<18:44:35,  7.55s/it]
 76%|███████▋  | 29027/37963 [69:40:54<18:39:07,  7.51s/it]
 76%|███████▋  | 29028/37963 [69:41:01<18:35:32,  7.49s/it]
 76%|███████▋  | 29029/37963 [69:41:09<18:37:34,  7.51s/it]
 76%|███████▋  | 29030/37963 [69:41:16<18:43:45,  7.55s/it]
                                                           
{'loss': '0.1112', 'grad_norm': '1.967', 'learning_rate': '2.767e-06', 'epoch': '0.7647'}

 76%|███████▋  | 29030/37963 [69:41:16<18:43:45,  7.55s/it]
 76%|███████▋  | 29031/37963 [69:41:24<18:43:31,  7.55s/it]
 76%|███████▋  | 29032/37963 [69:41:31<18:30:31,  7.46s/it]
 76%|███████▋  | 29033/37963 [69:41:39<18:36:50,  7.50s/it]
 76%|███████▋  | 29034/37963 [69:41:46<18:36:04,  7.50s/it]
 76%|███████▋  | 29035/37963 [69:41:54<18:38:03,  7.51s/it]
 76%|███████▋  | 29036/37963 [69:42:08<23:31:47,  9.49s/it]
 76%|███████▋  | 29037/37963 [69:42:15<22:01:33,  8.88s/it]
 76%|███████▋  | 29038/37963 [69:42:23<21:02:45,  8.49s/it]
 76%|███████▋  | 29039/37963 [69:42:43<29:41:47, 11.98s/it]
 76%|███████▋  | 29040/37963 [69:42:51<26:26:29, 10.67s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '1.808', 'learning_rate': '2.761e-06', 'epoch': '0.765'}

 76%|███████▋  | 29040/37963 [69:42:51<26:26:29, 10.67s/it]
 76%|███████▋  | 29041/37963 [69:43:05<29:00:16, 11.70s/it]
 77%|███████▋  | 29042/37963 [69:43:12<26:00:51, 10.50s/it]
 77%|███████▋  | 29043/37963 [69:43:26<28:20:21, 11.44s/it]
 77%|███████▋  | 29044/37963 [69:43:40<29:58:27, 12.10s/it]
 77%|███████▋  | 29045/37963 [69:43:47<26:33:20, 10.72s/it]
 77%|███████▋  | 29046/37963 [69:43:55<24:10:06,  9.76s/it]
 77%|███████▋  | 29047/37963 [69:44:02<22:21:50,  9.03s/it]
 77%|███████▋  | 29048/37963 [69:44:10<21:15:13,  8.58s/it]
 77%|███████▋  | 29049/37963 [69:44:17<20:22:51,  8.23s/it]
 77%|███████▋  | 29050/37963 [69:44:25<19:52:30,  8.03s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '2.998', 'learning_rate': '2.755e-06', 'epoch': '0.7652'}

 77%|███████▋  | 29050/37963 [69:44:25<19:52:30,  8.03s/it]
 77%|███████▋  | 29051/37963 [69:44:32<19:31:49,  7.89s/it]
 77%|███████▋  | 29052/37963 [69:44:40<19:12:46,  7.76s/it]
 77%|███████▋  | 29053/37963 [69:44:47<18:50:47,  7.61s/it]
 77%|███████▋  | 29054/37963 [69:44:54<18:48:00,  7.60s/it]
 77%|███████▋  | 29055/37963 [69:45:02<18:46:44,  7.59s/it]
 77%|███████▋  | 29056/37963 [69:45:09<18:40:14,  7.55s/it]
 77%|███████▋  | 29057/37963 [69:45:17<18:39:08,  7.54s/it]
 77%|███████▋  | 29058/37963 [69:45:25<18:41:36,  7.56s/it]
 77%|███████▋  | 29059/37963 [69:45:32<18:40:40,  7.55s/it]
 77%|███████▋  | 29060/37963 [69:45:40<18:40:08,  7.55s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '2.105', 'learning_rate': '2.749e-06', 'epoch': '0.7655'}

 77%|███████▋  | 29060/37963 [69:45:40<18:40:08,  7.55s/it]
 77%|███████▋  | 29061/37963 [69:45:54<23:22:55,  9.46s/it]
 77%|███████▋  | 29062/37963 [69:46:01<21:55:25,  8.87s/it]
 77%|███████▋  | 29063/37963 [69:46:09<21:01:55,  8.51s/it]
 77%|███████▋  | 29064/37963 [69:46:16<20:09:04,  8.15s/it]
 77%|███████▋  | 29065/37963 [69:46:30<24:10:23,  9.78s/it]
 77%|███████▋  | 29066/37963 [69:46:37<22:20:56,  9.04s/it]
 77%|███████▋  | 29067/37963 [69:46:45<21:15:46,  8.60s/it]
 77%|███████▋  | 29068/37963 [69:46:52<20:27:23,  8.28s/it]
 77%|███████▋  | 29069/37963 [69:47:00<19:56:14,  8.07s/it]
 77%|███████▋  | 29070/37963 [69:47:07<19:31:23,  7.90s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '2.066', 'learning_rate': '2.743e-06', 'epoch': '0.7657'}

 77%|███████▋  | 29070/37963 [69:47:07<19:31:23,  7.90s/it]
 77%|███████▋  | 29071/37963 [69:47:15<19:22:39,  7.85s/it]
 77%|███████▋  | 29072/37963 [69:47:22<19:12:17,  7.78s/it]
 77%|███████▋  | 29073/37963 [69:47:30<18:59:02,  7.69s/it]
 77%|███████▋  | 29074/37963 [69:47:37<18:51:01,  7.63s/it]
 77%|███████▋  | 29075/37963 [69:47:45<18:32:20,  7.51s/it]
 77%|███████▋  | 29076/37963 [69:47:52<18:31:17,  7.50s/it]
 77%|███████▋  | 29077/37963 [69:48:00<18:29:39,  7.49s/it]
 77%|███████▋  | 29078/37963 [69:48:07<18:36:28,  7.54s/it]
 77%|███████▋  | 29079/37963 [69:48:15<18:39:36,  7.56s/it]
 77%|███████▋  | 29080/37963 [69:48:22<18:38:26,  7.55s/it]
                                                           
{'loss': '0.1085', 'grad_norm': '2.588', 'learning_rate': '2.737e-06', 'epoch': '0.766'}

 77%|███████▋  | 29080/37963 [69:48:22<18:38:26,  7.55s/it]
 77%|███████▋  | 29081/37963 [69:48:30<18:25:42,  7.47s/it]
 77%|███████▋  | 29082/37963 [69:48:37<18:28:17,  7.49s/it]
 77%|███████▋  | 29083/37963 [69:48:51<23:24:00,  9.49s/it]
 77%|███████▋  | 29084/37963 [69:48:59<21:51:57,  8.87s/it]
 77%|███████▋  | 29085/37963 [69:49:06<20:48:43,  8.44s/it]
 77%|███████▋  | 29086/37963 [69:49:20<24:47:01, 10.05s/it]
 77%|███████▋  | 29087/37963 [69:49:28<22:50:44,  9.27s/it]
 77%|███████▋  | 29088/37963 [69:49:35<21:34:17,  8.75s/it]
 77%|███████▋  | 29089/37963 [69:49:42<20:31:38,  8.33s/it]
 77%|███████▋  | 29090/37963 [69:49:56<24:43:20, 10.03s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.15', 'learning_rate': '2.732e-06', 'epoch': '0.7663'}

 77%|███████▋  | 29090/37963 [69:49:56<24:43:20, 10.03s/it]
 77%|███████▋  | 29091/37963 [69:50:04<22:53:37,  9.29s/it]
 77%|███████▋  | 29092/37963 [69:50:11<21:24:08,  8.69s/it]
 77%|███████▋  | 29093/37963 [69:50:19<20:33:55,  8.35s/it]
 77%|███████▋  | 29094/37963 [69:50:26<19:46:30,  8.03s/it]
 77%|███████▋  | 29095/37963 [69:50:46<28:43:51, 11.66s/it]
 77%|███████▋  | 29096/37963 [69:51:00<30:29:53, 12.38s/it]
 77%|███████▋  | 29097/37963 [69:51:08<26:50:15, 10.90s/it]
 77%|███████▋  | 29098/37963 [69:51:15<24:19:22,  9.88s/it]
 77%|███████▋  | 29099/37963 [69:51:23<22:30:49,  9.14s/it]
 77%|███████▋  | 29100/37963 [69:51:30<21:10:49,  8.60s/it]
                                                           
{'loss': '0.1095', 'grad_norm': '1.544', 'learning_rate': '2.726e-06', 'epoch': '0.7665'}

 77%|███████▋  | 29100/37963 [69:51:30<21:10:49,  8.60s/it]
 77%|███████▋  | 29101/37963 [69:51:37<20:16:14,  8.23s/it]
 77%|███████▋  | 29102/37963 [69:51:45<19:38:50,  7.98s/it]
 77%|███████▋  | 29103/37963 [69:51:52<19:20:04,  7.86s/it]
 77%|███████▋  | 29104/37963 [69:52:00<19:06:36,  7.77s/it]
 77%|███████▋  | 29105/37963 [69:52:08<19:02:22,  7.74s/it]
 77%|███████▋  | 29106/37963 [69:52:15<18:51:19,  7.66s/it]
 77%|███████▋  | 29107/37963 [69:52:23<18:43:01,  7.61s/it]
 77%|███████▋  | 29108/37963 [69:52:30<18:44:10,  7.62s/it]
 77%|███████▋  | 29109/37963 [69:52:44<23:24:20,  9.52s/it]
 77%|███████▋  | 29110/37963 [69:52:52<22:00:22,  8.95s/it]
                                                           
{'loss': '0.1199', 'grad_norm': '2.638', 'learning_rate': '2.72e-06', 'epoch': '0.7668'}

 77%|███████▋  | 29110/37963 [69:52:52<22:00:22,  8.95s/it]
 77%|███████▋  | 29111/37963 [69:52:59<21:03:30,  8.56s/it]
 77%|███████▋  | 29112/37963 [69:53:07<20:21:22,  8.28s/it]
 77%|███████▋  | 29113/37963 [69:53:14<19:46:37,  8.04s/it]
 77%|███████▋  | 29114/37963 [69:53:22<19:24:28,  7.90s/it]
 77%|███████▋  | 29115/37963 [69:53:30<19:07:03,  7.78s/it]
 77%|███████▋  | 29116/37963 [69:53:43<23:37:53,  9.62s/it]
 77%|███████▋  | 29117/37963 [69:53:51<22:09:42,  9.02s/it]
 77%|███████▋  | 29118/37963 [69:53:59<21:08:15,  8.60s/it]
 77%|███████▋  | 29119/37963 [69:54:06<20:08:13,  8.20s/it]
 77%|███████▋  | 29120/37963 [69:54:13<19:26:45,  7.92s/it]
                                                           
{'loss': '0.0967', 'grad_norm': '1.928', 'learning_rate': '2.714e-06', 'epoch': '0.7671'}

 77%|███████▋  | 29120/37963 [69:54:13<19:26:45,  7.92s/it]
 77%|███████▋  | 29121/37963 [69:54:21<19:08:29,  7.79s/it]
 77%|███████▋  | 29122/37963 [69:54:28<18:57:50,  7.72s/it]
 77%|███████▋  | 29123/37963 [69:54:36<18:53:18,  7.69s/it]
 77%|███████▋  | 29124/37963 [69:54:43<18:46:37,  7.65s/it]
 77%|███████▋  | 29125/37963 [69:54:51<18:29:10,  7.53s/it]
 77%|███████▋  | 29126/37963 [69:54:58<18:30:29,  7.54s/it]
 77%|███████▋  | 29127/37963 [69:55:06<18:32:25,  7.55s/it]
 77%|███████▋  | 29128/37963 [69:55:13<18:33:58,  7.57s/it]
 77%|███████▋  | 29129/37963 [69:55:27<23:05:28,  9.41s/it]
 77%|███████▋  | 29130/37963 [69:55:41<26:07:58, 10.65s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '2.642', 'learning_rate': '2.708e-06', 'epoch': '0.7673'}

 77%|███████▋  | 29130/37963 [69:55:41<26:07:58, 10.65s/it]
 77%|███████▋  | 29131/37963 [69:55:48<23:49:16,  9.71s/it]
 77%|███████▋  | 29132/37963 [69:55:56<22:14:01,  9.06s/it]
 77%|███████▋  | 29133/37963 [69:56:03<20:55:31,  8.53s/it]
 77%|███████▋  | 29134/37963 [69:56:11<20:11:49,  8.24s/it]
 77%|███████▋  | 29135/37963 [69:56:18<19:30:14,  7.95s/it]
 77%|███████▋  | 29136/37963 [69:56:25<19:12:34,  7.83s/it]
 77%|███████▋  | 29137/37963 [69:56:33<19:00:11,  7.75s/it]
 77%|███████▋  | 29138/37963 [69:56:41<18:48:32,  7.67s/it]
 77%|███████▋  | 29139/37963 [69:56:48<18:44:48,  7.65s/it]
 77%|███████▋  | 29140/37963 [69:56:56<18:36:46,  7.59s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '2.665', 'learning_rate': '2.702e-06', 'epoch': '0.7676'}

 77%|███████▋  | 29140/37963 [69:56:56<18:36:46,  7.59s/it]
 77%|███████▋  | 29141/37963 [69:57:03<18:37:57,  7.60s/it]
 77%|███████▋  | 29142/37963 [69:57:11<18:29:26,  7.55s/it]
 77%|███████▋  | 29143/37963 [69:57:31<27:53:06, 11.38s/it]
 77%|███████▋  | 29144/37963 [69:57:45<29:56:24, 12.22s/it]
 77%|███████▋  | 29145/37963 [69:57:53<26:34:25, 10.85s/it]
 77%|███████▋  | 29146/37963 [69:58:00<24:03:54,  9.83s/it]
 77%|███████▋  | 29147/37963 [69:58:08<22:20:27,  9.12s/it]
 77%|███████▋  | 29148/37963 [69:58:15<21:08:57,  8.64s/it]
 77%|███████▋  | 29149/37963 [69:58:29<25:01:01, 10.22s/it]
 77%|███████▋  | 29150/37963 [69:58:37<23:03:52,  9.42s/it]
                                                           
{'loss': '0.1139', 'grad_norm': '2.268', 'learning_rate': '2.696e-06', 'epoch': '0.7679'}

 77%|███████▋  | 29150/37963 [69:58:37<23:03:52,  9.42s/it]
 77%|███████▋  | 29151/37963 [69:58:44<21:38:04,  8.84s/it]
 77%|███████▋  | 29152/37963 [69:58:52<20:43:35,  8.47s/it]
 77%|███████▋  | 29153/37963 [69:58:59<19:58:20,  8.16s/it]
 77%|███████▋  | 29154/37963 [69:59:07<19:22:14,  7.92s/it]
 77%|███████▋  | 29155/37963 [69:59:21<23:58:01,  9.80s/it]
 77%|███████▋  | 29156/37963 [69:59:28<22:21:32,  9.14s/it]
 77%|███████▋  | 29157/37963 [69:59:36<21:13:08,  8.67s/it]
 77%|███████▋  | 29158/37963 [69:59:43<20:22:42,  8.33s/it]
 77%|███████▋  | 29159/37963 [69:59:51<19:41:11,  8.05s/it]
 77%|███████▋  | 29160/37963 [69:59:58<19:17:31,  7.89s/it]
                                                           
{'loss': '0.09385', 'grad_norm': '2.074', 'learning_rate': '2.691e-06', 'epoch': '0.7681'}

 77%|███████▋  | 29160/37963 [69:59:58<19:17:31,  7.89s/it]
 77%|███████▋  | 29161/37963 [70:00:06<19:01:18,  7.78s/it]
 77%|███████▋  | 29162/37963 [70:00:13<18:51:48,  7.72s/it]
 77%|███████▋  | 29163/37963 [70:00:21<18:45:01,  7.67s/it]
 77%|███████▋  | 29164/37963 [70:00:35<23:16:56,  9.53s/it]
 77%|███████▋  | 29165/37963 [70:00:42<21:48:07,  8.92s/it]
 77%|███████▋  | 29166/37963 [70:00:50<20:47:06,  8.51s/it]
 77%|███████▋  | 29167/37963 [70:00:57<20:02:21,  8.20s/it]
 77%|███████▋  | 29168/37963 [70:01:05<19:31:34,  7.99s/it]
 77%|███████▋  | 29169/37963 [70:01:12<19:06:41,  7.82s/it]
 77%|███████▋  | 29170/37963 [70:01:20<18:48:44,  7.70s/it]
                                                           
{'loss': '0.08898', 'grad_norm': '1.89', 'learning_rate': '2.685e-06', 'epoch': '0.7684'}

 77%|███████▋  | 29170/37963 [70:01:20<18:48:44,  7.70s/it]
 77%|███████▋  | 29171/37963 [70:01:27<18:40:23,  7.65s/it]
 77%|███████▋  | 29172/37963 [70:01:35<18:23:46,  7.53s/it]
 77%|███████▋  | 29173/37963 [70:01:42<18:15:27,  7.48s/it]
 77%|███████▋  | 29174/37963 [70:01:49<18:10:19,  7.44s/it]
 77%|███████▋  | 29175/37963 [70:01:57<18:20:49,  7.52s/it]
 77%|███████▋  | 29176/37963 [70:02:11<22:55:47,  9.39s/it]
 77%|███████▋  | 29177/37963 [70:02:18<21:34:03,  8.84s/it]
 77%|███████▋  | 29178/37963 [70:02:26<20:36:41,  8.45s/it]
 77%|███████▋  | 29179/37963 [70:02:40<24:40:07, 10.11s/it]
 77%|███████▋  | 29180/37963 [70:02:47<22:40:42,  9.30s/it]
                                                           
{'loss': '0.1145', 'grad_norm': '1.897', 'learning_rate': '2.679e-06', 'epoch': '0.7686'}

 77%|███████▋  | 29180/37963 [70:02:47<22:40:42,  9.30s/it]
 77%|███████▋  | 29181/37963 [70:02:55<21:24:02,  8.77s/it]
 77%|███████▋  | 29182/37963 [70:03:02<20:27:45,  8.39s/it]
 77%|███████▋  | 29183/37963 [70:03:10<19:52:38,  8.15s/it]
 77%|███████▋  | 29184/37963 [70:03:17<19:26:02,  7.97s/it]
 77%|███████▋  | 29185/37963 [70:03:25<19:02:24,  7.81s/it]
 77%|███████▋  | 29186/37963 [70:03:32<18:48:59,  7.72s/it]
 77%|███████▋  | 29187/37963 [70:03:40<18:45:03,  7.69s/it]
 77%|███████▋  | 29188/37963 [70:03:47<18:27:48,  7.57s/it]
 77%|███████▋  | 29189/37963 [70:03:55<18:27:39,  7.57s/it]
 77%|███████▋  | 29190/37963 [70:04:02<18:28:21,  7.58s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '1.947', 'learning_rate': '2.673e-06', 'epoch': '0.7689'}

 77%|███████▋  | 29190/37963 [70:04:02<18:28:21,  7.58s/it]
 77%|███████▋  | 29191/37963 [70:04:17<23:14:36,  9.54s/it]
 77%|███████▋  | 29192/37963 [70:04:24<21:48:17,  8.95s/it]
 77%|███████▋  | 29193/37963 [70:04:38<25:32:57, 10.49s/it]
 77%|███████▋  | 29194/37963 [70:04:46<23:28:31,  9.64s/it]
 77%|███████▋  | 29195/37963 [70:04:53<21:56:19,  9.01s/it]
 77%|███████▋  | 29196/37963 [70:05:01<20:50:34,  8.56s/it]
 77%|███████▋  | 29197/37963 [70:05:15<24:35:37, 10.10s/it]
 77%|███████▋  | 29198/37963 [70:05:29<27:29:22, 11.29s/it]
 77%|███████▋  | 29199/37963 [70:05:36<24:37:55, 10.12s/it]
 77%|███████▋  | 29200/37963 [70:05:44<22:45:51,  9.35s/it]
                                                           
{'loss': '0.09326', 'grad_norm': '3.363', 'learning_rate': '2.667e-06', 'epoch': '0.7692'}

 77%|███████▋  | 29200/37963 [70:05:44<22:45:51,  9.35s/it]
 77%|███████▋  | 29201/37963 [70:05:51<21:14:35,  8.73s/it]
 77%|███████▋  | 29202/37963 [70:05:58<20:20:19,  8.36s/it]
 77%|███████▋  | 29203/37963 [70:06:12<24:28:16, 10.06s/it]
 77%|███████▋  | 29204/37963 [70:06:20<22:29:01,  9.24s/it]
 77%|███████▋  | 29205/37963 [70:06:27<21:11:41,  8.71s/it]
 77%|███████▋  | 29206/37963 [70:06:35<20:19:01,  8.35s/it]
 77%|███████▋  | 29207/37963 [70:06:42<19:45:51,  8.13s/it]
 77%|███████▋  | 29208/37963 [70:06:50<19:21:06,  7.96s/it]
 77%|███████▋  | 29209/37963 [70:07:04<23:36:39,  9.71s/it]
 77%|███████▋  | 29210/37963 [70:07:11<22:02:50,  9.07s/it]
                                                           
{'loss': '0.1098', 'grad_norm': '3.253', 'learning_rate': '2.662e-06', 'epoch': '0.7694'}

 77%|███████▋  | 29210/37963 [70:07:11<22:02:50,  9.07s/it]
 77%|███████▋  | 29211/37963 [70:07:19<20:49:35,  8.57s/it]
 77%|███████▋  | 29212/37963 [70:07:26<19:51:05,  8.17s/it]
 77%|███████▋  | 29213/37963 [70:07:33<19:14:23,  7.92s/it]
 77%|███████▋  | 29214/37963 [70:07:41<18:52:04,  7.76s/it]
 77%|███████▋  | 29215/37963 [70:07:48<18:45:06,  7.72s/it]
 77%|███████▋  | 29216/37963 [70:07:56<18:36:39,  7.66s/it]
 77%|███████▋  | 29217/37963 [70:08:03<18:33:15,  7.64s/it]
 77%|███████▋  | 29218/37963 [70:08:11<18:27:53,  7.60s/it]
 77%|███████▋  | 29219/37963 [70:08:18<18:26:18,  7.59s/it]
 77%|███████▋  | 29220/37963 [70:08:26<18:24:05,  7.58s/it]
                                                           
{'loss': '0.1162', 'grad_norm': '1.888', 'learning_rate': '2.656e-06', 'epoch': '0.7697'}

 77%|███████▋  | 29220/37963 [70:08:26<18:24:05,  7.58s/it]
 77%|███████▋  | 29221/37963 [70:08:33<18:20:26,  7.55s/it]
 77%|███████▋  | 29222/37963 [70:08:41<18:15:18,  7.52s/it]
 77%|███████▋  | 29223/37963 [70:08:48<18:19:49,  7.55s/it]
 77%|███████▋  | 29224/37963 [70:08:56<18:19:22,  7.55s/it]
 77%|███████▋  | 29225/37963 [70:09:10<23:05:36,  9.51s/it]
 77%|███████▋  | 29226/37963 [70:09:18<21:41:29,  8.94s/it]
 77%|███████▋  | 29227/37963 [70:09:25<20:37:11,  8.50s/it]
 77%|███████▋  | 29228/37963 [70:09:39<24:37:22, 10.15s/it]
 77%|███████▋  | 29229/37963 [70:09:47<22:41:34,  9.35s/it]
 77%|███████▋  | 29230/37963 [70:09:54<21:11:54,  8.74s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '2.077', 'learning_rate': '2.65e-06', 'epoch': '0.77'}

 77%|███████▋  | 29230/37963 [70:09:54<21:11:54,  8.74s/it]
 77%|███████▋  | 29231/37963 [70:10:02<20:22:48,  8.40s/it]
 77%|███████▋  | 29232/37963 [70:10:09<19:46:48,  8.16s/it]
 77%|███████▋  | 29233/37963 [70:10:17<19:17:41,  7.96s/it]
 77%|███████▋  | 29234/37963 [70:10:24<19:02:22,  7.85s/it]
 77%|███████▋  | 29235/37963 [70:10:38<23:26:06,  9.67s/it]
 77%|███████▋  | 29236/37963 [70:10:46<21:56:22,  9.05s/it]
 77%|███████▋  | 29237/37963 [70:11:00<25:32:10, 10.54s/it]
 77%|███████▋  | 29238/37963 [70:11:07<23:19:33,  9.62s/it]
 77%|███████▋  | 29239/37963 [70:11:15<21:44:44,  8.97s/it]
 77%|███████▋  | 29240/37963 [70:11:22<20:42:46,  8.55s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '2.671', 'learning_rate': '2.644e-06', 'epoch': '0.7702'}

 77%|███████▋  | 29240/37963 [70:11:22<20:42:46,  8.55s/it]
 77%|███████▋  | 29241/37963 [70:11:36<24:36:12, 10.16s/it]
 77%|███████▋  | 29242/37963 [70:11:44<22:38:31,  9.35s/it]
 77%|███████▋  | 29243/37963 [70:11:51<21:21:39,  8.82s/it]
 77%|███████▋  | 29244/37963 [70:11:59<20:15:07,  8.36s/it]
 77%|███████▋  | 29245/37963 [70:12:06<19:35:33,  8.09s/it]
 77%|███████▋  | 29246/37963 [70:12:14<19:11:04,  7.92s/it]
 77%|███████▋  | 29247/37963 [70:12:21<18:55:34,  7.82s/it]
 77%|███████▋  | 29248/37963 [70:12:29<18:46:00,  7.75s/it]
 77%|███████▋  | 29249/37963 [70:12:43<23:45:10,  9.81s/it]
 77%|███████▋  | 29250/37963 [70:12:51<22:05:18,  9.13s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.511', 'learning_rate': '2.638e-06', 'epoch': '0.7705'}

 77%|███████▋  | 29250/37963 [70:12:51<22:05:18,  9.13s/it]
 77%|███████▋  | 29251/37963 [70:13:05<25:32:32, 10.55s/it]
 77%|███████▋  | 29252/37963 [70:13:12<23:21:24,  9.65s/it]
 77%|███████▋  | 29253/37963 [70:13:20<21:54:20,  9.05s/it]
 77%|███████▋  | 29254/37963 [70:13:28<20:49:20,  8.61s/it]
 77%|███████▋  | 29255/37963 [70:13:41<24:41:57, 10.21s/it]
 77%|███████▋  | 29256/37963 [70:13:49<22:26:07,  9.28s/it]
 77%|███████▋  | 29257/37963 [70:13:56<21:05:03,  8.72s/it]
 77%|███████▋  | 29258/37963 [70:14:03<20:09:00,  8.33s/it]
 77%|███████▋  | 29259/37963 [70:14:11<19:32:21,  8.08s/it]
 77%|███████▋  | 29260/37963 [70:14:18<19:01:06,  7.87s/it]
                                                           
{'loss': '0.09637', 'grad_norm': '2.022', 'learning_rate': '2.633e-06', 'epoch': '0.7708'}

 77%|███████▋  | 29260/37963 [70:14:18<19:01:06,  7.87s/it]
 77%|███████▋  | 29261/37963 [70:14:26<18:44:15,  7.75s/it]
 77%|███████▋  | 29262/37963 [70:14:33<18:37:39,  7.71s/it]
 77%|███████▋  | 29263/37963 [70:14:41<18:28:08,  7.64s/it]
 77%|███████▋  | 29264/37963 [70:14:48<18:22:57,  7.61s/it]
 77%|███████▋  | 29265/37963 [70:14:56<18:08:59,  7.51s/it]
 77%|███████▋  | 29266/37963 [70:15:03<18:08:24,  7.51s/it]
 77%|███████▋  | 29267/37963 [70:15:11<18:15:09,  7.56s/it]
 77%|███████▋  | 29268/37963 [70:15:18<18:14:42,  7.55s/it]
 77%|███████▋  | 29269/37963 [70:15:26<18:16:26,  7.57s/it]
 77%|███████▋  | 29270/37963 [70:15:33<18:11:34,  7.53s/it]
                                                           
{'loss': '0.1031', 'grad_norm': '1.907', 'learning_rate': '2.627e-06', 'epoch': '0.771'}

 77%|███████▋  | 29270/37963 [70:15:33<18:11:34,  7.53s/it]
 77%|███████▋  | 29271/37963 [70:15:41<18:16:27,  7.57s/it]
 77%|███████▋  | 29272/37963 [70:15:49<18:14:30,  7.56s/it]
 77%|███████▋  | 29273/37963 [70:15:56<18:01:18,  7.47s/it]
 77%|███████▋  | 29274/37963 [70:16:03<18:02:11,  7.47s/it]
 77%|███████▋  | 29275/37963 [70:16:11<17:59:59,  7.46s/it]
 77%|███████▋  | 29276/37963 [70:16:18<18:04:00,  7.49s/it]
 77%|███████▋  | 29277/37963 [70:16:39<27:29:20, 11.39s/it]
 77%|███████▋  | 29278/37963 [70:16:46<24:38:10, 10.21s/it]
 77%|███████▋  | 29279/37963 [70:16:54<22:41:46,  9.41s/it]
 77%|███████▋  | 29280/37963 [70:17:01<21:21:00,  8.85s/it]
                                                           
{'loss': '0.1082', 'grad_norm': '1.457', 'learning_rate': '2.621e-06', 'epoch': '0.7713'}

 77%|███████▋  | 29280/37963 [70:17:01<21:21:00,  8.85s/it]
 77%|███████▋  | 29281/37963 [70:17:09<20:20:44,  8.44s/it]
 77%|███████▋  | 29282/37963 [70:17:16<19:43:19,  8.18s/it]
 77%|███████▋  | 29283/37963 [70:17:31<24:13:41, 10.05s/it]
 77%|███████▋  | 29284/37963 [70:17:38<22:27:26,  9.32s/it]
 77%|███████▋  | 29285/37963 [70:17:52<25:39:12, 10.64s/it]
 77%|███████▋  | 29286/37963 [70:18:00<23:26:35,  9.73s/it]
 77%|███████▋  | 29287/37963 [70:18:14<26:24:32, 10.96s/it]
 77%|███████▋  | 29288/37963 [70:18:21<24:02:41,  9.98s/it]
 77%|███████▋  | 29289/37963 [70:18:29<22:12:11,  9.22s/it]
 77%|███████▋  | 29290/37963 [70:18:36<20:52:21,  8.66s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '1.979', 'learning_rate': '2.615e-06', 'epoch': '0.7715'}

 77%|███████▋  | 29290/37963 [70:18:36<20:52:21,  8.66s/it]
 77%|███████▋  | 29291/37963 [70:18:43<19:55:01,  8.27s/it]
 77%|███████▋  | 29292/37963 [70:18:51<19:21:11,  8.03s/it]
 77%|███████▋  | 29293/37963 [70:18:59<19:02:43,  7.91s/it]
 77%|███████▋  | 29294/37963 [70:19:06<18:45:43,  7.79s/it]
 77%|███████▋  | 29295/37963 [70:19:14<18:34:25,  7.71s/it]
 77%|███████▋  | 29296/37963 [70:19:21<18:27:59,  7.67s/it]
 77%|███████▋  | 29297/37963 [70:19:29<18:26:38,  7.66s/it]
 77%|███████▋  | 29298/37963 [70:19:36<18:13:47,  7.57s/it]
 77%|███████▋  | 29299/37963 [70:19:50<22:41:24,  9.43s/it]
 77%|███████▋  | 29300/37963 [70:19:57<21:15:27,  8.83s/it]
                                                           
{'loss': '0.09926', 'grad_norm': '2.148', 'learning_rate': '2.61e-06', 'epoch': '0.7718'}

 77%|███████▋  | 29300/37963 [70:19:57<21:15:27,  8.83s/it]
 77%|███████▋  | 29301/37963 [70:20:05<20:25:29,  8.49s/it]
 77%|███████▋  | 29302/37963 [70:20:19<24:18:55, 10.11s/it]
 77%|███████▋  | 29303/37963 [70:20:26<22:21:04,  9.29s/it]
 77%|███████▋  | 29304/37963 [70:20:40<25:41:00, 10.68s/it]
 77%|███████▋  | 29305/37963 [70:20:48<23:27:41,  9.76s/it]
 77%|███████▋  | 29306/37963 [70:20:55<21:46:36,  9.06s/it]
 77%|███████▋  | 29307/37963 [70:21:03<20:40:29,  8.60s/it]
 77%|███████▋  | 29308/37963 [70:21:10<19:54:31,  8.28s/it]
 77%|███████▋  | 29309/37963 [70:21:18<19:05:14,  7.94s/it]
 77%|███████▋  | 29310/37963 [70:21:25<18:51:48,  7.85s/it]
                                                           
{'loss': '0.1173', 'grad_norm': '2.427', 'learning_rate': '2.604e-06', 'epoch': '0.7721'}

 77%|███████▋  | 29310/37963 [70:21:25<18:51:48,  7.85s/it]
 77%|███████▋  | 29311/37963 [70:21:33<18:44:37,  7.80s/it]
 77%|███████▋  | 29312/37963 [70:21:40<18:34:32,  7.73s/it]
 77%|███████▋  | 29313/37963 [70:21:48<18:27:04,  7.68s/it]
 77%|███████▋  | 29314/37963 [70:21:55<17:56:12,  7.47s/it]
 77%|███████▋  | 29315/37963 [70:22:02<17:59:18,  7.49s/it]
 77%|███████▋  | 29316/37963 [70:22:10<18:01:06,  7.50s/it]
 77%|███████▋  | 29317/37963 [70:22:18<18:03:45,  7.52s/it]
 77%|███████▋  | 29318/37963 [70:22:25<18:03:41,  7.52s/it]
 77%|███████▋  | 29319/37963 [70:22:33<18:04:46,  7.53s/it]
 77%|███████▋  | 29320/37963 [70:22:40<18:04:02,  7.53s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '1.662', 'learning_rate': '2.598e-06', 'epoch': '0.7723'}

 77%|███████▋  | 29320/37963 [70:22:40<18:04:02,  7.53s/it]
 77%|███████▋  | 29321/37963 [70:22:48<18:02:57,  7.52s/it]
 77%|███████▋  | 29322/37963 [70:22:55<18:11:19,  7.58s/it]
 77%|███████▋  | 29323/37963 [70:23:03<18:10:28,  7.57s/it]
 77%|███████▋  | 29324/37963 [70:23:17<22:42:01,  9.46s/it]
 77%|███████▋  | 29325/37963 [70:23:25<21:27:01,  8.94s/it]
 77%|███████▋  | 29326/37963 [70:23:32<20:28:29,  8.53s/it]
 77%|███████▋  | 29327/37963 [70:23:46<24:05:14, 10.04s/it]
 77%|███████▋  | 29328/37963 [70:23:53<22:18:06,  9.30s/it]
 77%|███████▋  | 29329/37963 [70:24:07<25:29:35, 10.63s/it]
 77%|███████▋  | 29330/37963 [70:24:14<23:11:43,  9.67s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '3.411', 'learning_rate': '2.592e-06', 'epoch': '0.7726'}

 77%|███████▋  | 29330/37963 [70:24:14<23:11:43,  9.67s/it]
 77%|███████▋  | 29331/37963 [70:24:22<21:41:41,  9.05s/it]
 77%|███████▋  | 29332/37963 [70:24:30<20:35:59,  8.59s/it]
 77%|███████▋  | 29333/37963 [70:24:37<19:49:21,  8.27s/it]
 77%|███████▋  | 29334/37963 [70:24:45<19:18:13,  8.05s/it]
 77%|███████▋  | 29335/37963 [70:24:52<18:55:40,  7.90s/it]
 77%|███████▋  | 29336/37963 [70:24:59<18:32:07,  7.73s/it]
 77%|███████▋  | 29337/37963 [70:25:14<23:08:43,  9.66s/it]
 77%|███████▋  | 29338/37963 [70:25:21<21:39:29,  9.04s/it]
 77%|███████▋  | 29339/37963 [70:25:29<20:28:47,  8.55s/it]
 77%|███████▋  | 29340/37963 [70:25:43<24:34:48, 10.26s/it]
                                                           
{'loss': '0.119', 'grad_norm': '2.145', 'learning_rate': '2.587e-06', 'epoch': '0.7729'}

 77%|███████▋  | 29340/37963 [70:25:43<24:34:48, 10.26s/it]
 77%|███████▋  | 29341/37963 [70:25:50<22:39:07,  9.46s/it]
 77%|███████▋  | 29342/37963 [70:25:58<21:08:56,  8.83s/it]
 77%|███████▋  | 29343/37963 [70:26:05<20:11:34,  8.43s/it]
 77%|███████▋  | 29344/37963 [70:26:13<19:34:21,  8.18s/it]
 77%|███████▋  | 29345/37963 [70:26:27<23:46:40,  9.93s/it]
 77%|███████▋  | 29346/37963 [70:26:35<22:03:16,  9.21s/it]
 77%|███████▋  | 29347/37963 [70:26:42<20:47:43,  8.69s/it]
 77%|███████▋  | 29348/37963 [70:26:50<19:58:52,  8.35s/it]
 77%|███████▋  | 29349/37963 [70:26:57<19:15:52,  8.05s/it]
 77%|███████▋  | 29350/37963 [70:27:04<18:53:44,  7.90s/it]
                                                           
{'loss': '0.0937', 'grad_norm': '2.251', 'learning_rate': '2.581e-06', 'epoch': '0.7731'}

 77%|███████▋  | 29350/37963 [70:27:04<18:53:44,  7.90s/it]
 77%|███████▋  | 29351/37963 [70:27:12<18:38:06,  7.79s/it]
 77%|███████▋  | 29352/37963 [70:27:19<18:26:38,  7.71s/it]
 77%|███████▋  | 29353/37963 [70:27:33<22:56:07,  9.59s/it]
 77%|███████▋  | 29354/37963 [70:27:41<21:36:05,  9.03s/it]
 77%|███████▋  | 29355/37963 [70:27:55<25:10:04, 10.53s/it]
 77%|███████▋  | 29356/37963 [70:28:03<23:08:25,  9.68s/it]
 77%|███████▋  | 29357/37963 [70:28:10<21:31:03,  9.00s/it]
 77%|███████▋  | 29358/37963 [70:28:18<20:28:09,  8.56s/it]
 77%|███████▋  | 29359/37963 [70:28:25<19:44:49,  8.26s/it]
 77%|███████▋  | 29360/37963 [70:28:33<19:11:48,  8.03s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '3.681', 'learning_rate': '2.575e-06', 'epoch': '0.7734'}

 77%|███████▋  | 29360/37963 [70:28:33<19:11:48,  8.03s/it]
 77%|███████▋  | 29361/37963 [70:28:40<18:50:15,  7.88s/it]
 77%|███████▋  | 29362/37963 [70:28:48<18:39:14,  7.81s/it]
 77%|███████▋  | 29363/37963 [70:28:55<18:18:26,  7.66s/it]
 77%|███████▋  | 29364/37963 [70:29:03<18:12:48,  7.63s/it]
 77%|███████▋  | 29365/37963 [70:29:11<18:14:54,  7.64s/it]
 77%|███████▋  | 29366/37963 [70:29:18<18:10:59,  7.61s/it]
 77%|███████▋  | 29367/37963 [70:29:26<18:06:24,  7.58s/it]
 77%|███████▋  | 29368/37963 [70:29:33<18:06:09,  7.58s/it]
 77%|███████▋  | 29369/37963 [70:29:41<18:09:48,  7.61s/it]
 77%|███████▋  | 29370/37963 [70:29:48<18:06:32,  7.59s/it]
                                                           
{'loss': '0.0949', 'grad_norm': '2.545', 'learning_rate': '2.57e-06', 'epoch': '0.7737'}

 77%|███████▋  | 29370/37963 [70:29:48<18:06:32,  7.59s/it]
 77%|███████▋  | 29371/37963 [70:29:56<18:03:17,  7.56s/it]
 77%|███████▋  | 29372/37963 [70:30:03<17:55:51,  7.51s/it]
 77%|███████▋  | 29373/37963 [70:30:17<22:31:43,  9.44s/it]
 77%|███████▋  | 29374/37963 [70:30:25<21:09:32,  8.87s/it]
 77%|███████▋  | 29375/37963 [70:30:33<20:18:06,  8.51s/it]
 77%|███████▋  | 29376/37963 [70:30:47<24:14:23, 10.16s/it]
 77%|███████▋  | 29377/37963 [70:30:54<22:17:22,  9.35s/it]
 77%|███████▋  | 29378/37963 [70:31:02<21:02:16,  8.82s/it]
 77%|███████▋  | 29379/37963 [70:31:09<20:07:29,  8.44s/it]
 77%|███████▋  | 29380/37963 [70:31:23<24:13:46, 10.16s/it]
                                                           
{'loss': '0.1069', 'grad_norm': '2.697', 'learning_rate': '2.564e-06', 'epoch': '0.7739'}

 77%|███████▋  | 29380/37963 [70:31:23<24:13:46, 10.16s/it]
 77%|███████▋  | 29381/37963 [70:31:31<22:20:58,  9.38s/it]
 77%|███████▋  | 29382/37963 [70:31:39<21:09:34,  8.88s/it]
 77%|███████▋  | 29383/37963 [70:31:46<20:11:17,  8.47s/it]
 77%|███████▋  | 29384/37963 [70:31:54<19:32:49,  8.20s/it]
 77%|███████▋  | 29385/37963 [70:32:08<23:41:15,  9.94s/it]
 77%|███████▋  | 29386/37963 [70:32:15<21:48:14,  9.15s/it]
 77%|███████▋  | 29387/37963 [70:32:22<20:35:46,  8.65s/it]
 77%|███████▋  | 29388/37963 [70:32:30<19:53:06,  8.35s/it]
 77%|███████▋  | 29389/37963 [70:32:38<19:21:30,  8.13s/it]
 77%|███████▋  | 29390/37963 [70:32:45<18:49:18,  7.90s/it]
                                                           
{'loss': '0.1073', 'grad_norm': '2.344', 'learning_rate': '2.558e-06', 'epoch': '0.7742'}

 77%|███████▋  | 29390/37963 [70:32:45<18:49:18,  7.90s/it]
 77%|███████▋  | 29391/37963 [70:32:59<23:04:55,  9.69s/it]
 77%|███████▋  | 29392/37963 [70:33:06<21:20:24,  8.96s/it]
 77%|███████▋  | 29393/37963 [70:33:20<24:48:26, 10.42s/it]
 77%|███████▋  | 29394/37963 [70:33:28<22:43:21,  9.55s/it]
 77%|███████▋  | 29395/37963 [70:33:35<21:07:01,  8.87s/it]
 77%|███████▋  | 29396/37963 [70:33:42<20:08:48,  8.47s/it]
 77%|███████▋  | 29397/37963 [70:33:50<19:28:14,  8.18s/it]
 77%|███████▋  | 29398/37963 [70:33:57<18:59:09,  7.98s/it]
 77%|███████▋  | 29399/37963 [70:34:05<18:50:55,  7.92s/it]
 77%|███████▋  | 29400/37963 [70:34:13<18:35:41,  7.82s/it]
                                                           
{'loss': '0.103', 'grad_norm': '3.449', 'learning_rate': '2.552e-06', 'epoch': '0.7744'}

 77%|███████▋  | 29400/37963 [70:34:13<18:35:41,  7.82s/it]
 77%|███████▋  | 29401/37963 [70:34:27<23:14:04,  9.77s/it]
 77%|███████▋  | 29402/37963 [70:34:34<21:24:22,  9.00s/it]
 77%|███████▋  | 29403/37963 [70:34:42<20:20:34,  8.56s/it]
 77%|███████▋  | 29404/37963 [70:34:56<24:03:34, 10.12s/it]
 77%|███████▋  | 29405/37963 [70:35:03<22:02:33,  9.27s/it]
 77%|███████▋  | 29406/37963 [70:35:10<20:49:34,  8.76s/it]
 77%|███████▋  | 29407/37963 [70:35:18<19:52:29,  8.36s/it]
 77%|███████▋  | 29408/37963 [70:35:25<19:16:02,  8.11s/it]
 77%|███████▋  | 29409/37963 [70:35:33<18:51:55,  7.94s/it]
 77%|███████▋  | 29410/37963 [70:35:40<18:20:08,  7.72s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '1.914', 'learning_rate': '2.547e-06', 'epoch': '0.7747'}

 77%|███████▋  | 29410/37963 [70:35:40<18:20:08,  7.72s/it]
 77%|███████▋  | 29411/37963 [70:35:48<18:09:45,  7.65s/it]
 77%|███████▋  | 29412/37963 [70:35:55<18:04:50,  7.61s/it]
 77%|███████▋  | 29413/37963 [70:36:03<17:58:02,  7.57s/it]
 77%|███████▋  | 29414/37963 [70:36:10<17:56:49,  7.56s/it]
 77%|███████▋  | 29415/37963 [70:36:18<17:58:41,  7.57s/it]
 77%|███████▋  | 29416/37963 [70:36:25<17:56:26,  7.56s/it]
 77%|███████▋  | 29417/37963 [70:36:39<22:30:44,  9.48s/it]
 77%|███████▋  | 29418/37963 [70:36:47<21:12:05,  8.93s/it]
 77%|███████▋  | 29419/37963 [70:36:54<20:10:31,  8.50s/it]
 77%|███████▋  | 29420/37963 [70:37:02<19:33:33,  8.24s/it]
                                                           
{'loss': '0.1181', 'grad_norm': '3.57', 'learning_rate': '2.541e-06', 'epoch': '0.775'}

 77%|███████▋  | 29420/37963 [70:37:02<19:33:33,  8.24s/it]
 77%|███████▋  | 29421/37963 [70:37:16<23:32:54,  9.92s/it]
 78%|███████▊  | 29422/37963 [70:37:23<21:47:50,  9.19s/it]
 78%|███████▊  | 29423/37963 [70:37:31<20:35:42,  8.68s/it]
 78%|███████▊  | 29424/37963 [70:37:38<19:46:13,  8.34s/it]
 78%|███████▊  | 29425/37963 [70:37:46<19:10:17,  8.08s/it]
 78%|███████▊  | 29426/37963 [70:38:00<23:27:24,  9.89s/it]
 78%|███████▊  | 29427/37963 [70:38:07<21:41:31,  9.15s/it]
 78%|███████▊  | 29428/37963 [70:38:15<20:37:44,  8.70s/it]
 78%|███████▊  | 29429/37963 [70:38:22<19:39:53,  8.30s/it]
 78%|███████▊  | 29430/37963 [70:38:30<19:09:58,  8.09s/it]
                                                           
{'loss': '0.09967', 'grad_norm': '2.278', 'learning_rate': '2.535e-06', 'epoch': '0.7752'}

 78%|███████▊  | 29430/37963 [70:38:30<19:09:58,  8.09s/it]
 78%|███████▊  | 29431/37963 [70:38:38<18:46:35,  7.92s/it]
 78%|███████▊  | 29432/37963 [70:38:45<18:31:02,  7.81s/it]
 78%|███████▊  | 29433/37963 [70:38:52<18:05:19,  7.63s/it]
 78%|███████▊  | 29434/37963 [70:39:00<17:58:44,  7.59s/it]
 78%|███████▊  | 29435/37963 [70:39:07<17:59:20,  7.59s/it]
 78%|███████▊  | 29436/37963 [70:39:21<22:31:02,  9.51s/it]
 78%|███████▊  | 29437/37963 [70:39:29<21:09:40,  8.94s/it]
 78%|███████▊  | 29438/37963 [70:39:36<20:08:13,  8.50s/it]
 78%|███████▊  | 29439/37963 [70:39:44<19:14:37,  8.13s/it]
 78%|███████▊  | 29440/37963 [70:39:58<23:39:41,  9.99s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '2.499', 'learning_rate': '2.53e-06', 'epoch': '0.7755'}

 78%|███████▊  | 29440/37963 [70:39:58<23:39:41,  9.99s/it]
 78%|███████▊  | 29441/37963 [70:40:06<21:59:37,  9.29s/it]
 78%|███████▊  | 29442/37963 [70:40:13<20:39:21,  8.73s/it]
 78%|███████▊  | 29443/37963 [70:40:21<19:58:38,  8.44s/it]
 78%|███████▊  | 29444/37963 [70:40:35<23:54:34, 10.10s/it]
 78%|███████▊  | 29445/37963 [70:40:42<22:06:24,  9.34s/it]
 78%|███████▊  | 29446/37963 [70:40:56<25:22:29, 10.73s/it]
 78%|███████▊  | 29447/37963 [70:41:04<23:06:27,  9.77s/it]
 78%|███████▊  | 29448/37963 [70:41:11<21:30:15,  9.09s/it]
 78%|███████▊  | 29449/37963 [70:41:19<20:12:06,  8.54s/it]
 78%|███████▊  | 29450/37963 [70:41:26<19:33:07,  8.27s/it]
                                                           
{'loss': '0.1119', 'grad_norm': '3.412', 'learning_rate': '2.524e-06', 'epoch': '0.7758'}

 78%|███████▊  | 29450/37963 [70:41:26<19:33:07,  8.27s/it]
 78%|███████▊  | 29451/37963 [70:41:34<18:48:36,  7.96s/it]
 78%|███████▊  | 29452/37963 [70:41:48<23:03:28,  9.75s/it]
 78%|███████▊  | 29453/37963 [70:41:55<21:34:51,  9.13s/it]
 78%|███████▊  | 29454/37963 [70:42:03<20:28:27,  8.66s/it]
 78%|███████▊  | 29455/37963 [70:42:10<19:40:51,  8.33s/it]
 78%|███████▊  | 29456/37963 [70:42:18<19:08:49,  8.10s/it]
 78%|███████▊  | 29457/37963 [70:42:26<18:50:34,  7.97s/it]
 78%|███████▊  | 29458/37963 [70:42:33<18:32:50,  7.85s/it]
 78%|███████▊  | 29459/37963 [70:42:41<18:15:13,  7.73s/it]
 78%|███████▊  | 29460/37963 [70:42:48<17:53:04,  7.57s/it]
                                                           
{'loss': '0.1077', 'grad_norm': '2.493', 'learning_rate': '2.518e-06', 'epoch': '0.776'}

 78%|███████▊  | 29460/37963 [70:42:48<17:53:04,  7.57s/it]
 78%|███████▊  | 29461/37963 [70:43:02<22:23:34,  9.48s/it]
 78%|███████▊  | 29462/37963 [70:43:09<21:02:00,  8.91s/it]
 78%|███████▊  | 29463/37963 [70:43:17<20:02:24,  8.49s/it]
 78%|███████▊  | 29464/37963 [70:43:24<19:13:30,  8.14s/it]
 78%|███████▊  | 29465/37963 [70:43:32<18:44:02,  7.94s/it]
 78%|███████▊  | 29466/37963 [70:43:39<18:26:41,  7.81s/it]
 78%|███████▊  | 29467/37963 [70:43:47<18:18:02,  7.75s/it]
 78%|███████▊  | 29468/37963 [70:43:54<18:06:55,  7.68s/it]
 78%|███████▊  | 29469/37963 [70:44:08<22:23:35,  9.49s/it]
 78%|███████▊  | 29470/37963 [70:44:16<21:03:24,  8.93s/it]
                                                           
{'loss': '0.1084', 'grad_norm': '2.877', 'learning_rate': '2.513e-06', 'epoch': '0.7763'}

 78%|███████▊  | 29470/37963 [70:44:16<21:03:24,  8.93s/it]
 78%|███████▊  | 29471/37963 [70:44:23<20:01:53,  8.49s/it]
 78%|███████▊  | 29472/37963 [70:44:31<19:20:08,  8.20s/it]
 78%|███████▊  | 29473/37963 [70:44:38<18:52:22,  8.00s/it]
 78%|███████▊  | 29474/37963 [70:44:46<18:30:27,  7.85s/it]
 78%|███████▊  | 29475/37963 [70:44:53<18:21:44,  7.79s/it]
 78%|███████▊  | 29476/37963 [70:45:07<22:45:41,  9.65s/it]
 78%|███████▊  | 29477/37963 [70:45:14<21:03:22,  8.93s/it]
 78%|███████▊  | 29478/37963 [70:45:22<20:05:22,  8.52s/it]
 78%|███████▊  | 29479/37963 [70:45:30<19:29:49,  8.27s/it]
 78%|███████▊  | 29480/37963 [70:45:37<18:57:00,  8.04s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '3.108', 'learning_rate': '2.507e-06', 'epoch': '0.7765'}

 78%|███████▊  | 29480/37963 [70:45:37<18:57:00,  8.04s/it]
 78%|███████▊  | 29481/37963 [70:45:45<18:37:07,  7.90s/it]
 78%|███████▊  | 29482/37963 [70:45:52<18:22:26,  7.80s/it]
 78%|███████▊  | 29483/37963 [70:46:00<18:12:00,  7.73s/it]
 78%|███████▊  | 29484/37963 [70:46:07<18:04:20,  7.67s/it]
 78%|███████▊  | 29485/37963 [70:46:15<17:59:54,  7.64s/it]
 78%|███████▊  | 29486/37963 [70:46:23<17:56:05,  7.62s/it]
 78%|███████▊  | 29487/37963 [70:46:30<17:57:04,  7.62s/it]
 78%|███████▊  | 29488/37963 [70:46:37<17:40:32,  7.51s/it]
 78%|███████▊  | 29489/37963 [70:46:52<22:15:43,  9.46s/it]
 78%|███████▊  | 29490/37963 [70:47:06<25:30:41, 10.84s/it]
                                                           
{'loss': '0.1151', 'grad_norm': '1.711', 'learning_rate': '2.501e-06', 'epoch': '0.7768'}

 78%|███████▊  | 29490/37963 [70:47:06<25:30:41, 10.84s/it]
 78%|███████▊  | 29491/37963 [70:47:13<22:56:02,  9.75s/it]
 78%|███████▊  | 29492/37963 [70:47:20<21:26:01,  9.11s/it]
 78%|███████▊  | 29493/37963 [70:47:28<20:08:52,  8.56s/it]
 78%|███████▊  | 29494/37963 [70:47:42<24:04:11, 10.23s/it]
 78%|███████▊  | 29495/37963 [70:47:49<22:10:01,  9.42s/it]
 78%|███████▊  | 29496/37963 [70:47:57<20:43:56,  8.81s/it]
 78%|███████▊  | 29497/37963 [70:48:04<19:48:27,  8.42s/it]
 78%|███████▊  | 29498/37963 [70:48:12<19:08:19,  8.14s/it]
 78%|███████▊  | 29499/37963 [70:48:19<18:41:13,  7.95s/it]
 78%|███████▊  | 29500/37963 [70:48:39<27:09:57, 11.56s/it]
                                                           
{'loss': '0.1079', 'grad_norm': '2.588', 'learning_rate': '2.496e-06', 'epoch': '0.7771'}

 78%|███████▊  | 29500/37963 [70:48:39<27:09:57, 11.56s/it]
 78%|███████▊  | 29501/37963 [70:48:47<24:11:22, 10.29s/it]
 78%|███████▊  | 29502/37963 [70:48:54<22:14:45,  9.47s/it]
 78%|███████▊  | 29503/37963 [70:49:02<20:54:01,  8.89s/it]
 78%|███████▊  | 29504/37963 [70:49:09<19:53:23,  8.46s/it]
 78%|███████▊  | 29505/37963 [70:49:23<23:50:53, 10.15s/it]
 78%|███████▊  | 29506/37963 [70:49:31<21:58:34,  9.35s/it]
 78%|███████▊  | 29507/37963 [70:49:38<20:40:06,  8.80s/it]
 78%|███████▊  | 29508/37963 [70:49:46<19:45:10,  8.41s/it]
 78%|███████▊  | 29509/37963 [70:49:53<19:06:24,  8.14s/it]
 78%|███████▊  | 29510/37963 [70:50:01<18:44:09,  7.98s/it]
                                                           
{'loss': '0.1062', 'grad_norm': '1.669', 'learning_rate': '2.49e-06', 'epoch': '0.7773'}

 78%|███████▊  | 29510/37963 [70:50:01<18:44:09,  7.98s/it]
 78%|███████▊  | 29511/37963 [70:50:08<18:17:26,  7.79s/it]
 78%|███████▊  | 29512/37963 [70:50:16<18:15:16,  7.78s/it]
 78%|███████▊  | 29513/37963 [70:50:23<17:55:42,  7.64s/it]
 78%|███████▊  | 29514/37963 [70:50:31<17:51:16,  7.61s/it]
 78%|███████▊  | 29515/37963 [70:50:38<17:48:36,  7.59s/it]
 78%|███████▊  | 29516/37963 [70:50:46<17:46:31,  7.58s/it]
 78%|███████▊  | 29517/37963 [70:50:53<17:38:42,  7.52s/it]
 78%|███████▊  | 29518/37963 [70:51:01<17:38:13,  7.52s/it]
 78%|███████▊  | 29519/37963 [70:51:08<17:39:26,  7.53s/it]
 78%|███████▊  | 29520/37963 [70:51:16<17:26:40,  7.44s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '1.547', 'learning_rate': '2.485e-06', 'epoch': '0.7776'}

 78%|███████▊  | 29520/37963 [70:51:16<17:26:40,  7.44s/it]
 78%|███████▊  | 29521/37963 [70:51:29<21:54:52,  9.35s/it]
 78%|███████▊  | 29522/37963 [70:51:43<25:12:54, 10.75s/it]
 78%|███████▊  | 29523/37963 [70:51:51<22:55:47,  9.78s/it]
 78%|███████▊  | 29524/37963 [70:51:58<21:09:44,  9.03s/it]
 78%|███████▊  | 29525/37963 [70:52:06<20:03:54,  8.56s/it]
 78%|███████▊  | 29526/37963 [70:52:13<19:20:59,  8.26s/it]
 78%|███████▊  | 29527/37963 [70:52:21<18:53:53,  8.06s/it]
 78%|███████▊  | 29528/37963 [70:52:28<18:36:41,  7.94s/it]
 78%|███████▊  | 29529/37963 [70:52:36<18:24:45,  7.86s/it]
 78%|███████▊  | 29530/37963 [70:52:44<18:14:02,  7.78s/it]
                                                           
{'loss': '0.0968', 'grad_norm': '1.781', 'learning_rate': '2.479e-06', 'epoch': '0.7779'}

 78%|███████▊  | 29530/37963 [70:52:44<18:14:02,  7.78s/it]
 78%|███████▊  | 29531/37963 [70:52:51<18:03:09,  7.71s/it]
 78%|███████▊  | 29532/37963 [70:52:59<17:58:44,  7.68s/it]
 78%|███████▊  | 29533/37963 [70:53:06<17:53:53,  7.64s/it]
 78%|███████▊  | 29534/37963 [70:53:14<17:48:14,  7.60s/it]
 78%|███████▊  | 29535/37963 [70:53:21<17:44:18,  7.58s/it]
 78%|███████▊  | 29536/37963 [70:53:29<17:41:05,  7.55s/it]
 78%|███████▊  | 29537/37963 [70:53:36<17:39:04,  7.54s/it]
 78%|███████▊  | 29538/37963 [70:53:50<22:01:46,  9.41s/it]
 78%|███████▊  | 29539/37963 [70:53:58<20:38:25,  8.82s/it]
 78%|███████▊  | 29540/37963 [70:54:05<19:44:53,  8.44s/it]
                                                           
{'loss': '0.1103', 'grad_norm': '2.439', 'learning_rate': '2.473e-06', 'epoch': '0.7781'}

 78%|███████▊  | 29540/37963 [70:54:05<19:44:53,  8.44s/it]
 78%|███████▊  | 29541/37963 [70:54:13<19:00:00,  8.12s/it]
 78%|███████▊  | 29542/37963 [70:54:26<23:02:18,  9.85s/it]
 78%|███████▊  | 29543/37963 [70:54:34<21:25:37,  9.16s/it]
 78%|███████▊  | 29544/37963 [70:54:48<24:43:55, 10.58s/it]
 78%|███████▊  | 29545/37963 [70:54:55<22:33:57,  9.65s/it]
 78%|███████▊  | 29546/37963 [70:55:03<21:02:35,  9.00s/it]
 78%|███████▊  | 29547/37963 [70:55:10<20:02:33,  8.57s/it]
 78%|███████▊  | 29548/37963 [70:55:18<19:20:25,  8.27s/it]
 78%|███████▊  | 29549/37963 [70:55:32<23:13:36,  9.94s/it]
 78%|███████▊  | 29550/37963 [70:55:39<21:36:46,  9.25s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '1.989', 'learning_rate': '2.468e-06', 'epoch': '0.7784'}

 78%|███████▊  | 29550/37963 [70:55:39<21:36:46,  9.25s/it]
 78%|███████▊  | 29551/37963 [70:55:47<20:24:32,  8.73s/it]
 78%|███████▊  | 29552/37963 [70:55:55<19:35:54,  8.39s/it]
 78%|███████▊  | 29553/37963 [70:56:09<23:34:09, 10.09s/it]
 78%|███████▊  | 29554/37963 [70:56:23<26:15:25, 11.24s/it]
 78%|███████▊  | 29555/37963 [70:56:30<23:46:17, 10.18s/it]
 78%|███████▊  | 29556/37963 [70:56:38<22:00:27,  9.42s/it]
 78%|███████▊  | 29557/37963 [70:56:45<20:39:45,  8.85s/it]
 78%|███████▊  | 29558/37963 [70:56:53<19:44:25,  8.46s/it]
 78%|███████▊  | 29559/37963 [70:57:00<19:01:54,  8.15s/it]
 78%|███████▊  | 29560/37963 [70:57:08<18:34:25,  7.96s/it]
                                                           
{'loss': '0.106', 'grad_norm': '1.627', 'learning_rate': '2.462e-06', 'epoch': '0.7787'}

 78%|███████▊  | 29560/37963 [70:57:08<18:34:25,  7.96s/it]
 78%|███████▊  | 29561/37963 [70:57:15<18:07:05,  7.76s/it]
 78%|███████▊  | 29562/37963 [70:57:23<18:03:32,  7.74s/it]
 78%|███████▊  | 29563/37963 [70:57:30<17:53:25,  7.67s/it]
 78%|███████▊  | 29564/37963 [70:57:38<17:54:06,  7.67s/it]
 78%|███████▊  | 29565/37963 [70:57:46<17:43:56,  7.60s/it]
 78%|███████▊  | 29566/37963 [70:57:53<17:43:06,  7.60s/it]
 78%|███████▊  | 29567/37963 [70:58:01<17:54:00,  7.68s/it]
 78%|███████▊  | 29568/37963 [70:58:08<17:46:25,  7.62s/it]
 78%|███████▊  | 29569/37963 [70:58:16<17:43:14,  7.60s/it]
 78%|███████▊  | 29570/37963 [70:58:30<22:01:04,  9.44s/it]
                                                           
{'loss': '0.114', 'grad_norm': '2.235', 'learning_rate': '2.456e-06', 'epoch': '0.7789'}

 78%|███████▊  | 29570/37963 [70:58:30<22:01:04,  9.44s/it]
 78%|███████▊  | 29571/37963 [70:58:37<20:46:09,  8.91s/it]
 78%|███████▊  | 29572/37963 [70:58:45<19:50:39,  8.51s/it]
 78%|███████▊  | 29573/37963 [70:58:53<19:09:42,  8.22s/it]
 78%|███████▊  | 29574/37963 [70:59:00<18:40:08,  8.01s/it]
 78%|███████▊  | 29575/37963 [70:59:08<18:21:19,  7.88s/it]
 78%|███████▊  | 29576/37963 [70:59:22<22:42:17,  9.75s/it]
 78%|███████▊  | 29577/37963 [70:59:29<21:13:23,  9.11s/it]
 78%|███████▊  | 29578/37963 [70:59:37<20:04:43,  8.62s/it]
 78%|███████▊  | 29579/37963 [70:59:44<19:18:43,  8.29s/it]
 78%|███████▊  | 29580/37963 [70:59:52<18:41:32,  8.03s/it]
                                                           
{'loss': '0.09712', 'grad_norm': '1.867', 'learning_rate': '2.451e-06', 'epoch': '0.7792'}

 78%|███████▊  | 29580/37963 [70:59:52<18:41:32,  8.03s/it]
 78%|███████▊  | 29581/37963 [70:59:59<18:19:08,  7.87s/it]
 78%|███████▊  | 29582/37963 [71:00:07<18:04:18,  7.76s/it]
 78%|███████▊  | 29583/37963 [71:00:14<17:56:48,  7.71s/it]
 78%|███████▊  | 29584/37963 [71:00:22<17:44:53,  7.63s/it]
 78%|███████▊  | 29585/37963 [71:00:29<17:37:56,  7.58s/it]
 78%|███████▊  | 29586/37963 [71:00:37<17:35:49,  7.56s/it]
 78%|███████▊  | 29587/37963 [71:00:44<17:34:21,  7.55s/it]
 78%|███████▊  | 29588/37963 [71:00:58<21:56:56,  9.43s/it]
 78%|███████▊  | 29589/37963 [71:01:12<24:53:09, 10.70s/it]
 78%|███████▊  | 29590/37963 [71:01:19<22:40:05,  9.75s/it]
                                                           
{'loss': '0.09694', 'grad_norm': '2.391', 'learning_rate': '2.445e-06', 'epoch': '0.7794'}

 78%|███████▊  | 29590/37963 [71:01:19<22:40:05,  9.75s/it]
 78%|███████▊  | 29591/37963 [71:01:27<21:06:59,  9.08s/it]
 78%|███████▊  | 29592/37963 [71:01:35<20:09:21,  8.67s/it]
 78%|███████▊  | 29593/37963 [71:01:49<23:50:32, 10.25s/it]
 78%|███████▊  | 29594/37963 [71:01:56<21:57:12,  9.44s/it]
 78%|███████▊  | 29595/37963 [71:02:10<25:06:23, 10.80s/it]
 78%|███████▊  | 29596/37963 [71:02:17<22:42:43,  9.77s/it]
 78%|███████▊  | 29597/37963 [71:02:25<20:57:26,  9.02s/it]
 78%|███████▊  | 29598/37963 [71:02:32<19:52:37,  8.55s/it]
 78%|███████▊  | 29599/37963 [71:02:40<19:07:08,  8.23s/it]
 78%|███████▊  | 29600/37963 [71:02:54<23:13:01,  9.99s/it]
                                                           
{'loss': '0.0999', 'grad_norm': '2.405', 'learning_rate': '2.44e-06', 'epoch': '0.7797'}

 78%|███████▊  | 29600/37963 [71:02:54<23:13:01,  9.99s/it]
 78%|███████▊  | 29601/37963 [71:03:01<21:15:57,  9.16s/it]
 78%|███████▊  | 29602/37963 [71:03:08<19:58:18,  8.60s/it]
 78%|███████▊  | 29603/37963 [71:03:16<19:06:07,  8.23s/it]
 78%|███████▊  | 29604/37963 [71:03:23<18:22:54,  7.92s/it]
 78%|███████▊  | 29605/37963 [71:03:30<17:57:17,  7.73s/it]
 78%|███████▊  | 29606/37963 [71:03:37<17:35:23,  7.58s/it]
 78%|███████▊  | 29607/37963 [71:03:51<22:07:06,  9.53s/it]
 78%|███████▊  | 29608/37963 [71:03:59<20:46:25,  8.95s/it]
 78%|███████▊  | 29609/37963 [71:04:07<19:49:06,  8.54s/it]
 78%|███████▊  | 29610/37963 [71:04:14<18:55:29,  8.16s/it]
                                                           
{'loss': '0.1155', 'grad_norm': '2.172', 'learning_rate': '2.434e-06', 'epoch': '0.78'}

 78%|███████▊  | 29610/37963 [71:04:14<18:55:29,  8.16s/it]
 78%|███████▊  | 29611/37963 [71:04:21<18:28:05,  7.96s/it]
 78%|███████▊  | 29612/37963 [71:04:29<18:10:55,  7.84s/it]
 78%|███████▊  | 29613/37963 [71:04:36<17:45:20,  7.66s/it]
 78%|███████▊  | 29614/37963 [71:04:44<17:43:08,  7.64s/it]
 78%|███████▊  | 29615/37963 [71:04:51<17:30:27,  7.55s/it]
 78%|███████▊  | 29616/37963 [71:04:59<17:27:18,  7.53s/it]
 78%|███████▊  | 29617/37963 [71:05:13<21:59:28,  9.49s/it]
 78%|███████▊  | 29618/37963 [71:05:20<20:44:16,  8.95s/it]
 78%|███████▊  | 29619/37963 [71:05:28<19:44:26,  8.52s/it]
 78%|███████▊  | 29620/37963 [71:05:36<19:12:12,  8.29s/it]
                                                           
{'loss': '0.1034', 'grad_norm': '2.025', 'learning_rate': '2.429e-06', 'epoch': '0.7802'}

 78%|███████▊  | 29620/37963 [71:05:36<19:12:12,  8.29s/it]
 78%|███████▊  | 29621/37963 [71:05:43<18:39:03,  8.05s/it]
 78%|███████▊  | 29622/37963 [71:05:51<18:19:07,  7.91s/it]
 78%|███████▊  | 29623/37963 [71:05:58<18:04:37,  7.80s/it]
 78%|███████▊  | 29624/37963 [71:06:12<22:19:19,  9.64s/it]
 78%|███████▊  | 29625/37963 [71:06:20<20:48:21,  8.98s/it]
 78%|███████▊  | 29626/37963 [71:06:27<19:39:55,  8.49s/it]
 78%|███████▊  | 29627/37963 [71:06:34<18:53:04,  8.16s/it]
 78%|███████▊  | 29628/37963 [71:06:42<18:36:27,  8.04s/it]
 78%|███████▊  | 29629/37963 [71:06:50<18:17:59,  7.90s/it]
 78%|███████▊  | 29630/37963 [71:06:57<18:01:40,  7.79s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '1.729', 'learning_rate': '2.423e-06', 'epoch': '0.7805'}

 78%|███████▊  | 29630/37963 [71:06:57<18:01:40,  7.79s/it]
 78%|███████▊  | 29631/37963 [71:07:05<17:49:28,  7.70s/it]
 78%|███████▊  | 29632/37963 [71:07:12<17:37:53,  7.62s/it]
 78%|███████▊  | 29633/37963 [71:07:19<17:27:58,  7.55s/it]
 78%|███████▊  | 29634/37963 [71:07:27<17:23:34,  7.52s/it]
 78%|███████▊  | 29635/37963 [71:07:34<17:22:06,  7.51s/it]
 78%|███████▊  | 29636/37963 [71:07:42<17:25:57,  7.54s/it]
 78%|███████▊  | 29637/37963 [71:07:56<21:59:01,  9.51s/it]
 78%|███████▊  | 29638/37963 [71:08:04<20:41:00,  8.94s/it]
 78%|███████▊  | 29639/37963 [71:08:18<24:11:44, 10.46s/it]
 78%|███████▊  | 29640/37963 [71:08:25<22:07:48,  9.57s/it]
                                                           
{'loss': '0.1068', 'grad_norm': '3.175', 'learning_rate': '2.417e-06', 'epoch': '0.7808'}

 78%|███████▊  | 29640/37963 [71:08:25<22:07:48,  9.57s/it]
 78%|███████▊  | 29641/37963 [71:08:33<20:41:36,  8.95s/it]
 78%|███████▊  | 29642/37963 [71:08:40<19:44:25,  8.54s/it]
 78%|███████▊  | 29643/37963 [71:08:54<23:30:46, 10.17s/it]
 78%|███████▊  | 29644/37963 [71:09:02<21:44:14,  9.41s/it]
 78%|███████▊  | 29645/37963 [71:09:09<20:25:22,  8.84s/it]
 78%|███████▊  | 29646/37963 [71:09:17<19:29:10,  8.43s/it]
 78%|███████▊  | 29647/37963 [71:09:24<18:51:19,  8.16s/it]
 78%|███████▊  | 29648/37963 [71:09:32<18:24:05,  7.97s/it]
 78%|███████▊  | 29649/37963 [71:09:52<27:03:56, 11.72s/it]
 78%|███████▊  | 29650/37963 [71:10:00<24:17:59, 10.52s/it]
                                                           
{'loss': '0.09814', 'grad_norm': '2.34', 'learning_rate': '2.412e-06', 'epoch': '0.781'}

 78%|███████▊  | 29650/37963 [71:10:00<24:17:59, 10.52s/it]
 78%|███████▊  | 29651/37963 [71:10:07<22:01:21,  9.54s/it]
 78%|███████▊  | 29652/37963 [71:10:15<20:43:29,  8.98s/it]
 78%|███████▊  | 29653/37963 [71:10:23<19:43:56,  8.55s/it]
 78%|███████▊  | 29654/37963 [71:10:30<19:03:32,  8.26s/it]
 78%|███████▊  | 29655/37963 [71:10:38<18:31:28,  8.03s/it]
 78%|███████▊  | 29656/37963 [71:10:45<18:11:06,  7.88s/it]
 78%|███████▊  | 29657/37963 [71:10:53<17:55:50,  7.77s/it]
 78%|███████▊  | 29658/37963 [71:11:00<17:42:34,  7.68s/it]
 78%|███████▊  | 29659/37963 [71:11:08<17:28:48,  7.58s/it]
 78%|███████▊  | 29660/37963 [71:11:15<17:24:58,  7.55s/it]
                                                           
{'loss': '0.09743', 'grad_norm': '1.864', 'learning_rate': '2.406e-06', 'epoch': '0.7813'}

 78%|███████▊  | 29660/37963 [71:11:15<17:24:58,  7.55s/it]
 78%|███████▊  | 29661/37963 [71:11:23<17:24:03,  7.55s/it]
 78%|███████▊  | 29662/37963 [71:11:36<21:37:06,  9.38s/it]
 78%|███████▊  | 29663/37963 [71:11:44<20:19:02,  8.81s/it]
 78%|███████▊  | 29664/37963 [71:11:51<19:25:21,  8.43s/it]
 78%|███████▊  | 29665/37963 [71:11:59<18:49:40,  8.17s/it]
 78%|███████▊  | 29666/37963 [71:12:06<18:24:22,  7.99s/it]
 78%|███████▊  | 29667/37963 [71:12:14<18:06:07,  7.86s/it]
 78%|███████▊  | 29668/37963 [71:12:28<22:11:48,  9.63s/it]
 78%|███████▊  | 29669/37963 [71:12:35<20:54:42,  9.08s/it]
 78%|███████▊  | 29670/37963 [71:12:43<19:40:22,  8.54s/it]
                                                           
{'loss': '0.09569', 'grad_norm': '2.251', 'learning_rate': '2.401e-06', 'epoch': '0.7816'}

 78%|███████▊  | 29670/37963 [71:12:43<19:40:22,  8.54s/it]
 78%|███████▊  | 29671/37963 [71:12:50<18:53:46,  8.20s/it]
 78%|███████▊  | 29672/37963 [71:13:04<22:57:39,  9.97s/it]
 78%|███████▊  | 29673/37963 [71:13:12<21:20:53,  9.27s/it]
 78%|███████▊  | 29674/37963 [71:13:19<20:09:32,  8.76s/it]
 78%|███████▊  | 29675/37963 [71:13:27<19:18:51,  8.39s/it]
 78%|███████▊  | 29676/37963 [71:13:34<18:39:15,  8.10s/it]
 78%|███████▊  | 29677/37963 [71:13:42<18:20:24,  7.97s/it]
 78%|███████▊  | 29678/37963 [71:13:50<18:01:11,  7.83s/it]
 78%|███████▊  | 29679/37963 [71:13:57<17:47:05,  7.73s/it]
 78%|███████▊  | 29680/37963 [71:14:05<17:41:24,  7.69s/it]
                                                           
{'loss': '0.1052', 'grad_norm': '1.88', 'learning_rate': '2.395e-06', 'epoch': '0.7818'}

 78%|███████▊  | 29680/37963 [71:14:05<17:41:24,  7.69s/it]
 78%|███████▊  | 29681/37963 [71:14:12<17:34:15,  7.64s/it]
 78%|███████▊  | 29682/37963 [71:14:26<22:02:28,  9.58s/it]
 78%|███████▊  | 29683/37963 [71:14:34<20:41:25,  9.00s/it]
 78%|███████▊  | 29684/37963 [71:14:48<24:08:11, 10.50s/it]
 78%|███████▊  | 29685/37963 [71:14:55<22:04:17,  9.60s/it]
 78%|███████▊  | 29686/37963 [71:15:03<20:37:53,  8.97s/it]
 78%|███████▊  | 29687/37963 [71:15:11<19:38:50,  8.55s/it]
 78%|███████▊  | 29688/37963 [71:15:18<18:59:31,  8.26s/it]
 78%|███████▊  | 29689/37963 [71:15:32<22:51:17,  9.94s/it]
 78%|███████▊  | 29690/37963 [71:15:40<21:17:16,  9.26s/it]
                                                           
{'loss': '0.109', 'grad_norm': '3.555', 'learning_rate': '2.39e-06', 'epoch': '0.7821'}

 78%|███████▊  | 29690/37963 [71:15:40<21:17:16,  9.26s/it]
 78%|███████▊  | 29691/37963 [71:15:47<20:04:20,  8.74s/it]
 78%|███████▊  | 29692/37963 [71:15:55<19:14:54,  8.38s/it]
 78%|███████▊  | 29693/37963 [71:16:02<18:45:32,  8.17s/it]
 78%|███████▊  | 29694/37963 [71:16:10<18:23:33,  8.01s/it]
 78%|███████▊  | 29695/37963 [71:16:18<18:03:04,  7.86s/it]
 78%|███████▊  | 29696/37963 [71:16:25<17:47:45,  7.75s/it]
 78%|███████▊  | 29697/37963 [71:16:39<22:06:39,  9.63s/it]
 78%|███████▊  | 29698/37963 [71:16:47<20:44:39,  9.04s/it]
 78%|███████▊  | 29699/37963 [71:16:54<19:42:43,  8.59s/it]
 78%|███████▊  | 29700/37963 [71:17:02<19:02:03,  8.29s/it]
                                                           
{'loss': '0.1073', 'grad_norm': '2.409', 'learning_rate': '2.384e-06', 'epoch': '0.7823'}

 78%|███████▊  | 29700/37963 [71:17:02<19:02:03,  8.29s/it]
 78%|███████▊  | 29701/37963 [71:17:16<22:59:47, 10.02s/it]
 78%|███████▊  | 29702/37963 [71:17:23<21:06:28,  9.20s/it]
 78%|███████▊  | 29703/37963 [71:17:31<19:54:41,  8.68s/it]
 78%|███████▊  | 29704/37963 [71:17:38<19:07:56,  8.34s/it]
 78%|███████▊  | 29705/37963 [71:17:46<18:32:33,  8.08s/it]
 78%|███████▊  | 29706/37963 [71:17:53<18:03:35,  7.87s/it]
 78%|███████▊  | 29707/37963 [71:18:01<17:47:16,  7.76s/it]
 78%|███████▊  | 29708/37963 [71:18:08<17:37:07,  7.68s/it]
 78%|███████▊  | 29709/37963 [71:18:16<17:32:03,  7.65s/it]
 78%|███████▊  | 29710/37963 [71:18:23<17:29:00,  7.63s/it]
                                                           
{'loss': '0.1073', 'grad_norm': '2.676', 'learning_rate': '2.379e-06', 'epoch': '0.7826'}

 78%|███████▊  | 29710/37963 [71:18:23<17:29:00,  7.63s/it]
 78%|███████▊  | 29711/37963 [71:18:31<17:28:41,  7.62s/it]
 78%|███████▊  | 29712/37963 [71:18:39<17:32:47,  7.66s/it]
 78%|███████▊  | 29713/37963 [71:18:46<17:23:11,  7.59s/it]
 78%|███████▊  | 29714/37963 [71:18:53<17:19:48,  7.56s/it]
 78%|███████▊  | 29715/37963 [71:19:01<17:17:59,  7.55s/it]
 78%|███████▊  | 29716/37963 [71:19:15<21:48:40,  9.52s/it]
 78%|███████▊  | 29717/37963 [71:19:23<20:27:12,  8.93s/it]
 78%|███████▊  | 29718/37963 [71:19:36<23:42:53, 10.35s/it]
 78%|███████▊  | 29719/37963 [71:19:44<21:42:47,  9.48s/it]
 78%|███████▊  | 29720/37963 [71:19:51<20:26:44,  8.93s/it]
                                                           
{'loss': '0.1137', 'grad_norm': '2.752', 'learning_rate': '2.373e-06', 'epoch': '0.7829'}

 78%|███████▊  | 29720/37963 [71:19:51<20:26:44,  8.93s/it]
 78%|███████▊  | 29721/37963 [71:19:59<19:26:26,  8.49s/it]
 78%|███████▊  | 29722/37963 [71:20:06<18:45:14,  8.19s/it]
 78%|███████▊  | 29723/37963 [71:20:20<22:40:09,  9.90s/it]
 78%|███████▊  | 29724/37963 [71:20:28<21:07:10,  9.23s/it]
 78%|███████▊  | 29725/37963 [71:20:42<24:11:28, 10.57s/it]
 78%|███████▊  | 29726/37963 [71:20:49<22:06:21,  9.66s/it]
 78%|███████▊  | 29727/37963 [71:20:57<20:39:18,  9.03s/it]
 78%|███████▊  | 29728/37963 [71:21:11<24:01:55, 10.51s/it]
 78%|███████▊  | 29729/37963 [71:21:18<21:57:45,  9.60s/it]
 78%|███████▊  | 29730/37963 [71:21:26<20:33:28,  8.99s/it]
                                                           
{'loss': '0.103', 'grad_norm': '2.084', 'learning_rate': '2.368e-06', 'epoch': '0.7831'}

 78%|███████▊  | 29730/37963 [71:21:26<20:33:28,  8.99s/it]
 78%|███████▊  | 29731/37963 [71:21:33<19:29:58,  8.53s/it]
 78%|███████▊  | 29732/37963 [71:21:41<18:50:18,  8.24s/it]
 78%|███████▊  | 29733/37963 [71:21:48<18:15:02,  7.98s/it]
 78%|███████▊  | 29734/37963 [71:21:56<17:54:58,  7.84s/it]
 78%|███████▊  | 29735/37963 [71:22:09<22:00:57,  9.63s/it]
 78%|███████▊  | 29736/37963 [71:22:17<20:37:33,  9.03s/it]
 78%|███████▊  | 29737/37963 [71:22:24<19:25:18,  8.50s/it]
 78%|███████▊  | 29738/37963 [71:22:32<18:45:15,  8.21s/it]
 78%|███████▊  | 29739/37963 [71:22:39<18:17:42,  8.01s/it]
 78%|███████▊  | 29740/37963 [71:22:47<17:39:51,  7.73s/it]
                                                           
{'loss': '0.1049', 'grad_norm': '2.532', 'learning_rate': '2.362e-06', 'epoch': '0.7834'}

 78%|███████▊  | 29740/37963 [71:22:47<17:39:51,  7.73s/it]
 78%|███████▊  | 29741/37963 [71:22:54<17:32:01,  7.68s/it]
 78%|███████▊  | 29742/37963 [71:23:01<17:15:34,  7.56s/it]
 78%|███████▊  | 29743/37963 [71:23:09<17:12:47,  7.54s/it]
 78%|███████▊  | 29744/37963 [71:23:16<17:09:51,  7.52s/it]
 78%|███████▊  | 29745/37963 [71:23:30<21:43:15,  9.52s/it]
 78%|███████▊  | 29746/37963 [71:23:38<20:22:57,  8.93s/it]
 78%|███████▊  | 29747/37963 [71:23:46<19:27:42,  8.53s/it]
 78%|███████▊  | 29748/37963 [71:23:53<18:50:53,  8.26s/it]
 78%|███████▊  | 29749/37963 [71:24:07<22:44:11,  9.96s/it]
 78%|███████▊  | 29750/37963 [71:24:15<21:05:45,  9.25s/it]
                                                           
{'loss': '0.1104', 'grad_norm': '1.831', 'learning_rate': '2.357e-06', 'epoch': '0.7837'}

 78%|███████▊  | 29750/37963 [71:24:15<21:05:45,  9.25s/it]
 78%|███████▊  | 29751/37963 [71:24:22<19:54:16,  8.73s/it]
 78%|███████▊  | 29752/37963 [71:24:30<19:04:48,  8.37s/it]
 78%|███████▊  | 29753/37963 [71:24:37<18:30:31,  8.12s/it]
 78%|███████▊  | 29754/37963 [71:24:45<18:13:05,  7.99s/it]
 78%|███████▊  | 29755/37963 [71:24:53<17:56:40,  7.87s/it]
 78%|███████▊  | 29756/37963 [71:25:00<17:44:14,  7.78s/it]
 78%|███████▊  | 29757/37963 [71:25:08<17:35:13,  7.72s/it]
 78%|███████▊  | 29758/37963 [71:25:15<17:28:06,  7.66s/it]
 78%|███████▊  | 29759/37963 [71:25:23<17:28:43,  7.67s/it]
 78%|███████▊  | 29760/37963 [71:25:30<17:19:23,  7.60s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '1.999', 'learning_rate': '2.351e-06', 'epoch': '0.7839'}

 78%|███████▊  | 29760/37963 [71:25:30<17:19:23,  7.60s/it]
 78%|███████▊  | 29761/37963 [71:25:38<17:17:21,  7.59s/it]
 78%|███████▊  | 29762/37963 [71:25:46<17:14:39,  7.57s/it]
 78%|███████▊  | 29763/37963 [71:25:53<17:14:18,  7.57s/it]
 78%|███████▊  | 29764/37963 [71:26:07<21:33:52,  9.47s/it]
 78%|███████▊  | 29765/37963 [71:26:21<24:35:07, 10.80s/it]
 78%|███████▊  | 29766/37963 [71:26:28<22:20:35,  9.81s/it]
 78%|███████▊  | 29767/37963 [71:26:36<20:51:08,  9.16s/it]
 78%|███████▊  | 29768/37963 [71:26:44<19:42:01,  8.65s/it]
 78%|███████▊  | 29769/37963 [71:26:51<18:56:38,  8.32s/it]
 78%|███████▊  | 29770/37963 [71:27:05<22:38:46,  9.95s/it]
                                                           
{'loss': '0.1069', 'grad_norm': '3.295', 'learning_rate': '2.346e-06', 'epoch': '0.7842'}

 78%|███████▊  | 29770/37963 [71:27:05<22:38:46,  9.95s/it]
 78%|███████▊  | 29771/37963 [71:27:12<20:58:41,  9.22s/it]
 78%|███████▊  | 29772/37963 [71:27:20<19:50:16,  8.72s/it]
 78%|███████▊  | 29773/37963 [71:27:40<27:56:45, 12.28s/it]
 78%|███████▊  | 29774/37963 [71:27:48<24:40:00, 10.84s/it]
 78%|███████▊  | 29775/37963 [71:27:56<22:24:38,  9.85s/it]
 78%|███████▊  | 29776/37963 [71:28:03<20:49:20,  9.16s/it]
 78%|███████▊  | 29777/37963 [71:28:11<19:42:45,  8.67s/it]
 78%|███████▊  | 29778/37963 [71:28:18<18:41:22,  8.22s/it]
 78%|███████▊  | 29779/37963 [71:28:25<18:10:51,  8.00s/it]
 78%|███████▊  | 29780/37963 [71:28:33<17:51:26,  7.86s/it]
                                                           
{'loss': '0.1005', 'grad_norm': '1.65', 'learning_rate': '2.34e-06', 'epoch': '0.7845'}

 78%|███████▊  | 29780/37963 [71:28:33<17:51:26,  7.86s/it]
 78%|███████▊  | 29781/37963 [71:28:40<17:43:46,  7.80s/it]
 78%|███████▊  | 29782/37963 [71:28:48<17:34:27,  7.73s/it]
 78%|███████▊  | 29783/37963 [71:28:56<17:28:49,  7.69s/it]
 78%|███████▊  | 29784/37963 [71:29:03<17:19:26,  7.63s/it]
 78%|███████▊  | 29785/37963 [71:29:11<17:15:04,  7.59s/it]
 78%|███████▊  | 29786/37963 [71:29:24<21:33:16,  9.49s/it]
 78%|███████▊  | 29787/37963 [71:29:32<20:11:48,  8.89s/it]
 78%|███████▊  | 29788/37963 [71:29:39<19:12:43,  8.46s/it]
 78%|███████▊  | 29789/37963 [71:29:53<22:57:15, 10.11s/it]
 78%|███████▊  | 29790/37963 [71:30:01<21:10:01,  9.32s/it]
                                                           
{'loss': '0.08754', 'grad_norm': '3.122', 'learning_rate': '2.335e-06', 'epoch': '0.7847'}

 78%|███████▊  | 29790/37963 [71:30:01<21:10:01,  9.32s/it]
 78%|███████▊  | 29791/37963 [71:30:08<19:52:33,  8.76s/it]
 78%|███████▊  | 29792/37963 [71:30:16<19:02:28,  8.39s/it]
 78%|███████▊  | 29793/37963 [71:30:23<18:28:52,  8.14s/it]
 78%|███████▊  | 29794/37963 [71:30:31<18:04:59,  7.97s/it]
 78%|███████▊  | 29795/37963 [71:30:39<17:52:40,  7.88s/it]
 78%|███████▊  | 29796/37963 [71:30:46<17:35:23,  7.75s/it]
 78%|███████▊  | 29797/37963 [71:30:54<17:29:56,  7.71s/it]
 78%|███████▊  | 29798/37963 [71:31:08<21:46:54,  9.60s/it]
 78%|███████▊  | 29799/37963 [71:31:15<20:12:06,  8.91s/it]
 78%|███████▊  | 29800/37963 [71:31:23<19:17:12,  8.51s/it]
                                                           
{'loss': '0.09836', 'grad_norm': '2.02', 'learning_rate': '2.329e-06', 'epoch': '0.785'}

 78%|███████▊  | 29800/37963 [71:31:23<19:17:12,  8.51s/it]
 79%|███████▊  | 29801/37963 [71:31:30<18:37:21,  8.21s/it]
 79%|███████▊  | 29802/37963 [71:31:37<18:01:01,  7.95s/it]
 79%|███████▊  | 29803/37963 [71:31:45<17:44:16,  7.83s/it]
 79%|███████▊  | 29804/37963 [71:31:53<17:34:35,  7.76s/it]
 79%|███████▊  | 29805/37963 [71:32:00<17:26:45,  7.70s/it]
 79%|███████▊  | 29806/37963 [71:32:07<17:09:36,  7.57s/it]
 79%|███████▊  | 29807/37963 [71:32:15<17:16:13,  7.62s/it]
 79%|███████▊  | 29808/37963 [71:32:23<17:09:10,  7.57s/it]
 79%|███████▊  | 29809/37963 [71:32:30<17:00:02,  7.51s/it]
 79%|███████▊  | 29810/37963 [71:32:37<16:57:17,  7.49s/it]
                                                           
{'loss': '0.09595', 'grad_norm': '2.688', 'learning_rate': '2.324e-06', 'epoch': '0.7852'}

 79%|███████▊  | 29810/37963 [71:32:37<16:57:17,  7.49s/it]
 79%|███████▊  | 29811/37963 [71:32:45<16:49:13,  7.43s/it]
 79%|███████▊  | 29812/37963 [71:32:59<21:14:11,  9.38s/it]
 79%|███████▊  | 29813/37963 [71:33:06<20:00:00,  8.83s/it]
 79%|███████▊  | 29814/37963 [71:33:14<19:04:02,  8.42s/it]
 79%|███████▊  | 29815/37963 [71:33:21<18:30:03,  8.17s/it]
 79%|███████▊  | 29816/37963 [71:33:35<22:25:39,  9.91s/it]
 79%|███████▊  | 29817/37963 [71:33:56<29:32:57, 13.06s/it]
 79%|███████▊  | 29818/37963 [71:34:03<25:53:13, 11.44s/it]
 79%|███████▊  | 29819/37963 [71:34:11<23:21:15, 10.32s/it]
 79%|███████▊  | 29820/37963 [71:34:25<25:50:08, 11.42s/it]
                                                           
{'loss': '0.1056', 'grad_norm': '2.673', 'learning_rate': '2.318e-06', 'epoch': '0.7855'}

 79%|███████▊  | 29820/37963 [71:34:25<25:50:08, 11.42s/it]
 79%|███████▊  | 29821/37963 [71:34:33<23:12:10, 10.26s/it]
 79%|███████▊  | 29822/37963 [71:34:40<21:13:27,  9.39s/it]
 79%|███████▊  | 29823/37963 [71:34:47<19:58:48,  8.84s/it]
 79%|███████▊  | 29824/37963 [71:34:55<19:04:42,  8.44s/it]
 79%|███████▊  | 29825/37963 [71:35:02<18:13:38,  8.06s/it]
 79%|███████▊  | 29826/37963 [71:35:10<17:50:39,  7.89s/it]
 79%|███████▊  | 29827/37963 [71:35:17<17:33:49,  7.77s/it]
 79%|███████▊  | 29828/37963 [71:35:25<17:22:50,  7.69s/it]
 79%|███████▊  | 29829/37963 [71:35:32<17:16:36,  7.65s/it]
 79%|███████▊  | 29830/37963 [71:35:40<17:09:37,  7.60s/it]
                                                           
{'loss': '0.09562', 'grad_norm': '2.895', 'learning_rate': '2.313e-06', 'epoch': '0.7858'}

 79%|███████▊  | 29830/37963 [71:35:40<17:09:37,  7.60s/it]
 79%|███████▊  | 29831/37963 [71:35:47<17:05:28,  7.57s/it]
 79%|███████▊  | 29832/37963 [71:36:01<21:21:29,  9.46s/it]
 79%|███████▊  | 29833/37963 [71:36:09<20:04:58,  8.89s/it]
 79%|███████▊  | 29834/37963 [71:36:16<19:11:31,  8.50s/it]
 79%|███████▊  | 29835/37963 [71:36:24<18:34:44,  8.23s/it]
 79%|███████▊  | 29836/37963 [71:36:31<18:04:28,  8.01s/it]
 79%|███████▊  | 29837/37963 [71:36:39<17:40:02,  7.83s/it]
 79%|███████▊  | 29838/37963 [71:36:52<21:41:18,  9.61s/it]
 79%|███████▊  | 29839/37963 [71:37:00<20:18:52,  9.00s/it]
 79%|███████▊  | 29840/37963 [71:37:08<19:18:30,  8.56s/it]
                                                           
{'loss': '0.1215', 'grad_norm': '3.58', 'learning_rate': '2.307e-06', 'epoch': '0.786'}

 79%|███████▊  | 29840/37963 [71:37:08<19:18:30,  8.56s/it]
 79%|███████▊  | 29841/37963 [71:37:15<18:43:03,  8.30s/it]
 79%|███████▊  | 29842/37963 [71:37:29<22:31:56,  9.99s/it]
 79%|███████▊  | 29843/37963 [71:37:37<20:52:19,  9.25s/it]
 79%|███████▊  | 29844/37963 [71:37:44<19:43:34,  8.75s/it]
 79%|███████▊  | 29845/37963 [71:37:52<18:53:51,  8.38s/it]
 79%|███████▊  | 29846/37963 [71:37:59<18:19:04,  8.12s/it]
 79%|███████▊  | 29847/37963 [71:38:07<17:52:12,  7.93s/it]
 79%|███████▊  | 29848/37963 [71:38:14<17:26:36,  7.74s/it]
 79%|███████▊  | 29849/37963 [71:38:22<17:17:46,  7.67s/it]
 79%|███████▊  | 29850/37963 [71:38:29<17:13:28,  7.64s/it]
                                                           
{'loss': '0.1065', 'grad_norm': '2.019', 'learning_rate': '2.302e-06', 'epoch': '0.7863'}

 79%|███████▊  | 29850/37963 [71:38:29<17:13:28,  7.64s/it]
 79%|███████▊  | 29851/37963 [71:38:37<17:09:03,  7.61s/it]
 79%|███████▊  | 29852/37963 [71:38:44<17:04:50,  7.58s/it]
 79%|███████▊  | 29853/37963 [71:38:52<16:55:11,  7.51s/it]
 79%|███████▊  | 29854/37963 [71:38:59<16:46:03,  7.44s/it]
 79%|███████▊  | 29855/37963 [71:39:06<16:41:04,  7.41s/it]
 79%|███████▊  | 29856/37963 [71:39:14<16:45:25,  7.44s/it]
 79%|███████▊  | 29857/37963 [71:39:21<16:48:08,  7.46s/it]
 79%|███████▊  | 29858/37963 [71:39:29<16:50:24,  7.48s/it]
 79%|███████▊  | 29859/37963 [71:39:36<16:53:16,  7.50s/it]
 79%|███████▊  | 29860/37963 [71:39:44<16:55:46,  7.52s/it]
                                                           
{'loss': '0.1057', 'grad_norm': '2.765', 'learning_rate': '2.296e-06', 'epoch': '0.7866'}

 79%|███████▊  | 29860/37963 [71:39:44<16:55:46,  7.52s/it]
 79%|███████▊  | 29861/37963 [71:39:51<16:44:02,  7.44s/it]
 79%|███████▊  | 29862/37963 [71:39:59<16:49:11,  7.47s/it]
 79%|███████▊  | 29863/37963 [71:40:06<16:49:23,  7.48s/it]
 79%|███████▊  | 29864/37963 [71:40:27<25:36:33, 11.38s/it]
 79%|███████▊  | 29865/37963 [71:40:34<23:01:52, 10.24s/it]
 79%|███████▊  | 29866/37963 [71:40:48<25:30:59, 11.34s/it]
 79%|███████▊  | 29867/37963 [71:40:56<22:57:10, 10.21s/it]
 79%|███████▊  | 29868/37963 [71:41:03<21:04:43,  9.37s/it]
 79%|███████▊  | 29869/37963 [71:41:11<19:49:00,  8.81s/it]
 79%|███████▊  | 29870/37963 [71:41:25<23:20:00, 10.38s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '2.871', 'learning_rate': '2.291e-06', 'epoch': '0.7868'}

 79%|███████▊  | 29870/37963 [71:41:25<23:20:00, 10.38s/it]
 79%|███████▊  | 29871/37963 [71:41:38<25:35:06, 11.38s/it]
 79%|███████▊  | 29872/37963 [71:41:46<22:59:02, 10.23s/it]
 79%|███████▊  | 29873/37963 [71:41:53<21:08:08,  9.41s/it]
 79%|███████▊  | 29874/37963 [71:42:01<19:53:35,  8.85s/it]
 79%|███████▊  | 29875/37963 [71:42:08<18:57:46,  8.44s/it]
 79%|███████▊  | 29876/37963 [71:42:16<18:19:23,  8.16s/it]
 79%|███████▊  | 29877/37963 [71:42:24<17:57:15,  7.99s/it]
 79%|███████▊  | 29878/37963 [71:42:31<17:40:22,  7.87s/it]
 79%|███████▊  | 29879/37963 [71:42:39<17:27:46,  7.78s/it]
 79%|███████▊  | 29880/37963 [71:42:46<17:18:12,  7.71s/it]
                                                           
{'loss': '0.09595', 'grad_norm': '2.18', 'learning_rate': '2.285e-06', 'epoch': '0.7871'}

 79%|███████▊  | 29880/37963 [71:42:46<17:18:12,  7.71s/it]
 79%|███████▊  | 29881/37963 [71:43:00<21:33:38,  9.60s/it]
 79%|███████▊  | 29882/37963 [71:43:08<20:04:51,  8.95s/it]
 79%|███████▊  | 29883/37963 [71:43:15<19:05:59,  8.51s/it]
 79%|███████▊  | 29884/37963 [71:43:23<18:23:18,  8.19s/it]
 79%|███████▊  | 29885/37963 [71:43:30<17:55:19,  7.99s/it]
 79%|███████▊  | 29886/37963 [71:43:38<17:30:46,  7.81s/it]
 79%|███████▊  | 29887/37963 [71:43:52<21:42:33,  9.68s/it]
 79%|███████▊  | 29888/37963 [71:43:59<20:17:50,  9.05s/it]
 79%|███████▊  | 29889/37963 [71:44:07<19:14:38,  8.58s/it]
 79%|███████▊  | 29890/37963 [71:44:14<18:30:33,  8.25s/it]
                                                           
{'loss': '0.1174', 'grad_norm': '3.158', 'learning_rate': '2.28e-06', 'epoch': '0.7873'}

 79%|███████▊  | 29890/37963 [71:44:14<18:30:33,  8.25s/it]
 79%|███████▊  | 29891/37963 [71:44:21<17:45:44,  7.92s/it]
 79%|███████▊  | 29892/37963 [71:44:29<17:26:35,  7.78s/it]
 79%|███████▊  | 29893/37963 [71:44:42<21:26:18,  9.56s/it]
 79%|███████▊  | 29894/37963 [71:44:50<20:09:04,  8.99s/it]
 79%|███████▊  | 29895/37963 [71:44:58<19:09:42,  8.55s/it]
 79%|███████▉  | 29896/37963 [71:45:05<18:33:12,  8.28s/it]
 79%|███████▉  | 29897/37963 [71:45:13<18:08:38,  8.10s/it]
 79%|███████▉  | 29898/37963 [71:45:20<17:44:35,  7.92s/it]
 79%|███████▉  | 29899/37963 [71:45:28<17:28:55,  7.80s/it]
 79%|███████▉  | 29900/37963 [71:45:36<17:17:45,  7.72s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '3.346', 'learning_rate': '2.275e-06', 'epoch': '0.7876'}

 79%|███████▉  | 29900/37963 [71:45:36<17:17:45,  7.72s/it]
 79%|███████▉  | 29901/37963 [71:45:43<17:13:20,  7.69s/it]
 79%|███████▉  | 29902/37963 [71:45:51<17:07:03,  7.64s/it]
 79%|███████▉  | 29903/37963 [71:45:58<17:10:59,  7.67s/it]
 79%|███████▉  | 29904/37963 [71:46:06<16:57:21,  7.57s/it]
 79%|███████▉  | 29905/37963 [71:46:13<16:53:17,  7.54s/it]
 79%|███████▉  | 29906/37963 [71:46:21<16:54:32,  7.56s/it]
 79%|███████▉  | 29907/37963 [71:46:28<16:45:10,  7.49s/it]
 79%|███████▉  | 29908/37963 [71:46:42<21:03:25,  9.41s/it]
 79%|███████▉  | 29909/37963 [71:46:50<19:45:33,  8.83s/it]
 79%|███████▉  | 29910/37963 [71:47:03<22:57:53, 10.27s/it]
                                                           
{'loss': '0.09584', 'grad_norm': '2.003', 'learning_rate': '2.269e-06', 'epoch': '0.7879'}

 79%|███████▉  | 29910/37963 [71:47:03<22:57:53, 10.27s/it]
 79%|███████▉  | 29911/37963 [71:47:10<20:58:41,  9.38s/it]
 79%|███████▉  | 29912/37963 [71:47:24<24:03:44, 10.76s/it]
 79%|███████▉  | 29913/37963 [71:47:32<21:42:42,  9.71s/it]
 79%|███████▉  | 29914/37963 [71:47:39<20:10:35,  9.02s/it]
 79%|███████▉  | 29915/37963 [71:47:47<19:06:21,  8.55s/it]
 79%|███████▉  | 29916/37963 [71:48:00<22:40:45, 10.15s/it]
 79%|███████▉  | 29917/37963 [71:48:08<20:58:44,  9.39s/it]
 79%|███████▉  | 29918/37963 [71:48:16<19:43:15,  8.82s/it]
 79%|███████▉  | 29919/37963 [71:48:23<18:45:58,  8.40s/it]
 79%|███████▉  | 29920/37963 [71:48:30<18:10:52,  8.14s/it]
                                                           
{'loss': '0.1048', 'grad_norm': '2.667', 'learning_rate': '2.264e-06', 'epoch': '0.7881'}

 79%|███████▉  | 29920/37963 [71:48:30<18:10:52,  8.14s/it]
 79%|███████▉  | 29921/37963 [71:48:38<17:43:27,  7.93s/it]
 79%|███████▉  | 29922/37963 [71:48:52<21:45:02,  9.74s/it]
 79%|███████▉  | 29923/37963 [71:48:59<20:14:10,  9.06s/it]
 79%|███████▉  | 29924/37963 [71:49:07<19:17:12,  8.64s/it]
 79%|███████▉  | 29925/37963 [71:49:14<18:29:48,  8.28s/it]
 79%|███████▉  | 29926/37963 [71:49:22<18:00:06,  8.06s/it]
 79%|███████▉  | 29927/37963 [71:49:30<17:36:35,  7.89s/it]
 79%|███████▉  | 29928/37963 [71:49:37<17:23:30,  7.79s/it]
 79%|███████▉  | 29929/37963 [71:49:45<17:15:45,  7.74s/it]
 79%|███████▉  | 29930/37963 [71:49:52<17:08:40,  7.68s/it]
                                                           
{'loss': '0.09686', 'grad_norm': '3.623', 'learning_rate': '2.258e-06', 'epoch': '0.7884'}

 79%|███████▉  | 29930/37963 [71:49:52<17:08:40,  7.68s/it]
 79%|███████▉  | 29931/37963 [71:49:59<16:51:06,  7.55s/it]
 79%|███████▉  | 29932/37963 [71:50:07<16:56:09,  7.59s/it]
 79%|███████▉  | 29933/37963 [71:50:28<25:33:14, 11.46s/it]
 79%|███████▉  | 29934/37963 [71:50:35<22:45:29, 10.20s/it]
 79%|███████▉  | 29935/37963 [71:50:42<20:55:47,  9.39s/it]
 79%|███████▉  | 29936/37963 [71:50:50<19:41:38,  8.83s/it]
 79%|███████▉  | 29937/37963 [71:50:57<18:47:18,  8.43s/it]
 79%|███████▉  | 29938/37963 [71:51:05<18:11:48,  8.16s/it]
 79%|███████▉  | 29939/37963 [71:51:12<17:42:58,  7.95s/it]
 79%|███████▉  | 29940/37963 [71:51:20<17:25:56,  7.82s/it]
                                                           
{'loss': '0.1139', 'grad_norm': '2.957', 'learning_rate': '2.253e-06', 'epoch': '0.7887'}

 79%|███████▉  | 29940/37963 [71:51:20<17:25:56,  7.82s/it]
 79%|███████▉  | 29941/37963 [71:51:34<21:39:55,  9.72s/it]
 79%|███████▉  | 29942/37963 [71:51:42<20:14:11,  9.08s/it]
 79%|███████▉  | 29943/37963 [71:51:49<19:10:58,  8.61s/it]
 79%|███████▉  | 29944/37963 [71:51:57<18:22:10,  8.25s/it]
 79%|███████▉  | 29945/37963 [71:52:04<17:53:48,  8.04s/it]
 79%|███████▉  | 29946/37963 [71:52:12<17:33:37,  7.89s/it]
 79%|███████▉  | 29947/37963 [71:52:19<17:21:53,  7.80s/it]
 79%|███████▉  | 29948/37963 [71:52:27<17:08:03,  7.70s/it]
 79%|███████▉  | 29949/37963 [71:52:34<16:59:34,  7.63s/it]
 79%|███████▉  | 29950/37963 [71:52:42<16:50:53,  7.57s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '2.258', 'learning_rate': '2.248e-06', 'epoch': '0.7889'}

 79%|███████▉  | 29950/37963 [71:52:42<16:50:53,  7.57s/it]
 79%|███████▉  | 29951/37963 [71:52:49<16:45:19,  7.53s/it]
 79%|███████▉  | 29952/37963 [71:52:57<16:43:40,  7.52s/it]
 79%|███████▉  | 29953/37963 [71:53:04<16:39:34,  7.49s/it]
 79%|███████▉  | 29954/37963 [71:53:11<16:40:31,  7.50s/it]
 79%|███████▉  | 29955/37963 [71:53:19<16:30:51,  7.42s/it]
 79%|███████▉  | 29956/37963 [71:53:26<16:37:41,  7.48s/it]
 79%|███████▉  | 29957/37963 [71:53:41<21:08:23,  9.51s/it]
 79%|███████▉  | 29958/37963 [71:53:48<19:47:28,  8.90s/it]
 79%|███████▉  | 29959/37963 [71:53:56<18:53:34,  8.50s/it]
 79%|███████▉  | 29960/37963 [71:54:03<18:06:22,  8.14s/it]
                                                           
{'loss': '0.09528', 'grad_norm': '2.868', 'learning_rate': '2.242e-06', 'epoch': '0.7892'}

 79%|███████▉  | 29960/37963 [71:54:03<18:06:22,  8.14s/it]
 79%|███████▉  | 29961/37963 [71:54:10<17:33:32,  7.90s/it]
 79%|███████▉  | 29962/37963 [71:54:18<17:21:00,  7.81s/it]
 79%|███████▉  | 29963/37963 [71:54:32<21:26:57,  9.65s/it]
 79%|███████▉  | 29964/37963 [71:54:46<24:26:32, 11.00s/it]
 79%|███████▉  | 29965/37963 [71:54:54<22:11:52,  9.99s/it]
 79%|███████▉  | 29966/37963 [71:55:01<20:34:00,  9.26s/it]
 79%|███████▉  | 29967/37963 [71:55:15<23:36:26, 10.63s/it]
 79%|███████▉  | 29968/37963 [71:55:22<21:31:04,  9.69s/it]
 79%|███████▉  | 29969/37963 [71:55:30<20:04:32,  9.04s/it]
 79%|███████▉  | 29970/37963 [71:55:37<19:01:36,  8.57s/it]
                                                           
{'loss': '0.1071', 'grad_norm': '2.991', 'learning_rate': '2.237e-06', 'epoch': '0.7895'}

 79%|███████▉  | 29970/37963 [71:55:37<19:01:36,  8.57s/it]
 79%|███████▉  | 29971/37963 [71:55:45<18:24:00,  8.29s/it]
 79%|███████▉  | 29972/37963 [71:55:52<17:46:55,  8.01s/it]
 79%|███████▉  | 29973/37963 [71:56:00<17:31:00,  7.89s/it]
 79%|███████▉  | 29974/37963 [71:56:08<17:15:44,  7.78s/it]
 79%|███████▉  | 29975/37963 [71:56:15<16:55:48,  7.63s/it]
 79%|███████▉  | 29976/37963 [71:56:22<16:42:18,  7.53s/it]
 79%|███████▉  | 29977/37963 [71:56:30<16:40:10,  7.51s/it]
 79%|███████▉  | 29978/37963 [71:56:37<16:40:50,  7.52s/it]
 79%|███████▉  | 29979/37963 [71:56:51<20:42:26,  9.34s/it]
 79%|███████▉  | 29980/37963 [71:56:58<19:34:07,  8.82s/it]
                                                           
{'loss': '0.09671', 'grad_norm': '2.373', 'learning_rate': '2.231e-06', 'epoch': '0.7897'}

 79%|███████▉  | 29980/37963 [71:56:58<19:34:07,  8.82s/it]
 79%|███████▉  | 29981/37963 [71:57:13<23:07:08, 10.43s/it]
 79%|███████▉  | 29982/37963 [71:57:20<21:17:32,  9.60s/it]
 79%|███████▉  | 29983/37963 [71:57:28<19:58:51,  9.01s/it]
 79%|███████▉  | 29984/37963 [71:57:35<18:57:28,  8.55s/it]
 79%|███████▉  | 29985/37963 [71:57:43<18:12:22,  8.22s/it]
 79%|███████▉  | 29986/37963 [71:57:50<17:43:09,  8.00s/it]
 79%|███████▉  | 29987/37963 [71:57:58<17:14:36,  7.78s/it]
 79%|███████▉  | 29988/37963 [71:58:12<21:34:51,  9.74s/it]
 79%|███████▉  | 29989/37963 [71:58:19<20:01:50,  9.04s/it]
 79%|███████▉  | 29990/37963 [71:58:27<18:53:39,  8.53s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '1.755', 'learning_rate': '2.226e-06', 'epoch': '0.79'}

 79%|███████▉  | 29990/37963 [71:58:27<18:53:39,  8.53s/it]
 79%|███████▉  | 29991/37963 [71:58:34<18:11:39,  8.22s/it]
 79%|███████▉  | 29992/37963 [71:58:42<17:45:22,  8.02s/it]
 79%|███████▉  | 29993/37963 [71:58:49<17:25:37,  7.87s/it]
 79%|███████▉  | 29994/37963 [71:58:57<17:08:53,  7.75s/it]
 79%|███████▉  | 29995/37963 [71:59:04<16:56:26,  7.65s/it]
 79%|███████▉  | 29996/37963 [71:59:12<16:51:19,  7.62s/it]
 79%|███████▉  | 29997/37963 [71:59:19<16:52:46,  7.63s/it]
 79%|███████▉  | 29998/37963 [71:59:27<16:50:29,  7.61s/it]
 79%|███████▉  | 29999/37963 [71:59:34<16:45:55,  7.58s/it]
 79%|███████▉  | 30000/37963 [71:59:42<16:37:23,  7.52s/it]
                                                           
{'loss': '0.1105', 'grad_norm': '2.598', 'learning_rate': '2.221e-06', 'epoch': '0.7902'}

 79%|███████▉  | 30000/37963 [71:59:42<16:37:23,  7.52s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.96s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.96s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 79%|███████▉  | 30001/37963 [72:00:41<51:14:14, 23.17s/it]
 79%|███████▉  | 30002/37963 [72:00:49<40:55:41, 18.51s/it]
 79%|███████▉  | 30003/37963 [72:01:03<38:07:13, 17.24s/it]
 79%|███████▉  | 30004/37963 [72:01:11<31:50:57, 14.41s/it]
 79%|███████▉  | 30005/37963 [72:01:19<27:22:42, 12.39s/it]
 79%|███████▉  | 30006/37963 [72:01:26<24:13:43, 10.96s/it]
 79%|███████▉  | 30007/37963 [72:01:34<22:03:08,  9.98s/it]
 79%|███████▉  | 30008/37963 [72:01:48<24:47:31, 11.22s/it]
 79%|███████▉  | 30009/37963 [72:01:56<22:25:08, 10.15s/it]
 79%|███████▉  | 30010/37963 [72:02:10<24:57:12, 11.30s/it]
                                                           
{'loss': '0.1127', 'grad_norm': '2.477', 'learning_rate': '2.215e-06', 'epoch': '0.7905'}

 79%|███████▉  | 30010/37963 [72:02:10<24:57:12, 11.30s/it]
 79%|███████▉  | 30011/37963 [72:02:17<22:28:35, 10.18s/it]
 79%|███████▉  | 30012/37963 [72:02:25<20:41:25,  9.37s/it]
 79%|███████▉  | 30013/37963 [72:02:33<19:35:32,  8.87s/it]
 79%|███████▉  | 30014/37963 [72:02:40<18:41:58,  8.47s/it]
 79%|███████▉  | 30015/37963 [72:02:48<18:03:42,  8.18s/it]
 79%|███████▉  | 30016/37963 [72:03:02<21:59:20,  9.96s/it]
 79%|███████▉  | 30017/37963 [72:03:16<24:43:27, 11.20s/it]
 79%|███████▉  | 30018/37963 [72:03:23<22:14:42, 10.08s/it]
 79%|███████▉  | 30019/37963 [72:03:31<20:33:30,  9.32s/it]
 79%|███████▉  | 30020/37963 [72:03:38<19:18:22,  8.75s/it]
                                                           
{'loss': '0.0979', 'grad_norm': '1.39', 'learning_rate': '2.21e-06', 'epoch': '0.7908'}

 79%|███████▉  | 30020/37963 [72:03:38<19:18:22,  8.75s/it]
 79%|███████▉  | 30021/37963 [72:03:46<18:30:00,  8.39s/it]
 79%|███████▉  | 30022/37963 [72:03:53<17:58:46,  8.15s/it]
 79%|███████▉  | 30023/37963 [72:04:01<17:31:47,  7.95s/it]
 79%|███████▉  | 30024/37963 [72:04:08<17:15:11,  7.82s/it]
 79%|███████▉  | 30025/37963 [72:04:23<21:24:46,  9.71s/it]
 79%|███████▉  | 30026/37963 [72:04:30<20:03:03,  9.09s/it]
 79%|███████▉  | 30027/37963 [72:04:38<19:02:08,  8.64s/it]
 79%|███████▉  | 30028/37963 [72:04:45<18:17:41,  8.30s/it]
 79%|███████▉  | 30029/37963 [72:04:53<17:42:17,  8.03s/it]
 79%|███████▉  | 30030/37963 [72:05:00<17:27:01,  7.92s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '2.983', 'learning_rate': '2.205e-06', 'epoch': '0.791'}

 79%|███████▉  | 30030/37963 [72:05:00<17:27:01,  7.92s/it]
 79%|███████▉  | 30031/37963 [72:05:14<21:19:51,  9.68s/it]
 79%|███████▉  | 30032/37963 [72:05:22<19:55:25,  9.04s/it]
 79%|███████▉  | 30033/37963 [72:05:29<18:53:52,  8.58s/it]
 79%|███████▉  | 30034/37963 [72:05:37<18:17:03,  8.30s/it]
 79%|███████▉  | 30035/37963 [72:05:44<17:45:15,  8.06s/it]
 79%|███████▉  | 30036/37963 [72:05:52<17:23:56,  7.90s/it]
 79%|███████▉  | 30037/37963 [72:06:00<17:15:11,  7.84s/it]
 79%|███████▉  | 30038/37963 [72:06:07<17:04:14,  7.75s/it]
 79%|███████▉  | 30039/37963 [72:06:15<16:55:44,  7.69s/it]
 79%|███████▉  | 30040/37963 [72:06:22<16:48:04,  7.63s/it]
                                                           
{'loss': '0.09981', 'grad_norm': '2.592', 'learning_rate': '2.199e-06', 'epoch': '0.7913'}

 79%|███████▉  | 30040/37963 [72:06:22<16:48:04,  7.63s/it]
 79%|███████▉  | 30041/37963 [72:06:36<21:08:48,  9.61s/it]
 79%|███████▉  | 30042/37963 [72:06:44<19:40:23,  8.94s/it]
 79%|███████▉  | 30043/37963 [72:06:51<18:48:25,  8.55s/it]
 79%|███████▉  | 30044/37963 [72:06:59<18:08:49,  8.25s/it]
 79%|███████▉  | 30045/37963 [72:07:07<17:44:09,  8.06s/it]
 79%|███████▉  | 30046/37963 [72:07:14<17:16:20,  7.85s/it]
 79%|███████▉  | 30047/37963 [72:07:22<17:05:26,  7.77s/it]
 79%|███████▉  | 30048/37963 [72:07:29<16:59:15,  7.73s/it]
 79%|███████▉  | 30049/37963 [72:07:37<16:54:45,  7.69s/it]
 79%|███████▉  | 30050/37963 [72:07:44<16:36:00,  7.55s/it]
                                                           
{'loss': '0.1077', 'grad_norm': '1.799', 'learning_rate': '2.194e-06', 'epoch': '0.7916'}

 79%|███████▉  | 30050/37963 [72:07:44<16:36:00,  7.55s/it]
 79%|███████▉  | 30051/37963 [72:07:58<21:00:14,  9.56s/it]
 79%|███████▉  | 30052/37963 [72:08:06<19:38:29,  8.94s/it]
 79%|███████▉  | 30053/37963 [72:08:13<18:44:54,  8.53s/it]
 79%|███████▉  | 30054/37963 [72:08:21<18:07:23,  8.25s/it]
 79%|███████▉  | 30055/37963 [72:08:28<17:40:36,  8.05s/it]
 79%|███████▉  | 30056/37963 [72:08:36<17:21:30,  7.90s/it]
 79%|███████▉  | 30057/37963 [72:08:44<17:09:27,  7.81s/it]
 79%|███████▉  | 30058/37963 [72:08:58<21:10:49,  9.65s/it]
 79%|███████▉  | 30059/37963 [72:09:05<19:46:27,  9.01s/it]
 79%|███████▉  | 30060/37963 [72:09:13<18:55:51,  8.62s/it]
                                                           
{'loss': '0.09967', 'grad_norm': '1.919', 'learning_rate': '2.189e-06', 'epoch': '0.7918'}

 79%|███████▉  | 30060/37963 [72:09:13<18:55:51,  8.62s/it]
 79%|███████▉  | 30061/37963 [72:09:26<22:15:51, 10.14s/it]
 79%|███████▉  | 30062/37963 [72:09:34<20:33:19,  9.37s/it]
 79%|███████▉  | 30063/37963 [72:09:48<23:42:46, 10.81s/it]
 79%|███████▉  | 30064/37963 [72:09:55<21:20:45,  9.73s/it]
 79%|███████▉  | 30065/37963 [72:10:03<19:57:05,  9.09s/it]
 79%|███████▉  | 30066/37963 [72:10:11<18:58:08,  8.65s/it]
 79%|███████▉  | 30067/37963 [72:10:18<18:15:31,  8.32s/it]
 79%|███████▉  | 30068/37963 [72:10:26<17:45:23,  8.10s/it]
 79%|███████▉  | 30069/37963 [72:10:40<21:53:06,  9.98s/it]
 79%|███████▉  | 30070/37963 [72:10:48<20:20:18,  9.28s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '2.839', 'learning_rate': '2.183e-06', 'epoch': '0.7921'}

 79%|███████▉  | 30070/37963 [72:10:48<20:20:18,  9.28s/it]
 79%|███████▉  | 30071/37963 [72:10:55<19:16:36,  8.79s/it]
 79%|███████▉  | 30072/37963 [72:11:03<18:26:32,  8.41s/it]
 79%|███████▉  | 30073/37963 [72:11:10<17:42:54,  8.08s/it]
 79%|███████▉  | 30074/37963 [72:11:18<17:15:35,  7.88s/it]
 79%|███████▉  | 30075/37963 [72:11:25<17:02:38,  7.78s/it]
 79%|███████▉  | 30076/37963 [72:11:33<16:53:43,  7.71s/it]
 79%|███████▉  | 30077/37963 [72:11:40<16:45:48,  7.65s/it]
 79%|███████▉  | 30078/37963 [72:11:48<16:41:30,  7.62s/it]
 79%|███████▉  | 30079/37963 [72:11:55<16:37:17,  7.59s/it]
 79%|███████▉  | 30080/37963 [72:12:03<16:34:02,  7.57s/it]
                                                           
{'loss': '0.09392', 'grad_norm': '2.54', 'learning_rate': '2.178e-06', 'epoch': '0.7924'}

 79%|███████▉  | 30080/37963 [72:12:03<16:34:02,  7.57s/it]
 79%|███████▉  | 30081/37963 [72:12:17<20:42:18,  9.46s/it]
 79%|███████▉  | 30082/37963 [72:12:24<19:30:48,  8.91s/it]
 79%|███████▉  | 30083/37963 [72:12:32<18:36:39,  8.50s/it]
 79%|███████▉  | 30084/37963 [72:12:40<17:59:43,  8.22s/it]
 79%|███████▉  | 30085/37963 [72:12:47<17:35:18,  8.04s/it]
 79%|███████▉  | 30086/37963 [72:12:55<17:21:28,  7.93s/it]
 79%|███████▉  | 30087/37963 [72:13:02<17:00:21,  7.77s/it]
 79%|███████▉  | 30088/37963 [72:13:10<16:45:01,  7.66s/it]
 79%|███████▉  | 30089/37963 [72:13:17<16:43:36,  7.65s/it]
 79%|███████▉  | 30090/37963 [72:13:25<16:41:54,  7.64s/it]
                                                           
{'loss': '0.1115', 'grad_norm': '2.403', 'learning_rate': '2.173e-06', 'epoch': '0.7926'}

 79%|███████▉  | 30090/37963 [72:13:25<16:41:54,  7.64s/it]
 79%|███████▉  | 30091/37963 [72:13:39<20:53:44,  9.56s/it]
 79%|███████▉  | 30092/37963 [72:13:46<19:32:31,  8.94s/it]
 79%|███████▉  | 30093/37963 [72:13:54<18:37:10,  8.52s/it]
 79%|███████▉  | 30094/37963 [72:14:01<17:57:38,  8.22s/it]
 79%|███████▉  | 30095/37963 [72:14:09<17:24:41,  7.97s/it]
 79%|███████▉  | 30096/37963 [72:14:16<17:11:24,  7.87s/it]
 79%|███████▉  | 30097/37963 [72:14:24<16:57:12,  7.76s/it]
 79%|███████▉  | 30098/37963 [72:14:31<16:47:06,  7.68s/it]
 79%|███████▉  | 30099/37963 [72:14:45<20:50:46,  9.54s/it]
 79%|███████▉  | 30100/37963 [72:14:53<19:19:18,  8.85s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '1.999', 'learning_rate': '2.167e-06', 'epoch': '0.7929'}

 79%|███████▉  | 30100/37963 [72:14:53<19:19:18,  8.85s/it]
 79%|███████▉  | 30101/37963 [72:15:00<18:27:31,  8.45s/it]
 79%|███████▉  | 30102/37963 [72:15:08<17:51:26,  8.18s/it]
 79%|███████▉  | 30103/37963 [72:15:15<17:25:26,  7.98s/it]
 79%|███████▉  | 30104/37963 [72:15:23<17:05:03,  7.83s/it]
 79%|███████▉  | 30105/37963 [72:15:30<16:52:32,  7.73s/it]
 79%|███████▉  | 30106/37963 [72:15:44<20:49:25,  9.54s/it]
 79%|███████▉  | 30107/37963 [72:15:51<19:33:24,  8.96s/it]
 79%|███████▉  | 30108/37963 [72:15:59<18:36:47,  8.53s/it]
 79%|███████▉  | 30109/37963 [72:16:06<17:47:28,  8.15s/it]
 79%|███████▉  | 30110/37963 [72:16:20<21:32:24,  9.87s/it]
                                                           
{'loss': '0.1152', 'grad_norm': '3.198', 'learning_rate': '2.162e-06', 'epoch': '0.7931'}

 79%|███████▉  | 30110/37963 [72:16:20<21:32:24,  9.87s/it]
 79%|███████▉  | 30111/37963 [72:16:28<20:03:55,  9.20s/it]
 79%|███████▉  | 30112/37963 [72:16:35<19:02:50,  8.73s/it]
 79%|███████▉  | 30113/37963 [72:16:56<26:55:45, 12.35s/it]
 79%|███████▉  | 30114/37963 [72:17:10<28:02:49, 12.86s/it]
 79%|███████▉  | 30115/37963 [72:17:18<24:26:05, 11.21s/it]
 79%|███████▉  | 30116/37963 [72:17:25<21:59:27, 10.09s/it]
 79%|███████▉  | 30117/37963 [72:17:33<20:21:17,  9.34s/it]
 79%|███████▉  | 30118/37963 [72:17:40<19:08:01,  8.78s/it]
 79%|███████▉  | 30119/37963 [72:17:47<18:05:38,  8.30s/it]
 79%|███████▉  | 30120/37963 [72:17:55<17:32:03,  8.05s/it]
                                                           
{'loss': '0.09796', 'grad_norm': '2.72', 'learning_rate': '2.157e-06', 'epoch': '0.7934'}

 79%|███████▉  | 30120/37963 [72:17:55<17:32:03,  8.05s/it]
 79%|███████▉  | 30121/37963 [72:18:02<17:12:52,  7.90s/it]
 79%|███████▉  | 30122/37963 [72:18:10<16:59:49,  7.80s/it]
 79%|███████▉  | 30123/37963 [72:18:18<16:50:23,  7.73s/it]
 79%|███████▉  | 30124/37963 [72:18:25<16:41:46,  7.67s/it]
 79%|███████▉  | 30125/37963 [72:18:33<16:38:26,  7.64s/it]
 79%|███████▉  | 30126/37963 [72:18:40<16:30:55,  7.59s/it]
 79%|███████▉  | 30127/37963 [72:18:48<16:29:01,  7.57s/it]
 79%|███████▉  | 30128/37963 [72:18:55<16:16:43,  7.48s/it]
 79%|███████▉  | 30129/37963 [72:19:03<16:21:50,  7.52s/it]
 79%|███████▉  | 30130/37963 [72:19:16<20:28:52,  9.41s/it]
                                                           
{'loss': '0.108', 'grad_norm': '3.315', 'learning_rate': '2.152e-06', 'epoch': '0.7937'}

 79%|███████▉  | 30130/37963 [72:19:16<20:28:52,  9.41s/it]
 79%|███████▉  | 30131/37963 [72:19:24<19:16:32,  8.86s/it]
 79%|███████▉  | 30132/37963 [72:19:31<18:12:10,  8.37s/it]
 79%|███████▉  | 30133/37963 [72:19:39<17:41:27,  8.13s/it]
 79%|███████▉  | 30134/37963 [72:19:46<17:21:56,  7.99s/it]
 79%|███████▉  | 30135/37963 [72:19:54<17:06:21,  7.87s/it]
 79%|███████▉  | 30136/37963 [72:20:08<21:00:29,  9.66s/it]
 79%|███████▉  | 30137/37963 [72:20:15<19:39:33,  9.04s/it]
 79%|███████▉  | 30138/37963 [72:20:23<18:38:57,  8.58s/it]
 79%|███████▉  | 30139/37963 [72:20:30<17:50:00,  8.21s/it]
 79%|███████▉  | 30140/37963 [72:20:38<17:21:07,  7.99s/it]
                                                           
{'loss': '0.1032', 'grad_norm': '2.381', 'learning_rate': '2.146e-06', 'epoch': '0.7939'}

 79%|███████▉  | 30140/37963 [72:20:38<17:21:07,  7.99s/it]
 79%|███████▉  | 30141/37963 [72:20:45<17:03:00,  7.85s/it]
 79%|███████▉  | 30142/37963 [72:20:53<16:56:08,  7.80s/it]
 79%|███████▉  | 30143/37963 [72:21:00<16:42:20,  7.69s/it]
 79%|███████▉  | 30144/37963 [72:21:14<20:46:19,  9.56s/it]
 79%|███████▉  | 30145/37963 [72:21:22<19:30:15,  8.98s/it]
 79%|███████▉  | 30146/37963 [72:21:29<18:32:43,  8.54s/it]
 79%|███████▉  | 30147/37963 [72:21:37<17:49:43,  8.21s/it]
 79%|███████▉  | 30148/37963 [72:21:44<17:25:53,  8.03s/it]
 79%|███████▉  | 30149/37963 [72:21:52<17:07:08,  7.89s/it]
 79%|███████▉  | 30150/37963 [72:21:59<16:50:05,  7.76s/it]
                                                           
{'loss': '0.09858', 'grad_norm': '2.745', 'learning_rate': '2.141e-06', 'epoch': '0.7942'}

 79%|███████▉  | 30150/37963 [72:21:59<16:50:05,  7.76s/it]
 79%|███████▉  | 30151/37963 [72:22:07<16:38:50,  7.67s/it]
 79%|███████▉  | 30152/37963 [72:22:14<16:33:49,  7.63s/it]
 79%|███████▉  | 30153/37963 [72:22:22<16:29:07,  7.60s/it]
 79%|███████▉  | 30154/37963 [72:22:29<16:22:52,  7.55s/it]
 79%|███████▉  | 30155/37963 [72:22:37<16:22:12,  7.55s/it]
 79%|███████▉  | 30156/37963 [72:22:45<16:21:04,  7.54s/it]
 79%|███████▉  | 30157/37963 [72:22:58<20:29:56,  9.45s/it]
 79%|███████▉  | 30158/37963 [72:23:12<23:24:59, 10.80s/it]
 79%|███████▉  | 30159/37963 [72:23:20<21:17:01,  9.82s/it]
 79%|███████▉  | 30160/37963 [72:23:27<19:45:04,  9.11s/it]
                                                           
{'loss': '0.1074', 'grad_norm': '2.27', 'learning_rate': '2.136e-06', 'epoch': '0.7945'}

 79%|███████▉  | 30160/37963 [72:23:27<19:45:04,  9.11s/it]
 79%|███████▉  | 30161/37963 [72:23:41<22:50:12, 10.54s/it]
 79%|███████▉  | 30162/37963 [72:23:49<20:53:47,  9.64s/it]
 79%|███████▉  | 30163/37963 [72:24:09<27:44:39, 12.81s/it]
 79%|███████▉  | 30164/37963 [72:24:16<24:18:06, 11.22s/it]
 79%|███████▉  | 30165/37963 [72:24:24<21:51:30, 10.09s/it]
 79%|███████▉  | 30166/37963 [72:24:31<20:12:25,  9.33s/it]
 79%|███████▉  | 30167/37963 [72:24:39<18:50:26,  8.70s/it]
 79%|███████▉  | 30168/37963 [72:24:46<18:10:42,  8.40s/it]
 79%|███████▉  | 30169/37963 [72:24:54<17:42:35,  8.18s/it]
 79%|███████▉  | 30170/37963 [72:25:02<17:17:35,  7.99s/it]
                                                           
{'loss': '0.0947', 'grad_norm': '2.204', 'learning_rate': '2.13e-06', 'epoch': '0.7947'}

 79%|███████▉  | 30170/37963 [72:25:02<17:17:35,  7.99s/it]
 79%|███████▉  | 30171/37963 [72:25:09<16:59:03,  7.85s/it]
 79%|███████▉  | 30172/37963 [72:25:17<16:48:59,  7.77s/it]
 79%|███████▉  | 30173/37963 [72:25:24<16:42:56,  7.72s/it]
 79%|███████▉  | 30174/37963 [72:25:32<16:27:13,  7.60s/it]
 79%|███████▉  | 30175/37963 [72:25:39<16:29:16,  7.62s/it]
 79%|███████▉  | 30176/37963 [72:25:47<16:24:09,  7.58s/it]
 79%|███████▉  | 30177/37963 [72:25:54<16:09:30,  7.47s/it]
 79%|███████▉  | 30178/37963 [72:26:02<16:12:25,  7.49s/it]
 79%|███████▉  | 30179/37963 [72:26:16<20:24:51,  9.44s/it]
 79%|███████▉  | 30180/37963 [72:26:29<23:10:57, 10.72s/it]
                                                           
{'loss': '0.102', 'grad_norm': '1.687', 'learning_rate': '2.125e-06', 'epoch': '0.795'}

 79%|███████▉  | 30180/37963 [72:26:29<23:10:57, 10.72s/it]
 80%|███████▉  | 30181/37963 [72:26:37<21:05:46,  9.76s/it]
 80%|███████▉  | 30182/37963 [72:26:44<19:42:50,  9.12s/it]
 80%|███████▉  | 30183/37963 [72:26:52<18:40:52,  8.64s/it]
 80%|███████▉  | 30184/37963 [72:26:59<17:55:30,  8.30s/it]
 80%|███████▉  | 30185/37963 [72:27:07<17:29:24,  8.10s/it]
 80%|███████▉  | 30186/37963 [72:27:15<17:08:18,  7.93s/it]
 80%|███████▉  | 30187/37963 [72:27:22<16:44:41,  7.75s/it]
 80%|███████▉  | 30188/37963 [72:27:36<20:52:49,  9.67s/it]
 80%|███████▉  | 30189/37963 [72:27:44<19:31:30,  9.04s/it]
 80%|███████▉  | 30190/37963 [72:27:51<18:35:48,  8.61s/it]
                                                           
{'loss': '0.1063', 'grad_norm': '3.047', 'learning_rate': '2.12e-06', 'epoch': '0.7953'}

 80%|███████▉  | 30190/37963 [72:27:51<18:35:48,  8.61s/it]
 80%|███████▉  | 30191/37963 [72:27:59<17:53:21,  8.29s/it]
 80%|███████▉  | 30192/37963 [72:28:06<17:13:56,  7.98s/it]
 80%|███████▉  | 30193/37963 [72:28:14<16:56:55,  7.85s/it]
 80%|███████▉  | 30194/37963 [72:28:21<16:46:30,  7.77s/it]
 80%|███████▉  | 30195/37963 [72:28:29<16:41:12,  7.73s/it]
 80%|███████▉  | 30196/37963 [72:28:36<16:31:41,  7.66s/it]
 80%|███████▉  | 30197/37963 [72:28:44<16:22:25,  7.59s/it]
 80%|███████▉  | 30198/37963 [72:28:51<16:19:37,  7.57s/it]
 80%|███████▉  | 30199/37963 [72:28:59<16:22:22,  7.59s/it]
 80%|███████▉  | 30200/37963 [72:29:06<16:15:02,  7.54s/it]
                                                           
{'loss': '0.1054', 'grad_norm': '2.283', 'learning_rate': '2.115e-06', 'epoch': '0.7955'}

 80%|███████▉  | 30200/37963 [72:29:06<16:15:02,  7.54s/it]
 80%|███████▉  | 30201/37963 [72:29:14<16:12:58,  7.52s/it]
 80%|███████▉  | 30202/37963 [72:29:21<16:11:54,  7.51s/it]
 80%|███████▉  | 30203/37963 [72:29:29<16:07:23,  7.48s/it]
 80%|███████▉  | 30204/37963 [72:29:42<20:10:11,  9.36s/it]
 80%|███████▉  | 30205/37963 [72:29:50<19:00:02,  8.82s/it]
 80%|███████▉  | 30206/37963 [72:29:58<18:09:33,  8.43s/it]
 80%|███████▉  | 30207/37963 [72:30:05<17:36:02,  8.17s/it]
 80%|███████▉  | 30208/37963 [72:30:19<21:16:12,  9.87s/it]
 80%|███████▉  | 30209/37963 [72:30:27<19:51:26,  9.22s/it]
 80%|███████▉  | 30210/37963 [72:30:34<18:46:58,  8.72s/it]
                                                           
{'loss': '0.1028', 'grad_norm': '2.533', 'learning_rate': '2.109e-06', 'epoch': '0.7958'}

 80%|███████▉  | 30210/37963 [72:30:34<18:46:58,  8.72s/it]
 80%|███████▉  | 30211/37963 [72:30:48<22:17:34, 10.35s/it]
 80%|███████▉  | 30212/37963 [72:30:56<20:28:56,  9.51s/it]
 80%|███████▉  | 30213/37963 [72:31:10<23:38:03, 10.98s/it]
 80%|███████▉  | 30214/37963 [72:31:24<25:39:23, 11.92s/it]
 80%|███████▉  | 30215/37963 [72:31:32<22:49:08, 10.60s/it]
 80%|███████▉  | 30216/37963 [72:31:39<20:43:06,  9.63s/it]
 80%|███████▉  | 30217/37963 [72:31:47<19:20:28,  8.99s/it]
 80%|███████▉  | 30218/37963 [72:31:54<18:24:56,  8.56s/it]
 80%|███████▉  | 30219/37963 [72:32:02<17:48:55,  8.28s/it]
 80%|███████▉  | 30220/37963 [72:32:10<17:18:18,  8.05s/it]
                                                           
{'loss': '0.1042', 'grad_norm': '2.545', 'learning_rate': '2.104e-06', 'epoch': '0.796'}

 80%|███████▉  | 30220/37963 [72:32:10<17:18:18,  8.05s/it]
 80%|███████▉  | 30221/37963 [72:32:17<16:57:01,  7.88s/it]
 80%|███████▉  | 30222/37963 [72:32:25<16:42:19,  7.77s/it]
 80%|███████▉  | 30223/37963 [72:32:32<16:31:52,  7.69s/it]
 80%|███████▉  | 30224/37963 [72:32:46<20:43:16,  9.64s/it]
 80%|███████▉  | 30225/37963 [72:32:54<19:16:26,  8.97s/it]
 80%|███████▉  | 30226/37963 [72:33:01<18:14:51,  8.49s/it]
 80%|███████▉  | 30227/37963 [72:33:09<17:38:04,  8.21s/it]
 80%|███████▉  | 30228/37963 [72:33:16<17:15:18,  8.03s/it]
 80%|███████▉  | 30229/37963 [72:33:24<16:54:23,  7.87s/it]
 80%|███████▉  | 30230/37963 [72:33:31<16:45:14,  7.80s/it]
                                                           
{'loss': '0.1022', 'grad_norm': '1.721', 'learning_rate': '2.099e-06', 'epoch': '0.7963'}

 80%|███████▉  | 30230/37963 [72:33:31<16:45:14,  7.80s/it]
 80%|███████▉  | 30231/37963 [72:33:39<16:24:48,  7.64s/it]
 80%|███████▉  | 30232/37963 [72:33:52<20:24:23,  9.50s/it]
 80%|███████▉  | 30233/37963 [72:34:06<23:11:08, 10.80s/it]
 80%|███████▉  | 30234/37963 [72:34:14<21:07:05,  9.84s/it]
 80%|███████▉  | 30235/37963 [72:34:21<19:31:51,  9.10s/it]
 80%|███████▉  | 30236/37963 [72:34:29<18:30:12,  8.62s/it]
 80%|███████▉  | 30237/37963 [72:34:36<17:47:35,  8.29s/it]
 80%|███████▉  | 30238/37963 [72:34:44<17:22:03,  8.09s/it]
 80%|███████▉  | 30239/37963 [72:34:51<16:55:58,  7.89s/it]
 80%|███████▉  | 30240/37963 [72:34:59<16:35:53,  7.74s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.217', 'learning_rate': '2.094e-06', 'epoch': '0.7966'}

 80%|███████▉  | 30240/37963 [72:34:59<16:35:53,  7.74s/it]
 80%|███████▉  | 30241/37963 [72:35:06<16:29:25,  7.69s/it]
 80%|███████▉  | 30242/37963 [72:35:14<16:27:14,  7.67s/it]
 80%|███████▉  | 30243/37963 [72:35:21<16:17:12,  7.59s/it]
 80%|███████▉  | 30244/37963 [72:35:29<16:18:59,  7.61s/it]
 80%|███████▉  | 30245/37963 [72:35:37<16:19:06,  7.61s/it]
 80%|███████▉  | 30246/37963 [72:35:44<16:19:03,  7.61s/it]
 80%|███████▉  | 30247/37963 [72:35:52<16:17:53,  7.60s/it]
 80%|███████▉  | 30248/37963 [72:35:59<16:13:14,  7.57s/it]
 80%|███████▉  | 30249/37963 [72:36:06<16:01:46,  7.48s/it]
 80%|███████▉  | 30250/37963 [72:36:14<16:01:35,  7.48s/it]
                                                           
{'loss': '0.1054', 'grad_norm': '2.482', 'learning_rate': '2.089e-06', 'epoch': '0.7968'}

 80%|███████▉  | 30250/37963 [72:36:14<16:01:35,  7.48s/it]
 80%|███████▉  | 30251/37963 [72:36:21<16:02:31,  7.49s/it]
 80%|███████▉  | 30252/37963 [72:36:29<15:52:49,  7.41s/it]
 80%|███████▉  | 30253/37963 [72:36:36<15:55:26,  7.44s/it]
 80%|███████▉  | 30254/37963 [72:36:44<15:59:56,  7.47s/it]
 80%|███████▉  | 30255/37963 [72:36:51<16:01:58,  7.49s/it]
 80%|███████▉  | 30256/37963 [72:37:11<24:03:14, 11.24s/it]
 80%|███████▉  | 30257/37963 [72:37:25<25:46:31, 12.04s/it]
 80%|███████▉  | 30258/37963 [72:37:32<22:42:12, 10.61s/it]
 80%|███████▉  | 30259/37963 [72:37:40<20:43:15,  9.68s/it]
 80%|███████▉  | 30260/37963 [72:37:47<19:18:40,  9.03s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '2.991', 'learning_rate': '2.083e-06', 'epoch': '0.7971'}

 80%|███████▉  | 30260/37963 [72:37:47<19:18:40,  9.03s/it]
 80%|███████▉  | 30261/37963 [72:37:55<18:21:50,  8.58s/it]
 80%|███████▉  | 30262/37963 [72:38:03<17:42:15,  8.28s/it]
 80%|███████▉  | 30263/37963 [72:38:23<25:20:59, 11.85s/it]
 80%|███████▉  | 30264/37963 [72:38:30<22:33:10, 10.55s/it]
 80%|███████▉  | 30265/37963 [72:38:38<20:36:11,  9.64s/it]
 80%|███████▉  | 30266/37963 [72:38:45<19:14:02,  9.00s/it]
 80%|███████▉  | 30267/37963 [72:38:53<18:12:41,  8.52s/it]
 80%|███████▉  | 30268/37963 [72:39:00<17:30:37,  8.19s/it]
 80%|███████▉  | 30269/37963 [72:39:07<16:58:37,  7.94s/it]
 80%|███████▉  | 30270/37963 [72:39:15<16:33:37,  7.75s/it]
                                                           
{'loss': '0.08982', 'grad_norm': '2.731', 'learning_rate': '2.078e-06', 'epoch': '0.7974'}

 80%|███████▉  | 30270/37963 [72:39:15<16:33:37,  7.75s/it]
 80%|███████▉  | 30271/37963 [72:39:29<20:31:33,  9.61s/it]
 80%|███████▉  | 30272/37963 [72:39:36<19:17:27,  9.03s/it]
 80%|███████▉  | 30273/37963 [72:39:44<18:21:54,  8.60s/it]
 80%|███████▉  | 30274/37963 [72:39:52<17:42:48,  8.29s/it]
 80%|███████▉  | 30275/37963 [72:39:59<17:13:53,  8.07s/it]
 80%|███████▉  | 30276/37963 [72:40:07<16:52:55,  7.91s/it]
 80%|███████▉  | 30277/37963 [72:40:14<16:29:28,  7.72s/it]
 80%|███████▉  | 30278/37963 [72:40:22<16:24:30,  7.69s/it]
 80%|███████▉  | 30279/37963 [72:40:29<16:18:18,  7.64s/it]
 80%|███████▉  | 30280/37963 [72:40:36<16:07:56,  7.56s/it]
                                                           
{'loss': '0.1035', 'grad_norm': '3.535', 'learning_rate': '2.073e-06', 'epoch': '0.7976'}

 80%|███████▉  | 30280/37963 [72:40:36<16:07:56,  7.56s/it]
 80%|███████▉  | 30281/37963 [72:40:44<16:03:51,  7.53s/it]
 80%|███████▉  | 30282/37963 [72:40:58<20:12:10,  9.47s/it]
 80%|███████▉  | 30283/37963 [72:41:05<18:59:38,  8.90s/it]
 80%|███████▉  | 30284/37963 [72:41:13<17:59:33,  8.44s/it]
 80%|███████▉  | 30285/37963 [72:41:20<17:19:59,  8.13s/it]
 80%|███████▉  | 30286/37963 [72:41:34<21:07:13,  9.90s/it]
 80%|███████▉  | 30287/37963 [72:41:42<19:26:28,  9.12s/it]
 80%|███████▉  | 30288/37963 [72:41:49<18:20:26,  8.60s/it]
 80%|███████▉  | 30289/37963 [72:41:57<17:41:10,  8.30s/it]
 80%|███████▉  | 30290/37963 [72:42:04<17:04:44,  8.01s/it]
                                                           
{'loss': '0.09428', 'grad_norm': '2.141', 'learning_rate': '2.068e-06', 'epoch': '0.7979'}

 80%|███████▉  | 30290/37963 [72:42:04<17:04:44,  8.01s/it]
 80%|███████▉  | 30291/37963 [72:42:11<16:44:47,  7.86s/it]
 80%|███████▉  | 30292/37963 [72:42:19<16:31:31,  7.76s/it]
 80%|███████▉  | 30293/37963 [72:42:27<16:32:23,  7.76s/it]
 80%|███████▉  | 30294/37963 [72:42:34<16:22:41,  7.69s/it]
 80%|███████▉  | 30295/37963 [72:42:42<16:17:50,  7.65s/it]
 80%|███████▉  | 30296/37963 [72:42:49<16:12:55,  7.61s/it]
 80%|███████▉  | 30297/37963 [72:42:57<16:09:43,  7.59s/it]
 80%|███████▉  | 30298/37963 [72:43:04<16:05:46,  7.56s/it]
 80%|███████▉  | 30299/37963 [72:43:12<16:08:50,  7.58s/it]
 80%|███████▉  | 30300/37963 [72:43:20<16:10:59,  7.60s/it]
                                                           
{'loss': '0.1048', 'grad_norm': '1.914', 'learning_rate': '2.062e-06', 'epoch': '0.7981'}

 80%|███████▉  | 30300/37963 [72:43:20<16:10:59,  7.60s/it]
 80%|███████▉  | 30301/37963 [72:43:27<16:07:08,  7.57s/it]
 80%|███████▉  | 30302/37963 [72:43:34<15:58:08,  7.50s/it]
 80%|███████▉  | 30303/37963 [72:43:42<16:00:37,  7.52s/it]
 80%|███████▉  | 30304/37963 [72:43:56<20:10:28,  9.48s/it]
 80%|███████▉  | 30305/37963 [72:44:10<22:51:34, 10.75s/it]
 80%|███████▉  | 30306/37963 [72:44:24<25:04:09, 11.79s/it]
 80%|███████▉  | 30307/37963 [72:44:32<22:24:04, 10.53s/it]
 80%|███████▉  | 30308/37963 [72:44:39<20:19:20,  9.56s/it]
 80%|███████▉  | 30309/37963 [72:44:46<19:00:20,  8.94s/it]
 80%|███████▉  | 30310/37963 [72:44:54<18:10:02,  8.55s/it]
                                                           
{'loss': '0.1082', 'grad_norm': '2.194', 'learning_rate': '2.057e-06', 'epoch': '0.7984'}

 80%|███████▉  | 30310/37963 [72:44:54<18:10:02,  8.55s/it]
 80%|███████▉  | 30311/37963 [72:45:14<25:46:39, 12.13s/it]
 80%|███████▉  | 30312/37963 [72:45:22<22:47:08, 10.72s/it]
 80%|███████▉  | 30313/37963 [72:45:30<20:47:54,  9.79s/it]
 80%|███████▉  | 30314/37963 [72:45:37<19:14:09,  9.05s/it]
 80%|███████▉  | 30315/37963 [72:45:44<18:08:24,  8.54s/it]
 80%|███████▉  | 30316/37963 [72:45:51<17:18:38,  8.15s/it]
 80%|███████▉  | 30317/37963 [72:45:59<16:57:41,  7.99s/it]
 80%|███████▉  | 30318/37963 [72:46:07<16:39:09,  7.84s/it]
 80%|███████▉  | 30319/37963 [72:46:20<20:24:18,  9.61s/it]
 80%|███████▉  | 30320/37963 [72:46:28<19:09:06,  9.02s/it]
                                                           
{'loss': '0.1017', 'grad_norm': '2.183', 'learning_rate': '2.052e-06', 'epoch': '0.7987'}

 80%|███████▉  | 30320/37963 [72:46:28<19:09:06,  9.02s/it]
 80%|███████▉  | 30321/37963 [72:46:36<18:17:11,  8.61s/it]
 80%|███████▉  | 30322/37963 [72:46:43<17:35:20,  8.29s/it]
 80%|███████▉  | 30323/37963 [72:46:51<17:01:48,  8.02s/it]
 80%|███████▉  | 30324/37963 [72:46:58<16:41:10,  7.86s/it]
 80%|███████▉  | 30325/37963 [72:47:05<16:24:14,  7.73s/it]
 80%|███████▉  | 30326/37963 [72:47:13<16:15:58,  7.67s/it]
 80%|███████▉  | 30327/37963 [72:47:21<16:09:52,  7.62s/it]
 80%|███████▉  | 30328/37963 [72:47:28<16:10:47,  7.63s/it]
 80%|███████▉  | 30329/37963 [72:47:36<16:04:01,  7.58s/it]
 80%|███████▉  | 30330/37963 [72:47:43<15:54:09,  7.50s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '2.775', 'learning_rate': '2.047e-06', 'epoch': '0.7989'}

 80%|███████▉  | 30330/37963 [72:47:43<15:54:09,  7.50s/it]
 80%|███████▉  | 30331/37963 [72:47:50<15:55:23,  7.51s/it]
 80%|███████▉  | 30332/37963 [72:47:58<15:56:45,  7.52s/it]
 80%|███████▉  | 30333/37963 [72:48:05<15:40:42,  7.40s/it]
 80%|███████▉  | 30334/37963 [72:48:13<15:41:22,  7.40s/it]
 80%|███████▉  | 30335/37963 [72:48:27<19:59:11,  9.43s/it]
 80%|███████▉  | 30336/37963 [72:48:40<22:39:52, 10.70s/it]
 80%|███████▉  | 30337/37963 [72:48:48<20:37:14,  9.73s/it]
 80%|███████▉  | 30338/37963 [72:48:55<19:09:21,  9.04s/it]
 80%|███████▉  | 30339/37963 [72:49:03<18:12:40,  8.60s/it]
 80%|███████▉  | 30340/37963 [72:49:10<17:33:02,  8.29s/it]
                                                           
{'loss': '0.1225', 'grad_norm': '2.431', 'learning_rate': '2.042e-06', 'epoch': '0.7992'}

 80%|███████▉  | 30340/37963 [72:49:10<17:33:02,  8.29s/it]
 80%|███████▉  | 30341/37963 [72:49:18<16:58:25,  8.02s/it]
 80%|███████▉  | 30342/37963 [72:49:25<16:35:44,  7.84s/it]
 80%|███████▉  | 30343/37963 [72:49:33<16:22:45,  7.74s/it]
 80%|███████▉  | 30344/37963 [72:49:40<16:06:10,  7.61s/it]
 80%|███████▉  | 30345/37963 [72:49:48<16:01:28,  7.57s/it]
 80%|███████▉  | 30346/37963 [72:49:55<16:02:11,  7.58s/it]
 80%|███████▉  | 30347/37963 [72:50:03<16:01:47,  7.58s/it]
 80%|███████▉  | 30348/37963 [72:50:10<16:04:11,  7.60s/it]
 80%|███████▉  | 30349/37963 [72:50:18<15:56:30,  7.54s/it]
 80%|███████▉  | 30350/37963 [72:50:31<19:50:16,  9.38s/it]
                                                           
{'loss': '0.1006', 'grad_norm': '3.153', 'learning_rate': '2.037e-06', 'epoch': '0.7995'}

 80%|███████▉  | 30350/37963 [72:50:31<19:50:16,  9.38s/it]
 80%|███████▉  | 30351/37963 [72:50:39<18:38:14,  8.81s/it]
 80%|███████▉  | 30352/37963 [72:50:46<17:50:13,  8.44s/it]
 80%|███████▉  | 30353/37963 [72:50:54<16:58:50,  8.03s/it]
 80%|███████▉  | 30354/37963 [72:51:01<16:39:02,  7.88s/it]
 80%|███████▉  | 30355/37963 [72:51:09<16:26:37,  7.78s/it]
 80%|███████▉  | 30356/37963 [72:51:23<20:19:09,  9.62s/it]
 80%|███████▉  | 30357/37963 [72:51:30<19:02:50,  9.02s/it]
 80%|███████▉  | 30358/37963 [72:51:44<22:14:12, 10.53s/it]
 80%|███████▉  | 30359/37963 [72:51:52<20:20:10,  9.63s/it]
 80%|███████▉  | 30360/37963 [72:52:06<23:14:42, 11.01s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '2.119', 'learning_rate': '2.031e-06', 'epoch': '0.7997'}

 80%|███████▉  | 30360/37963 [72:52:06<23:14:42, 11.01s/it]
 80%|███████▉  | 30361/37963 [72:52:13<20:58:20,  9.93s/it]
 80%|███████▉  | 30362/37963 [72:52:21<19:26:07,  9.20s/it]
 80%|███████▉  | 30363/37963 [72:52:35<22:34:01, 10.69s/it]
 80%|███████▉  | 30364/37963 [72:52:43<20:33:07,  9.74s/it]
 80%|███████▉  | 30365/37963 [72:52:50<19:06:07,  9.05s/it]
 80%|███████▉  | 30366/37963 [72:52:58<18:09:09,  8.60s/it]
 80%|███████▉  | 30367/37963 [72:53:05<17:30:42,  8.30s/it]
 80%|███████▉  | 30368/37963 [72:53:19<21:10:34, 10.04s/it]
 80%|███████▉  | 30369/37963 [72:53:27<19:41:20,  9.33s/it]
 80%|███████▉  | 30370/37963 [72:53:34<18:31:36,  8.78s/it]
                                                           
{'loss': '0.1153', 'grad_norm': '3.342', 'learning_rate': '2.026e-06', 'epoch': '0.8'}

 80%|███████▉  | 30370/37963 [72:53:34<18:31:36,  8.78s/it]
 80%|████████  | 30371/37963 [72:53:42<17:45:41,  8.42s/it]
 80%|████████  | 30372/37963 [72:53:49<17:09:50,  8.14s/it]
 80%|████████  | 30373/37963 [72:53:57<16:46:48,  7.96s/it]
 80%|████████  | 30374/37963 [72:54:05<16:30:19,  7.83s/it]
 80%|████████  | 30375/37963 [72:54:12<16:16:48,  7.72s/it]
 80%|████████  | 30376/37963 [72:54:19<16:05:50,  7.64s/it]
 80%|████████  | 30377/37963 [72:54:27<16:06:57,  7.65s/it]
 80%|████████  | 30378/37963 [72:54:35<15:59:27,  7.59s/it]
 80%|████████  | 30379/37963 [72:54:42<15:57:13,  7.57s/it]
 80%|████████  | 30380/37963 [72:54:57<20:16:26,  9.62s/it]
                                                           
{'loss': '0.09875', 'grad_norm': '1.962', 'learning_rate': '2.021e-06', 'epoch': '0.8003'}

 80%|████████  | 30380/37963 [72:54:57<20:16:26,  9.62s/it]
 80%|████████  | 30381/37963 [72:55:04<19:01:06,  9.03s/it]
 80%|████████  | 30382/37963 [72:55:12<18:01:11,  8.56s/it]
 80%|████████  | 30383/37963 [72:55:26<21:24:33, 10.17s/it]
 80%|████████  | 30384/37963 [72:55:33<19:49:38,  9.42s/it]
 80%|████████  | 30385/37963 [72:55:41<18:38:44,  8.86s/it]
 80%|████████  | 30386/37963 [72:55:48<17:43:58,  8.43s/it]
 80%|████████  | 30387/37963 [72:55:56<17:09:56,  8.16s/it]
 80%|████████  | 30388/37963 [72:56:03<16:45:25,  7.96s/it]
 80%|████████  | 30389/37963 [72:56:11<16:32:46,  7.86s/it]
 80%|████████  | 30390/37963 [72:56:18<16:19:27,  7.76s/it]
                                                           
{'loss': '0.1097', 'grad_norm': '2.15', 'learning_rate': '2.016e-06', 'epoch': '0.8005'}

 80%|████████  | 30390/37963 [72:56:18<16:19:27,  7.76s/it]
 80%|████████  | 30391/37963 [72:56:26<16:15:48,  7.73s/it]
 80%|████████  | 30392/37963 [72:56:34<16:07:29,  7.67s/it]
 80%|████████  | 30393/37963 [72:56:41<16:02:15,  7.63s/it]
 80%|████████  | 30394/37963 [72:56:49<15:55:06,  7.57s/it]
 80%|████████  | 30395/37963 [72:56:56<15:49:33,  7.53s/it]
 80%|████████  | 30396/37963 [72:57:03<15:46:46,  7.51s/it]
 80%|████████  | 30397/37963 [72:57:11<15:41:09,  7.46s/it]
 80%|████████  | 30398/37963 [72:57:25<19:52:40,  9.46s/it]
 80%|████████  | 30399/37963 [72:57:32<18:40:08,  8.89s/it]
 80%|████████  | 30400/37963 [72:57:40<17:50:32,  8.49s/it]
                                                           
{'loss': '0.1066', 'grad_norm': '2.659', 'learning_rate': '2.011e-06', 'epoch': '0.8008'}

 80%|████████  | 30400/37963 [72:57:40<17:50:32,  8.49s/it]
 80%|████████  | 30401/37963 [72:57:48<17:16:36,  8.22s/it]
 80%|████████  | 30402/37963 [72:58:01<20:47:11,  9.90s/it]
 80%|████████  | 30403/37963 [72:58:09<19:23:03,  9.23s/it]
 80%|████████  | 30404/37963 [72:58:17<18:23:10,  8.76s/it]
 80%|████████  | 30405/37963 [72:58:24<17:37:34,  8.40s/it]
 80%|████████  | 30406/37963 [72:58:32<17:04:51,  8.14s/it]
 80%|████████  | 30407/37963 [72:58:39<16:46:39,  7.99s/it]
 80%|████████  | 30408/37963 [72:58:47<16:27:07,  7.84s/it]
 80%|████████  | 30409/37963 [72:59:01<20:15:50,  9.66s/it]
 80%|████████  | 30410/37963 [72:59:08<18:58:29,  9.04s/it]
                                                           
{'loss': '0.1023', 'grad_norm': '2.864', 'learning_rate': '2.006e-06', 'epoch': '0.801'}

 80%|████████  | 30410/37963 [72:59:08<18:58:29,  9.04s/it]
 80%|████████  | 30411/37963 [72:59:16<18:01:11,  8.59s/it]
 80%|████████  | 30412/37963 [72:59:24<17:25:48,  8.31s/it]
 80%|████████  | 30413/37963 [72:59:31<16:56:22,  8.08s/it]
 80%|████████  | 30414/37963 [72:59:52<24:45:12, 11.80s/it]
 80%|████████  | 30415/37963 [72:59:59<22:02:49, 10.52s/it]
 80%|████████  | 30416/37963 [73:00:07<20:11:05,  9.63s/it]
 80%|████████  | 30417/37963 [73:00:21<23:01:07, 10.98s/it]
 80%|████████  | 30418/37963 [73:00:28<20:49:15,  9.93s/it]
 80%|████████  | 30419/37963 [73:00:36<19:14:44,  9.18s/it]
 80%|████████  | 30420/37963 [73:00:43<18:06:58,  8.65s/it]
                                                           
{'loss': '0.09261', 'grad_norm': '2.32', 'learning_rate': '2.001e-06', 'epoch': '0.8013'}

 80%|████████  | 30420/37963 [73:00:43<18:06:58,  8.65s/it]
 80%|████████  | 30421/37963 [73:00:51<17:22:13,  8.29s/it]
 80%|████████  | 30422/37963 [73:00:58<16:46:00,  8.00s/it]
 80%|████████  | 30423/37963 [73:01:06<16:28:06,  7.86s/it]
 80%|████████  | 30424/37963 [73:01:13<16:05:12,  7.68s/it]
 80%|████████  | 30425/37963 [73:01:20<15:51:08,  7.57s/it]
 80%|████████  | 30426/37963 [73:01:28<15:44:19,  7.52s/it]
 80%|████████  | 30427/37963 [73:01:35<15:44:00,  7.52s/it]
 80%|████████  | 30428/37963 [73:01:49<19:49:27,  9.47s/it]
 80%|████████  | 30429/37963 [73:01:56<18:30:01,  8.84s/it]
 80%|████████  | 30430/37963 [73:02:04<17:44:11,  8.48s/it]
                                                           
{'loss': '0.1021', 'grad_norm': '2.294', 'learning_rate': '1.996e-06', 'epoch': '0.8016'}

 80%|████████  | 30430/37963 [73:02:04<17:44:11,  8.48s/it]
 80%|████████  | 30431/37963 [73:02:12<17:05:59,  8.17s/it]
 80%|████████  | 30432/37963 [73:02:19<16:42:01,  7.98s/it]
 80%|████████  | 30433/37963 [73:02:27<16:22:54,  7.83s/it]
 80%|████████  | 30434/37963 [73:02:34<16:09:36,  7.73s/it]
 80%|████████  | 30435/37963 [73:02:48<20:09:41,  9.64s/it]
 80%|████████  | 30436/37963 [73:02:56<18:48:54,  9.00s/it]
 80%|████████  | 30437/37963 [73:03:03<17:48:19,  8.52s/it]
 80%|████████  | 30438/37963 [73:03:10<17:06:34,  8.19s/it]
 80%|████████  | 30439/37963 [73:03:18<16:42:44,  8.00s/it]
 80%|████████  | 30440/37963 [73:03:26<16:24:43,  7.85s/it]
                                                           
{'loss': '0.08898', 'grad_norm': '2.409', 'learning_rate': '1.99e-06', 'epoch': '0.8018'}

 80%|████████  | 30440/37963 [73:03:26<16:24:43,  7.85s/it]
 80%|████████  | 30441/37963 [73:03:33<16:05:00,  7.70s/it]
 80%|████████  | 30442/37963 [73:03:40<15:58:15,  7.64s/it]
 80%|████████  | 30443/37963 [73:03:48<15:55:21,  7.62s/it]
 80%|████████  | 30444/37963 [73:04:01<19:35:54,  9.38s/it]
 80%|████████  | 30445/37963 [73:04:09<18:25:22,  8.82s/it]
 80%|████████  | 30446/37963 [73:04:17<17:43:38,  8.49s/it]
 80%|████████  | 30447/37963 [73:04:24<17:10:10,  8.22s/it]
 80%|████████  | 30448/37963 [73:04:38<20:32:15,  9.84s/it]
 80%|████████  | 30449/37963 [73:04:46<19:10:41,  9.19s/it]
 80%|████████  | 30450/37963 [73:04:53<18:08:24,  8.69s/it]
                                                           
{'loss': '0.09224', 'grad_norm': '2.456', 'learning_rate': '1.985e-06', 'epoch': '0.8021'}

 80%|████████  | 30450/37963 [73:04:53<18:08:24,  8.69s/it]
 80%|████████  | 30451/37963 [73:05:00<17:09:31,  8.22s/it]
 80%|████████  | 30452/37963 [73:05:08<16:35:54,  7.96s/it]
 80%|████████  | 30453/37963 [73:05:15<16:18:57,  7.82s/it]
 80%|████████  | 30454/37963 [73:05:23<16:09:34,  7.75s/it]
 80%|████████  | 30455/37963 [73:05:30<16:11:58,  7.77s/it]
 80%|████████  | 30456/37963 [73:05:38<16:06:03,  7.72s/it]
 80%|████████  | 30457/37963 [73:05:46<15:57:45,  7.66s/it]
 80%|████████  | 30458/37963 [73:05:53<15:53:01,  7.62s/it]
 80%|████████  | 30459/37963 [73:06:07<19:50:29,  9.52s/it]
 80%|████████  | 30460/37963 [73:06:21<22:42:32, 10.90s/it]
                                                           
{'loss': '0.09958', 'grad_norm': '2.258', 'learning_rate': '1.98e-06', 'epoch': '0.8024'}

 80%|████████  | 30460/37963 [73:06:21<22:42:32, 10.90s/it]
 80%|████████  | 30461/37963 [73:06:29<20:37:47,  9.90s/it]
 80%|████████  | 30462/37963 [73:06:43<23:07:50, 11.10s/it]
 80%|████████  | 30463/37963 [73:06:57<24:55:09, 11.96s/it]
 80%|████████  | 30464/37963 [73:07:04<22:11:37, 10.65s/it]
 80%|████████  | 30465/37963 [73:07:12<20:14:05,  9.72s/it]
 80%|████████  | 30466/37963 [73:07:19<18:43:29,  8.99s/it]
 80%|████████  | 30467/37963 [73:07:27<17:48:12,  8.55s/it]
 80%|████████  | 30468/37963 [73:07:34<17:09:29,  8.24s/it]
 80%|████████  | 30469/37963 [73:07:41<16:36:02,  7.97s/it]
 80%|████████  | 30470/37963 [73:07:49<16:16:04,  7.82s/it]
                                                           
{'loss': '0.1019', 'grad_norm': '2.656', 'learning_rate': '1.975e-06', 'epoch': '0.8026'}

 80%|████████  | 30470/37963 [73:07:49<16:16:04,  7.82s/it]
 80%|████████  | 30471/37963 [73:07:56<16:00:47,  7.69s/it]
 80%|████████  | 30472/37963 [73:08:04<15:56:57,  7.66s/it]
 80%|████████  | 30473/37963 [73:08:11<15:55:20,  7.65s/it]
 80%|████████  | 30474/37963 [73:08:19<15:52:36,  7.63s/it]
 80%|████████  | 30475/37963 [73:08:27<15:48:03,  7.60s/it]
 80%|████████  | 30476/37963 [73:08:34<15:42:01,  7.55s/it]
 80%|████████  | 30477/37963 [73:08:42<15:40:01,  7.53s/it]
 80%|████████  | 30478/37963 [73:08:49<15:32:36,  7.48s/it]
 80%|████████  | 30479/37963 [73:08:57<15:40:47,  7.54s/it]
 80%|████████  | 30480/37963 [73:09:04<15:33:49,  7.49s/it]
                                                           
{'loss': '0.08144', 'grad_norm': '2.759', 'learning_rate': '1.97e-06', 'epoch': '0.8029'}

 80%|████████  | 30480/37963 [73:09:04<15:33:49,  7.49s/it]
 80%|████████  | 30481/37963 [73:09:25<23:45:06, 11.43s/it]
 80%|████████  | 30482/37963 [73:09:32<21:10:44, 10.19s/it]
 80%|████████  | 30483/37963 [73:09:39<19:32:14,  9.40s/it]
 80%|████████  | 30484/37963 [73:09:47<18:23:20,  8.85s/it]
 80%|████████  | 30485/37963 [73:09:54<17:30:43,  8.43s/it]
 80%|████████  | 30486/37963 [73:10:02<16:50:19,  8.11s/it]
 80%|████████  | 30487/37963 [73:10:09<16:17:42,  7.85s/it]
 80%|████████  | 30488/37963 [73:10:17<16:05:51,  7.75s/it]
 80%|████████  | 30489/37963 [73:10:24<15:58:48,  7.70s/it]
 80%|████████  | 30490/37963 [73:10:32<15:56:46,  7.68s/it]
                                                           
{'loss': '0.1', 'grad_norm': '4.488', 'learning_rate': '1.965e-06', 'epoch': '0.8032'}

 80%|████████  | 30490/37963 [73:10:32<15:56:46,  7.68s/it]
 80%|████████  | 30491/37963 [73:10:39<15:44:44,  7.59s/it]
 80%|████████  | 30492/37963 [73:10:53<19:26:04,  9.36s/it]
 80%|████████  | 30493/37963 [73:11:00<18:22:07,  8.85s/it]
 80%|████████  | 30494/37963 [73:11:14<21:40:11, 10.44s/it]
 80%|████████  | 30495/37963 [73:11:22<19:51:04,  9.57s/it]
 80%|████████  | 30496/37963 [73:11:30<18:38:00,  8.98s/it]
 80%|████████  | 30497/37963 [73:11:37<17:44:46,  8.56s/it]
 80%|████████  | 30498/37963 [73:11:45<17:05:38,  8.24s/it]
 80%|████████  | 30499/37963 [73:11:52<16:36:55,  8.01s/it]
 80%|████████  | 30500/37963 [73:12:00<16:13:20,  7.83s/it]
                                                           
{'loss': '0.09054', 'grad_norm': '2.291', 'learning_rate': '1.96e-06', 'epoch': '0.8034'}

 80%|████████  | 30500/37963 [73:12:00<16:13:20,  7.83s/it]
 80%|████████  | 30501/37963 [73:12:07<16:03:59,  7.75s/it]
 80%|████████  | 30502/37963 [73:12:15<15:55:25,  7.68s/it]
 80%|████████  | 30503/37963 [73:12:22<15:41:32,  7.57s/it]
 80%|████████  | 30504/37963 [73:12:30<15:40:30,  7.57s/it]
 80%|████████  | 30505/37963 [73:12:37<15:37:06,  7.54s/it]
 80%|████████  | 30506/37963 [73:12:45<15:36:46,  7.54s/it]
 80%|████████  | 30507/37963 [73:12:58<19:25:19,  9.38s/it]
 80%|████████  | 30508/37963 [73:13:06<18:16:45,  8.83s/it]
 80%|████████  | 30509/37963 [73:13:20<21:36:43, 10.44s/it]
 80%|████████  | 30510/37963 [73:13:34<23:58:32, 11.58s/it]
                                                           
{'loss': '0.1085', 'grad_norm': '2.5', 'learning_rate': '1.955e-06', 'epoch': '0.8037'}

 80%|████████  | 30510/37963 [73:13:34<23:58:32, 11.58s/it]
 80%|████████  | 30511/37963 [73:13:42<21:35:00, 10.43s/it]
 80%|████████  | 30512/37963 [73:13:56<23:39:33, 11.43s/it]
 80%|████████  | 30513/37963 [73:14:03<21:13:39, 10.26s/it]
 80%|████████  | 30514/37963 [73:14:10<19:20:06,  9.34s/it]
 80%|████████  | 30515/37963 [73:14:18<18:05:40,  8.75s/it]
 80%|████████  | 30516/37963 [73:14:25<17:20:27,  8.38s/it]
 80%|████████  | 30517/37963 [73:14:33<16:39:46,  8.06s/it]
 80%|████████  | 30518/37963 [73:14:40<16:19:56,  7.90s/it]
 80%|████████  | 30519/37963 [73:14:48<16:06:49,  7.79s/it]
 80%|████████  | 30520/37963 [73:14:55<15:52:29,  7.68s/it]
                                                           
{'loss': '0.09233', 'grad_norm': '2.89', 'learning_rate': '1.95e-06', 'epoch': '0.8039'}

 80%|████████  | 30520/37963 [73:14:55<15:52:29,  7.68s/it]
 80%|████████  | 30521/37963 [73:15:03<15:47:19,  7.64s/it]
 80%|████████  | 30522/37963 [73:15:10<15:47:08,  7.64s/it]
 80%|████████  | 30523/37963 [73:15:18<15:44:16,  7.62s/it]
 80%|████████  | 30524/37963 [73:15:32<19:35:41,  9.48s/it]
 80%|████████  | 30525/37963 [73:15:45<22:13:13, 10.75s/it]
 80%|████████  | 30526/37963 [73:15:53<20:11:54,  9.78s/it]
 80%|████████  | 30527/37963 [73:16:00<18:48:44,  9.11s/it]
 80%|████████  | 30528/37963 [73:16:08<17:51:46,  8.65s/it]
 80%|████████  | 30529/37963 [73:16:16<17:14:37,  8.35s/it]
 80%|████████  | 30530/37963 [73:16:23<16:48:37,  8.14s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '3.375', 'learning_rate': '1.945e-06', 'epoch': '0.8042'}

 80%|████████  | 30530/37963 [73:16:23<16:48:37,  8.14s/it]
 80%|████████  | 30531/37963 [73:16:31<16:26:04,  7.96s/it]
 80%|████████  | 30532/37963 [73:16:38<15:58:56,  7.74s/it]
 80%|████████  | 30533/37963 [73:16:46<15:50:24,  7.67s/it]
 80%|████████  | 30534/37963 [73:16:53<15:46:20,  7.64s/it]
 80%|████████  | 30535/37963 [73:17:00<15:34:14,  7.55s/it]
 80%|████████  | 30536/37963 [73:17:14<19:23:24,  9.40s/it]
 80%|████████  | 30537/37963 [73:17:28<21:58:56, 10.66s/it]
 80%|████████  | 30538/37963 [73:17:35<20:08:00,  9.76s/it]
 80%|████████  | 30539/37963 [73:17:43<18:42:52,  9.07s/it]
 80%|████████  | 30540/37963 [73:17:51<17:46:41,  8.62s/it]
                                                           
{'loss': '0.09945', 'grad_norm': '3.768', 'learning_rate': '1.94e-06', 'epoch': '0.8045'}

 80%|████████  | 30540/37963 [73:17:51<17:46:41,  8.62s/it]
 80%|████████  | 30541/37963 [73:17:58<17:00:14,  8.25s/it]
 80%|████████  | 30542/37963 [73:18:05<16:24:59,  7.96s/it]
 80%|████████  | 30543/37963 [73:18:13<16:01:01,  7.77s/it]
 80%|████████  | 30544/37963 [73:18:20<15:45:31,  7.65s/it]
 80%|████████  | 30545/37963 [73:18:27<15:40:33,  7.61s/it]
 80%|████████  | 30546/37963 [73:18:35<15:45:01,  7.64s/it]
 80%|████████  | 30547/37963 [73:18:43<15:41:06,  7.61s/it]
 80%|████████  | 30548/37963 [73:18:50<15:37:15,  7.58s/it]
 80%|████████  | 30549/37963 [73:18:58<15:35:53,  7.57s/it]
 80%|████████  | 30550/37963 [73:19:05<15:32:59,  7.55s/it]
                                                           
{'loss': '0.1018', 'grad_norm': '2.274', 'learning_rate': '1.935e-06', 'epoch': '0.8047'}

 80%|████████  | 30550/37963 [73:19:05<15:32:59,  7.55s/it]
 80%|████████  | 30551/37963 [73:19:13<15:31:02,  7.54s/it]
 80%|████████  | 30552/37963 [73:19:20<15:31:33,  7.54s/it]
 80%|████████  | 30553/37963 [73:19:28<15:26:12,  7.50s/it]
 80%|████████  | 30554/37963 [73:19:35<15:26:31,  7.50s/it]
 80%|████████  | 30555/37963 [73:19:43<15:20:00,  7.45s/it]
 80%|████████  | 30556/37963 [73:20:03<23:11:41, 11.27s/it]
 80%|████████  | 30557/37963 [73:20:10<20:53:03, 10.15s/it]
 80%|████████  | 30558/37963 [73:20:18<19:13:20,  9.35s/it]
 80%|████████  | 30559/37963 [73:20:32<22:03:01, 10.72s/it]
 80%|████████  | 30560/37963 [73:20:39<20:00:00,  9.73s/it]
                                                           
{'loss': '0.1013', 'grad_norm': '2.805', 'learning_rate': '1.93e-06', 'epoch': '0.805'}

 80%|████████  | 30560/37963 [73:20:39<20:00:00,  9.73s/it]
 81%|████████  | 30561/37963 [73:20:47<18:38:28,  9.07s/it]
 81%|████████  | 30562/37963 [73:21:01<21:41:01, 10.55s/it]
 81%|████████  | 30563/37963 [73:21:08<19:49:16,  9.64s/it]
 81%|████████  | 30564/37963 [73:21:16<18:30:05,  9.00s/it]
 81%|████████  | 30565/37963 [73:21:23<17:32:56,  8.54s/it]
 81%|████████  | 30566/37963 [73:21:30<16:45:49,  8.16s/it]
 81%|████████  | 30567/37963 [73:21:38<16:21:56,  7.97s/it]
 81%|████████  | 30568/37963 [73:21:45<15:51:32,  7.72s/it]
 81%|████████  | 30569/37963 [73:21:52<15:28:53,  7.54s/it]
 81%|████████  | 30570/37963 [73:22:00<15:30:54,  7.56s/it]
                                                           
{'loss': '0.08503', 'grad_norm': '1.981', 'learning_rate': '1.924e-06', 'epoch': '0.8053'}

 81%|████████  | 30570/37963 [73:22:00<15:30:54,  7.56s/it]
 81%|████████  | 30571/37963 [73:22:07<15:24:24,  7.50s/it]
 81%|████████  | 30572/37963 [73:22:14<15:15:56,  7.44s/it]
 81%|████████  | 30573/37963 [73:22:35<23:10:15, 11.29s/it]
 81%|████████  | 30574/37963 [73:22:42<20:46:50, 10.12s/it]
 81%|████████  | 30575/37963 [73:22:49<19:04:03,  9.29s/it]
 81%|████████  | 30576/37963 [73:22:57<18:03:10,  8.80s/it]
 81%|████████  | 30577/37963 [73:23:04<17:06:19,  8.34s/it]
 81%|████████  | 30578/37963 [73:23:12<16:37:56,  8.11s/it]
 81%|████████  | 30579/37963 [73:23:19<16:14:02,  7.91s/it]
 81%|████████  | 30580/37963 [73:23:27<16:01:48,  7.82s/it]
                                                           
{'loss': '0.09259', 'grad_norm': '2.174', 'learning_rate': '1.919e-06', 'epoch': '0.8055'}

 81%|████████  | 30580/37963 [73:23:27<16:01:48,  7.82s/it]
 81%|████████  | 30581/37963 [73:23:34<15:51:07,  7.73s/it]
 81%|████████  | 30582/37963 [73:23:42<15:43:07,  7.67s/it]
 81%|████████  | 30583/37963 [73:24:02<23:10:13, 11.30s/it]
 81%|████████  | 30584/37963 [73:24:09<20:52:30, 10.18s/it]
 81%|████████  | 30585/37963 [73:24:17<19:12:57,  9.38s/it]
 81%|████████  | 30586/37963 [73:24:24<18:03:36,  8.81s/it]
 81%|████████  | 30587/37963 [73:24:32<17:16:22,  8.43s/it]
 81%|████████  | 30588/37963 [73:24:39<16:33:12,  8.08s/it]
 81%|████████  | 30589/37963 [73:24:47<16:13:20,  7.92s/it]
 81%|████████  | 30590/37963 [73:24:54<15:56:15,  7.78s/it]
                                                           
{'loss': '0.1043', 'grad_norm': '2.891', 'learning_rate': '1.914e-06', 'epoch': '0.8058'}

 81%|████████  | 30590/37963 [73:24:54<15:56:15,  7.78s/it]
 81%|████████  | 30591/37963 [73:25:02<15:47:02,  7.71s/it]
 81%|████████  | 30592/37963 [73:25:09<15:40:40,  7.66s/it]
 81%|████████  | 30593/37963 [73:25:17<15:36:09,  7.62s/it]
 81%|████████  | 30594/37963 [73:25:24<15:32:50,  7.60s/it]
 81%|████████  | 30595/37963 [73:25:32<15:30:20,  7.58s/it]
 81%|████████  | 30596/37963 [73:25:39<15:29:37,  7.57s/it]
 81%|████████  | 30597/37963 [73:25:47<15:29:40,  7.57s/it]
 81%|████████  | 30598/37963 [73:25:54<15:20:07,  7.50s/it]
 81%|████████  | 30599/37963 [73:26:02<15:22:04,  7.51s/it]
 81%|████████  | 30600/37963 [73:26:09<15:24:36,  7.53s/it]
                                                           
{'loss': '0.09914', 'grad_norm': '2.016', 'learning_rate': '1.909e-06', 'epoch': '0.8061'}

 81%|████████  | 30600/37963 [73:26:09<15:24:36,  7.53s/it]
 81%|████████  | 30601/37963 [73:26:23<19:06:25,  9.34s/it]
 81%|████████  | 30602/37963 [73:26:37<22:09:00, 10.83s/it]
 81%|████████  | 30603/37963 [73:26:45<20:06:48,  9.84s/it]
 81%|████████  | 30604/37963 [73:26:52<18:30:06,  9.05s/it]
 81%|████████  | 30605/37963 [73:27:00<17:33:20,  8.59s/it]
 81%|████████  | 30606/37963 [73:27:07<16:56:28,  8.29s/it]
 81%|████████  | 30607/37963 [73:27:15<16:28:51,  8.07s/it]
 81%|████████  | 30608/37963 [73:27:28<19:56:52,  9.76s/it]
 81%|████████  | 30609/37963 [73:27:42<22:29:13, 11.01s/it]
 81%|████████  | 30610/37963 [73:27:50<20:27:27, 10.02s/it]
                                                           
{'loss': '0.09288', 'grad_norm': '2.078', 'learning_rate': '1.904e-06', 'epoch': '0.8063'}

 81%|████████  | 30610/37963 [73:27:50<20:27:27, 10.02s/it]
 81%|████████  | 30611/37963 [73:27:58<18:58:18,  9.29s/it]
 81%|████████  | 30612/37963 [73:28:05<17:52:38,  8.76s/it]
 81%|████████  | 30613/37963 [73:28:13<17:07:51,  8.39s/it]
 81%|████████  | 30614/37963 [73:28:20<16:32:39,  8.10s/it]
 81%|████████  | 30615/37963 [73:28:28<16:09:36,  7.92s/it]
 81%|████████  | 30616/37963 [73:28:35<15:50:33,  7.76s/it]
 81%|████████  | 30617/37963 [73:28:49<19:52:39,  9.74s/it]
 81%|████████  | 30618/37963 [73:28:57<18:21:51,  9.00s/it]
 81%|████████  | 30619/37963 [73:29:04<17:30:52,  8.59s/it]
 81%|████████  | 30620/37963 [73:29:12<16:52:16,  8.27s/it]
                                                           
{'loss': '0.09918', 'grad_norm': '2.319', 'learning_rate': '1.899e-06', 'epoch': '0.8066'}

 81%|████████  | 30620/37963 [73:29:12<16:52:16,  8.27s/it]
 81%|████████  | 30621/37963 [73:29:19<16:12:24,  7.95s/it]
 81%|████████  | 30622/37963 [73:29:27<16:01:40,  7.86s/it]
 81%|████████  | 30623/37963 [73:29:34<15:54:13,  7.80s/it]
 81%|████████  | 30624/37963 [73:29:42<15:47:38,  7.75s/it]
 81%|████████  | 30625/37963 [73:29:49<15:41:23,  7.70s/it]
 81%|████████  | 30626/37963 [73:29:57<15:35:55,  7.65s/it]
 81%|████████  | 30627/37963 [73:30:17<23:22:58, 11.47s/it]
 81%|████████  | 30628/37963 [73:30:25<21:04:31, 10.34s/it]
 81%|████████  | 30629/37963 [73:30:33<19:22:47,  9.51s/it]
 81%|████████  | 30630/37963 [73:30:40<18:13:07,  8.94s/it]
                                                           
{'loss': '0.1039', 'grad_norm': '2.412', 'learning_rate': '1.894e-06', 'epoch': '0.8068'}

 81%|████████  | 30630/37963 [73:30:40<18:13:07,  8.94s/it]
 81%|████████  | 30631/37963 [73:30:48<17:21:45,  8.52s/it]
 81%|████████  | 30632/37963 [73:31:02<20:40:27, 10.15s/it]
 81%|████████  | 30633/37963 [73:31:10<19:11:42,  9.43s/it]
 81%|████████  | 30634/37963 [73:31:17<17:54:57,  8.80s/it]
 81%|████████  | 30635/37963 [73:31:24<17:09:37,  8.43s/it]
 81%|████████  | 30636/37963 [73:31:32<16:37:36,  8.17s/it]
 81%|████████  | 30637/37963 [73:31:40<16:16:10,  7.99s/it]
 81%|████████  | 30638/37963 [73:31:47<15:56:53,  7.84s/it]
 81%|████████  | 30639/37963 [73:31:55<15:49:19,  7.78s/it]
 81%|████████  | 30640/37963 [73:32:02<15:40:25,  7.71s/it]
                                                           
{'loss': '0.1009', 'grad_norm': '2.087', 'learning_rate': '1.889e-06', 'epoch': '0.8071'}

 81%|████████  | 30640/37963 [73:32:02<15:40:25,  7.71s/it]
 81%|████████  | 30641/37963 [73:32:10<15:32:58,  7.65s/it]
 81%|████████  | 30642/37963 [73:32:17<15:30:41,  7.63s/it]
 81%|████████  | 30643/37963 [73:32:25<15:26:52,  7.60s/it]
 81%|████████  | 30644/37963 [73:32:32<15:21:42,  7.56s/it]
 81%|████████  | 30645/37963 [73:32:40<15:24:00,  7.58s/it]
 81%|████████  | 30646/37963 [73:32:47<15:21:02,  7.55s/it]
 81%|████████  | 30647/37963 [73:33:02<19:20:10,  9.51s/it]
 81%|████████  | 30648/37963 [73:33:16<22:11:53, 10.92s/it]
 81%|████████  | 30649/37963 [73:33:23<20:08:04,  9.91s/it]
 81%|████████  | 30650/37963 [73:33:31<18:45:59,  9.24s/it]
                                                           
{'loss': '0.09922', 'grad_norm': '3.488', 'learning_rate': '1.884e-06', 'epoch': '0.8074'}

 81%|████████  | 30650/37963 [73:33:31<18:45:59,  9.24s/it]
 81%|████████  | 30651/37963 [73:33:39<17:44:22,  8.73s/it]
 81%|████████  | 30652/37963 [73:33:46<16:59:23,  8.37s/it]
 81%|████████  | 30653/37963 [73:33:54<16:26:53,  8.10s/it]
 81%|████████  | 30654/37963 [73:34:07<19:54:10,  9.80s/it]
 81%|████████  | 30655/37963 [73:34:15<18:28:42,  9.10s/it]
 81%|████████  | 30656/37963 [73:34:22<17:22:14,  8.56s/it]
 81%|████████  | 30657/37963 [73:34:30<16:48:20,  8.28s/it]
 81%|████████  | 30658/37963 [73:34:37<16:08:36,  7.96s/it]
 81%|████████  | 30659/37963 [73:34:44<15:42:50,  7.75s/it]
 81%|████████  | 30660/37963 [73:34:52<15:34:10,  7.68s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '2.992', 'learning_rate': '1.879e-06', 'epoch': '0.8076'}

 81%|████████  | 30660/37963 [73:34:52<15:34:10,  7.68s/it]
 81%|████████  | 30661/37963 [73:35:12<23:13:03, 11.45s/it]
 81%|████████  | 30662/37963 [73:35:19<20:49:16, 10.27s/it]
 81%|████████  | 30663/37963 [73:35:27<18:57:21,  9.35s/it]
 81%|████████  | 30664/37963 [73:35:34<17:49:28,  8.79s/it]
 81%|████████  | 30665/37963 [73:35:42<17:04:13,  8.42s/it]
 81%|████████  | 30666/37963 [73:35:49<16:29:19,  8.13s/it]
 81%|████████  | 30667/37963 [73:35:57<16:07:18,  7.95s/it]
 81%|████████  | 30668/37963 [73:36:04<15:50:04,  7.81s/it]
 81%|████████  | 30669/37963 [73:36:12<15:43:20,  7.76s/it]
 81%|████████  | 30670/37963 [73:36:19<15:31:41,  7.67s/it]
                                                           
{'loss': '0.1068', 'grad_norm': '2.479', 'learning_rate': '1.874e-06', 'epoch': '0.8079'}

 81%|████████  | 30670/37963 [73:36:19<15:31:41,  7.67s/it]
 81%|████████  | 30671/37963 [73:36:27<15:26:45,  7.63s/it]
 81%|████████  | 30672/37963 [73:36:34<15:25:29,  7.62s/it]
 81%|████████  | 30673/37963 [73:36:42<15:22:05,  7.59s/it]
 81%|████████  | 30674/37963 [73:36:49<15:19:29,  7.57s/it]
 81%|████████  | 30675/37963 [73:36:57<15:12:01,  7.51s/it]
 81%|████████  | 30676/37963 [73:37:11<19:06:08,  9.44s/it]
 81%|████████  | 30677/37963 [73:37:18<17:58:01,  8.88s/it]
 81%|████████  | 30678/37963 [73:37:26<17:05:27,  8.45s/it]
 81%|████████  | 30679/37963 [73:37:33<16:33:06,  8.18s/it]
 81%|████████  | 30680/37963 [73:37:47<20:02:07,  9.90s/it]
                                                           
{'loss': '0.09094', 'grad_norm': '3.577', 'learning_rate': '1.87e-06', 'epoch': '0.8082'}

 81%|████████  | 30680/37963 [73:37:47<20:02:07,  9.90s/it]
 81%|████████  | 30681/37963 [73:38:01<22:29:46, 11.12s/it]
 81%|████████  | 30682/37963 [73:38:09<20:21:09, 10.06s/it]
 81%|████████  | 30683/37963 [73:38:16<18:45:23,  9.28s/it]
 81%|████████  | 30684/37963 [73:38:24<17:35:56,  8.70s/it]
 81%|████████  | 30685/37963 [73:38:31<16:56:42,  8.38s/it]
 81%|████████  | 30686/37963 [73:38:39<16:26:10,  8.13s/it]
 81%|████████  | 30687/37963 [73:38:46<15:58:12,  7.90s/it]
 81%|████████  | 30688/37963 [73:38:54<15:47:21,  7.81s/it]
 81%|████████  | 30689/37963 [73:39:01<15:35:59,  7.72s/it]
 81%|████████  | 30690/37963 [73:39:09<15:22:08,  7.61s/it]
                                                           
{'loss': '0.09338', 'grad_norm': '2.626', 'learning_rate': '1.865e-06', 'epoch': '0.8084'}

 81%|████████  | 30690/37963 [73:39:09<15:22:08,  7.61s/it]
 81%|████████  | 30691/37963 [73:39:16<15:18:46,  7.58s/it]
 81%|████████  | 30692/37963 [73:39:24<15:17:54,  7.57s/it]
 81%|████████  | 30693/37963 [73:39:31<15:15:24,  7.56s/it]
 81%|████████  | 30694/37963 [73:39:45<19:07:33,  9.47s/it]
 81%|████████  | 30695/37963 [73:39:53<17:56:43,  8.89s/it]
 81%|████████  | 30696/37963 [73:40:07<20:58:53, 10.39s/it]
 81%|████████  | 30697/37963 [73:40:14<19:13:12,  9.52s/it]
 81%|████████  | 30698/37963 [73:40:22<18:00:52,  8.93s/it]
 81%|████████  | 30699/37963 [73:40:29<17:08:44,  8.50s/it]
 81%|████████  | 30700/37963 [73:40:36<16:20:41,  8.10s/it]
                                                           
{'loss': '0.1067', 'grad_norm': '3.521', 'learning_rate': '1.86e-06', 'epoch': '0.8087'}

 81%|████████  | 30700/37963 [73:40:36<16:20:41,  8.10s/it]
 81%|████████  | 30701/37963 [73:40:43<15:50:43,  7.86s/it]
 81%|████████  | 30702/37963 [73:40:51<15:34:19,  7.72s/it]
 81%|████████  | 30703/37963 [73:40:58<15:26:39,  7.66s/it]
 81%|████████  | 30704/37963 [73:41:12<19:13:28,  9.53s/it]
 81%|████████  | 30705/37963 [73:41:20<18:02:06,  8.95s/it]
 81%|████████  | 30706/37963 [73:41:28<17:13:25,  8.54s/it]
 81%|████████  | 30707/37963 [73:41:35<16:28:43,  8.18s/it]
 81%|████████  | 30708/37963 [73:41:42<16:06:47,  8.00s/it]
 81%|████████  | 30709/37963 [73:41:56<19:43:09,  9.79s/it]
 81%|████████  | 30710/37963 [73:42:10<22:09:44, 11.00s/it]
                                                           
{'loss': '0.09177', 'grad_norm': '2.133', 'learning_rate': '1.855e-06', 'epoch': '0.8089'}

 81%|████████  | 30710/37963 [73:42:10<22:09:44, 11.00s/it]
 81%|████████  | 30711/37963 [73:42:18<20:03:26,  9.96s/it]
 81%|████████  | 30712/37963 [73:42:25<18:34:47,  9.22s/it]
 81%|████████  | 30713/37963 [73:42:33<17:27:40,  8.67s/it]
 81%|████████  | 30714/37963 [73:42:40<16:46:21,  8.33s/it]
 81%|████████  | 30715/37963 [73:42:47<16:10:21,  8.03s/it]
 81%|████████  | 30716/37963 [73:42:55<15:47:55,  7.85s/it]
 81%|████████  | 30717/37963 [73:43:02<15:36:20,  7.75s/it]
 81%|████████  | 30718/37963 [73:43:10<15:28:23,  7.69s/it]
 81%|████████  | 30719/37963 [73:43:18<15:23:30,  7.65s/it]
 81%|████████  | 30720/37963 [73:43:25<15:14:32,  7.58s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '2.906', 'learning_rate': '1.85e-06', 'epoch': '0.8092'}

 81%|████████  | 30720/37963 [73:43:25<15:14:32,  7.58s/it]
 81%|████████  | 30721/37963 [73:43:32<15:12:13,  7.56s/it]
 81%|████████  | 30722/37963 [73:43:40<15:12:22,  7.56s/it]
 81%|████████  | 30723/37963 [73:43:48<15:12:03,  7.56s/it]
 81%|████████  | 30724/37963 [73:43:55<15:11:25,  7.55s/it]
 81%|████████  | 30725/37963 [73:44:03<15:10:50,  7.55s/it]
 81%|████████  | 30726/37963 [73:44:10<15:11:16,  7.56s/it]
 81%|████████  | 30727/37963 [73:44:24<19:00:10,  9.45s/it]
 81%|████████  | 30728/37963 [73:44:32<17:53:03,  8.90s/it]
 81%|████████  | 30729/37963 [73:44:39<16:58:16,  8.45s/it]
 81%|████████  | 30730/37963 [73:44:47<16:29:00,  8.20s/it]
                                                           
{'loss': '0.1053', 'grad_norm': '3.156', 'learning_rate': '1.845e-06', 'epoch': '0.8095'}

 81%|████████  | 30730/37963 [73:44:47<16:29:00,  8.20s/it]
 81%|████████  | 30731/37963 [73:44:54<16:03:24,  7.99s/it]
 81%|████████  | 30732/37963 [73:45:08<19:41:18,  9.80s/it]
 81%|████████  | 30733/37963 [73:45:16<18:28:01,  9.20s/it]
 81%|████████  | 30734/37963 [73:45:30<21:19:16, 10.62s/it]
 81%|████████  | 30735/37963 [73:45:38<19:29:01,  9.70s/it]
 81%|████████  | 30736/37963 [73:45:45<18:08:54,  9.04s/it]
 81%|████████  | 30737/37963 [73:45:52<17:09:40,  8.55s/it]
 81%|████████  | 30738/37963 [73:46:06<20:23:07, 10.16s/it]
 81%|████████  | 30739/37963 [73:46:14<18:42:18,  9.32s/it]
 81%|████████  | 30740/37963 [73:46:21<17:32:13,  8.74s/it]
                                                           
{'loss': '0.1011', 'grad_norm': '3.252', 'learning_rate': '1.84e-06', 'epoch': '0.8097'}

 81%|████████  | 30740/37963 [73:46:21<17:32:13,  8.74s/it]
 81%|████████  | 30741/37963 [73:46:29<16:46:26,  8.36s/it]
 81%|████████  | 30742/37963 [73:46:36<16:13:09,  8.09s/it]
 81%|████████  | 30743/37963 [73:46:50<19:53:49,  9.92s/it]
 81%|████████  | 30744/37963 [73:46:58<18:26:21,  9.20s/it]
 81%|████████  | 30745/37963 [73:47:05<17:28:36,  8.72s/it]
 81%|████████  | 30746/37963 [73:47:13<16:45:29,  8.36s/it]
 81%|████████  | 30747/37963 [73:47:20<16:16:19,  8.12s/it]
 81%|████████  | 30748/37963 [73:47:28<15:56:11,  7.95s/it]
 81%|████████  | 30749/37963 [73:47:36<15:43:44,  7.85s/it]
 81%|████████  | 30750/37963 [73:47:43<15:24:57,  7.69s/it]
                                                           
{'loss': '0.1091', 'grad_norm': '1.717', 'learning_rate': '1.835e-06', 'epoch': '0.81'}

 81%|████████  | 30750/37963 [73:47:43<15:24:57,  7.69s/it]
 81%|████████  | 30751/37963 [73:47:57<19:19:21,  9.65s/it]
 81%|████████  | 30752/37963 [73:48:04<17:54:29,  8.94s/it]
 81%|████████  | 30753/37963 [73:48:12<17:06:10,  8.54s/it]
 81%|████████  | 30754/37963 [73:48:26<20:20:47, 10.16s/it]
 81%|████████  | 30755/37963 [73:48:34<18:48:16,  9.39s/it]
 81%|████████  | 30756/37963 [73:48:41<17:45:53,  8.87s/it]
 81%|████████  | 30757/37963 [73:48:49<16:53:10,  8.44s/it]
 81%|████████  | 30758/37963 [73:49:03<20:09:52, 10.08s/it]
 81%|████████  | 30759/37963 [73:49:10<18:47:39,  9.39s/it]
 81%|████████  | 30760/37963 [73:49:18<17:38:43,  8.82s/it]
                                                           
{'loss': '0.09579', 'grad_norm': '1.93', 'learning_rate': '1.83e-06', 'epoch': '0.8103'}

 81%|████████  | 30760/37963 [73:49:18<17:38:43,  8.82s/it]
 81%|████████  | 30761/37963 [73:49:25<16:52:58,  8.44s/it]
 81%|████████  | 30762/37963 [73:49:33<16:20:17,  8.17s/it]
 81%|████████  | 30763/37963 [73:49:40<15:58:09,  7.98s/it]
 81%|████████  | 30764/37963 [73:49:48<15:42:42,  7.86s/it]
 81%|████████  | 30765/37963 [73:49:56<15:34:26,  7.79s/it]
 81%|████████  | 30766/37963 [73:50:03<15:30:01,  7.75s/it]
 81%|████████  | 30767/37963 [73:50:11<15:17:16,  7.65s/it]
 81%|████████  | 30768/37963 [73:50:18<15:19:13,  7.67s/it]
 81%|████████  | 30769/37963 [73:50:26<15:13:23,  7.62s/it]
 81%|████████  | 30770/37963 [73:50:34<15:13:02,  7.62s/it]
                                                           
{'loss': '0.09764', 'grad_norm': '2.655', 'learning_rate': '1.825e-06', 'epoch': '0.8105'}

 81%|████████  | 30770/37963 [73:50:34<15:13:02,  7.62s/it]
 81%|████████  | 30771/37963 [73:50:48<19:06:26,  9.56s/it]
 81%|████████  | 30772/37963 [73:50:55<17:58:54,  9.00s/it]
 81%|████████  | 30773/37963 [73:51:03<17:05:13,  8.56s/it]
 81%|████████  | 30774/37963 [73:51:10<16:28:32,  8.25s/it]
 81%|████████  | 30775/37963 [73:51:18<16:01:24,  8.03s/it]
 81%|████████  | 30776/37963 [73:51:25<15:38:15,  7.83s/it]
 81%|████████  | 30777/37963 [73:51:33<15:27:33,  7.74s/it]
 81%|████████  | 30778/37963 [73:51:40<15:16:05,  7.65s/it]
 81%|████████  | 30779/37963 [73:51:54<19:03:07,  9.55s/it]
 81%|████████  | 30780/37963 [73:52:08<21:35:18, 10.82s/it]
                                                           
{'loss': '0.09764', 'grad_norm': '2.505', 'learning_rate': '1.82e-06', 'epoch': '0.8108'}

 81%|████████  | 30780/37963 [73:52:08<21:35:18, 10.82s/it]
 81%|████████  | 30781/37963 [73:52:16<19:41:48,  9.87s/it]
 81%|████████  | 30782/37963 [73:52:23<18:20:59,  9.20s/it]
 81%|████████  | 30783/37963 [73:52:31<17:25:04,  8.73s/it]
 81%|████████  | 30784/37963 [73:52:38<16:41:41,  8.37s/it]
 81%|████████  | 30785/37963 [73:52:46<16:10:20,  8.11s/it]
 81%|████████  | 30786/37963 [73:53:00<19:36:28,  9.84s/it]
 81%|████████  | 30787/37963 [73:53:08<18:22:05,  9.21s/it]
 81%|████████  | 30788/37963 [73:53:15<17:16:20,  8.67s/it]
 81%|████████  | 30789/37963 [73:53:23<16:38:51,  8.35s/it]
 81%|████████  | 30790/37963 [73:53:30<16:11:19,  8.12s/it]
                                                           
{'loss': '0.1124', 'grad_norm': '2.185', 'learning_rate': '1.815e-06', 'epoch': '0.8111'}

 81%|████████  | 30790/37963 [73:53:30<16:11:19,  8.12s/it]
 81%|████████  | 30791/37963 [73:53:38<15:50:18,  7.95s/it]
 81%|████████  | 30792/37963 [73:53:45<15:22:28,  7.72s/it]
 81%|████████  | 30793/37963 [73:53:52<15:14:46,  7.66s/it]
 81%|████████  | 30794/37963 [73:54:06<19:03:44,  9.57s/it]
 81%|████████  | 30795/37963 [73:54:14<17:37:00,  8.85s/it]
 81%|████████  | 30796/37963 [73:54:21<16:50:50,  8.46s/it]
 81%|████████  | 30797/37963 [73:54:35<19:58:55, 10.04s/it]
 81%|████████  | 30798/37963 [73:54:42<18:23:40,  9.24s/it]
 81%|████████  | 30799/37963 [73:54:50<17:21:07,  8.72s/it]
 81%|████████  | 30800/37963 [73:54:57<16:37:15,  8.35s/it]
                                                           
{'loss': '0.09924', 'grad_norm': '2.528', 'learning_rate': '1.81e-06', 'epoch': '0.8113'}

 81%|████████  | 30800/37963 [73:54:57<16:37:15,  8.35s/it]
 81%|████████  | 30801/37963 [73:55:05<16:04:54,  8.08s/it]
 81%|████████  | 30802/37963 [73:55:12<15:43:28,  7.91s/it]
 81%|████████  | 30803/37963 [73:55:26<19:24:14,  9.76s/it]
 81%|████████  | 30804/37963 [73:55:34<18:02:28,  9.07s/it]
 81%|████████  | 30805/37963 [73:55:41<17:02:57,  8.57s/it]
 81%|████████  | 30806/37963 [73:55:55<20:14:30, 10.18s/it]
 81%|████████  | 30807/37963 [73:56:03<18:42:10,  9.41s/it]
 81%|████████  | 30808/37963 [73:56:10<17:32:08,  8.82s/it]
 81%|████████  | 30809/37963 [73:56:18<16:37:59,  8.37s/it]
 81%|████████  | 30810/37963 [73:56:25<16:07:58,  8.12s/it]
                                                           
{'loss': '0.0972', 'grad_norm': '2.203', 'learning_rate': '1.805e-06', 'epoch': '0.8116'}

 81%|████████  | 30810/37963 [73:56:25<16:07:58,  8.12s/it]
 81%|████████  | 30811/37963 [73:56:33<15:45:09,  7.93s/it]
 81%|████████  | 30812/37963 [73:56:40<15:32:55,  7.83s/it]
 81%|████████  | 30813/37963 [73:56:48<15:21:41,  7.73s/it]
 81%|████████  | 30814/37963 [73:56:55<15:14:22,  7.67s/it]
 81%|████████  | 30815/37963 [73:57:09<19:02:29,  9.59s/it]
 81%|████████  | 30816/37963 [73:57:17<17:45:03,  8.94s/it]
 81%|████████  | 30817/37963 [73:57:24<17:00:13,  8.57s/it]
 81%|████████  | 30818/37963 [73:57:32<16:26:45,  8.29s/it]
 81%|████████  | 30819/37963 [73:57:40<16:03:59,  8.10s/it]
 81%|████████  | 30820/37963 [73:57:47<15:42:54,  7.92s/it]
                                                           
{'loss': '0.09998', 'grad_norm': '2.296', 'learning_rate': '1.801e-06', 'epoch': '0.8118'}

 81%|████████  | 30820/37963 [73:57:47<15:42:54,  7.92s/it]
 81%|████████  | 30821/37963 [73:57:55<15:28:40,  7.80s/it]
 81%|████████  | 30822/37963 [73:58:02<15:14:30,  7.68s/it]
 81%|████████  | 30823/37963 [73:58:10<15:05:56,  7.61s/it]
 81%|████████  | 30824/37963 [73:58:17<15:02:26,  7.58s/it]
 81%|████████  | 30825/37963 [73:58:25<14:58:58,  7.56s/it]
 81%|████████  | 30826/37963 [73:58:32<14:58:15,  7.55s/it]
 81%|████████  | 30827/37963 [73:58:40<14:53:26,  7.51s/it]
 81%|████████  | 30828/37963 [73:58:47<14:55:16,  7.53s/it]
 81%|████████  | 30829/37963 [73:58:55<14:55:42,  7.53s/it]
 81%|████████  | 30830/37963 [73:59:09<18:51:47,  9.52s/it]
                                                           
{'loss': '0.08232', 'grad_norm': '1.886', 'learning_rate': '1.796e-06', 'epoch': '0.8121'}

 81%|████████  | 30830/37963 [73:59:09<18:51:47,  9.52s/it]
 81%|████████  | 30831/37963 [73:59:16<17:39:53,  8.92s/it]
 81%|████████  | 30832/37963 [73:59:24<16:49:30,  8.49s/it]
 81%|████████  | 30833/37963 [73:59:38<20:11:13, 10.19s/it]
 81%|████████  | 30834/37963 [73:59:52<22:24:25, 11.32s/it]
 81%|████████  | 30835/37963 [73:59:59<20:09:33, 10.18s/it]
 81%|████████  | 30836/37963 [74:00:07<18:31:38,  9.36s/it]
 81%|████████  | 30837/37963 [74:00:14<17:27:53,  8.82s/it]
 81%|████████  | 30838/37963 [74:00:22<16:43:56,  8.45s/it]
 81%|████████  | 30839/37963 [74:00:29<16:02:58,  8.11s/it]
 81%|████████  | 30840/37963 [74:00:37<15:42:44,  7.94s/it]
                                                           
{'loss': '0.09803', 'grad_norm': '2.387', 'learning_rate': '1.791e-06', 'epoch': '0.8124'}

 81%|████████  | 30840/37963 [74:00:37<15:42:44,  7.94s/it]
 81%|████████  | 30841/37963 [74:00:44<15:23:40,  7.78s/it]
 81%|████████  | 30842/37963 [74:00:52<15:11:11,  7.68s/it]
 81%|████████  | 30843/37963 [74:00:59<15:06:27,  7.64s/it]
 81%|████████  | 30844/37963 [74:01:13<18:50:30,  9.53s/it]
 81%|████████▏ | 30845/37963 [74:01:27<21:37:26, 10.94s/it]
 81%|████████▏ | 30846/37963 [74:01:35<19:35:08,  9.91s/it]
 81%|████████▏ | 30847/37963 [74:01:42<18:04:53,  9.15s/it]
 81%|████████▏ | 30848/37963 [74:01:50<17:09:30,  8.68s/it]
 81%|████████▏ | 30849/37963 [74:01:57<16:28:28,  8.34s/it]
 81%|████████▏ | 30850/37963 [74:02:05<16:00:34,  8.10s/it]
                                                           
{'loss': '0.1041', 'grad_norm': '3.496', 'learning_rate': '1.786e-06', 'epoch': '0.8126'}

 81%|████████▏ | 30850/37963 [74:02:05<16:00:34,  8.10s/it]
 81%|████████▏ | 30851/37963 [74:02:26<23:24:58, 11.85s/it]
 81%|████████▏ | 30852/37963 [74:02:33<20:52:28, 10.57s/it]
 81%|████████▏ | 30853/37963 [74:02:40<18:55:22,  9.58s/it]
 81%|████████▏ | 30854/37963 [74:02:48<17:40:54,  8.95s/it]
 81%|████████▏ | 30855/37963 [74:02:55<16:50:51,  8.53s/it]
 81%|████████▏ | 30856/37963 [74:03:03<16:13:49,  8.22s/it]
 81%|████████▏ | 30857/37963 [74:03:10<15:45:54,  7.99s/it]
 81%|████████▏ | 30858/37963 [74:03:18<15:27:39,  7.83s/it]
 81%|████████▏ | 30859/37963 [74:03:25<15:17:27,  7.75s/it]
 81%|████████▏ | 30860/37963 [74:03:33<15:13:35,  7.72s/it]
                                                           
{'loss': '0.09498', 'grad_norm': '3.124', 'learning_rate': '1.781e-06', 'epoch': '0.8129'}

 81%|████████▏ | 30860/37963 [74:03:33<15:13:35,  7.72s/it]
 81%|████████▏ | 30861/37963 [74:03:40<15:02:08,  7.62s/it]
 81%|████████▏ | 30862/37963 [74:03:48<14:52:22,  7.54s/it]
 81%|████████▏ | 30863/37963 [74:03:55<14:47:54,  7.50s/it]
 81%|████████▏ | 30864/37963 [74:04:03<14:49:29,  7.52s/it]
 81%|████████▏ | 30865/37963 [74:04:10<14:51:55,  7.54s/it]
 81%|████████▏ | 30866/37963 [74:04:18<14:47:25,  7.50s/it]
 81%|████████▏ | 30867/37963 [74:04:25<14:41:21,  7.45s/it]
 81%|████████▏ | 30868/37963 [74:04:39<18:34:15,  9.42s/it]
 81%|████████▏ | 30869/37963 [74:04:47<17:29:46,  8.88s/it]
 81%|████████▏ | 30870/37963 [74:04:54<16:35:50,  8.42s/it]
                                                           
{'loss': '0.09154', 'grad_norm': '1.708', 'learning_rate': '1.776e-06', 'epoch': '0.8132'}

 81%|████████▏ | 30870/37963 [74:04:54<16:35:50,  8.42s/it]
 81%|████████▏ | 30871/37963 [74:05:02<16:04:03,  8.16s/it]
 81%|████████▏ | 30872/37963 [74:05:09<15:39:00,  7.95s/it]
 81%|████████▏ | 30873/37963 [74:05:17<15:26:35,  7.84s/it]
 81%|████████▏ | 30874/37963 [74:05:24<15:08:16,  7.69s/it]
 81%|████████▏ | 30875/37963 [74:05:32<15:00:57,  7.63s/it]
 81%|████████▏ | 30876/37963 [74:05:46<18:45:29,  9.53s/it]
 81%|████████▏ | 30877/37963 [74:05:53<17:34:51,  8.93s/it]
 81%|████████▏ | 30878/37963 [74:06:07<20:43:05, 10.53s/it]
 81%|████████▏ | 30879/37963 [74:06:15<18:54:40,  9.61s/it]
 81%|████████▏ | 30880/37963 [74:06:22<17:41:15,  8.99s/it]
                                                           
{'loss': '0.09005', 'grad_norm': '1.978', 'learning_rate': '1.771e-06', 'epoch': '0.8134'}

 81%|████████▏ | 30880/37963 [74:06:22<17:41:15,  8.99s/it]
 81%|████████▏ | 30881/37963 [74:06:30<16:49:19,  8.55s/it]
 81%|████████▏ | 30882/37963 [74:06:37<16:12:06,  8.24s/it]
 81%|████████▏ | 30883/37963 [74:06:45<15:45:08,  8.01s/it]
 81%|████████▏ | 30884/37963 [74:06:52<15:26:45,  7.86s/it]
 81%|████████▏ | 30885/37963 [74:07:00<15:06:15,  7.68s/it]
 81%|████████▏ | 30886/37963 [74:07:07<14:51:41,  7.56s/it]
 81%|████████▏ | 30887/37963 [74:07:14<14:52:18,  7.57s/it]
 81%|████████▏ | 30888/37963 [74:07:28<18:37:46,  9.48s/it]
 81%|████████▏ | 30889/37963 [74:07:36<17:29:32,  8.90s/it]
 81%|████████▏ | 30890/37963 [74:07:43<16:37:17,  8.46s/it]
                                                           
{'loss': '0.09742', 'grad_norm': '2.623', 'learning_rate': '1.767e-06', 'epoch': '0.8137'}

 81%|████████▏ | 30890/37963 [74:07:43<16:37:17,  8.46s/it]
 81%|████████▏ | 30891/37963 [74:07:51<16:02:49,  8.17s/it]
 81%|████████▏ | 30892/37963 [74:08:05<19:17:32,  9.82s/it]
 81%|████████▏ | 30893/37963 [74:08:18<21:36:17, 11.00s/it]
 81%|████████▏ | 30894/37963 [74:08:26<19:37:18,  9.99s/it]
 81%|████████▏ | 30895/37963 [74:08:40<21:59:32, 11.20s/it]
 81%|████████▏ | 30896/37963 [74:08:48<19:49:56, 10.10s/it]
 81%|████████▏ | 30897/37963 [74:08:55<18:19:40,  9.34s/it]
 81%|████████▏ | 30898/37963 [74:09:03<17:15:45,  8.80s/it]
 81%|████████▏ | 30899/37963 [74:09:17<20:28:27, 10.43s/it]
 81%|████████▏ | 30900/37963 [74:09:24<18:47:02,  9.57s/it]
                                                           
{'loss': '0.09497', 'grad_norm': '3.081', 'learning_rate': '1.762e-06', 'epoch': '0.814'}

 81%|████████▏ | 30900/37963 [74:09:24<18:47:02,  9.57s/it]
 81%|████████▏ | 30901/37963 [74:09:32<17:37:38,  8.99s/it]
 81%|████████▏ | 30902/37963 [74:09:39<16:39:37,  8.49s/it]
 81%|████████▏ | 30903/37963 [74:09:47<16:06:23,  8.21s/it]
 81%|████████▏ | 30904/37963 [74:09:54<15:36:35,  7.96s/it]
 81%|████████▏ | 30905/37963 [74:10:02<15:22:41,  7.84s/it]
 81%|████████▏ | 30906/37963 [74:10:09<15:04:04,  7.69s/it]
 81%|████████▏ | 30907/37963 [74:10:17<15:04:09,  7.69s/it]
 81%|████████▏ | 30908/37963 [74:10:24<14:57:46,  7.64s/it]
 81%|████████▏ | 30909/37963 [74:10:32<14:46:37,  7.54s/it]
 81%|████████▏ | 30910/37963 [74:10:39<14:46:13,  7.54s/it]
                                                           
{'loss': '0.09916', 'grad_norm': '2.204', 'learning_rate': '1.757e-06', 'epoch': '0.8142'}

 81%|████████▏ | 30910/37963 [74:10:39<14:46:13,  7.54s/it]
 81%|████████▏ | 30911/37963 [74:10:47<14:48:49,  7.56s/it]
 81%|████████▏ | 30912/37963 [74:10:55<14:55:20,  7.62s/it]
 81%|████████▏ | 30913/37963 [74:11:02<14:49:03,  7.57s/it]
 81%|████████▏ | 30914/37963 [74:11:10<14:44:37,  7.53s/it]
 81%|████████▏ | 30915/37963 [74:11:17<14:39:46,  7.49s/it]
 81%|████████▏ | 30916/37963 [74:11:24<14:40:16,  7.49s/it]
 81%|████████▏ | 30917/37963 [74:11:32<14:27:19,  7.39s/it]
 81%|████████▏ | 30918/37963 [74:11:39<14:31:07,  7.42s/it]
 81%|████████▏ | 30919/37963 [74:11:47<14:33:21,  7.44s/it]
 81%|████████▏ | 30920/37963 [74:11:54<14:38:04,  7.48s/it]
                                                           
{'loss': '0.09919', 'grad_norm': '2.765', 'learning_rate': '1.752e-06', 'epoch': '0.8145'}

 81%|████████▏ | 30920/37963 [74:11:54<14:38:04,  7.48s/it]
 81%|████████▏ | 30921/37963 [74:12:02<14:40:22,  7.50s/it]
 81%|████████▏ | 30922/37963 [74:12:09<14:41:09,  7.51s/it]
 81%|████████▏ | 30923/37963 [74:12:23<18:18:36,  9.36s/it]
 81%|████████▏ | 30924/37963 [74:12:30<17:07:54,  8.76s/it]
 81%|████████▏ | 30925/37963 [74:12:51<24:10:41, 12.37s/it]
 81%|████████▏ | 30926/37963 [74:12:59<21:23:22, 10.94s/it]
 81%|████████▏ | 30927/37963 [74:13:06<19:19:29,  9.89s/it]
 81%|████████▏ | 30928/37963 [74:13:14<17:54:58,  9.17s/it]
 81%|████████▏ | 30929/37963 [74:13:21<16:50:56,  8.62s/it]
 81%|████████▏ | 30930/37963 [74:13:28<16:13:31,  8.31s/it]
                                                           
{'loss': '0.09559', 'grad_norm': '4.495', 'learning_rate': '1.747e-06', 'epoch': '0.8147'}

 81%|████████▏ | 30930/37963 [74:13:28<16:13:31,  8.31s/it]
 81%|████████▏ | 30931/37963 [74:13:36<15:44:52,  8.06s/it]
 81%|████████▏ | 30932/37963 [74:13:43<15:24:25,  7.89s/it]
 81%|████████▏ | 30933/37963 [74:13:51<15:07:20,  7.74s/it]
 81%|████████▏ | 30934/37963 [74:13:58<14:58:43,  7.67s/it]
 81%|████████▏ | 30935/37963 [74:14:13<18:48:40,  9.64s/it]
 81%|████████▏ | 30936/37963 [74:14:20<17:37:49,  9.03s/it]
 81%|████████▏ | 30937/37963 [74:14:28<16:43:54,  8.57s/it]
 81%|████████▏ | 30938/37963 [74:14:35<15:59:07,  8.19s/it]
 81%|████████▏ | 30939/37963 [74:14:49<19:20:06,  9.91s/it]
 82%|████████▏ | 30940/37963 [74:15:03<21:38:48, 11.10s/it]
                                                           
{'loss': '0.09825', 'grad_norm': '2.445', 'learning_rate': '1.742e-06', 'epoch': '0.815'}

 82%|████████▏ | 30940/37963 [74:15:03<21:38:48, 11.10s/it]
 82%|████████▏ | 30941/37963 [74:15:10<19:35:11, 10.04s/it]
 82%|████████▏ | 30942/37963 [74:15:24<21:51:41, 11.21s/it]
 82%|████████▏ | 30943/37963 [74:15:32<19:41:59, 10.10s/it]
 82%|████████▏ | 30944/37963 [74:15:39<18:16:53,  9.38s/it]
 82%|████████▏ | 30945/37963 [74:15:47<17:11:04,  8.82s/it]
 82%|████████▏ | 30946/37963 [74:15:55<16:27:09,  8.44s/it]
 82%|████████▏ | 30947/37963 [74:16:02<15:56:31,  8.18s/it]
 82%|████████▏ | 30948/37963 [74:16:16<19:18:22,  9.91s/it]
 82%|████████▏ | 30949/37963 [74:16:24<18:00:57,  9.25s/it]
 82%|████████▏ | 30950/37963 [74:16:31<17:01:07,  8.74s/it]
                                                           
{'loss': '0.1037', 'grad_norm': '3.459', 'learning_rate': '1.738e-06', 'epoch': '0.8153'}

 82%|████████▏ | 30950/37963 [74:16:31<17:01:07,  8.74s/it]
 82%|████████▏ | 30951/37963 [74:16:39<16:21:30,  8.40s/it]
 82%|████████▏ | 30952/37963 [74:16:46<15:50:38,  8.14s/it]
 82%|████████▏ | 30953/37963 [74:16:54<15:28:20,  7.95s/it]
 82%|████████▏ | 30954/37963 [74:17:02<15:14:35,  7.83s/it]
 82%|████████▏ | 30955/37963 [74:17:09<15:04:10,  7.74s/it]
 82%|████████▏ | 30956/37963 [74:17:17<14:57:30,  7.69s/it]
 82%|████████▏ | 30957/37963 [74:17:24<14:51:15,  7.63s/it]
 82%|████████▏ | 30958/37963 [74:17:32<14:49:49,  7.62s/it]
 82%|████████▏ | 30959/37963 [74:17:39<14:37:28,  7.52s/it]
 82%|████████▏ | 30960/37963 [74:17:46<14:34:48,  7.50s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '1.824', 'learning_rate': '1.733e-06', 'epoch': '0.8155'}

 82%|████████▏ | 30960/37963 [74:17:46<14:34:48,  7.50s/it]
 82%|████████▏ | 30961/37963 [74:17:54<14:36:17,  7.51s/it]
 82%|████████▏ | 30962/37963 [74:18:01<14:27:12,  7.43s/it]
 82%|████████▏ | 30963/37963 [74:18:09<14:32:39,  7.48s/it]
 82%|████████▏ | 30964/37963 [74:18:16<14:31:15,  7.47s/it]
 82%|████████▏ | 30965/37963 [74:18:24<14:38:43,  7.53s/it]
 82%|████████▏ | 30966/37963 [74:18:31<14:24:51,  7.42s/it]
 82%|████████▏ | 30967/37963 [74:18:39<14:27:25,  7.44s/it]
 82%|████████▏ | 30968/37963 [74:18:52<17:58:30,  9.25s/it]
 82%|████████▏ | 30969/37963 [74:19:00<17:03:54,  8.78s/it]
 82%|████████▏ | 30970/37963 [74:19:07<16:19:23,  8.40s/it]
                                                           
{'loss': '0.101', 'grad_norm': '3.343', 'learning_rate': '1.728e-06', 'epoch': '0.8158'}

 82%|████████▏ | 30970/37963 [74:19:07<16:19:23,  8.40s/it]
 82%|████████▏ | 30971/37963 [74:19:15<15:47:12,  8.13s/it]
 82%|████████▏ | 30972/37963 [74:19:22<15:23:43,  7.93s/it]
 82%|████████▏ | 30973/37963 [74:19:29<14:56:08,  7.69s/it]
 82%|████████▏ | 30974/37963 [74:19:43<18:35:04,  9.57s/it]
 82%|████████▏ | 30975/37963 [74:19:57<21:01:53, 10.83s/it]
 82%|████████▏ | 30976/37963 [74:20:05<19:07:00,  9.85s/it]
 82%|████████▏ | 30977/37963 [74:20:12<17:49:20,  9.18s/it]
 82%|████████▏ | 30978/37963 [74:20:20<16:50:04,  8.68s/it]
 82%|████████▏ | 30979/37963 [74:20:34<19:49:05, 10.22s/it]
 82%|████████▏ | 30980/37963 [74:20:41<18:16:03,  9.42s/it]
                                                           
{'loss': '0.09804', 'grad_norm': '2.793', 'learning_rate': '1.723e-06', 'epoch': '0.8161'}

 82%|████████▏ | 30980/37963 [74:20:41<18:16:03,  9.42s/it]
 82%|████████▏ | 30981/37963 [74:20:49<17:07:49,  8.83s/it]
 82%|████████▏ | 30982/37963 [74:20:56<16:22:36,  8.45s/it]
 82%|████████▏ | 30983/37963 [74:21:04<15:55:59,  8.22s/it]
 82%|████████▏ | 30984/37963 [74:21:18<19:09:05,  9.88s/it]
 82%|████████▏ | 30985/37963 [74:21:25<17:50:57,  9.21s/it]
 82%|████████▏ | 30986/37963 [74:21:33<16:55:11,  8.73s/it]
 82%|████████▏ | 30987/37963 [74:21:47<20:11:19, 10.42s/it]
 82%|████████▏ | 30988/37963 [74:21:55<18:33:39,  9.58s/it]
 82%|████████▏ | 30989/37963 [74:22:02<17:24:04,  8.98s/it]
 82%|████████▏ | 30990/37963 [74:22:10<16:27:05,  8.49s/it]
                                                           
{'loss': '0.08718', 'grad_norm': '2.374', 'learning_rate': '1.718e-06', 'epoch': '0.8163'}

 82%|████████▏ | 30990/37963 [74:22:10<16:27:05,  8.49s/it]
 82%|████████▏ | 30991/37963 [74:22:24<19:42:43, 10.18s/it]
 82%|████████▏ | 30992/37963 [74:22:31<18:04:03,  9.33s/it]
 82%|████████▏ | 30993/37963 [74:22:39<17:01:01,  8.79s/it]
 82%|████████▏ | 30994/37963 [74:22:53<20:16:46, 10.48s/it]
 82%|████████▏ | 30995/37963 [74:23:01<18:35:22,  9.60s/it]
 82%|████████▏ | 30996/37963 [74:23:08<17:16:54,  8.93s/it]
 82%|████████▏ | 30997/37963 [74:23:15<16:14:29,  8.39s/it]
 82%|████████▏ | 30998/37963 [74:23:23<15:45:25,  8.14s/it]
 82%|████████▏ | 30999/37963 [74:23:30<15:28:21,  8.00s/it]
 82%|████████▏ | 31000/37963 [74:23:38<15:11:34,  7.85s/it]
                                                           
{'loss': '0.09073', 'grad_norm': '1.735', 'learning_rate': '1.714e-06', 'epoch': '0.8166'}

 82%|████████▏ | 31000/37963 [74:23:38<15:11:34,  7.85s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.76s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.76s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 82%|████████▏ | 31001/37963 [74:24:36<44:09:40, 22.84s/it]
 82%|████████▏ | 31002/37963 [74:24:43<35:09:01, 18.18s/it]
 82%|████████▏ | 31003/37963 [74:24:51<28:57:47, 14.98s/it]
 82%|████████▏ | 31004/37963 [74:24:58<24:31:34, 12.69s/it]
 82%|████████▏ | 31005/37963 [74:25:05<21:23:41, 11.07s/it]
 82%|████████▏ | 31006/37963 [74:25:13<19:25:19, 10.05s/it]
 82%|████████▏ | 31007/37963 [74:25:21<18:00:33,  9.32s/it]
 82%|████████▏ | 31008/37963 [74:25:28<16:48:58,  8.70s/it]
 82%|████████▏ | 31009/37963 [74:25:35<16:03:26,  8.31s/it]
 82%|████████▏ | 31010/37963 [74:25:43<15:28:57,  8.02s/it]
                                                           
{'loss': '0.09816', 'grad_norm': '2.217', 'learning_rate': '1.709e-06', 'epoch': '0.8169'}

 82%|████████▏ | 31010/37963 [74:25:43<15:28:57,  8.02s/it]
 82%|████████▏ | 31011/37963 [74:25:50<15:11:38,  7.87s/it]
 82%|████████▏ | 31012/37963 [74:25:58<15:00:24,  7.77s/it]
 82%|████████▏ | 31013/37963 [74:26:05<14:52:53,  7.71s/it]
 82%|████████▏ | 31014/37963 [74:26:13<14:51:14,  7.70s/it]
 82%|████████▏ | 31015/37963 [74:26:20<14:47:27,  7.66s/it]
 82%|████████▏ | 31016/37963 [74:26:34<18:25:04,  9.54s/it]
 82%|████████▏ | 31017/37963 [74:26:42<17:10:12,  8.90s/it]
 82%|████████▏ | 31018/37963 [74:26:49<16:20:01,  8.47s/it]
 82%|████████▏ | 31019/37963 [74:26:57<15:46:57,  8.18s/it]
 82%|████████▏ | 31020/37963 [74:27:04<15:25:44,  8.00s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '1.974', 'learning_rate': '1.704e-06', 'epoch': '0.8171'}

 82%|████████▏ | 31020/37963 [74:27:04<15:25:44,  8.00s/it]
 82%|████████▏ | 31021/37963 [74:27:18<18:59:51,  9.85s/it]
 82%|████████▏ | 31022/37963 [74:27:26<17:41:49,  9.18s/it]
 82%|████████▏ | 31023/37963 [74:27:34<16:45:23,  8.69s/it]
 82%|████████▏ | 31024/37963 [74:27:48<19:46:27, 10.26s/it]
 82%|████████▏ | 31025/37963 [74:27:55<18:14:58,  9.47s/it]
 82%|████████▏ | 31026/37963 [74:28:09<20:50:29, 10.82s/it]
 82%|████████▏ | 31027/37963 [74:28:17<18:56:01,  9.83s/it]
 82%|████████▏ | 31028/37963 [74:28:30<21:11:10, 11.00s/it]
 82%|████████▏ | 31029/37963 [74:28:38<19:12:11,  9.97s/it]
 82%|████████▏ | 31030/37963 [74:28:45<17:48:52,  9.25s/it]
                                                           
{'loss': '0.1058', 'grad_norm': '2.85', 'learning_rate': '1.699e-06', 'epoch': '0.8174'}

 82%|████████▏ | 31030/37963 [74:28:45<17:48:52,  9.25s/it]
 82%|████████▏ | 31031/37963 [74:28:53<16:49:13,  8.74s/it]
 82%|████████▏ | 31032/37963 [74:29:01<16:10:26,  8.40s/it]
 82%|████████▏ | 31033/37963 [74:29:08<15:40:04,  8.14s/it]
 82%|████████▏ | 31034/37963 [74:29:16<15:18:46,  7.96s/it]
 82%|████████▏ | 31035/37963 [74:29:23<15:03:39,  7.83s/it]
 82%|████████▏ | 31036/37963 [74:29:31<14:44:54,  7.66s/it]
 82%|████████▏ | 31037/37963 [74:29:44<18:20:02,  9.53s/it]
 82%|████████▏ | 31038/37963 [74:29:52<17:03:39,  8.87s/it]
 82%|████████▏ | 31039/37963 [74:30:06<20:04:49, 10.44s/it]
 82%|████████▏ | 31040/37963 [74:30:13<18:08:57,  9.44s/it]
                                                           
{'loss': '0.09839', 'grad_norm': '2.09', 'learning_rate': '1.695e-06', 'epoch': '0.8176'}

 82%|████████▏ | 31040/37963 [74:30:13<18:08:57,  9.44s/it]
 82%|████████▏ | 31041/37963 [74:30:20<17:02:10,  8.86s/it]
 82%|████████▏ | 31042/37963 [74:30:28<16:02:41,  8.35s/it]
 82%|████████▏ | 31043/37963 [74:30:42<19:16:56, 10.03s/it]
 82%|████████▏ | 31044/37963 [74:30:49<17:37:54,  9.17s/it]
 82%|████████▏ | 31045/37963 [74:30:56<16:41:40,  8.69s/it]
 82%|████████▏ | 31046/37963 [74:31:04<16:06:43,  8.39s/it]
 82%|████████▏ | 31047/37963 [74:31:12<15:40:24,  8.16s/it]
 82%|████████▏ | 31048/37963 [74:31:19<15:20:59,  7.99s/it]
 82%|████████▏ | 31049/37963 [74:31:27<15:09:25,  7.89s/it]
 82%|████████▏ | 31050/37963 [74:31:34<14:58:04,  7.79s/it]
                                                           
{'loss': '0.09805', 'grad_norm': '2.481', 'learning_rate': '1.69e-06', 'epoch': '0.8179'}

 82%|████████▏ | 31050/37963 [74:31:34<14:58:04,  7.79s/it]
 82%|████████▏ | 31051/37963 [74:31:42<14:48:57,  7.72s/it]
 82%|████████▏ | 31052/37963 [74:31:49<14:35:42,  7.60s/it]
 82%|████████▏ | 31053/37963 [74:31:57<14:34:51,  7.60s/it]
 82%|████████▏ | 31054/37963 [74:32:04<14:33:06,  7.58s/it]
 82%|████████▏ | 31055/37963 [74:32:12<14:29:05,  7.55s/it]
 82%|████████▏ | 31056/37963 [74:32:19<14:22:17,  7.49s/it]
 82%|████████▏ | 31057/37963 [74:32:27<14:20:34,  7.48s/it]
 82%|████████▏ | 31058/37963 [74:32:34<14:18:47,  7.46s/it]
 82%|████████▏ | 31059/37963 [74:32:42<14:23:58,  7.51s/it]
 82%|████████▏ | 31060/37963 [74:32:49<14:26:03,  7.53s/it]
                                                           
{'loss': '0.1061', 'grad_norm': '3.07', 'learning_rate': '1.685e-06', 'epoch': '0.8182'}

 82%|████████▏ | 31060/37963 [74:32:49<14:26:03,  7.53s/it]
 82%|████████▏ | 31061/37963 [74:32:57<14:26:45,  7.53s/it]
 82%|████████▏ | 31062/37963 [74:33:04<14:23:13,  7.51s/it]
 82%|████████▏ | 31063/37963 [74:33:12<14:23:09,  7.51s/it]
 82%|████████▏ | 31064/37963 [74:33:19<14:23:38,  7.51s/it]
 82%|████████▏ | 31065/37963 [74:33:33<18:03:54,  9.43s/it]
 82%|████████▏ | 31066/37963 [74:33:41<16:58:52,  8.86s/it]
 82%|████████▏ | 31067/37963 [74:33:48<16:15:39,  8.49s/it]
 82%|████████▏ | 31068/37963 [74:33:56<15:37:22,  8.16s/it]
 82%|████████▏ | 31069/37963 [74:34:03<15:14:05,  7.96s/it]
 82%|████████▏ | 31070/37963 [74:34:17<18:28:33,  9.65s/it]
                                                           
{'loss': '0.08926', 'grad_norm': '2.835', 'learning_rate': '1.68e-06', 'epoch': '0.8184'}

 82%|████████▏ | 31070/37963 [74:34:17<18:28:33,  9.65s/it]
 82%|████████▏ | 31071/37963 [74:34:30<20:45:48, 10.85s/it]
 82%|████████▏ | 31072/37963 [74:34:38<18:51:13,  9.85s/it]
 82%|████████▏ | 31073/37963 [74:34:52<21:07:38, 11.04s/it]
 82%|████████▏ | 31074/37963 [74:34:59<19:04:07,  9.96s/it]
 82%|████████▏ | 31075/37963 [74:35:07<17:36:02,  9.20s/it]
 82%|████████▏ | 31076/37963 [74:35:14<16:37:26,  8.69s/it]
 82%|████████▏ | 31077/37963 [74:35:22<16:00:07,  8.37s/it]
 82%|████████▏ | 31078/37963 [74:35:29<15:30:56,  8.11s/it]
 82%|████████▏ | 31079/37963 [74:35:37<15:06:05,  7.90s/it]
 82%|████████▏ | 31080/37963 [74:35:44<14:53:17,  7.79s/it]
                                                           
{'loss': '0.08962', 'grad_norm': '3.791', 'learning_rate': '1.676e-06', 'epoch': '0.8187'}

 82%|████████▏ | 31080/37963 [74:35:44<14:53:17,  7.79s/it]
 82%|████████▏ | 31081/37963 [74:35:51<14:32:42,  7.61s/it]
 82%|████████▏ | 31082/37963 [74:36:05<18:08:50,  9.49s/it]
 82%|████████▏ | 31083/37963 [74:36:13<17:02:44,  8.92s/it]
 82%|████████▏ | 31084/37963 [74:36:20<16:14:05,  8.50s/it]
 82%|████████▏ | 31085/37963 [74:36:34<19:21:51, 10.14s/it]
 82%|████████▏ | 31086/37963 [74:36:42<17:53:22,  9.36s/it]
 82%|████████▏ | 31087/37963 [74:36:49<16:49:12,  8.81s/it]
 82%|████████▏ | 31088/37963 [74:36:57<16:06:40,  8.44s/it]
 82%|████████▏ | 31089/37963 [74:37:05<15:36:03,  8.17s/it]
 82%|████████▏ | 31090/37963 [74:37:12<15:07:46,  7.92s/it]
                                                           
{'loss': '0.09554', 'grad_norm': '2.325', 'learning_rate': '1.671e-06', 'epoch': '0.819'}

 82%|████████▏ | 31090/37963 [74:37:12<15:07:46,  7.92s/it]
 82%|████████▏ | 31091/37963 [74:37:26<18:42:16,  9.80s/it]
 82%|████████▏ | 31092/37963 [74:37:34<17:26:10,  9.14s/it]
 82%|████████▏ | 31093/37963 [74:37:41<16:30:57,  8.65s/it]
 82%|████████▏ | 31094/37963 [74:37:55<19:40:17, 10.31s/it]
 82%|████████▏ | 31095/37963 [74:38:03<18:04:42,  9.48s/it]
 82%|████████▏ | 31096/37963 [74:38:11<16:59:59,  8.91s/it]
 82%|████████▏ | 31097/37963 [74:38:18<16:11:07,  8.49s/it]
 82%|████████▏ | 31098/37963 [74:38:26<15:41:32,  8.23s/it]
 82%|████████▏ | 31099/37963 [74:38:33<15:10:18,  7.96s/it]
 82%|████████▏ | 31100/37963 [74:38:40<14:54:53,  7.82s/it]
                                                           
{'loss': '0.08167', 'grad_norm': '2.198', 'learning_rate': '1.666e-06', 'epoch': '0.8192'}

 82%|████████▏ | 31100/37963 [74:38:40<14:54:53,  7.82s/it]
 82%|████████▏ | 31101/37963 [74:38:48<14:41:09,  7.70s/it]
 82%|████████▏ | 31102/37963 [74:38:55<14:24:59,  7.56s/it]
 82%|████████▏ | 31103/37963 [74:39:03<14:24:44,  7.56s/it]
 82%|████████▏ | 31104/37963 [74:39:10<14:27:07,  7.59s/it]
 82%|████████▏ | 31105/37963 [74:39:18<14:15:10,  7.48s/it]
 82%|████████▏ | 31106/37963 [74:39:25<14:17:22,  7.50s/it]
 82%|████████▏ | 31107/37963 [74:39:33<14:17:05,  7.50s/it]
 82%|████████▏ | 31108/37963 [74:39:40<14:20:01,  7.53s/it]
 82%|████████▏ | 31109/37963 [74:39:48<14:11:44,  7.46s/it]
 82%|████████▏ | 31110/37963 [74:39:55<14:16:37,  7.50s/it]
                                                           
{'loss': '0.09294', 'grad_norm': '2.703', 'learning_rate': '1.661e-06', 'epoch': '0.8195'}

 82%|████████▏ | 31110/37963 [74:39:55<14:16:37,  7.50s/it]
 82%|████████▏ | 31111/37963 [74:40:03<14:20:49,  7.54s/it]
 82%|████████▏ | 31112/37963 [74:40:10<14:23:28,  7.56s/it]
 82%|████████▏ | 31113/37963 [74:40:18<14:19:33,  7.53s/it]
 82%|████████▏ | 31114/37963 [74:40:25<14:22:23,  7.55s/it]
 82%|████████▏ | 31115/37963 [74:40:33<14:19:50,  7.53s/it]
 82%|████████▏ | 31116/37963 [74:40:40<14:20:31,  7.54s/it]
 82%|████████▏ | 31117/37963 [74:40:48<14:12:58,  7.48s/it]
 82%|████████▏ | 31118/37963 [74:40:55<14:14:15,  7.49s/it]
 82%|████████▏ | 31119/37963 [74:41:03<14:18:50,  7.53s/it]
 82%|████████▏ | 31120/37963 [74:41:17<17:47:07,  9.36s/it]
                                                           
{'loss': '0.09292', 'grad_norm': '2.386', 'learning_rate': '1.657e-06', 'epoch': '0.8197'}

 82%|████████▏ | 31120/37963 [74:41:17<17:47:07,  9.36s/it]
 82%|████████▏ | 31121/37963 [74:41:30<20:20:43, 10.70s/it]
 82%|████████▏ | 31122/37963 [74:41:38<18:31:22,  9.75s/it]
 82%|████████▏ | 31123/37963 [74:41:45<17:14:17,  9.07s/it]
 82%|████████▏ | 31124/37963 [74:41:59<19:49:55, 10.44s/it]
 82%|████████▏ | 31125/37963 [74:42:07<18:12:12,  9.58s/it]
 82%|████████▏ | 31126/37963 [74:42:14<16:55:09,  8.91s/it]
 82%|████████▏ | 31127/37963 [74:42:21<16:05:00,  8.47s/it]
 82%|████████▏ | 31128/37963 [74:42:29<15:31:16,  8.18s/it]
 82%|████████▏ | 31129/37963 [74:42:36<15:08:44,  7.98s/it]
 82%|████████▏ | 31130/37963 [74:42:50<18:30:29,  9.75s/it]
                                                           
{'loss': '0.09442', 'grad_norm': '2.841', 'learning_rate': '1.652e-06', 'epoch': '0.82'}

 82%|████████▏ | 31130/37963 [74:42:50<18:30:29,  9.75s/it]
 82%|████████▏ | 31131/37963 [74:43:04<20:45:56, 10.94s/it]
 82%|████████▏ | 31132/37963 [74:43:12<18:49:06,  9.92s/it]
 82%|████████▏ | 31133/37963 [74:43:19<17:26:26,  9.19s/it]
 82%|████████▏ | 31134/37963 [74:43:26<16:14:51,  8.57s/it]
 82%|████████▏ | 31135/37963 [74:43:34<15:39:06,  8.25s/it]
 82%|████████▏ | 31136/37963 [74:43:41<15:16:09,  8.05s/it]
 82%|████████▏ | 31137/37963 [74:43:49<15:00:14,  7.91s/it]
 82%|████████▏ | 31138/37963 [74:43:56<14:42:07,  7.76s/it]
 82%|████████▏ | 31139/37963 [74:44:04<14:35:03,  7.69s/it]
 82%|████████▏ | 31140/37963 [74:44:11<14:33:13,  7.68s/it]
                                                           
{'loss': '0.08836', 'grad_norm': '1.894', 'learning_rate': '1.647e-06', 'epoch': '0.8203'}

 82%|████████▏ | 31140/37963 [74:44:11<14:33:13,  7.68s/it]
 82%|████████▏ | 31141/37963 [74:44:25<18:09:20,  9.58s/it]
 82%|████████▏ | 31142/37963 [74:44:39<20:38:10, 10.89s/it]
 82%|████████▏ | 31143/37963 [74:44:47<18:46:30,  9.91s/it]
 82%|████████▏ | 31144/37963 [74:44:54<17:13:55,  9.10s/it]
 82%|████████▏ | 31145/37963 [74:45:02<16:19:31,  8.62s/it]
 82%|████████▏ | 31146/37963 [74:45:09<15:45:02,  8.32s/it]
 82%|████████▏ | 31147/37963 [74:45:17<15:17:21,  8.08s/it]
 82%|████████▏ | 31148/37963 [74:45:24<15:01:46,  7.94s/it]
 82%|████████▏ | 31149/37963 [74:45:32<14:52:39,  7.86s/it]
 82%|████████▏ | 31150/37963 [74:45:40<14:44:43,  7.79s/it]
                                                           
{'loss': '0.0985', 'grad_norm': '2.151', 'learning_rate': '1.643e-06', 'epoch': '0.8205'}

 82%|████████▏ | 31150/37963 [74:45:40<14:44:43,  7.79s/it]
 82%|████████▏ | 31151/37963 [74:45:47<14:35:34,  7.71s/it]
 82%|████████▏ | 31152/37963 [74:45:55<14:38:33,  7.74s/it]
 82%|████████▏ | 31153/37963 [74:46:03<14:28:12,  7.65s/it]
 82%|████████▏ | 31154/37963 [74:46:10<14:18:22,  7.56s/it]
 82%|████████▏ | 31155/37963 [74:46:17<14:16:23,  7.55s/it]
 82%|████████▏ | 31156/37963 [74:46:25<14:14:38,  7.53s/it]
 82%|████████▏ | 31157/37963 [74:46:32<14:08:22,  7.48s/it]
 82%|████████▏ | 31158/37963 [74:46:40<14:06:05,  7.46s/it]
 82%|████████▏ | 31159/37963 [74:46:47<14:08:01,  7.48s/it]
 82%|████████▏ | 31160/37963 [74:46:55<14:12:47,  7.52s/it]
                                                           
{'loss': '0.09844', 'grad_norm': '2.39', 'learning_rate': '1.638e-06', 'epoch': '0.8208'}

 82%|████████▏ | 31160/37963 [74:46:55<14:12:47,  7.52s/it]
 82%|████████▏ | 31161/37963 [74:47:02<14:08:31,  7.48s/it]
 82%|████████▏ | 31162/37963 [74:47:10<14:08:30,  7.49s/it]
 82%|████████▏ | 31163/37963 [74:47:17<14:09:55,  7.50s/it]
 82%|████████▏ | 31164/37963 [74:47:31<17:45:27,  9.40s/it]
 82%|████████▏ | 31165/37963 [74:47:39<16:41:25,  8.84s/it]
 82%|████████▏ | 31166/37963 [74:47:52<19:31:52, 10.34s/it]
 82%|████████▏ | 31167/37963 [74:48:00<17:57:29,  9.51s/it]
 82%|████████▏ | 31168/37963 [74:48:08<16:55:18,  8.97s/it]
 82%|████████▏ | 31169/37963 [74:48:15<16:05:20,  8.53s/it]
 82%|████████▏ | 31170/37963 [74:48:23<15:33:16,  8.24s/it]
                                                           
{'loss': '0.09439', 'grad_norm': '2.467', 'learning_rate': '1.633e-06', 'epoch': '0.8211'}

 82%|████████▏ | 31170/37963 [74:48:23<15:33:16,  8.24s/it]
 82%|████████▏ | 31171/37963 [74:48:30<15:10:16,  8.04s/it]
 82%|████████▏ | 31172/37963 [74:48:44<18:33:20,  9.84s/it]
 82%|████████▏ | 31173/37963 [74:48:52<17:15:56,  9.15s/it]
 82%|████████▏ | 31174/37963 [74:48:59<16:18:47,  8.65s/it]
 82%|████████▏ | 31175/37963 [74:49:26<26:36:43, 14.11s/it]
 82%|████████▏ | 31176/37963 [74:49:34<23:00:02, 12.20s/it]
 82%|████████▏ | 31177/37963 [74:49:41<20:14:49, 10.74s/it]
 82%|████████▏ | 31178/37963 [74:49:49<18:26:00,  9.78s/it]
 82%|████████▏ | 31179/37963 [74:49:56<17:04:02,  9.06s/it]
 82%|████████▏ | 31180/37963 [74:50:04<16:18:10,  8.65s/it]
                                                           
{'loss': '0.0944', 'grad_norm': '2.334', 'learning_rate': '1.629e-06', 'epoch': '0.8213'}

 82%|████████▏ | 31180/37963 [74:50:04<16:18:10,  8.65s/it]
 82%|████████▏ | 31181/37963 [74:50:11<15:31:26,  8.24s/it]
 82%|████████▏ | 31182/37963 [74:50:19<15:08:22,  8.04s/it]
 82%|████████▏ | 31183/37963 [74:50:26<14:47:44,  7.86s/it]
 82%|████████▏ | 31184/37963 [74:50:34<14:35:22,  7.75s/it]
 82%|████████▏ | 31185/37963 [74:50:41<14:27:53,  7.68s/it]
 82%|████████▏ | 31186/37963 [74:50:49<14:23:38,  7.65s/it]
 82%|████████▏ | 31187/37963 [74:51:03<18:08:10,  9.64s/it]
 82%|████████▏ | 31188/37963 [74:51:17<20:37:39, 10.96s/it]
 82%|████████▏ | 31189/37963 [74:51:25<18:39:54,  9.92s/it]
 82%|████████▏ | 31190/37963 [74:51:32<17:19:50,  9.21s/it]
                                                           
{'loss': '0.09891', 'grad_norm': '3.167', 'learning_rate': '1.624e-06', 'epoch': '0.8216'}

 82%|████████▏ | 31190/37963 [74:51:32<17:19:50,  9.21s/it]
 82%|████████▏ | 31191/37963 [74:51:40<16:24:11,  8.72s/it]
 82%|████████▏ | 31192/37963 [74:51:47<15:44:47,  8.37s/it]
 82%|████████▏ | 31193/37963 [74:51:55<15:16:43,  8.12s/it]
 82%|████████▏ | 31194/37963 [74:52:02<14:56:54,  7.95s/it]
 82%|████████▏ | 31195/37963 [74:52:10<14:45:10,  7.85s/it]
 82%|████████▏ | 31196/37963 [74:52:17<14:29:34,  7.71s/it]
 82%|████████▏ | 31197/37963 [74:52:25<14:19:25,  7.62s/it]
 82%|████████▏ | 31198/37963 [74:52:32<14:17:45,  7.61s/it]
 82%|████████▏ | 31199/37963 [74:52:40<14:06:59,  7.51s/it]
 82%|████████▏ | 31200/37963 [74:52:47<14:07:39,  7.52s/it]
                                                           
{'loss': '0.09546', 'grad_norm': '2.136', 'learning_rate': '1.619e-06', 'epoch': '0.8219'}

 82%|████████▏ | 31200/37963 [74:52:47<14:07:39,  7.52s/it]
 82%|████████▏ | 31201/37963 [74:52:55<14:01:00,  7.46s/it]
 82%|████████▏ | 31202/37963 [74:53:02<14:02:47,  7.48s/it]
 82%|████████▏ | 31203/37963 [74:53:10<14:02:58,  7.48s/it]
 82%|████████▏ | 31204/37963 [74:53:17<14:02:35,  7.48s/it]
 82%|████████▏ | 31205/37963 [74:53:25<14:03:20,  7.49s/it]
 82%|████████▏ | 31206/37963 [74:53:32<14:06:19,  7.52s/it]
 82%|████████▏ | 31207/37963 [74:53:40<14:05:20,  7.51s/it]
 82%|████████▏ | 31208/37963 [74:53:54<17:42:31,  9.44s/it]
 82%|████████▏ | 31209/37963 [74:54:01<16:38:02,  8.87s/it]
 82%|████████▏ | 31210/37963 [74:54:08<15:39:46,  8.35s/it]
                                                           
{'loss': '0.101', 'grad_norm': '2.16', 'learning_rate': '1.615e-06', 'epoch': '0.8221'}

 82%|████████▏ | 31210/37963 [74:54:08<15:39:46,  8.35s/it]
 82%|████████▏ | 31211/37963 [74:54:16<15:15:35,  8.14s/it]
 82%|████████▏ | 31212/37963 [74:54:23<14:49:55,  7.91s/it]
 82%|████████▏ | 31213/37963 [74:54:31<14:36:19,  7.79s/it]
 82%|████████▏ | 31214/37963 [74:54:38<14:23:55,  7.68s/it]
 82%|████████▏ | 31215/37963 [74:54:46<14:17:30,  7.62s/it]
 82%|████████▏ | 31216/37963 [74:55:00<17:56:37,  9.57s/it]
 82%|████████▏ | 31217/37963 [74:55:07<16:46:40,  8.95s/it]
 82%|████████▏ | 31218/37963 [74:55:15<15:58:39,  8.53s/it]
 82%|████████▏ | 31219/37963 [74:55:22<15:23:09,  8.21s/it]
 82%|████████▏ | 31220/37963 [74:55:30<14:58:15,  7.99s/it]
                                                           
{'loss': '0.09323', 'grad_norm': '2.196', 'learning_rate': '1.61e-06', 'epoch': '0.8224'}

 82%|████████▏ | 31220/37963 [74:55:30<14:58:15,  7.99s/it]
 82%|████████▏ | 31221/37963 [74:55:50<21:49:47, 11.66s/it]
 82%|████████▏ | 31222/37963 [74:55:58<19:32:28, 10.44s/it]
 82%|████████▏ | 31223/37963 [74:56:05<17:53:32,  9.56s/it]
 82%|████████▏ | 31224/37963 [74:56:19<20:15:55, 10.83s/it]
 82%|████████▏ | 31225/37963 [74:56:33<22:02:36, 11.78s/it]
 82%|████████▏ | 31226/37963 [74:56:40<19:38:41, 10.50s/it]
 82%|████████▏ | 31227/37963 [74:56:48<17:55:49,  9.58s/it]
 82%|████████▏ | 31228/37963 [74:56:55<16:47:52,  8.98s/it]
 82%|████████▏ | 31229/37963 [74:57:03<15:56:45,  8.52s/it]
 82%|████████▏ | 31230/37963 [74:57:11<15:25:03,  8.24s/it]
                                                           
{'loss': '0.11', 'grad_norm': '2.604', 'learning_rate': '1.605e-06', 'epoch': '0.8226'}

 82%|████████▏ | 31230/37963 [74:57:11<15:25:03,  8.24s/it]
 82%|████████▏ | 31231/37963 [74:57:18<15:00:22,  8.02s/it]
 82%|████████▏ | 31232/37963 [74:57:25<14:38:44,  7.83s/it]
 82%|████████▏ | 31233/37963 [74:57:33<14:21:25,  7.68s/it]
 82%|████████▏ | 31234/37963 [74:57:40<14:07:11,  7.55s/it]
 82%|████████▏ | 31235/37963 [74:57:48<14:08:11,  7.56s/it]
 82%|████████▏ | 31236/37963 [74:58:01<17:37:17,  9.43s/it]
 82%|████████▏ | 31237/37963 [74:58:15<19:54:42, 10.66s/it]
 82%|████████▏ | 31238/37963 [74:58:22<17:59:51,  9.63s/it]
 82%|████████▏ | 31239/37963 [74:58:30<16:51:12,  9.02s/it]
 82%|████████▏ | 31240/37963 [74:58:37<15:59:34,  8.56s/it]
                                                           
{'loss': '0.1019', 'grad_norm': '2.88', 'learning_rate': '1.601e-06', 'epoch': '0.8229'}

 82%|████████▏ | 31240/37963 [74:58:37<15:59:34,  8.56s/it]
 82%|████████▏ | 31241/37963 [74:58:45<15:23:42,  8.24s/it]
 82%|████████▏ | 31242/37963 [74:58:52<15:01:46,  8.05s/it]
 82%|████████▏ | 31243/37963 [74:59:00<14:43:16,  7.89s/it]
 82%|████████▏ | 31244/37963 [74:59:07<14:33:14,  7.80s/it]
 82%|████████▏ | 31245/37963 [74:59:15<14:22:44,  7.71s/it]
 82%|████████▏ | 31246/37963 [74:59:22<14:15:18,  7.64s/it]
 82%|████████▏ | 31247/37963 [74:59:30<14:11:45,  7.61s/it]
 82%|████████▏ | 31248/37963 [74:59:37<14:06:54,  7.57s/it]
 82%|████████▏ | 31249/37963 [74:59:45<14:05:09,  7.55s/it]
 82%|████████▏ | 31250/37963 [74:59:52<14:03:26,  7.54s/it]
                                                           
{'loss': '0.09335', 'grad_norm': '2.125', 'learning_rate': '1.596e-06', 'epoch': '0.8232'}

 82%|████████▏ | 31250/37963 [74:59:52<14:03:26,  7.54s/it]
 82%|████████▏ | 31251/37963 [75:00:00<14:01:42,  7.52s/it]
 82%|████████▏ | 31252/37963 [75:00:14<17:30:45,  9.39s/it]
 82%|████████▏ | 31253/37963 [75:00:21<16:30:56,  8.86s/it]
 82%|████████▏ | 31254/37963 [75:00:29<15:45:06,  8.45s/it]
 82%|████████▏ | 31255/37963 [75:00:36<15:13:15,  8.17s/it]
 82%|████████▏ | 31256/37963 [75:00:44<14:52:03,  7.98s/it]
 82%|████████▏ | 31257/37963 [75:00:51<14:38:33,  7.86s/it]
 82%|████████▏ | 31258/37963 [75:00:59<14:28:56,  7.78s/it]
 82%|████████▏ | 31259/37963 [75:01:07<14:20:23,  7.70s/it]
 82%|████████▏ | 31260/37963 [75:01:14<14:13:53,  7.64s/it]
                                                           
{'loss': '0.1001', 'grad_norm': '2.689', 'learning_rate': '1.591e-06', 'epoch': '0.8234'}

 82%|████████▏ | 31260/37963 [75:01:14<14:13:53,  7.64s/it]
 82%|████████▏ | 31261/37963 [75:01:28<17:44:15,  9.53s/it]
 82%|████████▏ | 31262/37963 [75:01:35<16:22:51,  8.80s/it]
 82%|████████▏ | 31263/37963 [75:01:43<15:45:28,  8.47s/it]
 82%|████████▏ | 31264/37963 [75:01:50<15:12:12,  8.17s/it]
 82%|████████▏ | 31265/37963 [75:01:58<14:50:54,  7.98s/it]
 82%|████████▏ | 31266/37963 [75:02:05<14:35:05,  7.84s/it]
 82%|████████▏ | 31267/37963 [75:02:13<14:26:15,  7.76s/it]
 82%|████████▏ | 31268/37963 [75:02:20<14:07:49,  7.60s/it]
 82%|████████▏ | 31269/37963 [75:02:34<17:44:31,  9.54s/it]
 82%|████████▏ | 31270/37963 [75:02:42<16:40:41,  8.97s/it]
                                                           
{'loss': '0.08985', 'grad_norm': '2.23', 'learning_rate': '1.587e-06', 'epoch': '0.8237'}

 82%|████████▏ | 31270/37963 [75:02:42<16:40:41,  8.97s/it]
 82%|████████▏ | 31271/37963 [75:02:56<19:20:25, 10.40s/it]
 82%|████████▏ | 31272/37963 [75:03:03<17:42:14,  9.53s/it]
 82%|████████▏ | 31273/37963 [75:03:17<20:11:12, 10.86s/it]
 82%|████████▏ | 31274/37963 [75:03:25<18:28:10,  9.94s/it]
 82%|████████▏ | 31275/37963 [75:03:39<20:43:55, 11.16s/it]
 82%|████████▏ | 31276/37963 [75:03:46<18:41:22, 10.06s/it]
 82%|████████▏ | 31277/37963 [75:03:54<17:14:55,  9.29s/it]
 82%|████████▏ | 31278/37963 [75:04:01<16:19:48,  8.79s/it]
 82%|████████▏ | 31279/37963 [75:04:09<15:36:53,  8.41s/it]
 82%|████████▏ | 31280/37963 [75:04:16<15:07:38,  8.15s/it]
                                                           
{'loss': '0.1102', 'grad_norm': '3.79', 'learning_rate': '1.582e-06', 'epoch': '0.824'}

 82%|████████▏ | 31280/37963 [75:04:16<15:07:38,  8.15s/it]
 82%|████████▏ | 31281/37963 [75:04:24<14:45:41,  7.95s/it]
 82%|████████▏ | 31282/37963 [75:04:31<14:30:28,  7.82s/it]
 82%|████████▏ | 31283/37963 [75:04:39<14:18:40,  7.71s/it]
 82%|████████▏ | 31284/37963 [75:04:53<17:52:20,  9.63s/it]
 82%|████████▏ | 31285/37963 [75:05:01<16:43:54,  9.02s/it]
 82%|████████▏ | 31286/37963 [75:05:15<19:32:53, 10.54s/it]
 82%|████████▏ | 31287/37963 [75:05:22<17:54:14,  9.65s/it]
 82%|████████▏ | 31288/37963 [75:05:30<16:44:25,  9.03s/it]
 82%|████████▏ | 31289/37963 [75:05:38<15:59:31,  8.63s/it]
 82%|████████▏ | 31290/37963 [75:05:45<15:29:12,  8.35s/it]
                                                           
{'loss': '0.08063', 'grad_norm': '2.325', 'learning_rate': '1.578e-06', 'epoch': '0.8242'}

 82%|████████▏ | 31290/37963 [75:05:45<15:29:12,  8.35s/it]
 82%|████████▏ | 31291/37963 [75:05:53<15:01:23,  8.11s/it]
 82%|████████▏ | 31292/37963 [75:06:00<14:42:54,  7.94s/it]
 82%|████████▏ | 31293/37963 [75:06:08<14:30:18,  7.83s/it]
 82%|████████▏ | 31294/37963 [75:06:16<14:21:20,  7.75s/it]
 82%|████████▏ | 31295/37963 [75:06:23<14:16:38,  7.71s/it]
 82%|████████▏ | 31296/37963 [75:06:31<14:11:48,  7.67s/it]
 82%|████████▏ | 31297/37963 [75:06:38<14:07:04,  7.62s/it]
 82%|████████▏ | 31298/37963 [75:06:46<14:02:38,  7.59s/it]
 82%|████████▏ | 31299/37963 [75:06:53<14:05:08,  7.61s/it]
 82%|████████▏ | 31300/37963 [75:07:07<17:36:24,  9.51s/it]
                                                           
{'loss': '0.08979', 'grad_norm': '2.276', 'learning_rate': '1.573e-06', 'epoch': '0.8245'}

 82%|████████▏ | 31300/37963 [75:07:07<17:36:24,  9.51s/it]
 82%|████████▏ | 31301/37963 [75:07:15<16:30:31,  8.92s/it]
 82%|████████▏ | 31302/37963 [75:07:22<15:43:00,  8.49s/it]
 82%|████████▏ | 31303/37963 [75:07:30<15:06:50,  8.17s/it]
 82%|████████▏ | 31304/37963 [75:07:37<14:49:58,  8.02s/it]
 82%|████████▏ | 31305/37963 [75:07:45<14:26:15,  7.81s/it]
 82%|████████▏ | 31306/37963 [75:07:52<14:14:08,  7.70s/it]
 82%|████████▏ | 31307/37963 [75:08:00<14:08:54,  7.65s/it]
 82%|████████▏ | 31308/37963 [75:08:07<14:03:04,  7.60s/it]
 82%|████████▏ | 31309/37963 [75:08:15<13:59:14,  7.57s/it]
 82%|████████▏ | 31310/37963 [75:08:29<17:31:44,  9.49s/it]
                                                           
{'loss': '0.09065', 'grad_norm': '2.053', 'learning_rate': '1.568e-06', 'epoch': '0.8248'}

 82%|████████▏ | 31310/37963 [75:08:29<17:31:44,  9.49s/it]
 82%|████████▏ | 31311/37963 [75:08:36<16:29:33,  8.93s/it]
 82%|████████▏ | 31312/37963 [75:08:44<15:44:03,  8.52s/it]
 82%|████████▏ | 31313/37963 [75:08:52<15:15:18,  8.26s/it]
 82%|████████▏ | 31314/37963 [75:08:59<14:50:07,  8.03s/it]
 82%|████████▏ | 31315/37963 [75:09:06<14:27:33,  7.83s/it]
 82%|████████▏ | 31316/37963 [75:09:14<14:17:57,  7.74s/it]
 82%|████████▏ | 31317/37963 [75:09:22<14:12:49,  7.70s/it]
 82%|████████▏ | 31318/37963 [75:09:35<17:39:08,  9.56s/it]
 82%|████████▏ | 31319/37963 [75:09:50<20:09:56, 10.93s/it]
 83%|████████▎ | 31320/37963 [75:09:57<18:13:34,  9.88s/it]
                                                           
{'loss': '0.1051', 'grad_norm': '2.178', 'learning_rate': '1.564e-06', 'epoch': '0.825'}

 83%|████████▎ | 31320/37963 [75:09:57<18:13:34,  9.88s/it]
 83%|████████▎ | 31321/37963 [75:10:11<20:32:39, 11.14s/it]
 83%|████████▎ | 31322/37963 [75:10:19<18:34:14, 10.07s/it]
 83%|████████▎ | 31323/37963 [75:10:26<17:08:20,  9.29s/it]
 83%|████████▎ | 31324/37963 [75:10:34<16:06:19,  8.73s/it]
 83%|████████▎ | 31325/37963 [75:10:41<15:24:39,  8.36s/it]
 83%|████████▎ | 31326/37963 [75:10:55<18:31:22, 10.05s/it]
 83%|████████▎ | 31327/37963 [75:11:02<17:05:57,  9.28s/it]
 83%|████████▎ | 31328/37963 [75:11:17<19:47:02, 10.73s/it]
 83%|████████▎ | 31329/37963 [75:11:24<18:04:13,  9.81s/it]
 83%|████████▎ | 31330/37963 [75:11:32<16:47:06,  9.11s/it]
                                                           
{'loss': '0.1024', 'grad_norm': '2.728', 'learning_rate': '1.559e-06', 'epoch': '0.8253'}

 83%|████████▎ | 31330/37963 [75:11:32<16:47:06,  9.11s/it]
 83%|████████▎ | 31331/37963 [75:11:39<15:53:13,  8.62s/it]
 83%|████████▎ | 31332/37963 [75:11:47<15:15:18,  8.28s/it]
 83%|████████▎ | 31333/37963 [75:11:54<14:53:47,  8.09s/it]
 83%|████████▎ | 31334/37963 [75:12:02<14:35:00,  7.92s/it]
 83%|████████▎ | 31335/37963 [75:12:09<14:21:21,  7.80s/it]
 83%|████████▎ | 31336/37963 [75:12:17<14:10:26,  7.70s/it]
 83%|████████▎ | 31337/37963 [75:12:30<17:21:56,  9.44s/it]
 83%|████████▎ | 31338/37963 [75:12:38<16:19:14,  8.87s/it]
 83%|████████▎ | 31339/37963 [75:12:45<15:35:13,  8.47s/it]
 83%|████████▎ | 31340/37963 [75:12:53<15:01:07,  8.16s/it]
                                                           
{'loss': '0.09521', 'grad_norm': '2.817', 'learning_rate': '1.555e-06', 'epoch': '0.8255'}

 83%|████████▎ | 31340/37963 [75:12:53<15:01:07,  8.16s/it]
 83%|████████▎ | 31341/37963 [75:13:00<14:41:19,  7.99s/it]
 83%|████████▎ | 31342/37963 [75:13:08<14:26:18,  7.85s/it]
 83%|████████▎ | 31343/37963 [75:13:15<14:14:12,  7.74s/it]
 83%|████████▎ | 31344/37963 [75:13:23<14:06:09,  7.67s/it]
 83%|████████▎ | 31345/37963 [75:13:30<14:00:52,  7.62s/it]
 83%|████████▎ | 31346/37963 [75:13:38<13:57:15,  7.59s/it]
 83%|████████▎ | 31347/37963 [75:13:46<13:56:10,  7.58s/it]
 83%|████████▎ | 31348/37963 [75:13:53<13:55:06,  7.57s/it]
 83%|████████▎ | 31349/37963 [75:14:01<13:53:02,  7.56s/it]
 83%|████████▎ | 31350/37963 [75:14:08<13:52:08,  7.55s/it]
                                                           
{'loss': '0.09253', 'grad_norm': '1.874', 'learning_rate': '1.55e-06', 'epoch': '0.8258'}

 83%|████████▎ | 31350/37963 [75:14:08<13:52:08,  7.55s/it]
 83%|████████▎ | 31351/37963 [75:14:16<13:51:00,  7.54s/it]
 83%|████████▎ | 31352/37963 [75:14:23<13:53:11,  7.56s/it]
 83%|████████▎ | 31353/37963 [75:14:31<13:53:09,  7.56s/it]
 83%|████████▎ | 31354/37963 [75:14:45<17:30:54,  9.54s/it]
 83%|████████▎ | 31355/37963 [75:14:53<16:24:42,  8.94s/it]
 83%|████████▎ | 31356/37963 [75:15:07<19:15:16, 10.49s/it]
 83%|████████▎ | 31357/37963 [75:15:14<17:37:15,  9.60s/it]
 83%|████████▎ | 31358/37963 [75:15:22<16:30:29,  9.00s/it]
 83%|████████▎ | 31359/37963 [75:15:29<15:38:29,  8.53s/it]
 83%|████████▎ | 31360/37963 [75:15:37<15:05:05,  8.22s/it]
                                                           
{'loss': '0.09666', 'grad_norm': '2.457', 'learning_rate': '1.546e-06', 'epoch': '0.8261'}

 83%|████████▎ | 31360/37963 [75:15:37<15:05:05,  8.22s/it]
 83%|████████▎ | 31361/37963 [75:15:44<14:47:38,  8.07s/it]
 83%|████████▎ | 31362/37963 [75:15:52<14:30:21,  7.91s/it]
 83%|████████▎ | 31363/37963 [75:16:00<14:19:05,  7.81s/it]
 83%|████████▎ | 31364/37963 [75:16:07<14:07:47,  7.71s/it]
 83%|████████▎ | 31365/37963 [75:16:21<17:33:21,  9.58s/it]
 83%|████████▎ | 31366/37963 [75:16:35<20:04:16, 10.95s/it]
 83%|████████▎ | 31367/37963 [75:16:43<18:06:26,  9.88s/it]
 83%|████████▎ | 31368/37963 [75:16:50<16:49:21,  9.18s/it]
 83%|████████▎ | 31369/37963 [75:17:04<19:18:58, 10.55s/it]
 83%|████████▎ | 31370/37963 [75:17:18<21:15:11, 11.60s/it]
                                                           
{'loss': '0.09276', 'grad_norm': '1.94', 'learning_rate': '1.541e-06', 'epoch': '0.8263'}

 83%|████████▎ | 31370/37963 [75:17:18<21:15:11, 11.60s/it]
 83%|████████▎ | 31371/37963 [75:17:25<19:01:45, 10.39s/it]
 83%|████████▎ | 31372/37963 [75:17:33<17:26:25,  9.53s/it]
 83%|████████▎ | 31373/37963 [75:17:41<16:23:52,  8.96s/it]
 83%|████████▎ | 31374/37963 [75:17:48<15:27:16,  8.44s/it]
 83%|████████▎ | 31375/37963 [75:17:55<14:56:25,  8.16s/it]
 83%|████████▎ | 31376/37963 [75:18:09<18:13:14,  9.96s/it]
 83%|████████▎ | 31377/37963 [75:18:17<16:56:01,  9.26s/it]
 83%|████████▎ | 31378/37963 [75:18:25<16:05:05,  8.79s/it]
 83%|████████▎ | 31379/37963 [75:18:32<15:23:30,  8.42s/it]
 83%|████████▎ | 31380/37963 [75:18:40<14:58:14,  8.19s/it]
                                                           
{'loss': '0.08962', 'grad_norm': '2.851', 'learning_rate': '1.537e-06', 'epoch': '0.8266'}

 83%|████████▎ | 31380/37963 [75:18:40<14:58:14,  8.19s/it]
 83%|████████▎ | 31381/37963 [75:18:47<14:31:42,  7.95s/it]
 83%|████████▎ | 31382/37963 [75:19:01<17:44:43,  9.71s/it]
 83%|████████▎ | 31383/37963 [75:19:08<16:24:06,  8.97s/it]
 83%|████████▎ | 31384/37963 [75:19:16<15:37:40,  8.55s/it]
 83%|████████▎ | 31385/37963 [75:19:24<15:03:54,  8.24s/it]
 83%|████████▎ | 31386/37963 [75:19:31<14:45:40,  8.08s/it]
 83%|████████▎ | 31387/37963 [75:19:39<14:26:13,  7.90s/it]
 83%|████████▎ | 31388/37963 [75:19:46<14:14:08,  7.79s/it]
 83%|████████▎ | 31389/37963 [75:19:54<14:06:01,  7.72s/it]
 83%|████████▎ | 31390/37963 [75:20:01<13:52:46,  7.60s/it]
                                                           
{'loss': '0.08627', 'grad_norm': '2.196', 'learning_rate': '1.532e-06', 'epoch': '0.8269'}

 83%|████████▎ | 31390/37963 [75:20:01<13:52:46,  7.60s/it]
 83%|████████▎ | 31391/37963 [75:20:09<13:47:16,  7.55s/it]
 83%|████████▎ | 31392/37963 [75:20:16<13:47:28,  7.56s/it]
 83%|████████▎ | 31393/37963 [75:20:24<13:47:08,  7.55s/it]
 83%|████████▎ | 31394/37963 [75:20:31<13:50:42,  7.59s/it]
 83%|████████▎ | 31395/37963 [75:20:39<13:47:17,  7.56s/it]
 83%|████████▎ | 31396/37963 [75:20:46<13:41:06,  7.50s/it]
 83%|████████▎ | 31397/37963 [75:20:54<13:41:59,  7.51s/it]
 83%|████████▎ | 31398/37963 [75:21:01<13:42:22,  7.52s/it]
 83%|████████▎ | 31399/37963 [75:21:15<17:18:35,  9.49s/it]
 83%|████████▎ | 31400/37963 [75:21:23<16:18:38,  8.95s/it]
                                                           
{'loss': '0.1034', 'grad_norm': '2.707', 'learning_rate': '1.527e-06', 'epoch': '0.8271'}

 83%|████████▎ | 31400/37963 [75:21:23<16:18:38,  8.95s/it]
 83%|████████▎ | 31401/37963 [75:21:37<19:02:47, 10.45s/it]
 83%|████████▎ | 31402/37963 [75:21:45<17:30:09,  9.60s/it]
 83%|████████▎ | 31403/37963 [75:21:52<16:22:52,  8.99s/it]
 83%|████████▎ | 31404/37963 [75:22:00<15:34:59,  8.55s/it]
 83%|████████▎ | 31405/37963 [75:22:07<15:01:01,  8.24s/it]
 83%|████████▎ | 31406/37963 [75:22:15<14:42:23,  8.07s/it]
 83%|████████▎ | 31407/37963 [75:22:23<14:25:29,  7.92s/it]
 83%|████████▎ | 31408/37963 [75:22:30<14:11:54,  7.80s/it]
 83%|████████▎ | 31409/37963 [75:22:44<17:33:45,  9.65s/it]
 83%|████████▎ | 31410/37963 [75:22:52<16:25:38,  9.02s/it]
                                                           
{'loss': '0.09459', 'grad_norm': '2.332', 'learning_rate': '1.523e-06', 'epoch': '0.8274'}

 83%|████████▎ | 31410/37963 [75:22:52<16:25:38,  9.02s/it]
 83%|████████▎ | 31411/37963 [75:22:59<15:37:26,  8.58s/it]
 83%|████████▎ | 31412/37963 [75:23:07<15:00:47,  8.25s/it]
 83%|████████▎ | 31413/37963 [75:23:14<14:33:02,  8.00s/it]
 83%|████████▎ | 31414/37963 [75:23:21<14:16:40,  7.85s/it]
 83%|████████▎ | 31415/37963 [75:23:29<14:06:13,  7.75s/it]
 83%|████████▎ | 31416/37963 [75:23:43<17:31:55,  9.64s/it]
 83%|████████▎ | 31417/37963 [75:23:57<19:50:01, 10.91s/it]
 83%|████████▎ | 31418/37963 [75:24:11<21:33:12, 11.86s/it]
 83%|████████▎ | 31419/37963 [75:24:19<19:10:52, 10.55s/it]
 83%|████████▎ | 31420/37963 [75:24:26<17:30:27,  9.63s/it]
                                                           
{'loss': '0.09244', 'grad_norm': '1.83', 'learning_rate': '1.518e-06', 'epoch': '0.8277'}

 83%|████████▎ | 31420/37963 [75:24:26<17:30:27,  9.63s/it]
 83%|████████▎ | 31421/37963 [75:24:34<16:25:37,  9.04s/it]
 83%|████████▎ | 31422/37963 [75:24:48<19:04:25, 10.50s/it]
 83%|████████▎ | 31423/37963 [75:24:55<17:20:44,  9.55s/it]
 83%|████████▎ | 31424/37963 [75:25:02<16:08:15,  8.88s/it]
 83%|████████▎ | 31425/37963 [75:25:10<15:22:56,  8.47s/it]
 83%|████████▎ | 31426/37963 [75:25:17<14:51:40,  8.18s/it]
 83%|████████▎ | 31427/37963 [75:25:25<14:22:39,  7.92s/it]
 83%|████████▎ | 31428/37963 [75:25:32<14:00:42,  7.72s/it]
 83%|████████▎ | 31429/37963 [75:25:39<13:56:02,  7.68s/it]
 83%|████████▎ | 31430/37963 [75:25:53<17:18:13,  9.54s/it]
                                                           
{'loss': '0.09589', 'grad_norm': '2.564', 'learning_rate': '1.514e-06', 'epoch': '0.8279'}

 83%|████████▎ | 31430/37963 [75:25:53<17:18:13,  9.54s/it]
 83%|████████▎ | 31431/37963 [75:26:01<16:14:33,  8.95s/it]
 83%|████████▎ | 31432/37963 [75:26:08<15:27:02,  8.52s/it]
 83%|████████▎ | 31433/37963 [75:26:16<14:53:41,  8.21s/it]
 83%|████████▎ | 31434/37963 [75:26:23<14:30:54,  8.00s/it]
 83%|████████▎ | 31435/37963 [75:26:31<14:14:01,  7.85s/it]
 83%|████████▎ | 31436/37963 [75:26:38<13:55:17,  7.68s/it]
 83%|████████▎ | 31437/37963 [75:26:46<13:49:04,  7.62s/it]
 83%|████████▎ | 31438/37963 [75:26:53<13:44:55,  7.59s/it]
 83%|████████▎ | 31439/37963 [75:27:01<13:42:30,  7.56s/it]
 83%|████████▎ | 31440/37963 [75:27:08<13:44:55,  7.59s/it]
                                                           
{'loss': '0.09247', 'grad_norm': '2.174', 'learning_rate': '1.509e-06', 'epoch': '0.8282'}

 83%|████████▎ | 31440/37963 [75:27:08<13:44:55,  7.59s/it]
 83%|████████▎ | 31441/37963 [75:27:16<13:43:52,  7.58s/it]
 83%|████████▎ | 31442/37963 [75:27:24<13:47:07,  7.61s/it]
 83%|████████▎ | 31443/37963 [75:27:31<13:46:20,  7.60s/it]
 83%|████████▎ | 31444/37963 [75:27:39<13:45:39,  7.60s/it]
 83%|████████▎ | 31445/37963 [75:27:46<13:35:28,  7.51s/it]
 83%|████████▎ | 31446/37963 [75:27:54<13:38:01,  7.53s/it]
 83%|████████▎ | 31447/37963 [75:28:01<13:33:56,  7.49s/it]
 83%|████████▎ | 31448/37963 [75:28:08<13:30:57,  7.47s/it]
 83%|████████▎ | 31449/37963 [75:28:16<13:30:54,  7.47s/it]
 83%|████████▎ | 31450/37963 [75:28:23<13:33:03,  7.49s/it]
                                                           
{'loss': '0.1055', 'grad_norm': '2.841', 'learning_rate': '1.505e-06', 'epoch': '0.8284'}

 83%|████████▎ | 31450/37963 [75:28:23<13:33:03,  7.49s/it]
 83%|████████▎ | 31451/37963 [75:28:43<20:14:33, 11.19s/it]
 83%|████████▎ | 31452/37963 [75:28:51<18:13:38, 10.08s/it]
 83%|████████▎ | 31453/37963 [75:28:58<16:53:02,  9.34s/it]
 83%|████████▎ | 31454/37963 [75:29:05<15:42:39,  8.69s/it]
 83%|████████▎ | 31455/37963 [75:29:13<15:01:16,  8.31s/it]
 83%|████████▎ | 31456/37963 [75:29:20<14:34:59,  8.07s/it]
 83%|████████▎ | 31457/37963 [75:29:28<14:18:13,  7.91s/it]
 83%|████████▎ | 31458/37963 [75:29:42<17:46:42,  9.84s/it]
 83%|████████▎ | 31459/37963 [75:29:50<16:31:19,  9.15s/it]
 83%|████████▎ | 31460/37963 [75:29:57<15:37:24,  8.65s/it]
                                                           
{'loss': '0.09474', 'grad_norm': '2.416', 'learning_rate': '1.5e-06', 'epoch': '0.8287'}

 83%|████████▎ | 31460/37963 [75:29:57<15:37:24,  8.65s/it]
 83%|████████▎ | 31461/37963 [75:30:05<15:01:15,  8.32s/it]
 83%|████████▎ | 31462/37963 [75:30:13<14:39:20,  8.12s/it]
 83%|████████▎ | 31463/37963 [75:30:20<14:18:58,  7.93s/it]
 83%|████████▎ | 31464/37963 [75:30:27<14:04:32,  7.80s/it]
 83%|████████▎ | 31465/37963 [75:30:42<17:27:55,  9.68s/it]
 83%|████████▎ | 31466/37963 [75:30:55<19:44:15, 10.94s/it]
 83%|████████▎ | 31467/37963 [75:31:10<21:37:10, 11.98s/it]
 83%|████████▎ | 31468/37963 [75:31:24<22:48:32, 12.64s/it]
 83%|████████▎ | 31469/37963 [75:31:32<20:01:21, 11.10s/it]
 83%|████████▎ | 31470/37963 [75:31:39<18:04:19, 10.02s/it]
                                                           
{'loss': '0.09343', 'grad_norm': '2.896', 'learning_rate': '1.496e-06', 'epoch': '0.829'}

 83%|████████▎ | 31470/37963 [75:31:39<18:04:19, 10.02s/it]
 83%|████████▎ | 31471/37963 [75:31:46<16:37:32,  9.22s/it]
 83%|████████▎ | 31472/37963 [75:31:54<15:43:31,  8.72s/it]
 83%|████████▎ | 31473/37963 [75:32:02<15:06:22,  8.38s/it]
 83%|████████▎ | 31474/37963 [75:32:09<14:37:34,  8.11s/it]
 83%|████████▎ | 31475/37963 [75:32:16<14:10:18,  7.86s/it]
 83%|████████▎ | 31476/37963 [75:32:24<13:57:45,  7.75s/it]
 83%|████████▎ | 31477/37963 [75:32:31<13:49:44,  7.68s/it]
 83%|████████▎ | 31478/37963 [75:32:38<13:34:18,  7.53s/it]
 83%|████████▎ | 31479/37963 [75:32:53<17:04:25,  9.48s/it]
 83%|████████▎ | 31480/37963 [75:33:00<16:02:10,  8.90s/it]
                                                           
{'loss': '0.09462', 'grad_norm': '2.704', 'learning_rate': '1.491e-06', 'epoch': '0.8292'}

 83%|████████▎ | 31480/37963 [75:33:00<16:02:10,  8.90s/it]
 83%|████████▎ | 31481/37963 [75:33:08<15:17:19,  8.49s/it]
 83%|████████▎ | 31482/37963 [75:33:15<14:45:14,  8.20s/it]
 83%|████████▎ | 31483/37963 [75:33:23<14:23:29,  8.00s/it]
 83%|████████▎ | 31484/37963 [75:33:30<14:06:23,  7.84s/it]
 83%|████████▎ | 31485/37963 [75:33:37<13:42:14,  7.62s/it]
 83%|████████▎ | 31486/37963 [75:33:45<13:37:19,  7.57s/it]
 83%|████████▎ | 31487/37963 [75:33:52<13:36:31,  7.57s/it]
 83%|████████▎ | 31488/37963 [75:34:00<13:36:14,  7.56s/it]
 83%|████████▎ | 31489/37963 [75:34:07<13:38:33,  7.59s/it]
 83%|████████▎ | 31490/37963 [75:34:15<13:29:49,  7.51s/it]
                                                           
{'loss': '0.0879', 'grad_norm': '3.594', 'learning_rate': '1.487e-06', 'epoch': '0.8295'}

 83%|████████▎ | 31490/37963 [75:34:15<13:29:49,  7.51s/it]
 83%|████████▎ | 31491/37963 [75:34:22<13:35:06,  7.56s/it]
 83%|████████▎ | 31492/37963 [75:34:30<13:28:42,  7.50s/it]
 83%|████████▎ | 31493/37963 [75:34:37<13:32:06,  7.53s/it]
 83%|████████▎ | 31494/37963 [75:34:45<13:26:33,  7.48s/it]
 83%|████████▎ | 31495/37963 [75:34:52<13:26:43,  7.48s/it]
 83%|████████▎ | 31496/37963 [75:35:00<13:28:30,  7.50s/it]
 83%|████████▎ | 31497/37963 [75:35:07<13:30:53,  7.52s/it]
 83%|████████▎ | 31498/37963 [75:35:15<13:23:40,  7.46s/it]
 83%|████████▎ | 31499/37963 [75:35:22<13:25:48,  7.48s/it]
 83%|████████▎ | 31500/37963 [75:35:30<13:28:11,  7.50s/it]
                                                           
{'loss': '0.0898', 'grad_norm': '2.16', 'learning_rate': '1.482e-06', 'epoch': '0.8298'}

 83%|████████▎ | 31500/37963 [75:35:30<13:28:11,  7.50s/it]
 83%|████████▎ | 31501/37963 [75:35:44<16:51:49,  9.39s/it]
 83%|████████▎ | 31502/37963 [75:35:51<15:49:14,  8.82s/it]
 83%|████████▎ | 31503/37963 [75:35:59<15:07:41,  8.43s/it]
 83%|████████▎ | 31504/37963 [75:36:06<14:37:51,  8.15s/it]
 83%|████████▎ | 31505/37963 [75:36:20<17:45:07,  9.90s/it]
 83%|████████▎ | 31506/37963 [75:36:34<19:54:31, 11.10s/it]
 83%|████████▎ | 31507/37963 [75:36:41<18:00:01, 10.04s/it]
 83%|████████▎ | 31508/37963 [75:36:49<16:38:24,  9.28s/it]
 83%|████████▎ | 31509/37963 [75:36:56<15:39:47,  8.74s/it]
 83%|████████▎ | 31510/37963 [75:37:04<14:50:11,  8.28s/it]
                                                           
{'loss': '0.09546', 'grad_norm': '1.958', 'learning_rate': '1.478e-06', 'epoch': '0.83'}

 83%|████████▎ | 31510/37963 [75:37:04<14:50:11,  8.28s/it]
 83%|████████▎ | 31511/37963 [75:37:11<14:26:13,  8.06s/it]
 83%|████████▎ | 31512/37963 [75:37:19<14:12:32,  7.93s/it]
 83%|████████▎ | 31513/37963 [75:37:39<20:54:02, 11.67s/it]
 83%|████████▎ | 31514/37963 [75:38:00<25:40:09, 14.33s/it]
 83%|████████▎ | 31515/37963 [75:38:07<21:58:15, 12.27s/it]
 83%|████████▎ | 31516/37963 [75:38:15<19:18:21, 10.78s/it]
 83%|████████▎ | 31517/37963 [75:38:22<17:32:41,  9.80s/it]
 83%|████████▎ | 31518/37963 [75:38:30<16:18:07,  9.11s/it]
 83%|████████▎ | 31519/37963 [75:38:37<15:28:11,  8.64s/it]
 83%|████████▎ | 31520/37963 [75:38:44<14:45:49,  8.25s/it]
                                                           
{'loss': '0.09059', 'grad_norm': '3.193', 'learning_rate': '1.474e-06', 'epoch': '0.8303'}

 83%|████████▎ | 31520/37963 [75:38:44<14:45:49,  8.25s/it]
 83%|████████▎ | 31521/37963 [75:38:52<14:23:13,  8.04s/it]
 83%|████████▎ | 31522/37963 [75:39:00<14:09:08,  7.91s/it]
 83%|████████▎ | 31523/37963 [75:39:07<13:55:08,  7.78s/it]
 83%|████████▎ | 31524/37963 [75:39:15<13:46:14,  7.70s/it]
 83%|████████▎ | 31525/37963 [75:39:22<13:41:03,  7.65s/it]
 83%|████████▎ | 31526/37963 [75:39:30<13:38:16,  7.63s/it]
 83%|████████▎ | 31527/37963 [75:39:38<13:47:21,  7.71s/it]
 83%|████████▎ | 31528/37963 [75:39:51<17:02:04,  9.53s/it]
 83%|████████▎ | 31529/37963 [75:39:59<15:56:19,  8.92s/it]
 83%|████████▎ | 31530/37963 [75:40:06<15:13:16,  8.52s/it]
                                                           
{'loss': '0.09903', 'grad_norm': '2.95', 'learning_rate': '1.469e-06', 'epoch': '0.8305'}

 83%|████████▎ | 31530/37963 [75:40:06<15:13:16,  8.52s/it]
 83%|████████▎ | 31531/37963 [75:40:14<14:35:05,  8.16s/it]
 83%|████████▎ | 31532/37963 [75:40:21<14:16:37,  7.99s/it]
 83%|████████▎ | 31533/37963 [75:40:29<13:55:20,  7.79s/it]
 83%|████████▎ | 31534/37963 [75:40:36<13:49:04,  7.74s/it]
 83%|████████▎ | 31535/37963 [75:40:44<13:44:01,  7.69s/it]
 83%|████████▎ | 31536/37963 [75:40:52<13:41:11,  7.67s/it]
 83%|████████▎ | 31537/37963 [75:40:59<13:36:50,  7.63s/it]
 83%|████████▎ | 31538/37963 [75:41:07<13:34:23,  7.61s/it]
 83%|████████▎ | 31539/37963 [75:41:14<13:25:14,  7.52s/it]
 83%|████████▎ | 31540/37963 [75:41:21<13:26:03,  7.53s/it]
                                                           
{'loss': '0.1009', 'grad_norm': '2.88', 'learning_rate': '1.465e-06', 'epoch': '0.8308'}

 83%|████████▎ | 31540/37963 [75:41:21<13:26:03,  7.53s/it]
 83%|████████▎ | 31541/37963 [75:41:29<13:27:00,  7.54s/it]
 83%|████████▎ | 31542/37963 [75:41:37<13:25:48,  7.53s/it]
 83%|████████▎ | 31543/37963 [75:41:44<13:30:08,  7.57s/it]
 83%|████████▎ | 31544/37963 [75:41:52<13:24:49,  7.52s/it]
 83%|████████▎ | 31545/37963 [75:41:59<13:24:57,  7.53s/it]
 83%|████████▎ | 31546/37963 [75:42:07<13:25:03,  7.53s/it]
 83%|████████▎ | 31547/37963 [75:42:14<13:19:12,  7.47s/it]
 83%|████████▎ | 31548/37963 [75:42:28<16:51:15,  9.46s/it]
 83%|████████▎ | 31549/37963 [75:42:36<15:49:49,  8.89s/it]
 83%|████████▎ | 31550/37963 [75:42:50<18:37:31, 10.46s/it]
                                                           
{'loss': '0.1025', 'grad_norm': '2.814', 'learning_rate': '1.46e-06', 'epoch': '0.8311'}

 83%|████████▎ | 31550/37963 [75:42:50<18:37:31, 10.46s/it]
 83%|████████▎ | 31551/37963 [75:42:57<17:03:33,  9.58s/it]
 83%|████████▎ | 31552/37963 [75:43:05<15:55:01,  8.94s/it]
 83%|████████▎ | 31553/37963 [75:43:12<15:11:03,  8.53s/it]
 83%|████████▎ | 31554/37963 [75:43:20<14:40:30,  8.24s/it]
 83%|████████▎ | 31555/37963 [75:43:27<14:14:31,  8.00s/it]
 83%|████████▎ | 31556/37963 [75:43:41<17:27:28,  9.81s/it]
 83%|████████▎ | 31557/37963 [75:43:49<16:08:47,  9.07s/it]
 83%|████████▎ | 31558/37963 [75:43:56<15:20:00,  8.62s/it]
 83%|████████▎ | 31559/37963 [75:44:10<18:14:23, 10.25s/it]
 83%|████████▎ | 31560/37963 [75:44:24<20:13:49, 11.37s/it]
                                                           
{'loss': '0.08357', 'grad_norm': '2.656', 'learning_rate': '1.456e-06', 'epoch': '0.8313'}

 83%|████████▎ | 31560/37963 [75:44:24<20:13:49, 11.37s/it]
 83%|████████▎ | 31561/37963 [75:44:32<18:08:35, 10.20s/it]
 83%|████████▎ | 31562/37963 [75:44:46<20:21:56, 11.45s/it]
 83%|████████▎ | 31563/37963 [75:44:54<18:23:26, 10.34s/it]
 83%|████████▎ | 31564/37963 [75:45:08<20:12:59, 11.37s/it]
 83%|████████▎ | 31565/37963 [75:45:15<18:05:59, 10.18s/it]
 83%|████████▎ | 31566/37963 [75:45:23<16:45:06,  9.43s/it]
 83%|████████▎ | 31567/37963 [75:45:30<15:35:22,  8.77s/it]
 83%|████████▎ | 31568/37963 [75:45:38<14:54:01,  8.39s/it]
 83%|████████▎ | 31569/37963 [75:45:45<14:20:04,  8.07s/it]
 83%|████████▎ | 31570/37963 [75:45:52<13:53:45,  7.82s/it]
                                                           
{'loss': '0.08574', 'grad_norm': '2.285', 'learning_rate': '1.451e-06', 'epoch': '0.8316'}

 83%|████████▎ | 31570/37963 [75:45:52<13:53:45,  7.82s/it]
 83%|████████▎ | 31571/37963 [75:46:06<17:16:24,  9.73s/it]
 83%|████████▎ | 31572/37963 [75:46:14<16:05:21,  9.06s/it]
 83%|████████▎ | 31573/37963 [75:46:21<15:17:20,  8.61s/it]
 83%|████████▎ | 31574/37963 [75:46:29<14:42:03,  8.28s/it]
 83%|████████▎ | 31575/37963 [75:46:36<14:17:42,  8.06s/it]
 83%|████████▎ | 31576/37963 [75:46:44<14:01:04,  7.90s/it]
 83%|████████▎ | 31577/37963 [75:46:51<13:48:18,  7.78s/it]
 83%|████████▎ | 31578/37963 [75:46:59<13:38:27,  7.69s/it]
 83%|████████▎ | 31579/37963 [75:47:06<13:32:46,  7.64s/it]
 83%|████████▎ | 31580/37963 [75:47:14<13:30:17,  7.62s/it]
                                                           
{'loss': '0.08635', 'grad_norm': '2.672', 'learning_rate': '1.447e-06', 'epoch': '0.8319'}

 83%|████████▎ | 31580/37963 [75:47:14<13:30:17,  7.62s/it]
 83%|████████▎ | 31581/37963 [75:47:22<13:29:14,  7.61s/it]
 83%|████████▎ | 31582/37963 [75:47:29<13:18:42,  7.51s/it]
 83%|████████▎ | 31583/37963 [75:47:36<13:17:56,  7.50s/it]
 83%|████████▎ | 31584/37963 [75:47:44<13:10:57,  7.44s/it]
 83%|████████▎ | 31585/37963 [75:47:51<13:07:48,  7.41s/it]
 83%|████████▎ | 31586/37963 [75:47:59<13:12:38,  7.46s/it]
 83%|████████▎ | 31587/37963 [75:48:06<13:14:59,  7.48s/it]
 83%|████████▎ | 31588/37963 [75:48:13<13:07:25,  7.41s/it]
 83%|████████▎ | 31589/37963 [75:48:21<13:00:50,  7.35s/it]
 83%|████████▎ | 31590/37963 [75:48:28<13:07:54,  7.42s/it]
                                                           
{'loss': '0.0873', 'grad_norm': '2.575', 'learning_rate': '1.442e-06', 'epoch': '0.8321'}

 83%|████████▎ | 31590/37963 [75:48:28<13:07:54,  7.42s/it]
 83%|████████▎ | 31591/37963 [75:48:36<13:09:56,  7.44s/it]
 83%|████████▎ | 31592/37963 [75:48:49<16:34:41,  9.37s/it]
 83%|████████▎ | 31593/37963 [75:48:57<15:34:13,  8.80s/it]
 83%|████████▎ | 31594/37963 [75:49:04<14:50:51,  8.39s/it]
 83%|████████▎ | 31595/37963 [75:49:12<14:24:12,  8.14s/it]
 83%|████████▎ | 31596/37963 [75:49:19<14:01:18,  7.93s/it]
 83%|████████▎ | 31597/37963 [75:49:27<13:53:03,  7.85s/it]
 83%|████████▎ | 31598/37963 [75:49:35<13:41:43,  7.75s/it]
 83%|████████▎ | 31599/37963 [75:49:42<13:27:23,  7.61s/it]
 83%|████████▎ | 31600/37963 [75:49:49<13:22:49,  7.57s/it]
                                                           
{'loss': '0.1089', 'grad_norm': '2.208', 'learning_rate': '1.438e-06', 'epoch': '0.8324'}

 83%|████████▎ | 31600/37963 [75:49:49<13:22:49,  7.57s/it]
 83%|████████▎ | 31601/37963 [75:50:03<16:50:28,  9.53s/it]
 83%|████████▎ | 31602/37963 [75:50:11<15:42:37,  8.89s/it]
 83%|████████▎ | 31603/37963 [75:50:18<14:59:10,  8.48s/it]
 83%|████████▎ | 31604/37963 [75:50:26<14:28:11,  8.19s/it]
 83%|████████▎ | 31605/37963 [75:50:40<17:29:12,  9.90s/it]
 83%|████████▎ | 31606/37963 [75:50:54<19:37:46, 11.12s/it]
 83%|████████▎ | 31607/37963 [75:51:01<17:38:09,  9.99s/it]
 83%|████████▎ | 31608/37963 [75:51:15<19:41:18, 11.15s/it]
 83%|████████▎ | 31609/37963 [75:51:22<17:35:58,  9.97s/it]
 83%|████████▎ | 31610/37963 [75:51:30<16:17:46,  9.23s/it]
                                                           
{'loss': '0.09494', 'grad_norm': '3.383', 'learning_rate': '1.434e-06', 'epoch': '0.8327'}

 83%|████████▎ | 31610/37963 [75:51:30<16:17:46,  9.23s/it]
 83%|████████▎ | 31611/37963 [75:51:44<18:48:41, 10.66s/it]
 83%|████████▎ | 31612/37963 [75:51:51<17:13:55,  9.77s/it]
 83%|████████▎ | 31613/37963 [75:52:05<19:30:56, 11.06s/it]
 83%|████████▎ | 31614/37963 [75:52:13<17:40:03, 10.02s/it]
 83%|████████▎ | 31615/37963 [75:52:20<16:09:54,  9.17s/it]
 83%|████████▎ | 31616/37963 [75:52:28<15:17:11,  8.67s/it]
 83%|████████▎ | 31617/37963 [75:52:35<14:35:26,  8.28s/it]
 83%|████████▎ | 31618/37963 [75:52:42<14:04:38,  7.99s/it]
 83%|████████▎ | 31619/37963 [75:52:50<13:50:00,  7.85s/it]
 83%|████████▎ | 31620/37963 [75:52:57<13:37:06,  7.73s/it]
                                                           
{'loss': '0.09124', 'grad_norm': '2.888', 'learning_rate': '1.429e-06', 'epoch': '0.8329'}

 83%|████████▎ | 31620/37963 [75:52:57<13:37:06,  7.73s/it]
 83%|████████▎ | 31621/37963 [75:53:05<13:28:47,  7.65s/it]
 83%|████████▎ | 31622/37963 [75:53:12<13:22:10,  7.59s/it]
 83%|████████▎ | 31623/37963 [75:53:19<13:09:40,  7.47s/it]
 83%|████████▎ | 31624/37963 [75:53:34<16:41:37,  9.48s/it]
 83%|████████▎ | 31625/37963 [75:53:41<15:41:03,  8.91s/it]
 83%|████████▎ | 31626/37963 [75:53:49<14:57:15,  8.50s/it]
 83%|████████▎ | 31627/37963 [75:53:56<14:29:37,  8.24s/it]
 83%|████████▎ | 31628/37963 [75:54:04<14:08:50,  8.04s/it]
 83%|████████▎ | 31629/37963 [75:54:11<13:52:26,  7.89s/it]
 83%|████████▎ | 31630/37963 [75:54:19<13:40:05,  7.77s/it]
                                                           
{'loss': '0.09182', 'grad_norm': '2.376', 'learning_rate': '1.425e-06', 'epoch': '0.8332'}

 83%|████████▎ | 31630/37963 [75:54:19<13:40:05,  7.77s/it]
 83%|████████▎ | 31631/37963 [75:54:27<13:33:33,  7.71s/it]
 83%|████████▎ | 31632/37963 [75:54:34<13:25:20,  7.63s/it]
 83%|████████▎ | 31633/37963 [75:54:42<13:21:33,  7.60s/it]
 83%|████████▎ | 31634/37963 [75:54:49<13:18:10,  7.57s/it]
 83%|████████▎ | 31635/37963 [75:54:57<13:15:15,  7.54s/it]
 83%|████████▎ | 31636/37963 [75:55:10<16:29:24,  9.38s/it]
 83%|████████▎ | 31637/37963 [75:55:18<15:29:06,  8.81s/it]
 83%|████████▎ | 31638/37963 [75:55:25<14:40:41,  8.35s/it]
 83%|████████▎ | 31639/37963 [75:55:33<14:17:40,  8.14s/it]
 83%|████████▎ | 31640/37963 [75:55:40<14:03:52,  8.01s/it]
                                                           
{'loss': '0.08636', 'grad_norm': '3.834', 'learning_rate': '1.42e-06', 'epoch': '0.8334'}

 83%|████████▎ | 31640/37963 [75:55:40<14:03:52,  8.01s/it]
 83%|████████▎ | 31641/37963 [75:55:48<13:47:24,  7.85s/it]
 83%|████████▎ | 31642/37963 [75:55:55<13:37:23,  7.76s/it]
 83%|████████▎ | 31643/37963 [75:56:03<13:27:19,  7.66s/it]
 83%|████████▎ | 31644/37963 [75:56:10<13:24:38,  7.64s/it]
 83%|████████▎ | 31645/37963 [75:56:18<13:23:32,  7.63s/it]
 83%|████████▎ | 31646/37963 [75:56:26<13:21:34,  7.61s/it]
 83%|████████▎ | 31647/37963 [75:56:40<16:46:47,  9.56s/it]
 83%|████████▎ | 31648/37963 [75:56:47<15:42:24,  8.95s/it]
 83%|████████▎ | 31649/37963 [75:57:01<18:21:57, 10.47s/it]
 83%|████████▎ | 31650/37963 [75:57:09<16:50:40,  9.61s/it]
                                                           
{'loss': '0.0925', 'grad_norm': '2.719', 'learning_rate': '1.416e-06', 'epoch': '0.8337'}

 83%|████████▎ | 31650/37963 [75:57:09<16:50:40,  9.61s/it]
 83%|████████▎ | 31651/37963 [75:57:16<15:44:40,  8.98s/it]
 83%|████████▎ | 31652/37963 [75:57:24<14:53:47,  8.50s/it]
 83%|████████▎ | 31653/37963 [75:57:31<14:27:06,  8.25s/it]
 83%|████████▎ | 31654/37963 [75:57:45<17:28:43,  9.97s/it]
 83%|████████▎ | 31655/37963 [75:57:53<16:12:49,  9.25s/it]
 83%|████████▎ | 31656/37963 [75:58:07<18:41:01, 10.66s/it]
 83%|████████▎ | 31657/37963 [75:58:21<20:17:59, 11.59s/it]
 83%|████████▎ | 31658/37963 [75:58:28<18:15:14, 10.42s/it]
 83%|████████▎ | 31659/37963 [75:58:36<16:36:32,  9.48s/it]
 83%|████████▎ | 31660/37963 [75:58:43<15:34:04,  8.89s/it]
                                                           
{'loss': '0.09361', 'grad_norm': '3.035', 'learning_rate': '1.412e-06', 'epoch': '0.834'}

 83%|████████▎ | 31660/37963 [75:58:43<15:34:04,  8.89s/it]
 83%|████████▎ | 31661/37963 [75:58:51<14:51:11,  8.48s/it]
 83%|████████▎ | 31662/37963 [75:59:04<17:34:07, 10.04s/it]
 83%|████████▎ | 31663/37963 [75:59:12<16:23:32,  9.37s/it]
 83%|████████▎ | 31664/37963 [75:59:20<15:26:08,  8.82s/it]
 83%|████████▎ | 31665/37963 [75:59:27<14:45:10,  8.43s/it]
 83%|████████▎ | 31666/37963 [75:59:35<14:10:58,  8.11s/it]
 83%|████████▎ | 31667/37963 [75:59:42<13:49:48,  7.91s/it]
 83%|████████▎ | 31668/37963 [75:59:50<13:38:58,  7.81s/it]
 83%|████████▎ | 31669/37963 [75:59:57<13:21:10,  7.64s/it]
 83%|████████▎ | 31670/37963 [76:00:04<13:16:44,  7.60s/it]
                                                           
{'loss': '0.09212', 'grad_norm': '1.963', 'learning_rate': '1.407e-06', 'epoch': '0.8342'}

 83%|████████▎ | 31670/37963 [76:00:04<13:16:44,  7.60s/it]
 83%|████████▎ | 31671/37963 [76:00:12<13:04:41,  7.48s/it]
 83%|████████▎ | 31672/37963 [76:00:25<16:27:36,  9.42s/it]
 83%|████████▎ | 31673/37963 [76:00:33<15:29:00,  8.86s/it]
 83%|████████▎ | 31674/37963 [76:00:40<14:43:28,  8.43s/it]
 83%|████████▎ | 31675/37963 [76:00:48<14:14:30,  8.15s/it]
 83%|████████▎ | 31676/37963 [76:00:55<13:53:33,  7.95s/it]
 83%|████████▎ | 31677/37963 [76:01:03<13:43:00,  7.86s/it]
 83%|████████▎ | 31678/37963 [76:01:11<13:32:22,  7.76s/it]
 83%|████████▎ | 31679/37963 [76:01:18<13:17:45,  7.62s/it]
 83%|████████▎ | 31680/37963 [76:01:25<13:13:03,  7.57s/it]
                                                           
{'loss': '0.1011', 'grad_norm': '2.777', 'learning_rate': '1.403e-06', 'epoch': '0.8345'}

 83%|████████▎ | 31680/37963 [76:01:25<13:13:03,  7.57s/it]
 83%|████████▎ | 31681/37963 [76:01:33<13:06:29,  7.51s/it]
 83%|████████▎ | 31682/37963 [76:01:40<13:04:13,  7.49s/it]
 83%|████████▎ | 31683/37963 [76:01:48<13:04:25,  7.49s/it]
 83%|████████▎ | 31684/37963 [76:02:02<16:28:54,  9.45s/it]
 83%|████████▎ | 31685/37963 [76:02:09<15:29:08,  8.88s/it]
 83%|████████▎ | 31686/37963 [76:02:17<14:47:42,  8.49s/it]
 83%|████████▎ | 31687/37963 [76:02:24<14:16:48,  8.19s/it]
 83%|████████▎ | 31688/37963 [76:02:32<13:53:59,  7.97s/it]
 83%|████████▎ | 31689/37963 [76:02:39<13:40:56,  7.85s/it]
 83%|████████▎ | 31690/37963 [76:02:47<13:33:44,  7.78s/it]
                                                           
{'loss': '0.09514', 'grad_norm': '3.075', 'learning_rate': '1.399e-06', 'epoch': '0.8348'}

 83%|████████▎ | 31690/37963 [76:02:47<13:33:44,  7.78s/it]
 83%|████████▎ | 31691/37963 [76:02:54<13:23:25,  7.69s/it]
 83%|████████▎ | 31692/37963 [76:03:02<13:22:50,  7.68s/it]
 83%|████████▎ | 31693/37963 [76:03:16<16:39:28,  9.56s/it]
 83%|████████▎ | 31694/37963 [76:03:23<15:27:15,  8.87s/it]
 83%|████████▎ | 31695/37963 [76:03:31<14:41:53,  8.44s/it]
 83%|████████▎ | 31696/37963 [76:03:38<14:13:09,  8.17s/it]
 83%|████████▎ | 31697/37963 [76:03:46<13:48:22,  7.93s/it]
 83%|████████▎ | 31698/37963 [76:03:53<13:35:31,  7.81s/it]
 83%|████████▎ | 31699/37963 [76:04:01<13:26:19,  7.72s/it]
 84%|████████▎ | 31700/37963 [76:04:14<16:36:55,  9.55s/it]
                                                           
{'loss': '0.09455', 'grad_norm': '2.714', 'learning_rate': '1.394e-06', 'epoch': '0.835'}

 84%|████████▎ | 31700/37963 [76:04:14<16:36:55,  9.55s/it]
 84%|████████▎ | 31701/37963 [76:04:28<18:55:00, 10.88s/it]
 84%|████████▎ | 31702/37963 [76:04:36<17:13:17,  9.90s/it]
 84%|████████▎ | 31703/37963 [76:04:44<15:57:43,  9.18s/it]
 84%|████████▎ | 31704/37963 [76:04:51<15:07:22,  8.70s/it]
 84%|████████▎ | 31705/37963 [76:04:59<14:31:32,  8.36s/it]
 84%|████████▎ | 31706/37963 [76:05:13<17:26:28, 10.03s/it]
 84%|████████▎ | 31707/37963 [76:05:20<16:10:37,  9.31s/it]
 84%|████████▎ | 31708/37963 [76:05:28<15:17:04,  8.80s/it]
 84%|████████▎ | 31709/37963 [76:05:35<14:37:36,  8.42s/it]
 84%|████████▎ | 31710/37963 [76:05:49<17:24:01, 10.02s/it]
                                                           
{'loss': '0.0912', 'grad_norm': '3.603', 'learning_rate': '1.39e-06', 'epoch': '0.8353'}

 84%|████████▎ | 31710/37963 [76:05:49<17:24:01, 10.02s/it]
 84%|████████▎ | 31711/37963 [76:05:57<16:02:47,  9.24s/it]
 84%|████████▎ | 31712/37963 [76:06:04<15:07:38,  8.71s/it]
 84%|████████▎ | 31713/37963 [76:06:12<14:30:58,  8.36s/it]
 84%|████████▎ | 31714/37963 [76:06:19<14:05:28,  8.12s/it]
 84%|████████▎ | 31715/37963 [76:06:27<13:47:01,  7.94s/it]
 84%|████████▎ | 31716/37963 [76:06:41<17:04:12,  9.84s/it]
 84%|████████▎ | 31717/37963 [76:06:55<19:09:01, 11.04s/it]
 84%|████████▎ | 31718/37963 [76:07:02<17:10:42,  9.90s/it]
 84%|████████▎ | 31719/37963 [76:07:10<15:58:24,  9.21s/it]
 84%|████████▎ | 31720/37963 [76:07:17<14:59:46,  8.65s/it]
                                                           
{'loss': '0.08657', 'grad_norm': '2.612', 'learning_rate': '1.386e-06', 'epoch': '0.8356'}

 84%|████████▎ | 31720/37963 [76:07:17<14:59:46,  8.65s/it]
 84%|████████▎ | 31721/37963 [76:07:25<14:25:34,  8.32s/it]
 84%|████████▎ | 31722/37963 [76:07:32<14:02:46,  8.10s/it]
 84%|████████▎ | 31723/37963 [76:07:40<13:44:03,  7.92s/it]
 84%|████████▎ | 31724/37963 [76:07:47<13:31:34,  7.80s/it]
 84%|████████▎ | 31725/37963 [76:07:55<13:22:13,  7.72s/it]
 84%|████████▎ | 31726/37963 [76:08:02<13:21:00,  7.71s/it]
 84%|████████▎ | 31727/37963 [76:08:10<13:15:59,  7.66s/it]
 84%|████████▎ | 31728/37963 [76:08:17<13:11:00,  7.61s/it]
 84%|████████▎ | 31729/37963 [76:08:25<13:04:18,  7.55s/it]
 84%|████████▎ | 31730/37963 [76:08:32<12:59:56,  7.51s/it]
                                                           
{'loss': '0.105', 'grad_norm': '2.353', 'learning_rate': '1.381e-06', 'epoch': '0.8358'}

 84%|████████▎ | 31730/37963 [76:08:32<12:59:56,  7.51s/it]
 84%|████████▎ | 31731/37963 [76:08:40<12:59:20,  7.50s/it]
 84%|████████▎ | 31732/37963 [76:08:54<16:19:46,  9.43s/it]
 84%|████████▎ | 31733/37963 [76:09:01<15:18:49,  8.85s/it]
 84%|████████▎ | 31734/37963 [76:09:09<14:37:38,  8.45s/it]
 84%|████████▎ | 31735/37963 [76:09:16<14:10:24,  8.19s/it]
 84%|████████▎ | 31736/37963 [76:09:24<13:47:36,  7.97s/it]
 84%|████████▎ | 31737/37963 [76:09:31<13:27:09,  7.78s/it]
 84%|████████▎ | 31738/37963 [76:09:39<13:20:12,  7.71s/it]
 84%|████████▎ | 31739/37963 [76:09:52<16:28:35,  9.53s/it]
 84%|████████▎ | 31740/37963 [76:10:00<15:21:01,  8.88s/it]
                                                           
{'loss': '0.09698', 'grad_norm': '2.344', 'learning_rate': '1.377e-06', 'epoch': '0.8361'}

 84%|████████▎ | 31740/37963 [76:10:00<15:21:01,  8.88s/it]
 84%|████████▎ | 31741/37963 [76:10:07<14:30:48,  8.40s/it]
 84%|████████▎ | 31742/37963 [76:10:15<14:06:33,  8.16s/it]
 84%|████████▎ | 31743/37963 [76:10:22<13:43:42,  7.95s/it]
 84%|████████▎ | 31744/37963 [76:10:30<13:33:33,  7.85s/it]
 84%|████████▎ | 31745/37963 [76:10:37<13:15:13,  7.67s/it]
 84%|████████▎ | 31746/37963 [76:10:44<13:09:20,  7.62s/it]
 84%|████████▎ | 31747/37963 [76:10:52<13:06:26,  7.59s/it]
 84%|████████▎ | 31748/37963 [76:11:06<16:27:40,  9.54s/it]
 84%|████████▎ | 31749/37963 [76:11:14<15:24:28,  8.93s/it]
 84%|████████▎ | 31750/37963 [76:11:21<14:40:10,  8.50s/it]
                                                           
{'loss': '0.1002', 'grad_norm': '3.215', 'learning_rate': '1.373e-06', 'epoch': '0.8363'}

 84%|████████▎ | 31750/37963 [76:11:21<14:40:10,  8.50s/it]
 84%|████████▎ | 31751/37963 [76:11:29<14:10:16,  8.21s/it]
 84%|████████▎ | 31752/37963 [76:11:36<13:40:19,  7.92s/it]
 84%|████████▎ | 31753/37963 [76:11:43<13:28:36,  7.81s/it]
 84%|████████▎ | 31754/37963 [76:11:51<13:19:23,  7.72s/it]
 84%|████████▎ | 31755/37963 [76:12:05<16:39:35,  9.66s/it]
 84%|████████▎ | 31756/37963 [76:12:19<18:52:06, 10.94s/it]
 84%|████████▎ | 31757/37963 [76:12:26<17:00:03,  9.86s/it]
 84%|████████▎ | 31758/37963 [76:12:34<15:37:22,  9.06s/it]
 84%|████████▎ | 31759/37963 [76:12:41<14:50:56,  8.62s/it]
 84%|████████▎ | 31760/37963 [76:12:48<14:09:08,  8.21s/it]
                                                           
{'loss': '0.09045', 'grad_norm': '2.118', 'learning_rate': '1.368e-06', 'epoch': '0.8366'}

 84%|████████▎ | 31760/37963 [76:12:48<14:09:08,  8.21s/it]
 84%|████████▎ | 31761/37963 [76:13:02<17:05:08,  9.92s/it]
 84%|████████▎ | 31762/37963 [76:13:10<15:47:41,  9.17s/it]
 84%|████████▎ | 31763/37963 [76:13:17<14:56:50,  8.68s/it]
 84%|████████▎ | 31764/37963 [76:13:31<17:41:59, 10.28s/it]
 84%|████████▎ | 31765/37963 [76:13:46<19:45:28, 11.48s/it]
 84%|████████▎ | 31766/37963 [76:13:53<17:41:38, 10.28s/it]
 84%|████████▎ | 31767/37963 [76:14:01<16:16:30,  9.46s/it]
 84%|████████▎ | 31768/37963 [76:14:08<15:16:11,  8.87s/it]
 84%|████████▎ | 31769/37963 [76:14:16<14:37:33,  8.50s/it]
 84%|████████▎ | 31770/37963 [76:14:23<14:05:47,  8.19s/it]
                                                           
{'loss': '0.08608', 'grad_norm': '2.112', 'learning_rate': '1.364e-06', 'epoch': '0.8369'}

 84%|████████▎ | 31770/37963 [76:14:23<14:05:47,  8.19s/it]
 84%|████████▎ | 31771/37963 [76:14:31<13:42:22,  7.97s/it]
 84%|████████▎ | 31772/37963 [76:14:38<13:31:13,  7.86s/it]
 84%|████████▎ | 31773/37963 [76:14:46<13:22:08,  7.78s/it]
 84%|████████▎ | 31774/37963 [76:14:53<13:12:08,  7.68s/it]
 84%|████████▎ | 31775/37963 [76:15:07<16:23:31,  9.54s/it]
 84%|████████▎ | 31776/37963 [76:15:15<15:17:02,  8.89s/it]
 84%|████████▎ | 31777/37963 [76:15:22<14:34:33,  8.48s/it]
 84%|████████▎ | 31778/37963 [76:15:30<14:04:58,  8.20s/it]
 84%|████████▎ | 31779/37963 [76:15:37<13:37:30,  7.93s/it]
 84%|████████▎ | 31780/37963 [76:15:44<13:26:35,  7.83s/it]
                                                           
{'loss': '0.09624', 'grad_norm': '2.794', 'learning_rate': '1.36e-06', 'epoch': '0.8371'}

 84%|████████▎ | 31780/37963 [76:15:44<13:26:35,  7.83s/it]
 84%|████████▎ | 31781/37963 [76:15:52<13:10:05,  7.67s/it]
 84%|████████▎ | 31782/37963 [76:15:59<13:05:41,  7.63s/it]
 84%|████████▎ | 31783/37963 [76:16:07<13:00:07,  7.57s/it]
 84%|████████▎ | 31784/37963 [76:16:21<16:15:04,  9.47s/it]
 84%|████████▎ | 31785/37963 [76:16:28<15:16:09,  8.90s/it]
 84%|████████▎ | 31786/37963 [76:16:36<14:36:43,  8.52s/it]
 84%|████████▎ | 31787/37963 [76:16:43<14:06:25,  8.22s/it]
 84%|████████▎ | 31788/37963 [76:16:51<13:47:05,  8.04s/it]
 84%|████████▎ | 31789/37963 [76:16:58<13:30:10,  7.87s/it]
 84%|████████▎ | 31790/37963 [76:17:06<13:11:42,  7.70s/it]
                                                           
{'loss': '0.09443', 'grad_norm': '2.008', 'learning_rate': '1.355e-06', 'epoch': '0.8374'}

 84%|████████▎ | 31790/37963 [76:17:06<13:11:42,  7.70s/it]
 84%|████████▎ | 31791/37963 [76:17:20<16:23:14,  9.56s/it]
 84%|████████▎ | 31792/37963 [76:17:27<15:21:12,  8.96s/it]
 84%|████████▎ | 31793/37963 [76:17:35<14:30:08,  8.46s/it]
 84%|████████▎ | 31794/37963 [76:17:42<13:58:52,  8.16s/it]
 84%|████████▍ | 31795/37963 [76:17:50<13:39:10,  7.97s/it]
 84%|████████▍ | 31796/37963 [76:17:57<13:28:39,  7.87s/it]
 84%|████████▍ | 31797/37963 [76:18:05<13:16:53,  7.75s/it]
 84%|████████▍ | 31798/37963 [76:18:12<13:09:10,  7.68s/it]
 84%|████████▍ | 31799/37963 [76:18:20<13:04:00,  7.63s/it]
 84%|████████▍ | 31800/37963 [76:18:27<12:53:16,  7.53s/it]
                                                           
{'loss': '0.1134', 'grad_norm': '2.541', 'learning_rate': '1.351e-06', 'epoch': '0.8377'}

 84%|████████▍ | 31800/37963 [76:18:27<12:53:16,  7.53s/it]
 84%|████████▍ | 31801/37963 [76:18:34<12:43:11,  7.43s/it]
 84%|████████▍ | 31802/37963 [76:18:42<12:42:16,  7.42s/it]
 84%|████████▍ | 31803/37963 [76:18:49<12:43:51,  7.44s/it]
 84%|████████▍ | 31804/37963 [76:19:03<16:07:54,  9.43s/it]
 84%|████████▍ | 31805/37963 [76:19:10<15:00:17,  8.77s/it]
 84%|████████▍ | 31806/37963 [76:19:18<14:25:02,  8.43s/it]
 84%|████████▍ | 31807/37963 [76:19:26<13:58:22,  8.17s/it]
 84%|████████▍ | 31808/37963 [76:19:33<13:37:51,  7.97s/it]
 84%|████████▍ | 31809/37963 [76:19:53<20:00:53, 11.71s/it]
 84%|████████▍ | 31810/37963 [76:20:01<17:55:39, 10.49s/it]
                                                           
{'loss': '0.09294', 'grad_norm': '3.499', 'learning_rate': '1.347e-06', 'epoch': '0.8379'}

 84%|████████▍ | 31810/37963 [76:20:01<17:55:39, 10.49s/it]
 84%|████████▍ | 31811/37963 [76:20:15<19:25:19, 11.37s/it]
 84%|████████▍ | 31812/37963 [76:20:28<20:44:13, 12.14s/it]
 84%|████████▍ | 31813/37963 [76:20:36<18:25:16, 10.78s/it]
 84%|████████▍ | 31814/37963 [76:20:44<16:50:58,  9.86s/it]
 84%|████████▍ | 31815/37963 [76:20:51<15:34:19,  9.12s/it]
 84%|████████▍ | 31816/37963 [76:20:59<14:46:40,  8.65s/it]
 84%|████████▍ | 31817/37963 [76:21:06<14:08:47,  8.29s/it]
 84%|████████▍ | 31818/37963 [76:21:14<13:50:16,  8.11s/it]
 84%|████████▍ | 31819/37963 [76:21:21<13:31:59,  7.93s/it]
 84%|████████▍ | 31820/37963 [76:21:29<13:23:02,  7.84s/it]
                                                           
{'loss': '0.0871', 'grad_norm': '3.44', 'learning_rate': '1.343e-06', 'epoch': '0.8382'}

 84%|████████▍ | 31820/37963 [76:21:29<13:23:02,  7.84s/it]
 84%|████████▍ | 31821/37963 [76:21:37<13:19:23,  7.81s/it]
 84%|████████▍ | 31822/37963 [76:21:44<13:09:30,  7.71s/it]
 84%|████████▍ | 31823/37963 [76:21:52<13:07:00,  7.69s/it]
 84%|████████▍ | 31824/37963 [76:21:59<12:56:48,  7.59s/it]
 84%|████████▍ | 31825/37963 [76:22:07<12:56:54,  7.59s/it]
 84%|████████▍ | 31826/37963 [76:22:21<16:15:23,  9.54s/it]
 84%|████████▍ | 31827/37963 [76:22:28<15:11:31,  8.91s/it]
 84%|████████▍ | 31828/37963 [76:22:36<14:28:56,  8.50s/it]
 84%|████████▍ | 31829/37963 [76:22:44<14:02:56,  8.25s/it]
 84%|████████▍ | 31830/37963 [76:22:51<13:43:52,  8.06s/it]
                                                           
{'loss': '0.08447', 'grad_norm': '2.789', 'learning_rate': '1.338e-06', 'epoch': '0.8385'}

 84%|████████▍ | 31830/37963 [76:22:51<13:43:52,  8.06s/it]
 84%|████████▍ | 31831/37963 [76:22:59<13:24:45,  7.87s/it]
 84%|████████▍ | 31832/37963 [76:23:13<16:32:30,  9.71s/it]
 84%|████████▍ | 31833/37963 [76:23:20<15:23:29,  9.04s/it]
 84%|████████▍ | 31834/37963 [76:23:28<14:36:35,  8.58s/it]
 84%|████████▍ | 31835/37963 [76:23:35<14:04:54,  8.27s/it]
 84%|████████▍ | 31836/37963 [76:23:43<13:45:18,  8.08s/it]
 84%|████████▍ | 31837/37963 [76:23:50<13:28:10,  7.92s/it]
 84%|████████▍ | 31838/37963 [76:23:58<13:16:50,  7.81s/it]
 84%|████████▍ | 31839/37963 [76:24:05<13:10:40,  7.75s/it]
 84%|████████▍ | 31840/37963 [76:24:13<13:03:23,  7.68s/it]
                                                           
{'loss': '0.1015', 'grad_norm': '3.239', 'learning_rate': '1.334e-06', 'epoch': '0.8387'}

 84%|████████▍ | 31840/37963 [76:24:13<13:03:23,  7.68s/it]
 84%|████████▍ | 31841/37963 [76:24:20<12:57:32,  7.62s/it]
 84%|████████▍ | 31842/37963 [76:24:34<16:10:36,  9.51s/it]
 84%|████████▍ | 31843/37963 [76:24:42<15:10:25,  8.93s/it]
 84%|████████▍ | 31844/37963 [76:24:49<14:24:09,  8.47s/it]
 84%|████████▍ | 31845/37963 [76:24:57<13:54:39,  8.19s/it]
 84%|████████▍ | 31846/37963 [76:25:04<13:32:04,  7.97s/it]
 84%|████████▍ | 31847/37963 [76:25:12<13:17:36,  7.82s/it]
 84%|████████▍ | 31848/37963 [76:25:19<13:05:49,  7.71s/it]
 84%|████████▍ | 31849/37963 [76:25:27<13:01:42,  7.67s/it]
 84%|████████▍ | 31850/37963 [76:25:34<12:55:39,  7.61s/it]
                                                           
{'loss': '0.1088', 'grad_norm': '4.142', 'learning_rate': '1.33e-06', 'epoch': '0.839'}

 84%|████████▍ | 31850/37963 [76:25:34<12:55:39,  7.61s/it]
 84%|████████▍ | 31851/37963 [76:25:48<16:13:23,  9.56s/it]
 84%|████████▍ | 31852/37963 [76:25:56<15:11:07,  8.95s/it]
 84%|████████▍ | 31853/37963 [76:26:04<14:30:32,  8.55s/it]
 84%|████████▍ | 31854/37963 [76:26:11<13:50:39,  8.16s/it]
 84%|████████▍ | 31855/37963 [76:26:18<13:30:32,  7.96s/it]
 84%|████████▍ | 31856/37963 [76:26:26<13:16:39,  7.83s/it]
 84%|████████▍ | 31857/37963 [76:26:46<19:41:40, 11.61s/it]
 84%|████████▍ | 31858/37963 [76:26:54<17:38:19, 10.40s/it]
 84%|████████▍ | 31859/37963 [76:27:08<19:26:04, 11.46s/it]
 84%|████████▍ | 31860/37963 [76:27:15<17:23:50, 10.26s/it]
                                                           
{'loss': '0.09349', 'grad_norm': '2.565', 'learning_rate': '1.326e-06', 'epoch': '0.8392'}

 84%|████████▍ | 31860/37963 [76:27:15<17:23:50, 10.26s/it]
 84%|████████▍ | 31861/37963 [76:27:23<16:05:01,  9.49s/it]
 84%|████████▍ | 31862/37963 [76:27:30<15:04:25,  8.89s/it]
 84%|████████▍ | 31863/37963 [76:27:38<14:24:23,  8.50s/it]
 84%|████████▍ | 31864/37963 [76:27:45<13:51:53,  8.18s/it]
 84%|████████▍ | 31865/37963 [76:27:53<13:34:06,  8.01s/it]
 84%|████████▍ | 31866/37963 [76:28:01<13:18:51,  7.86s/it]
 84%|████████▍ | 31867/37963 [76:28:15<16:31:18,  9.76s/it]
 84%|████████▍ | 31868/37963 [76:28:22<15:24:11,  9.10s/it]
 84%|████████▍ | 31869/37963 [76:28:30<14:34:00,  8.61s/it]
 84%|████████▍ | 31870/37963 [76:28:37<14:01:18,  8.28s/it]
                                                           
{'loss': '0.0923', 'grad_norm': '3.104', 'learning_rate': '1.321e-06', 'epoch': '0.8395'}

 84%|████████▍ | 31870/37963 [76:28:37<14:01:18,  8.28s/it]
 84%|████████▍ | 31871/37963 [76:28:45<13:39:58,  8.08s/it]
 84%|████████▍ | 31872/37963 [76:28:53<13:24:24,  7.92s/it]
 84%|████████▍ | 31873/37963 [76:29:00<13:07:27,  7.76s/it]
 84%|████████▍ | 31874/37963 [76:29:14<16:14:59,  9.61s/it]
 84%|████████▍ | 31875/37963 [76:29:22<15:18:30,  9.05s/it]
 84%|████████▍ | 31876/37963 [76:29:36<17:55:21, 10.60s/it]
 84%|████████▍ | 31877/37963 [76:29:43<16:23:49,  9.70s/it]
 84%|████████▍ | 31878/37963 [76:29:51<15:17:27,  9.05s/it]
 84%|████████▍ | 31879/37963 [76:29:58<14:31:01,  8.59s/it]
 84%|████████▍ | 31880/37963 [76:30:06<13:59:55,  8.28s/it]
                                                           
{'loss': '0.09301', 'grad_norm': '2.445', 'learning_rate': '1.317e-06', 'epoch': '0.8398'}

 84%|████████▍ | 31880/37963 [76:30:06<13:59:55,  8.28s/it]
 84%|████████▍ | 31881/37963 [76:30:14<13:39:26,  8.08s/it]
 84%|████████▍ | 31882/37963 [76:30:21<13:27:54,  7.97s/it]
 84%|████████▍ | 31883/37963 [76:30:29<13:11:25,  7.81s/it]
 84%|████████▍ | 31884/37963 [76:30:36<12:58:08,  7.68s/it]
 84%|████████▍ | 31885/37963 [76:30:43<12:46:02,  7.56s/it]
 84%|████████▍ | 31886/37963 [76:30:51<12:42:50,  7.53s/it]
 84%|████████▍ | 31887/37963 [76:30:58<12:43:52,  7.54s/it]
 84%|████████▍ | 31888/37963 [76:31:12<15:59:58,  9.48s/it]
 84%|████████▍ | 31889/37963 [76:31:20<15:02:53,  8.92s/it]
 84%|████████▍ | 31890/37963 [76:31:28<14:20:49,  8.50s/it]
                                                           
{'loss': '0.1001', 'grad_norm': '3.459', 'learning_rate': '1.313e-06', 'epoch': '0.84'}

 84%|████████▍ | 31890/37963 [76:31:28<14:20:49,  8.50s/it]
 84%|████████▍ | 31891/37963 [76:31:35<13:50:13,  8.20s/it]
 84%|████████▍ | 31892/37963 [76:31:43<13:26:07,  7.97s/it]
 84%|████████▍ | 31893/37963 [76:31:50<13:10:09,  7.81s/it]
 84%|████████▍ | 31894/37963 [76:31:57<13:01:40,  7.73s/it]
 84%|████████▍ | 31895/37963 [76:32:05<12:50:58,  7.62s/it]
 84%|████████▍ | 31896/37963 [76:32:12<12:49:21,  7.61s/it]
 84%|████████▍ | 31897/37963 [76:32:20<12:51:37,  7.63s/it]
 84%|████████▍ | 31898/37963 [76:32:28<12:46:31,  7.58s/it]
 84%|████████▍ | 31899/37963 [76:32:35<12:41:59,  7.54s/it]
 84%|████████▍ | 31900/37963 [76:32:43<12:39:39,  7.52s/it]
                                                           
{'loss': '0.09097', 'grad_norm': '4.49', 'learning_rate': '1.309e-06', 'epoch': '0.8403'}

 84%|████████▍ | 31900/37963 [76:32:43<12:39:39,  7.52s/it]
 84%|████████▍ | 31901/37963 [76:32:50<12:34:18,  7.47s/it]
 84%|████████▍ | 31902/37963 [76:32:57<12:35:45,  7.48s/it]
 84%|████████▍ | 31903/37963 [76:33:05<12:41:31,  7.54s/it]
 84%|████████▍ | 31904/37963 [76:33:19<15:58:03,  9.49s/it]
 84%|████████▍ | 31905/37963 [76:33:33<18:10:24, 10.80s/it]
 84%|████████▍ | 31906/37963 [76:33:41<16:37:52,  9.88s/it]
 84%|████████▍ | 31907/37963 [76:33:48<15:21:30,  9.13s/it]
 84%|████████▍ | 31908/37963 [76:34:02<17:45:44, 10.56s/it]
 84%|████████▍ | 31909/37963 [76:34:10<16:17:17,  9.69s/it]
 84%|████████▍ | 31910/37963 [76:34:17<15:10:50,  9.03s/it]
                                                           
{'loss': '0.08534', 'grad_norm': '2.342', 'learning_rate': '1.304e-06', 'epoch': '0.8406'}

 84%|████████▍ | 31910/37963 [76:34:17<15:10:50,  9.03s/it]
 84%|████████▍ | 31911/37963 [76:34:24<14:15:39,  8.48s/it]
 84%|████████▍ | 31912/37963 [76:34:38<17:06:00, 10.17s/it]
 84%|████████▍ | 31913/37963 [76:34:46<15:41:00,  9.33s/it]
 84%|████████▍ | 31914/37963 [76:34:53<14:46:45,  8.80s/it]
 84%|████████▍ | 31915/37963 [76:35:07<17:22:51, 10.35s/it]
 84%|████████▍ | 31916/37963 [76:35:15<16:00:04,  9.53s/it]
 84%|████████▍ | 31917/37963 [76:35:23<15:05:57,  8.99s/it]
 84%|████████▍ | 31918/37963 [76:35:30<14:24:45,  8.58s/it]
 84%|████████▍ | 31919/37963 [76:35:44<17:03:25, 10.16s/it]
 84%|████████▍ | 31920/37963 [76:35:52<15:50:12,  9.43s/it]
                                                           
{'loss': '0.09927', 'grad_norm': '2.31', 'learning_rate': '1.3e-06', 'epoch': '0.8408'}

 84%|████████▍ | 31920/37963 [76:35:52<15:50:12,  9.43s/it]
 84%|████████▍ | 31921/37963 [76:35:59<14:54:37,  8.88s/it]
 84%|████████▍ | 31922/37963 [76:36:07<14:14:26,  8.49s/it]
 84%|████████▍ | 31923/37963 [76:36:15<13:44:53,  8.19s/it]
 84%|████████▍ | 31924/37963 [76:36:22<13:26:38,  8.01s/it]
 84%|████████▍ | 31925/37963 [76:36:36<16:23:41,  9.77s/it]
 84%|████████▍ | 31926/37963 [76:36:43<15:03:54,  8.98s/it]
 84%|████████▍ | 31927/37963 [76:36:51<14:23:54,  8.59s/it]
 84%|████████▍ | 31928/37963 [76:36:58<13:51:40,  8.27s/it]
 84%|████████▍ | 31929/37963 [76:37:06<13:35:09,  8.11s/it]
 84%|████████▍ | 31930/37963 [76:37:13<13:13:05,  7.89s/it]
                                                           
{'loss': '0.09479', 'grad_norm': '2.573', 'learning_rate': '1.296e-06', 'epoch': '0.8411'}

 84%|████████▍ | 31930/37963 [76:37:13<13:13:05,  7.89s/it]
 84%|████████▍ | 31931/37963 [76:37:21<13:07:48,  7.84s/it]
 84%|████████▍ | 31932/37963 [76:37:29<12:58:18,  7.74s/it]
 84%|████████▍ | 31933/37963 [76:37:36<12:53:34,  7.70s/it]
 84%|████████▍ | 31934/37963 [76:37:50<16:02:41,  9.58s/it]
 84%|████████▍ | 31935/37963 [76:37:58<15:01:47,  8.98s/it]
 84%|████████▍ | 31936/37963 [76:38:05<14:12:42,  8.49s/it]
 84%|████████▍ | 31937/37963 [76:38:13<13:43:30,  8.20s/it]
 84%|████████▍ | 31938/37963 [76:38:20<13:23:23,  8.00s/it]
 84%|████████▍ | 31939/37963 [76:38:28<13:09:55,  7.87s/it]
 84%|████████▍ | 31940/37963 [76:38:35<12:59:39,  7.77s/it]
                                                           
{'loss': '0.08151', 'grad_norm': '3.22', 'learning_rate': '1.292e-06', 'epoch': '0.8413'}

 84%|████████▍ | 31940/37963 [76:38:35<12:59:39,  7.77s/it]
 84%|████████▍ | 31941/37963 [76:38:43<12:48:27,  7.66s/it]
 84%|████████▍ | 31942/37963 [76:38:50<12:47:18,  7.65s/it]
 84%|████████▍ | 31943/37963 [76:38:58<12:45:39,  7.63s/it]
 84%|████████▍ | 31944/37963 [76:39:05<12:38:33,  7.56s/it]
 84%|████████▍ | 31945/37963 [76:39:13<12:42:50,  7.61s/it]
 84%|████████▍ | 31946/37963 [76:39:21<12:41:10,  7.59s/it]
 84%|████████▍ | 31947/37963 [76:39:28<12:35:26,  7.53s/it]
 84%|████████▍ | 31948/37963 [76:39:36<12:38:37,  7.57s/it]
 84%|████████▍ | 31949/37963 [76:39:43<12:38:13,  7.56s/it]
 84%|████████▍ | 31950/37963 [76:39:51<12:37:31,  7.56s/it]
                                                           
{'loss': '0.09876', 'grad_norm': '2.511', 'learning_rate': '1.288e-06', 'epoch': '0.8416'}

 84%|████████▍ | 31950/37963 [76:39:51<12:37:31,  7.56s/it]
 84%|████████▍ | 31951/37963 [76:39:58<12:33:18,  7.52s/it]
 84%|████████▍ | 31952/37963 [76:40:12<15:47:34,  9.46s/it]
 84%|████████▍ | 31953/37963 [76:40:20<14:53:13,  8.92s/it]
 84%|████████▍ | 31954/37963 [76:40:34<17:24:19, 10.43s/it]
 84%|████████▍ | 31955/37963 [76:40:41<16:00:19,  9.59s/it]
 84%|████████▍ | 31956/37963 [76:40:49<14:58:30,  8.97s/it]
 84%|████████▍ | 31957/37963 [76:40:56<14:13:47,  8.53s/it]
 84%|████████▍ | 31958/37963 [76:41:04<13:43:57,  8.23s/it]
 84%|████████▍ | 31959/37963 [76:41:11<13:22:21,  8.02s/it]
 84%|████████▍ | 31960/37963 [76:41:26<16:25:18,  9.85s/it]
                                                           
{'loss': '0.09452', 'grad_norm': '2.487', 'learning_rate': '1.283e-06', 'epoch': '0.8419'}

 84%|████████▍ | 31960/37963 [76:41:26<16:25:18,  9.85s/it]
 84%|████████▍ | 31961/37963 [76:41:33<15:11:51,  9.12s/it]
 84%|████████▍ | 31962/37963 [76:41:47<17:37:50, 10.58s/it]
 84%|████████▍ | 31963/37963 [76:41:55<16:07:57,  9.68s/it]
 84%|████████▍ | 31964/37963 [76:42:02<15:05:43,  9.06s/it]
 84%|████████▍ | 31965/37963 [76:42:16<17:27:49, 10.48s/it]
 84%|████████▍ | 31966/37963 [76:42:30<19:12:28, 11.53s/it]
 84%|████████▍ | 31967/37963 [76:42:38<17:16:02, 10.37s/it]
 84%|████████▍ | 31968/37963 [76:42:45<15:49:44,  9.51s/it]
 84%|████████▍ | 31969/37963 [76:42:53<14:52:56,  8.94s/it]
 84%|████████▍ | 31970/37963 [76:43:07<17:22:22, 10.44s/it]
                                                           
{'loss': '0.09899', 'grad_norm': '3.07', 'learning_rate': '1.279e-06', 'epoch': '0.8421'}

 84%|████████▍ | 31970/37963 [76:43:07<17:22:22, 10.44s/it]
 84%|████████▍ | 31971/37963 [76:43:14<15:59:18,  9.61s/it]
 84%|████████▍ | 31972/37963 [76:43:22<14:58:28,  9.00s/it]
 84%|████████▍ | 31973/37963 [76:43:29<14:14:23,  8.56s/it]
 84%|████████▍ | 31974/37963 [76:43:37<13:37:11,  8.19s/it]
 84%|████████▍ | 31975/37963 [76:43:44<13:21:25,  8.03s/it]
 84%|████████▍ | 31976/37963 [76:43:52<13:03:04,  7.85s/it]
 84%|████████▍ | 31977/37963 [76:43:59<12:53:02,  7.75s/it]
 84%|████████▍ | 31978/37963 [76:44:07<12:42:48,  7.65s/it]
 84%|████████▍ | 31979/37963 [76:44:21<15:56:01,  9.59s/it]
 84%|████████▍ | 31980/37963 [76:44:28<14:56:01,  8.99s/it]
                                                           
{'loss': '0.09422', 'grad_norm': '2.583', 'learning_rate': '1.275e-06', 'epoch': '0.8424'}

 84%|████████▍ | 31980/37963 [76:44:28<14:56:01,  8.99s/it]
 84%|████████▍ | 31981/37963 [76:44:36<14:10:24,  8.53s/it]
 84%|████████▍ | 31982/37963 [76:44:43<13:39:29,  8.22s/it]
 84%|████████▍ | 31983/37963 [76:44:51<13:23:00,  8.06s/it]
 84%|████████▍ | 31984/37963 [76:44:59<13:09:04,  7.92s/it]
 84%|████████▍ | 31985/37963 [76:45:06<12:55:32,  7.78s/it]
 84%|████████▍ | 31986/37963 [76:45:14<12:47:23,  7.70s/it]
 84%|████████▍ | 31987/37963 [76:45:21<12:44:31,  7.68s/it]
 84%|████████▍ | 31988/37963 [76:45:29<12:40:48,  7.64s/it]
 84%|████████▍ | 31989/37963 [76:45:36<12:38:05,  7.61s/it]
 84%|████████▍ | 31990/37963 [76:45:44<12:36:15,  7.60s/it]
                                                           
{'loss': '0.08603', 'grad_norm': '2.687', 'learning_rate': '1.271e-06', 'epoch': '0.8427'}

 84%|████████▍ | 31990/37963 [76:45:44<12:36:15,  7.60s/it]
 84%|████████▍ | 31991/37963 [76:45:51<12:33:30,  7.57s/it]
 84%|████████▍ | 31992/37963 [76:45:59<12:32:30,  7.56s/it]
 84%|████████▍ | 31993/37963 [76:46:07<12:31:17,  7.55s/it]
 84%|████████▍ | 31994/37963 [76:46:14<12:21:27,  7.45s/it]
 84%|████████▍ | 31995/37963 [76:46:21<12:15:27,  7.39s/it]
 84%|████████▍ | 31996/37963 [76:46:29<12:23:00,  7.47s/it]
 84%|████████▍ | 31997/37963 [76:46:36<12:28:24,  7.53s/it]
 84%|████████▍ | 31998/37963 [76:46:44<12:33:06,  7.58s/it]
 84%|████████▍ | 31999/37963 [76:46:52<12:33:26,  7.58s/it]
 84%|████████▍ | 32000/37963 [76:46:59<12:31:48,  7.56s/it]
                                                           
{'loss': '0.0982', 'grad_norm': '2.814', 'learning_rate': '1.267e-06', 'epoch': '0.8429'}

 84%|████████▍ | 32000/37963 [76:46:59<12:31:48,  7.56s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.65s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 84%|████████▍ | 32001/37963 [76:48:04<40:47:03, 24.63s/it]
 84%|████████▍ | 32002/37963 [76:48:18<35:36:20, 21.50s/it]
 84%|████████▍ | 32003/37963 [76:48:32<31:54:28, 19.27s/it]
 84%|████████▍ | 32004/37963 [76:48:39<26:00:03, 15.71s/it]
 84%|████████▍ | 32005/37963 [76:48:47<21:55:04, 13.24s/it]
 84%|████████▍ | 32006/37963 [76:48:54<18:57:00, 11.45s/it]
 84%|████████▍ | 32007/37963 [76:49:08<20:11:32, 12.20s/it]
 84%|████████▍ | 32008/37963 [76:49:15<17:48:38, 10.77s/it]
 84%|████████▍ | 32009/37963 [76:49:23<16:13:30,  9.81s/it]
 84%|████████▍ | 32010/37963 [76:49:30<15:02:28,  9.10s/it]
                                                           
{'loss': '0.09256', 'grad_norm': '2.656', 'learning_rate': '1.263e-06', 'epoch': '0.8432'}

 84%|████████▍ | 32010/37963 [76:49:30<15:02:28,  9.10s/it]
 84%|████████▍ | 32011/37963 [76:49:38<14:14:13,  8.61s/it]
 84%|████████▍ | 32012/37963 [76:49:52<17:04:55, 10.33s/it]
 84%|████████▍ | 32013/37963 [76:50:00<15:42:09,  9.50s/it]
 84%|████████▍ | 32014/37963 [76:50:07<14:42:58,  8.91s/it]
 84%|████████▍ | 32015/37963 [76:50:15<14:00:24,  8.48s/it]
 84%|████████▍ | 32016/37963 [76:50:22<13:32:05,  8.19s/it]
 84%|████████▍ | 32017/37963 [76:50:36<16:23:02,  9.92s/it]
 84%|████████▍ | 32018/37963 [76:50:44<15:16:24,  9.25s/it]
 84%|████████▍ | 32019/37963 [76:50:52<14:27:18,  8.75s/it]
 84%|████████▍ | 32020/37963 [76:50:59<13:51:24,  8.39s/it]
                                                           
{'loss': '0.08686', 'grad_norm': '3.278', 'learning_rate': '1.258e-06', 'epoch': '0.8435'}

 84%|████████▍ | 32020/37963 [76:50:59<13:51:24,  8.39s/it]
 84%|████████▍ | 32021/37963 [76:51:07<13:25:02,  8.13s/it]
 84%|████████▍ | 32022/37963 [76:51:21<16:19:34,  9.89s/it]
 84%|████████▍ | 32023/37963 [76:51:28<15:07:53,  9.17s/it]
 84%|████████▍ | 32024/37963 [76:51:36<14:18:57,  8.68s/it]
 84%|████████▍ | 32025/37963 [76:51:43<13:42:49,  8.31s/it]
 84%|████████▍ | 32026/37963 [76:51:50<13:13:59,  8.02s/it]
 84%|████████▍ | 32027/37963 [76:51:58<12:58:30,  7.87s/it]
 84%|████████▍ | 32028/37963 [76:52:06<12:49:43,  7.78s/it]
 84%|████████▍ | 32029/37963 [76:52:13<12:43:14,  7.72s/it]
 84%|████████▍ | 32030/37963 [76:52:21<12:38:10,  7.67s/it]
                                                           
{'loss': '0.09544', 'grad_norm': '3.08', 'learning_rate': '1.254e-06', 'epoch': '0.8437'}

 84%|████████▍ | 32030/37963 [76:52:21<12:38:10,  7.67s/it]
 84%|████████▍ | 32031/37963 [76:52:28<12:27:55,  7.56s/it]
 84%|████████▍ | 32032/37963 [76:52:42<15:31:18,  9.42s/it]
 84%|████████▍ | 32033/37963 [76:52:49<14:32:01,  8.82s/it]
 84%|████████▍ | 32034/37963 [76:52:57<13:58:05,  8.48s/it]
 84%|████████▍ | 32035/37963 [76:53:05<13:34:03,  8.24s/it]
 84%|████████▍ | 32036/37963 [76:53:12<13:15:42,  8.06s/it]
 84%|████████▍ | 32037/37963 [76:53:20<13:05:44,  7.96s/it]
 84%|████████▍ | 32038/37963 [76:53:27<12:54:33,  7.84s/it]
 84%|████████▍ | 32039/37963 [76:53:35<12:45:20,  7.75s/it]
 84%|████████▍ | 32040/37963 [76:53:43<12:45:17,  7.75s/it]
                                                           
{'loss': '0.08158', 'grad_norm': '2.716', 'learning_rate': '1.25e-06', 'epoch': '0.844'}

 84%|████████▍ | 32040/37963 [76:53:43<12:45:17,  7.75s/it]
 84%|████████▍ | 32041/37963 [76:53:50<12:33:48,  7.64s/it]
 84%|████████▍ | 32042/37963 [76:53:58<12:26:54,  7.57s/it]
 84%|████████▍ | 32043/37963 [76:54:05<12:26:15,  7.56s/it]
 84%|████████▍ | 32044/37963 [76:54:12<12:19:44,  7.50s/it]
 84%|████████▍ | 32045/37963 [76:54:20<12:24:21,  7.55s/it]
 84%|████████▍ | 32046/37963 [76:54:28<12:22:24,  7.53s/it]
 84%|████████▍ | 32047/37963 [76:54:35<12:22:59,  7.54s/it]
 84%|████████▍ | 32048/37963 [76:54:43<12:23:39,  7.54s/it]
 84%|████████▍ | 32049/37963 [76:54:50<12:16:52,  7.48s/it]
 84%|████████▍ | 32050/37963 [76:54:57<12:13:55,  7.45s/it]
                                                           
{'loss': '0.1026', 'grad_norm': '2.562', 'learning_rate': '1.246e-06', 'epoch': '0.8442'}

 84%|████████▍ | 32050/37963 [76:54:57<12:13:55,  7.45s/it]
 84%|████████▍ | 32051/37963 [76:55:11<15:15:07,  9.29s/it]
 84%|████████▍ | 32052/37963 [76:55:25<17:30:17, 10.66s/it]
 84%|████████▍ | 32053/37963 [76:55:33<16:04:34,  9.79s/it]
 84%|████████▍ | 32054/37963 [76:55:40<14:57:14,  9.11s/it]
 84%|████████▍ | 32055/37963 [76:55:47<14:04:17,  8.57s/it]
 84%|████████▍ | 32056/37963 [76:56:01<16:39:59, 10.16s/it]
 84%|████████▍ | 32057/37963 [76:56:09<15:22:48,  9.37s/it]
 84%|████████▍ | 32058/37963 [76:56:23<17:39:32, 10.77s/it]
 84%|████████▍ | 32059/37963 [76:56:31<16:09:51,  9.86s/it]
 84%|████████▍ | 32060/37963 [76:56:38<15:02:02,  9.17s/it]
                                                           
{'loss': '0.08959', 'grad_norm': '2.803', 'learning_rate': '1.242e-06', 'epoch': '0.8445'}

 84%|████████▍ | 32060/37963 [76:56:38<15:02:02,  9.17s/it]
 84%|████████▍ | 32061/37963 [76:56:46<14:15:10,  8.69s/it]
 84%|████████▍ | 32062/37963 [76:56:53<13:34:31,  8.28s/it]
 84%|████████▍ | 32063/37963 [76:57:00<13:09:22,  8.03s/it]
 84%|████████▍ | 32064/37963 [76:57:08<12:55:27,  7.89s/it]
 84%|████████▍ | 32065/37963 [76:57:15<12:39:44,  7.73s/it]
 84%|████████▍ | 32066/37963 [76:57:36<18:51:35, 11.51s/it]
 84%|████████▍ | 32067/37963 [76:57:50<20:06:18, 12.28s/it]
 84%|████████▍ | 32068/37963 [76:57:57<17:46:52, 10.86s/it]
 84%|████████▍ | 32069/37963 [76:58:05<16:01:25,  9.79s/it]
 84%|████████▍ | 32070/37963 [76:58:12<14:50:35,  9.07s/it]
                                                           
{'loss': '0.09495', 'grad_norm': '2.61', 'learning_rate': '1.238e-06', 'epoch': '0.8448'}

 84%|████████▍ | 32070/37963 [76:58:12<14:50:35,  9.07s/it]
 84%|████████▍ | 32071/37963 [76:58:20<14:04:20,  8.60s/it]
 84%|████████▍ | 32072/37963 [76:58:27<13:26:23,  8.21s/it]
 84%|████████▍ | 32073/37963 [76:58:34<13:05:23,  8.00s/it]
 84%|████████▍ | 32074/37963 [76:58:42<12:56:32,  7.91s/it]
 84%|████████▍ | 32075/37963 [76:58:50<12:44:49,  7.79s/it]
 84%|████████▍ | 32076/37963 [76:58:57<12:37:05,  7.72s/it]
 84%|████████▍ | 32077/37963 [76:59:05<12:28:12,  7.63s/it]
 84%|████████▍ | 32078/37963 [76:59:12<12:28:54,  7.64s/it]
 85%|████████▍ | 32079/37963 [76:59:20<12:26:08,  7.61s/it]
 85%|████████▍ | 32080/37963 [76:59:27<12:24:24,  7.59s/it]
                                                           
{'loss': '0.08377', 'grad_norm': '3.024', 'learning_rate': '1.234e-06', 'epoch': '0.845'}

 85%|████████▍ | 32080/37963 [76:59:27<12:24:24,  7.59s/it]
 85%|████████▍ | 32081/37963 [76:59:41<15:31:17,  9.50s/it]
 85%|████████▍ | 32082/37963 [76:59:49<14:31:30,  8.89s/it]
 85%|████████▍ | 32083/37963 [76:59:56<13:53:30,  8.51s/it]
 85%|████████▍ | 32084/37963 [77:00:04<13:17:28,  8.14s/it]
 85%|████████▍ | 32085/37963 [77:00:11<13:01:34,  7.98s/it]
 85%|████████▍ | 32086/37963 [77:00:19<12:49:00,  7.85s/it]
 85%|████████▍ | 32087/37963 [77:00:26<12:39:11,  7.75s/it]
 85%|████████▍ | 32088/37963 [77:00:34<12:35:04,  7.71s/it]
 85%|████████▍ | 32089/37963 [77:00:41<12:26:17,  7.62s/it]
 85%|████████▍ | 32090/37963 [77:00:49<12:24:46,  7.61s/it]
                                                           
{'loss': '0.08124', 'grad_norm': '3.204', 'learning_rate': '1.23e-06', 'epoch': '0.8453'}

 85%|████████▍ | 32090/37963 [77:00:49<12:24:46,  7.61s/it]
 85%|████████▍ | 32091/37963 [77:00:56<12:20:23,  7.57s/it]
 85%|████████▍ | 32092/37963 [77:01:04<12:18:32,  7.55s/it]
 85%|████████▍ | 32093/37963 [77:01:11<12:21:15,  7.58s/it]
 85%|████████▍ | 32094/37963 [77:01:19<12:23:50,  7.60s/it]
 85%|████████▍ | 32095/37963 [77:01:27<12:20:11,  7.57s/it]
 85%|████████▍ | 32096/37963 [77:01:41<15:27:07,  9.48s/it]
 85%|████████▍ | 32097/37963 [77:01:48<14:25:36,  8.85s/it]
 85%|████████▍ | 32098/37963 [77:01:55<13:40:08,  8.39s/it]
 85%|████████▍ | 32099/37963 [77:02:03<13:16:29,  8.15s/it]
 85%|████████▍ | 32100/37963 [77:02:17<16:11:07,  9.94s/it]
                                                           
{'loss': '0.0888', 'grad_norm': '3.191', 'learning_rate': '1.226e-06', 'epoch': '0.8456'}

 85%|████████▍ | 32100/37963 [77:02:17<16:11:07,  9.94s/it]
 85%|████████▍ | 32101/37963 [77:02:25<15:00:42,  9.22s/it]
 85%|████████▍ | 32102/37963 [77:02:32<14:07:23,  8.67s/it]
 85%|████████▍ | 32103/37963 [77:02:40<13:35:54,  8.35s/it]
 85%|████████▍ | 32104/37963 [77:02:47<13:16:16,  8.15s/it]
 85%|████████▍ | 32105/37963 [77:02:55<12:58:00,  7.97s/it]
 85%|████████▍ | 32106/37963 [77:03:09<15:58:19,  9.82s/it]
 85%|████████▍ | 32107/37963 [77:03:23<18:04:11, 11.11s/it]
 85%|████████▍ | 32108/37963 [77:03:31<16:22:34, 10.07s/it]
 85%|████████▍ | 32109/37963 [77:03:38<15:06:49,  9.29s/it]
 85%|████████▍ | 32110/37963 [77:03:46<14:14:23,  8.76s/it]
                                                           
{'loss': '0.08308', 'grad_norm': '2.659', 'learning_rate': '1.221e-06', 'epoch': '0.8458'}

 85%|████████▍ | 32110/37963 [77:03:46<14:14:23,  8.76s/it]
 85%|████████▍ | 32111/37963 [77:03:53<13:38:25,  8.39s/it]
 85%|████████▍ | 32112/37963 [77:04:01<13:13:38,  8.14s/it]
 85%|████████▍ | 32113/37963 [77:04:15<16:02:16,  9.87s/it]
 85%|████████▍ | 32114/37963 [77:04:28<17:57:25, 11.05s/it]
 85%|████████▍ | 32115/37963 [77:04:42<19:14:34, 11.85s/it]
 85%|████████▍ | 32116/37963 [77:04:50<17:10:35, 10.58s/it]
 85%|████████▍ | 32117/37963 [77:04:57<15:41:37,  9.66s/it]
 85%|████████▍ | 32118/37963 [77:05:05<14:32:24,  8.96s/it]
 85%|████████▍ | 32119/37963 [77:05:12<13:50:01,  8.52s/it]
 85%|████████▍ | 32120/37963 [77:05:20<13:20:50,  8.22s/it]
                                                           
{'loss': '0.09259', 'grad_norm': '3.259', 'learning_rate': '1.217e-06', 'epoch': '0.8461'}

 85%|████████▍ | 32120/37963 [77:05:20<13:20:50,  8.22s/it]
 85%|████████▍ | 32121/37963 [77:05:27<12:59:16,  8.00s/it]
 85%|████████▍ | 32122/37963 [77:05:35<12:42:55,  7.84s/it]
 85%|████████▍ | 32123/37963 [77:05:42<12:33:10,  7.74s/it]
 85%|████████▍ | 32124/37963 [77:05:49<12:15:14,  7.56s/it]
 85%|████████▍ | 32125/37963 [77:06:03<15:17:33,  9.43s/it]
 85%|████████▍ | 32126/37963 [77:06:10<14:17:55,  8.82s/it]
 85%|████████▍ | 32127/37963 [77:06:18<13:42:30,  8.46s/it]
 85%|████████▍ | 32128/37963 [77:06:25<13:07:27,  8.10s/it]
 85%|████████▍ | 32129/37963 [77:06:33<12:47:09,  7.89s/it]
 85%|████████▍ | 32130/37963 [77:06:40<12:38:07,  7.80s/it]
                                                           
{'loss': '0.08169', 'grad_norm': '3.197', 'learning_rate': '1.213e-06', 'epoch': '0.8464'}

 85%|████████▍ | 32130/37963 [77:06:40<12:38:07,  7.80s/it]
 85%|████████▍ | 32131/37963 [77:06:48<12:30:33,  7.72s/it]
 85%|████████▍ | 32132/37963 [77:06:55<12:25:30,  7.67s/it]
 85%|████████▍ | 32133/37963 [77:07:03<12:22:48,  7.64s/it]
 85%|████████▍ | 32134/37963 [77:07:11<12:19:52,  7.62s/it]
 85%|████████▍ | 32135/37963 [77:07:18<12:20:50,  7.63s/it]
 85%|████████▍ | 32136/37963 [77:07:26<12:17:45,  7.60s/it]
 85%|████████▍ | 32137/37963 [77:07:33<12:16:40,  7.59s/it]
 85%|████████▍ | 32138/37963 [77:07:41<12:10:32,  7.52s/it]
 85%|████████▍ | 32139/37963 [77:07:48<12:14:36,  7.57s/it]
 85%|████████▍ | 32140/37963 [77:07:56<12:14:39,  7.57s/it]
                                                           
{'loss': '0.09122', 'grad_norm': '3.293', 'learning_rate': '1.209e-06', 'epoch': '0.8466'}

 85%|████████▍ | 32140/37963 [77:07:56<12:14:39,  7.57s/it]
 85%|████████▍ | 32141/37963 [77:08:03<12:15:15,  7.58s/it]
 85%|████████▍ | 32142/37963 [77:08:11<12:19:25,  7.62s/it]
 85%|████████▍ | 32143/37963 [77:08:19<12:16:29,  7.59s/it]
 85%|████████▍ | 32144/37963 [77:08:33<15:19:52,  9.48s/it]
 85%|████████▍ | 32145/37963 [77:08:40<14:29:00,  8.96s/it]
 85%|████████▍ | 32146/37963 [77:08:48<13:49:28,  8.56s/it]
 85%|████████▍ | 32147/37963 [77:08:56<13:21:31,  8.27s/it]
 85%|████████▍ | 32148/37963 [77:09:03<13:03:21,  8.08s/it]
 85%|████████▍ | 32149/37963 [77:09:11<12:52:53,  7.98s/it]
 85%|████████▍ | 32150/37963 [77:09:25<15:46:15,  9.77s/it]
                                                           
{'loss': '0.09173', 'grad_norm': '3.09', 'learning_rate': '1.205e-06', 'epoch': '0.8469'}

 85%|████████▍ | 32150/37963 [77:09:25<15:46:15,  9.77s/it]
 85%|████████▍ | 32151/37963 [77:09:32<14:40:30,  9.09s/it]
 85%|████████▍ | 32152/37963 [77:09:40<13:58:14,  8.65s/it]
 85%|████████▍ | 32153/37963 [77:09:48<13:26:12,  8.33s/it]
 85%|████████▍ | 32154/37963 [77:10:02<16:21:36, 10.14s/it]
 85%|████████▍ | 32155/37963 [77:10:09<15:03:07,  9.33s/it]
 85%|████████▍ | 32156/37963 [77:10:23<17:17:02, 10.72s/it]
 85%|████████▍ | 32157/37963 [77:10:31<15:41:46,  9.73s/it]
 85%|████████▍ | 32158/37963 [77:10:38<14:37:48,  9.07s/it]
 85%|████████▍ | 32159/37963 [77:10:53<17:08:28, 10.63s/it]
 85%|████████▍ | 32160/37963 [77:11:00<15:39:44,  9.72s/it]
                                                           
{'loss': '0.0919', 'grad_norm': '3.548', 'learning_rate': '1.201e-06', 'epoch': '0.8471'}

 85%|████████▍ | 32160/37963 [77:11:00<15:39:44,  9.72s/it]
 85%|████████▍ | 32161/37963 [77:11:08<14:36:30,  9.06s/it]
 85%|████████▍ | 32162/37963 [77:11:22<16:58:08, 10.53s/it]
 85%|████████▍ | 32163/37963 [77:11:29<15:34:46,  9.67s/it]
 85%|████████▍ | 32164/37963 [77:11:37<14:29:30,  9.00s/it]
 85%|████████▍ | 32165/37963 [77:11:51<16:56:19, 10.52s/it]
 85%|████████▍ | 32166/37963 [77:11:58<15:27:09,  9.60s/it]
 85%|████████▍ | 32167/37963 [77:12:06<14:28:32,  8.99s/it]
 85%|████████▍ | 32168/37963 [77:12:13<13:45:46,  8.55s/it]
 85%|████████▍ | 32169/37963 [77:12:21<13:15:18,  8.24s/it]
 85%|████████▍ | 32170/37963 [77:12:28<12:55:11,  8.03s/it]
                                                           
{'loss': '0.09846', 'grad_norm': '2.931', 'learning_rate': '1.197e-06', 'epoch': '0.8474'}

 85%|████████▍ | 32170/37963 [77:12:28<12:55:11,  8.03s/it]
 85%|████████▍ | 32171/37963 [77:12:36<12:40:46,  7.88s/it]
 85%|████████▍ | 32172/37963 [77:12:43<12:30:47,  7.78s/it]
 85%|████████▍ | 32173/37963 [77:12:57<15:27:36,  9.61s/it]
 85%|████████▍ | 32174/37963 [77:13:05<14:28:18,  9.00s/it]
 85%|████████▍ | 32175/37963 [77:13:13<13:49:01,  8.59s/it]
 85%|████████▍ | 32176/37963 [77:13:20<13:17:54,  8.27s/it]
 85%|████████▍ | 32177/37963 [77:13:28<12:53:44,  8.02s/it]
 85%|████████▍ | 32178/37963 [77:13:35<12:42:45,  7.91s/it]
 85%|████████▍ | 32179/37963 [77:13:43<12:34:51,  7.83s/it]
 85%|████████▍ | 32180/37963 [77:13:50<12:26:18,  7.74s/it]
                                                           
{'loss': '0.09039', 'grad_norm': '3.154', 'learning_rate': '1.193e-06', 'epoch': '0.8477'}

 85%|████████▍ | 32180/37963 [77:13:50<12:26:18,  7.74s/it]
 85%|████████▍ | 32181/37963 [77:13:58<12:19:37,  7.68s/it]
 85%|████████▍ | 32182/37963 [77:14:05<12:12:52,  7.61s/it]
 85%|████████▍ | 32183/37963 [77:14:13<12:05:16,  7.53s/it]
 85%|████████▍ | 32184/37963 [77:14:20<12:05:02,  7.53s/it]
 85%|████████▍ | 32185/37963 [77:14:28<12:04:51,  7.53s/it]
 85%|████████▍ | 32186/37963 [77:14:35<12:02:31,  7.50s/it]
 85%|████████▍ | 32187/37963 [77:14:43<12:05:08,  7.53s/it]
 85%|████████▍ | 32188/37963 [77:14:50<12:04:44,  7.53s/it]
 85%|████████▍ | 32189/37963 [77:14:58<12:04:34,  7.53s/it]
 85%|████████▍ | 32190/37963 [77:15:05<12:05:50,  7.54s/it]
                                                           
{'loss': '0.09682', 'grad_norm': '1.809', 'learning_rate': '1.189e-06', 'epoch': '0.8479'}

 85%|████████▍ | 32190/37963 [77:15:05<12:05:50,  7.54s/it]
 85%|████████▍ | 32191/37963 [77:15:13<12:08:14,  7.57s/it]
 85%|████████▍ | 32192/37963 [77:15:27<15:14:26,  9.51s/it]
 85%|████████▍ | 32193/37963 [77:15:35<14:16:17,  8.90s/it]
 85%|████████▍ | 32194/37963 [77:15:42<13:36:47,  8.50s/it]
 85%|████████▍ | 32195/37963 [77:15:50<13:09:25,  8.21s/it]
 85%|████████▍ | 32196/37963 [77:15:57<12:46:17,  7.97s/it]
 85%|████████▍ | 32197/37963 [77:16:05<12:31:40,  7.82s/it]
 85%|████████▍ | 32198/37963 [77:16:12<12:23:05,  7.73s/it]
 85%|████████▍ | 32199/37963 [77:16:19<12:09:05,  7.59s/it]
 85%|████████▍ | 32200/37963 [77:16:33<15:12:18,  9.50s/it]
                                                           
{'loss': '0.07978', 'grad_norm': '1.819', 'learning_rate': '1.185e-06', 'epoch': '0.8482'}

 85%|████████▍ | 32200/37963 [77:16:33<15:12:18,  9.50s/it]
 85%|████████▍ | 32201/37963 [77:16:47<17:19:27, 10.82s/it]
 85%|████████▍ | 32202/37963 [77:16:54<15:36:31,  9.75s/it]
 85%|████████▍ | 32203/37963 [77:17:02<14:31:25,  9.08s/it]
 85%|████████▍ | 32204/37963 [77:17:10<13:49:46,  8.64s/it]
 85%|████████▍ | 32205/37963 [77:17:17<13:10:53,  8.24s/it]
 85%|████████▍ | 32206/37963 [77:17:24<12:41:37,  7.94s/it]
 85%|████████▍ | 32207/37963 [77:17:38<15:27:58,  9.67s/it]
 85%|████████▍ | 32208/37963 [77:17:46<14:32:32,  9.10s/it]
 85%|████████▍ | 32209/37963 [77:17:53<13:46:13,  8.62s/it]
 85%|████████▍ | 32210/37963 [77:18:01<13:16:25,  8.31s/it]
                                                           
{'loss': '0.09013', 'grad_norm': '2.156', 'learning_rate': '1.181e-06', 'epoch': '0.8485'}

 85%|████████▍ | 32210/37963 [77:18:01<13:16:25,  8.31s/it]
 85%|████████▍ | 32211/37963 [77:18:15<15:55:57,  9.97s/it]
 85%|████████▍ | 32212/37963 [77:18:22<14:49:01,  9.28s/it]
 85%|████████▍ | 32213/37963 [77:18:36<16:54:49, 10.59s/it]
 85%|████████▍ | 32214/37963 [77:18:50<18:35:42, 11.64s/it]
 85%|████████▍ | 32215/37963 [77:18:58<16:39:34, 10.43s/it]
 85%|████████▍ | 32216/37963 [77:19:05<15:15:50,  9.56s/it]
 85%|████████▍ | 32217/37963 [77:19:13<14:15:08,  8.93s/it]
 85%|████████▍ | 32218/37963 [77:19:20<13:34:45,  8.51s/it]
 85%|████████▍ | 32219/37963 [77:19:28<13:12:45,  8.28s/it]
 85%|████████▍ | 32220/37963 [77:19:35<12:51:14,  8.06s/it]
                                                           
{'loss': '0.09555', 'grad_norm': '3.262', 'learning_rate': '1.177e-06', 'epoch': '0.8487'}

 85%|████████▍ | 32220/37963 [77:19:35<12:51:14,  8.06s/it]
 85%|████████▍ | 32221/37963 [77:19:43<12:38:18,  7.92s/it]
 85%|████████▍ | 32222/37963 [77:19:57<15:36:11,  9.78s/it]
 85%|████████▍ | 32223/37963 [77:20:05<14:32:37,  9.12s/it]
 85%|████████▍ | 32224/37963 [77:20:12<13:44:40,  8.62s/it]
 85%|████████▍ | 32225/37963 [77:20:20<13:12:29,  8.29s/it]
 85%|████████▍ | 32226/37963 [77:20:27<12:39:22,  7.94s/it]
 85%|████████▍ | 32227/37963 [77:20:34<12:23:24,  7.78s/it]
 85%|████████▍ | 32228/37963 [77:20:42<12:16:05,  7.70s/it]
 85%|████████▍ | 32229/37963 [77:20:49<12:09:51,  7.64s/it]
 85%|████████▍ | 32230/37963 [77:20:57<12:06:40,  7.61s/it]
                                                           
{'loss': '0.1011', 'grad_norm': '2.691', 'learning_rate': '1.173e-06', 'epoch': '0.849'}

 85%|████████▍ | 32230/37963 [77:20:57<12:06:40,  7.61s/it]
 85%|████████▍ | 32231/37963 [77:21:04<12:04:50,  7.59s/it]
 85%|████████▍ | 32232/37963 [77:21:12<12:04:33,  7.59s/it]
 85%|████████▍ | 32233/37963 [77:21:19<12:01:57,  7.56s/it]
 85%|████████▍ | 32234/37963 [77:21:27<12:01:57,  7.56s/it]
 85%|████████▍ | 32235/37963 [77:21:34<11:56:21,  7.50s/it]
 85%|████████▍ | 32236/37963 [77:21:42<11:52:08,  7.46s/it]
 85%|████████▍ | 32237/37963 [77:21:56<14:59:22,  9.42s/it]
 85%|████████▍ | 32238/37963 [77:22:03<14:07:35,  8.88s/it]
 85%|████████▍ | 32239/37963 [77:22:11<13:32:13,  8.51s/it]
 85%|████████▍ | 32240/37963 [77:22:18<13:02:05,  8.20s/it]
                                                           
{'loss': '0.0979', 'grad_norm': '3.008', 'learning_rate': '1.169e-06', 'epoch': '0.8493'}

 85%|████████▍ | 32240/37963 [77:22:18<13:02:05,  8.20s/it]
 85%|████████▍ | 32241/37963 [77:22:26<12:40:06,  7.97s/it]
 85%|████████▍ | 32242/37963 [77:22:33<12:27:34,  7.84s/it]
 85%|████████▍ | 32243/37963 [77:22:41<12:19:07,  7.75s/it]
 85%|████████▍ | 32244/37963 [77:22:48<12:12:26,  7.68s/it]
 85%|████████▍ | 32245/37963 [77:22:56<12:09:55,  7.66s/it]
 85%|████████▍ | 32246/37963 [77:23:10<15:03:22,  9.48s/it]
 85%|████████▍ | 32247/37963 [77:23:17<14:07:24,  8.90s/it]
 85%|████████▍ | 32248/37963 [77:23:25<13:19:25,  8.39s/it]
 85%|████████▍ | 32249/37963 [77:23:38<15:51:36,  9.99s/it]
 85%|████████▍ | 32250/37963 [77:23:46<14:35:32,  9.20s/it]
                                                           
{'loss': '0.08286', 'grad_norm': '2.912', 'learning_rate': '1.165e-06', 'epoch': '0.8495'}

 85%|████████▍ | 32250/37963 [77:23:46<14:35:32,  9.20s/it]
 85%|████████▍ | 32251/37963 [77:23:53<13:46:00,  8.68s/it]
 85%|████████▍ | 32252/37963 [77:24:00<13:06:53,  8.27s/it]
 85%|████████▍ | 32253/37963 [77:24:08<12:40:14,  7.99s/it]
 85%|████████▍ | 32254/37963 [77:24:15<12:28:30,  7.87s/it]
 85%|████████▍ | 32255/37963 [77:24:29<15:23:20,  9.71s/it]
 85%|████████▍ | 32256/37963 [77:24:37<14:16:35,  9.01s/it]
 85%|████████▍ | 32257/37963 [77:24:44<13:29:10,  8.51s/it]
 85%|████████▍ | 32258/37963 [77:24:58<16:06:31, 10.17s/it]
 85%|████████▍ | 32259/37963 [77:25:05<14:49:56,  9.36s/it]
 85%|████████▍ | 32260/37963 [77:25:13<13:59:20,  8.83s/it]
                                                           
{'loss': '0.082', 'grad_norm': '4.35', 'learning_rate': '1.161e-06', 'epoch': '0.8498'}

 85%|████████▍ | 32260/37963 [77:25:13<13:59:20,  8.83s/it]
 85%|████████▍ | 32261/37963 [77:25:21<13:24:29,  8.47s/it]
 85%|████████▍ | 32262/37963 [77:25:35<16:00:35, 10.11s/it]
 85%|████████▍ | 32263/37963 [77:25:42<14:50:27,  9.37s/it]
 85%|████████▍ | 32264/37963 [77:25:50<13:57:07,  8.81s/it]
 85%|████████▍ | 32265/37963 [77:25:57<13:14:25,  8.37s/it]
 85%|████████▍ | 32266/37963 [77:26:05<12:50:38,  8.12s/it]
 85%|████████▍ | 32267/37963 [77:26:12<12:34:40,  7.95s/it]
 85%|████████▍ | 32268/37963 [77:26:20<12:20:38,  7.80s/it]
 85%|████████▌ | 32269/37963 [77:26:27<12:15:00,  7.75s/it]
 85%|████████▌ | 32270/37963 [77:26:35<12:12:40,  7.72s/it]
                                                           
{'loss': '0.09112', 'grad_norm': '2.895', 'learning_rate': '1.157e-06', 'epoch': '0.85'}

 85%|████████▌ | 32270/37963 [77:26:35<12:12:40,  7.72s/it]
 85%|████████▌ | 32271/37963 [77:26:49<15:08:10,  9.57s/it]
 85%|████████▌ | 32272/37963 [77:26:56<14:10:57,  8.97s/it]
 85%|████████▌ | 32273/37963 [77:27:04<13:20:12,  8.44s/it]
 85%|████████▌ | 32274/37963 [77:27:11<12:57:15,  8.20s/it]
 85%|████████▌ | 32275/37963 [77:27:19<12:36:45,  7.98s/it]
 85%|████████▌ | 32276/37963 [77:27:26<12:19:03,  7.80s/it]
 85%|████████▌ | 32277/37963 [77:27:34<12:11:29,  7.72s/it]
 85%|████████▌ | 32278/37963 [77:27:41<12:05:36,  7.66s/it]
 85%|████████▌ | 32279/37963 [77:27:49<12:02:10,  7.62s/it]
 85%|████████▌ | 32280/37963 [77:27:56<11:59:19,  7.59s/it]
                                                           
{'loss': '0.09141', 'grad_norm': '2.649', 'learning_rate': '1.153e-06', 'epoch': '0.8503'}

 85%|████████▌ | 32280/37963 [77:27:56<11:59:19,  7.59s/it]
 85%|████████▌ | 32281/37963 [77:28:04<11:51:08,  7.51s/it]
 85%|████████▌ | 32282/37963 [77:28:11<11:56:21,  7.57s/it]
 85%|████████▌ | 32283/37963 [77:28:19<11:53:38,  7.54s/it]
 85%|████████▌ | 32284/37963 [77:28:26<11:58:07,  7.59s/it]
 85%|████████▌ | 32285/37963 [77:28:34<11:57:04,  7.58s/it]
 85%|████████▌ | 32286/37963 [77:28:41<11:54:14,  7.55s/it]
 85%|████████▌ | 32287/37963 [77:28:55<14:56:42,  9.48s/it]
 85%|████████▌ | 32288/37963 [77:29:03<13:51:53,  8.80s/it]
 85%|████████▌ | 32289/37963 [77:29:10<13:13:12,  8.39s/it]
 85%|████████▌ | 32290/37963 [77:29:18<12:49:40,  8.14s/it]
                                                           
{'loss': '0.0875', 'grad_norm': '2.337', 'learning_rate': '1.149e-06', 'epoch': '0.8506'}

 85%|████████▌ | 32290/37963 [77:29:18<12:49:40,  8.14s/it]
 85%|████████▌ | 32291/37963 [77:29:25<12:27:35,  7.91s/it]
 85%|████████▌ | 32292/37963 [77:29:39<15:11:25,  9.64s/it]
 85%|████████▌ | 32293/37963 [77:29:46<14:05:48,  8.95s/it]
 85%|████████▌ | 32294/37963 [77:29:54<13:25:04,  8.52s/it]
 85%|████████▌ | 32295/37963 [77:30:01<12:59:52,  8.26s/it]
 85%|████████▌ | 32296/37963 [77:30:09<12:45:12,  8.10s/it]
 85%|████████▌ | 32297/37963 [77:30:16<12:26:16,  7.90s/it]
 85%|████████▌ | 32298/37963 [77:30:30<15:20:19,  9.75s/it]
 85%|████████▌ | 32299/37963 [77:30:38<14:23:40,  9.15s/it]
 85%|████████▌ | 32300/37963 [77:30:46<13:40:26,  8.69s/it]
                                                           
{'loss': '0.07944', 'grad_norm': '3.472', 'learning_rate': '1.145e-06', 'epoch': '0.8508'}

 85%|████████▌ | 32300/37963 [77:30:46<13:40:26,  8.69s/it]
 85%|████████▌ | 32301/37963 [77:30:53<12:56:11,  8.23s/it]
 85%|████████▌ | 32302/37963 [77:31:13<18:35:01, 11.82s/it]
 85%|████████▌ | 32303/37963 [77:31:20<16:27:33, 10.47s/it]
 85%|████████▌ | 32304/37963 [77:31:28<15:02:00,  9.56s/it]
 85%|████████▌ | 32305/37963 [77:31:35<14:05:14,  8.96s/it]
 85%|████████▌ | 32306/37963 [77:31:43<13:24:51,  8.54s/it]
 85%|████████▌ | 32307/37963 [77:31:51<12:57:52,  8.25s/it]
 85%|████████▌ | 32308/37963 [77:31:58<12:39:23,  8.06s/it]
 85%|████████▌ | 32309/37963 [77:32:12<15:15:36,  9.72s/it]
 85%|████████▌ | 32310/37963 [77:32:19<14:15:22,  9.08s/it]
                                                           
{'loss': '0.09361', 'grad_norm': '2.985', 'learning_rate': '1.141e-06', 'epoch': '0.8511'}

 85%|████████▌ | 32310/37963 [77:32:19<14:15:22,  9.08s/it]
 85%|████████▌ | 32311/37963 [77:32:27<13:35:19,  8.66s/it]
 85%|████████▌ | 32312/37963 [77:32:35<13:04:46,  8.33s/it]
 85%|████████▌ | 32313/37963 [77:32:42<12:44:05,  8.11s/it]
 85%|████████▌ | 32314/37963 [77:32:50<12:29:38,  7.96s/it]
 85%|████████▌ | 32315/37963 [77:33:10<18:22:22, 11.71s/it]
 85%|████████▌ | 32316/37963 [77:33:18<16:21:37, 10.43s/it]
 85%|████████▌ | 32317/37963 [77:33:25<14:59:22,  9.56s/it]
 85%|████████▌ | 32318/37963 [77:33:33<14:02:19,  8.95s/it]
 85%|████████▌ | 32319/37963 [77:33:40<13:23:50,  8.55s/it]
 85%|████████▌ | 32320/37963 [77:33:48<12:54:27,  8.23s/it]
                                                           
{'loss': '0.08721', 'grad_norm': '4.027', 'learning_rate': '1.137e-06', 'epoch': '0.8514'}

 85%|████████▌ | 32320/37963 [77:33:48<12:54:27,  8.23s/it]
 85%|████████▌ | 32321/37963 [77:33:55<12:34:27,  8.02s/it]
 85%|████████▌ | 32322/37963 [77:34:03<12:19:19,  7.86s/it]
 85%|████████▌ | 32323/37963 [77:34:11<12:13:31,  7.80s/it]
 85%|████████▌ | 32324/37963 [77:34:18<12:04:40,  7.71s/it]
 85%|████████▌ | 32325/37963 [77:34:26<11:59:38,  7.66s/it]
 85%|████████▌ | 32326/37963 [77:34:33<12:00:27,  7.67s/it]
 85%|████████▌ | 32327/37963 [77:34:41<11:54:08,  7.60s/it]
 85%|████████▌ | 32328/37963 [77:34:48<11:46:25,  7.52s/it]
 85%|████████▌ | 32329/37963 [77:34:56<11:45:58,  7.52s/it]
 85%|████████▌ | 32330/37963 [77:35:03<11:45:53,  7.52s/it]
                                                           
{'loss': '0.08125', 'grad_norm': '2.53', 'learning_rate': '1.133e-06', 'epoch': '0.8516'}

 85%|████████▌ | 32330/37963 [77:35:03<11:45:53,  7.52s/it]
 85%|████████▌ | 32331/37963 [77:35:17<14:44:17,  9.42s/it]
 85%|████████▌ | 32332/37963 [77:35:25<13:51:32,  8.86s/it]
 85%|████████▌ | 32333/37963 [77:35:32<13:17:32,  8.50s/it]
 85%|████████▌ | 32334/37963 [77:35:39<12:44:02,  8.14s/it]
 85%|████████▌ | 32335/37963 [77:35:47<12:20:31,  7.89s/it]
 85%|████████▌ | 32336/37963 [77:35:54<12:13:35,  7.82s/it]
 85%|████████▌ | 32337/37963 [77:36:02<12:03:06,  7.71s/it]
 85%|████████▌ | 32338/37963 [77:36:10<12:00:46,  7.69s/it]
 85%|████████▌ | 32339/37963 [77:36:17<11:54:31,  7.62s/it]
 85%|████████▌ | 32340/37963 [77:36:25<11:55:19,  7.63s/it]
                                                           
{'loss': '0.09234', 'grad_norm': '4.727', 'learning_rate': '1.129e-06', 'epoch': '0.8519'}

 85%|████████▌ | 32340/37963 [77:36:25<11:55:19,  7.63s/it]
 85%|████████▌ | 32341/37963 [77:36:32<11:46:18,  7.54s/it]
 85%|████████▌ | 32342/37963 [77:36:40<11:46:07,  7.54s/it]
 85%|████████▌ | 32343/37963 [77:36:47<11:48:21,  7.56s/it]
 85%|████████▌ | 32344/37963 [77:36:54<11:41:16,  7.49s/it]
 85%|████████▌ | 32345/37963 [77:37:15<17:44:08, 11.36s/it]
 85%|████████▌ | 32346/37963 [77:37:22<15:55:02, 10.20s/it]
 85%|████████▌ | 32347/37963 [77:37:30<14:39:41,  9.40s/it]
 85%|████████▌ | 32348/37963 [77:37:37<13:43:07,  8.80s/it]
 85%|████████▌ | 32349/37963 [77:37:45<13:09:18,  8.44s/it]
 85%|████████▌ | 32350/37963 [77:37:59<15:38:01, 10.03s/it]
                                                           
{'loss': '0.09532', 'grad_norm': '3.658', 'learning_rate': '1.125e-06', 'epoch': '0.8521'}

 85%|████████▌ | 32350/37963 [77:37:59<15:38:01, 10.03s/it]
 85%|████████▌ | 32351/37963 [77:38:06<14:28:47,  9.29s/it]
 85%|████████▌ | 32352/37963 [77:38:20<16:41:05, 10.70s/it]
 85%|████████▌ | 32353/37963 [77:38:28<15:11:22,  9.75s/it]
 85%|████████▌ | 32354/37963 [77:38:35<14:07:39,  9.07s/it]
 85%|████████▌ | 32355/37963 [77:38:43<13:24:11,  8.60s/it]
 85%|████████▌ | 32356/37963 [77:38:50<12:53:44,  8.28s/it]
 85%|████████▌ | 32357/37963 [77:38:58<12:32:16,  8.05s/it]
 85%|████████▌ | 32358/37963 [77:39:12<15:19:38,  9.84s/it]
 85%|████████▌ | 32359/37963 [77:39:20<14:22:55,  9.24s/it]
 85%|████████▌ | 32360/37963 [77:39:27<13:31:04,  8.69s/it]
                                                           
{'loss': '0.09071', 'grad_norm': '2.558', 'learning_rate': '1.121e-06', 'epoch': '0.8524'}

 85%|████████▌ | 32360/37963 [77:39:27<13:31:04,  8.69s/it]
 85%|████████▌ | 32361/37963 [77:39:34<12:56:42,  8.32s/it]
 85%|████████▌ | 32362/37963 [77:39:42<12:33:49,  8.08s/it]
 85%|████████▌ | 32363/37963 [77:39:56<15:06:53,  9.72s/it]
 85%|████████▌ | 32364/37963 [77:40:03<14:04:52,  9.05s/it]
 85%|████████▌ | 32365/37963 [77:40:17<16:18:30, 10.49s/it]
 85%|████████▌ | 32366/37963 [77:40:24<14:57:21,  9.62s/it]
 85%|████████▌ | 32367/37963 [77:40:32<14:00:46,  9.01s/it]
 85%|████████▌ | 32368/37963 [77:40:40<13:19:42,  8.58s/it]
 85%|████████▌ | 32369/37963 [77:40:47<12:49:15,  8.25s/it]
 85%|████████▌ | 32370/37963 [77:40:55<12:27:54,  8.02s/it]
                                                           
{'loss': '0.09067', 'grad_norm': '3.099', 'learning_rate': '1.117e-06', 'epoch': '0.8527'}

 85%|████████▌ | 32370/37963 [77:40:55<12:27:54,  8.02s/it]
 85%|████████▌ | 32371/37963 [77:41:02<12:07:30,  7.81s/it]
 85%|████████▌ | 32372/37963 [77:41:09<11:53:21,  7.66s/it]
 85%|████████▌ | 32373/37963 [77:41:17<11:43:55,  7.56s/it]
 85%|████████▌ | 32374/37963 [77:41:24<11:42:26,  7.54s/it]
 85%|████████▌ | 32375/37963 [77:41:32<11:40:37,  7.52s/it]
 85%|████████▌ | 32376/37963 [77:41:39<11:40:21,  7.52s/it]
 85%|████████▌ | 32377/37963 [77:41:53<14:36:55,  9.42s/it]
 85%|████████▌ | 32378/37963 [77:42:00<13:38:27,  8.79s/it]
 85%|████████▌ | 32379/37963 [77:42:08<13:07:48,  8.46s/it]
 85%|████████▌ | 32380/37963 [77:42:15<12:43:20,  8.20s/it]
                                                           
{'loss': '0.09211', 'grad_norm': '2.741', 'learning_rate': '1.113e-06', 'epoch': '0.8529'}

 85%|████████▌ | 32380/37963 [77:42:15<12:43:20,  8.20s/it]
 85%|████████▌ | 32381/37963 [77:42:23<12:21:36,  7.97s/it]
 85%|████████▌ | 32382/37963 [77:42:30<12:07:44,  7.82s/it]
 85%|████████▌ | 32383/37963 [77:42:38<12:01:44,  7.76s/it]
 85%|████████▌ | 32384/37963 [77:42:46<11:56:30,  7.71s/it]
 85%|████████▌ | 32385/37963 [77:42:53<11:53:09,  7.67s/it]
 85%|████████▌ | 32386/37963 [77:43:01<11:50:31,  7.64s/it]
 85%|████████▌ | 32387/37963 [77:43:08<11:45:04,  7.59s/it]
 85%|████████▌ | 32388/37963 [77:43:16<11:41:03,  7.55s/it]
 85%|████████▌ | 32389/37963 [77:43:29<14:34:34,  9.41s/it]
 85%|████████▌ | 32390/37963 [77:43:37<13:41:41,  8.85s/it]
                                                           
{'loss': '0.08574', 'grad_norm': '2.904', 'learning_rate': '1.11e-06', 'epoch': '0.8532'}

 85%|████████▌ | 32390/37963 [77:43:37<13:41:41,  8.85s/it]
 85%|████████▌ | 32391/37963 [77:43:45<13:08:46,  8.49s/it]
 85%|████████▌ | 32392/37963 [77:43:52<12:40:36,  8.19s/it]
 85%|████████▌ | 32393/37963 [77:44:00<12:25:45,  8.03s/it]
 85%|████████▌ | 32394/37963 [77:44:07<12:10:19,  7.87s/it]
 85%|████████▌ | 32395/37963 [77:44:22<15:08:31,  9.79s/it]
 85%|████████▌ | 32396/37963 [77:44:29<14:05:38,  9.11s/it]
 85%|████████▌ | 32397/37963 [77:44:49<19:14:52, 12.45s/it]
 85%|████████▌ | 32398/37963 [77:44:57<16:49:10, 10.88s/it]
 85%|████████▌ | 32399/37963 [77:45:04<15:10:47,  9.82s/it]
 85%|████████▌ | 32400/37963 [77:45:11<14:06:23,  9.13s/it]
                                                           
{'loss': '0.08381', 'grad_norm': '2.702', 'learning_rate': '1.106e-06', 'epoch': '0.8535'}

 85%|████████▌ | 32400/37963 [77:45:11<14:06:23,  9.13s/it]
 85%|████████▌ | 32401/37963 [77:45:19<13:24:38,  8.68s/it]
 85%|████████▌ | 32402/37963 [77:45:27<12:53:34,  8.35s/it]
 85%|████████▌ | 32403/37963 [77:45:34<12:31:51,  8.11s/it]
 85%|████████▌ | 32404/37963 [77:45:42<12:15:22,  7.94s/it]
 85%|████████▌ | 32405/37963 [77:45:49<12:03:24,  7.81s/it]
 85%|████████▌ | 32406/37963 [77:45:57<11:54:14,  7.71s/it]
 85%|████████▌ | 32407/37963 [77:46:04<11:48:36,  7.65s/it]
 85%|████████▌ | 32408/37963 [77:46:18<14:39:09,  9.50s/it]
 85%|████████▌ | 32409/37963 [77:46:25<13:43:21,  8.89s/it]
 85%|████████▌ | 32410/37963 [77:46:33<13:06:14,  8.50s/it]
                                                           
{'loss': '0.08438', 'grad_norm': '2.841', 'learning_rate': '1.102e-06', 'epoch': '0.8537'}

 85%|████████▌ | 32410/37963 [77:46:33<13:06:14,  8.50s/it]
 85%|████████▌ | 32411/37963 [77:46:47<15:39:58, 10.16s/it]
 85%|████████▌ | 32412/37963 [77:47:01<17:24:56, 11.29s/it]
 85%|████████▌ | 32413/37963 [77:47:09<15:43:51, 10.20s/it]
 85%|████████▌ | 32414/37963 [77:47:16<14:28:37,  9.39s/it]
 85%|████████▌ | 32415/37963 [77:47:24<13:33:51,  8.80s/it]
 85%|████████▌ | 32416/37963 [77:47:31<12:54:16,  8.38s/it]
 85%|████████▌ | 32417/37963 [77:47:39<12:33:04,  8.15s/it]
 85%|████████▌ | 32418/37963 [77:47:46<12:16:02,  7.96s/it]
 85%|████████▌ | 32419/37963 [77:47:54<12:01:36,  7.81s/it]
 85%|████████▌ | 32420/37963 [77:48:01<11:53:36,  7.72s/it]
                                                           
{'loss': '0.09209', 'grad_norm': '2.91', 'learning_rate': '1.098e-06', 'epoch': '0.854'}

 85%|████████▌ | 32420/37963 [77:48:01<11:53:36,  7.72s/it]
 85%|████████▌ | 32421/37963 [77:48:09<11:46:46,  7.65s/it]
 85%|████████▌ | 32422/37963 [77:48:16<11:46:50,  7.65s/it]
 85%|████████▌ | 32423/37963 [77:48:24<11:40:58,  7.59s/it]
 85%|████████▌ | 32424/37963 [77:48:31<11:42:24,  7.61s/it]
 85%|████████▌ | 32425/37963 [77:48:39<11:39:35,  7.58s/it]
 85%|████████▌ | 32426/37963 [77:48:53<14:36:47,  9.50s/it]
 85%|████████▌ | 32427/37963 [77:49:00<13:43:12,  8.92s/it]
 85%|████████▌ | 32428/37963 [77:49:08<13:06:15,  8.52s/it]
 85%|████████▌ | 32429/37963 [77:49:16<12:40:21,  8.24s/it]
 85%|████████▌ | 32430/37963 [77:49:23<12:19:28,  8.02s/it]
                                                           
{'loss': '0.08502', 'grad_norm': '1.996', 'learning_rate': '1.094e-06', 'epoch': '0.8543'}

 85%|████████▌ | 32430/37963 [77:49:23<12:19:28,  8.02s/it]
 85%|████████▌ | 32431/37963 [77:49:31<12:10:09,  7.92s/it]
 85%|████████▌ | 32432/37963 [77:49:38<11:59:57,  7.81s/it]
 85%|████████▌ | 32433/37963 [77:49:46<11:49:48,  7.70s/it]
 85%|████████▌ | 32434/37963 [77:49:53<11:43:25,  7.63s/it]
 85%|████████▌ | 32435/37963 [77:50:01<11:37:29,  7.57s/it]
 85%|████████▌ | 32436/37963 [77:50:08<11:30:39,  7.50s/it]
 85%|████████▌ | 32437/37963 [77:50:22<14:29:57,  9.45s/it]
 85%|████████▌ | 32438/37963 [77:50:30<13:37:05,  8.87s/it]
 85%|████████▌ | 32439/37963 [77:50:44<16:04:56, 10.48s/it]
 85%|████████▌ | 32440/37963 [77:50:51<14:40:18,  9.56s/it]
                                                           
{'loss': '0.09586', 'grad_norm': '2.735', 'learning_rate': '1.09e-06', 'epoch': '0.8545'}

 85%|████████▌ | 32440/37963 [77:50:51<14:40:18,  9.56s/it]
 85%|████████▌ | 32441/37963 [77:50:59<13:41:30,  8.93s/it]
 85%|████████▌ | 32442/37963 [77:51:06<13:05:34,  8.54s/it]
 85%|████████▌ | 32443/37963 [77:51:14<12:31:07,  8.16s/it]
 85%|████████▌ | 32444/37963 [77:51:28<15:13:09,  9.93s/it]
 85%|████████▌ | 32445/37963 [77:51:35<14:03:40,  9.17s/it]
 85%|████████▌ | 32446/37963 [77:51:49<16:10:21, 10.55s/it]
 85%|████████▌ | 32447/37963 [77:51:56<14:51:15,  9.69s/it]
 85%|████████▌ | 32448/37963 [77:52:04<13:50:39,  9.04s/it]
 85%|████████▌ | 32449/37963 [77:52:11<13:07:38,  8.57s/it]
 85%|████████▌ | 32450/37963 [77:52:19<12:43:48,  8.31s/it]
                                                           
{'loss': '0.09278', 'grad_norm': '4.296', 'learning_rate': '1.086e-06', 'epoch': '0.8548'}

 85%|████████▌ | 32450/37963 [77:52:19<12:43:48,  8.31s/it]
 85%|████████▌ | 32451/37963 [77:52:27<12:23:01,  8.09s/it]
 85%|████████▌ | 32452/37963 [77:52:34<12:06:33,  7.91s/it]
 85%|████████▌ | 32453/37963 [77:52:42<11:53:46,  7.77s/it]
 85%|████████▌ | 32454/37963 [77:52:49<11:45:09,  7.68s/it]
 85%|████████▌ | 32455/37963 [77:52:56<11:33:54,  7.56s/it]
 85%|████████▌ | 32456/37963 [77:53:04<11:26:07,  7.48s/it]
 85%|████████▌ | 32457/37963 [77:53:11<11:25:25,  7.47s/it]
 85%|████████▌ | 32458/37963 [77:53:19<11:30:38,  7.53s/it]
 86%|████████▌ | 32459/37963 [77:53:39<17:23:33, 11.38s/it]
 86%|████████▌ | 32460/37963 [77:53:53<18:36:06, 12.17s/it]
                                                           
{'loss': '0.08726', 'grad_norm': '2.164', 'learning_rate': '1.082e-06', 'epoch': '0.855'}

 86%|████████▌ | 32460/37963 [77:53:53<18:36:06, 12.17s/it]
 86%|████████▌ | 32461/37963 [77:54:00<16:20:36, 10.69s/it]
 86%|████████▌ | 32462/37963 [77:54:08<14:53:00,  9.74s/it]
 86%|████████▌ | 32463/37963 [77:54:16<13:54:56,  9.11s/it]
 86%|████████▌ | 32464/37963 [77:54:23<13:11:25,  8.64s/it]
 86%|████████▌ | 32465/37963 [77:54:31<12:40:57,  8.30s/it]
 86%|████████▌ | 32466/37963 [77:54:38<12:20:41,  8.08s/it]
 86%|████████▌ | 32467/37963 [77:54:46<12:05:29,  7.92s/it]
 86%|████████▌ | 32468/37963 [77:54:53<11:56:17,  7.82s/it]
 86%|████████▌ | 32469/37963 [77:55:01<11:47:32,  7.73s/it]
 86%|████████▌ | 32470/37963 [77:55:09<11:45:42,  7.71s/it]
                                                           
{'loss': '0.1029', 'grad_norm': '4.076', 'learning_rate': '1.078e-06', 'epoch': '0.8553'}

 86%|████████▌ | 32470/37963 [77:55:09<11:45:42,  7.71s/it]
 86%|████████▌ | 32471/37963 [77:55:16<11:38:35,  7.63s/it]
 86%|████████▌ | 32472/37963 [77:55:24<11:35:03,  7.59s/it]
 86%|████████▌ | 32473/37963 [77:55:31<11:34:52,  7.59s/it]
 86%|████████▌ | 32474/37963 [77:55:39<11:35:19,  7.60s/it]
 86%|████████▌ | 32475/37963 [77:55:46<11:32:43,  7.57s/it]
 86%|████████▌ | 32476/37963 [77:55:54<11:32:01,  7.57s/it]
 86%|████████▌ | 32477/37963 [77:56:01<11:31:02,  7.56s/it]
 86%|████████▌ | 32478/37963 [77:56:15<14:22:43,  9.44s/it]
 86%|████████▌ | 32479/37963 [77:56:23<13:33:09,  8.90s/it]
 86%|████████▌ | 32480/37963 [77:56:30<12:56:23,  8.50s/it]
                                                           
{'loss': '0.09607', 'grad_norm': '3.859', 'learning_rate': '1.075e-06', 'epoch': '0.8556'}

 86%|████████▌ | 32480/37963 [77:56:30<12:56:23,  8.50s/it]
 86%|████████▌ | 32481/37963 [77:56:38<12:31:04,  8.22s/it]
 86%|████████▌ | 32482/37963 [77:56:45<12:10:40,  8.00s/it]
 86%|████████▌ | 32483/37963 [77:56:59<14:57:57,  9.83s/it]
 86%|████████▌ | 32484/37963 [77:57:07<13:54:42,  9.14s/it]
 86%|████████▌ | 32485/37963 [77:57:15<13:11:48,  8.67s/it]
 86%|████████▌ | 32486/37963 [77:57:22<12:40:43,  8.33s/it]
 86%|████████▌ | 32487/37963 [77:57:30<12:24:43,  8.16s/it]
 86%|████████▌ | 32488/37963 [77:57:37<12:06:54,  7.97s/it]
 86%|████████▌ | 32489/37963 [77:57:45<11:54:00,  7.83s/it]
 86%|████████▌ | 32490/37963 [77:58:05<17:35:26, 11.57s/it]
                                                           
{'loss': '0.0993', 'grad_norm': '3.339', 'learning_rate': '1.071e-06', 'epoch': '0.8558'}

 86%|████████▌ | 32490/37963 [77:58:05<17:35:26, 11.57s/it]
 86%|████████▌ | 32491/37963 [77:58:13<15:49:20, 10.41s/it]
 86%|████████▌ | 32492/37963 [77:58:21<14:34:14,  9.59s/it]
 86%|████████▌ | 32493/37963 [77:58:28<13:39:50,  8.99s/it]
 86%|████████▌ | 32494/37963 [77:58:36<12:59:31,  8.55s/it]
 86%|████████▌ | 32495/37963 [77:58:44<12:42:36,  8.37s/it]
 86%|████████▌ | 32496/37963 [77:58:51<12:19:16,  8.11s/it]
 86%|████████▌ | 32497/37963 [77:58:59<12:11:57,  8.03s/it]
 86%|████████▌ | 32498/37963 [77:59:13<15:00:16,  9.88s/it]
 86%|████████▌ | 32499/37963 [77:59:21<13:55:59,  9.18s/it]
 86%|████████▌ | 32500/37963 [77:59:28<13:10:14,  8.68s/it]
                                                           
{'loss': '0.08483', 'grad_norm': '2.228', 'learning_rate': '1.067e-06', 'epoch': '0.8561'}

 86%|████████▌ | 32500/37963 [77:59:28<13:10:14,  8.68s/it]
 86%|████████▌ | 32501/37963 [77:59:36<12:32:24,  8.27s/it]
 86%|████████▌ | 32502/37963 [77:59:43<12:11:34,  8.04s/it]
 86%|████████▌ | 32503/37963 [77:59:51<11:56:47,  7.88s/it]
 86%|████████▌ | 32504/37963 [78:00:05<14:43:20,  9.71s/it]
 86%|████████▌ | 32505/37963 [78:00:12<13:41:02,  9.03s/it]
 86%|████████▌ | 32506/37963 [78:00:19<12:53:43,  8.51s/it]
 86%|████████▌ | 32507/37963 [78:00:40<18:19:05, 12.09s/it]
 86%|████████▌ | 32508/37963 [78:00:47<16:15:27, 10.73s/it]
 86%|████████▌ | 32509/37963 [78:00:55<14:53:29,  9.83s/it]
 86%|████████▌ | 32510/37963 [78:01:03<13:50:26,  9.14s/it]
                                                           
{'loss': '0.08611', 'grad_norm': '2.469', 'learning_rate': '1.063e-06', 'epoch': '0.8564'}

 86%|████████▌ | 32510/37963 [78:01:03<13:50:26,  9.14s/it]
 86%|████████▌ | 32511/37963 [78:01:10<13:08:40,  8.68s/it]
 86%|████████▌ | 32512/37963 [78:01:18<12:38:58,  8.35s/it]
 86%|████████▌ | 32513/37963 [78:01:25<12:16:43,  8.11s/it]
 86%|████████▌ | 32514/37963 [78:01:33<12:00:43,  7.94s/it]
 86%|████████▌ | 32515/37963 [78:01:40<11:49:27,  7.81s/it]
 86%|████████▌ | 32516/37963 [78:01:48<11:43:34,  7.75s/it]
 86%|████████▌ | 32517/37963 [78:01:55<11:37:15,  7.68s/it]
 86%|████████▌ | 32518/37963 [78:02:03<11:32:33,  7.63s/it]
 86%|████████▌ | 32519/37963 [78:02:10<11:27:42,  7.58s/it]
 86%|████████▌ | 32520/37963 [78:02:18<11:23:54,  7.54s/it]
                                                           
{'loss': '0.08846', 'grad_norm': '3.926', 'learning_rate': '1.059e-06', 'epoch': '0.8566'}

 86%|████████▌ | 32520/37963 [78:02:18<11:23:54,  7.54s/it]
 86%|████████▌ | 32521/37963 [78:02:25<11:22:31,  7.53s/it]
 86%|████████▌ | 32522/37963 [78:02:33<11:23:10,  7.53s/it]
 86%|████████▌ | 32523/37963 [78:02:40<11:21:44,  7.52s/it]
 86%|████████▌ | 32524/37963 [78:02:48<11:22:43,  7.53s/it]
 86%|████████▌ | 32525/37963 [78:02:55<11:19:16,  7.49s/it]
 86%|████████▌ | 32526/37963 [78:03:03<11:22:13,  7.53s/it]
 86%|████████▌ | 32527/37963 [78:03:11<11:22:00,  7.53s/it]
 86%|████████▌ | 32528/37963 [78:03:18<11:14:29,  7.45s/it]
 86%|████████▌ | 32529/37963 [78:03:25<11:17:29,  7.48s/it]
 86%|████████▌ | 32530/37963 [78:03:33<11:20:22,  7.51s/it]
                                                           
{'loss': '0.0994', 'grad_norm': '3.02', 'learning_rate': '1.055e-06', 'epoch': '0.8569'}

 86%|████████▌ | 32530/37963 [78:03:33<11:20:22,  7.51s/it]
 86%|████████▌ | 32531/37963 [78:03:40<11:19:23,  7.50s/it]
 86%|████████▌ | 32532/37963 [78:03:48<11:19:29,  7.51s/it]
 86%|████████▌ | 32533/37963 [78:04:01<14:02:46,  9.31s/it]
 86%|████████▌ | 32534/37963 [78:04:22<18:58:48, 12.59s/it]
 86%|████████▌ | 32535/37963 [78:04:29<16:37:43, 11.03s/it]
 86%|████████▌ | 32536/37963 [78:04:37<14:59:50,  9.95s/it]
 86%|████████▌ | 32537/37963 [78:04:44<13:54:38,  9.23s/it]
 86%|████████▌ | 32538/37963 [78:04:52<13:10:56,  8.75s/it]
 86%|████████▌ | 32539/37963 [78:05:06<15:32:03, 10.31s/it]
 86%|████████▌ | 32540/37963 [78:05:13<14:07:56,  9.38s/it]
                                                           
{'loss': '0.08617', 'grad_norm': '2.963', 'learning_rate': '1.052e-06', 'epoch': '0.8572'}

 86%|████████▌ | 32540/37963 [78:05:13<14:07:56,  9.38s/it]
 86%|████████▌ | 32541/37963 [78:05:20<13:16:41,  8.82s/it]
 86%|████████▌ | 32542/37963 [78:05:28<12:39:38,  8.41s/it]
 86%|████████▌ | 32543/37963 [78:05:35<12:14:52,  8.14s/it]
 86%|████████▌ | 32544/37963 [78:05:50<15:01:28,  9.98s/it]
 86%|████████▌ | 32545/37963 [78:05:57<13:54:42,  9.24s/it]
 86%|████████▌ | 32546/37963 [78:06:05<13:07:33,  8.72s/it]
 86%|████████▌ | 32547/37963 [78:06:19<15:27:15, 10.27s/it]
 86%|████████▌ | 32548/37963 [78:06:26<14:03:39,  9.35s/it]
 86%|████████▌ | 32549/37963 [78:06:33<13:16:34,  8.83s/it]
 86%|████████▌ | 32550/37963 [78:06:41<12:41:38,  8.44s/it]
                                                           
{'loss': '0.08804', 'grad_norm': '2.674', 'learning_rate': '1.048e-06', 'epoch': '0.8574'}

 86%|████████▌ | 32550/37963 [78:06:41<12:41:38,  8.44s/it]
 86%|████████▌ | 32551/37963 [78:06:55<15:10:42, 10.10s/it]
 86%|████████▌ | 32552/37963 [78:07:02<14:02:51,  9.35s/it]
 86%|████████▌ | 32553/37963 [78:07:16<15:59:38, 10.64s/it]
 86%|████████▌ | 32554/37963 [78:07:24<14:35:56,  9.72s/it]
 86%|████████▌ | 32555/37963 [78:07:31<13:33:19,  9.02s/it]
 86%|████████▌ | 32556/37963 [78:07:39<12:55:06,  8.60s/it]
 86%|████████▌ | 32557/37963 [78:07:46<12:19:53,  8.21s/it]
 86%|████████▌ | 32558/37963 [78:07:54<12:03:17,  8.03s/it]
 86%|████████▌ | 32559/37963 [78:08:01<11:49:19,  7.88s/it]
 86%|████████▌ | 32560/37963 [78:08:09<11:40:23,  7.78s/it]
                                                           
{'loss': '0.08581', 'grad_norm': '2.411', 'learning_rate': '1.044e-06', 'epoch': '0.8577'}

 86%|████████▌ | 32560/37963 [78:08:09<11:40:23,  7.78s/it]
 86%|████████▌ | 32561/37963 [78:08:16<11:33:24,  7.70s/it]
 86%|████████▌ | 32562/37963 [78:08:24<11:31:17,  7.68s/it]
 86%|████████▌ | 32563/37963 [78:08:31<11:21:50,  7.58s/it]
 86%|████████▌ | 32564/37963 [78:08:39<11:19:06,  7.55s/it]
 86%|████████▌ | 32565/37963 [78:08:46<11:19:42,  7.56s/it]
 86%|████████▌ | 32566/37963 [78:08:54<11:18:51,  7.55s/it]
 86%|████████▌ | 32567/37963 [78:09:01<11:16:39,  7.52s/it]
 86%|████████▌ | 32568/37963 [78:09:08<11:08:49,  7.44s/it]
 86%|████████▌ | 32569/37963 [78:09:16<11:01:45,  7.36s/it]
 86%|████████▌ | 32570/37963 [78:09:23<11:05:39,  7.41s/it]
                                                           
{'loss': '0.1086', 'grad_norm': '3.089', 'learning_rate': '1.04e-06', 'epoch': '0.8579'}

 86%|████████▌ | 32570/37963 [78:09:23<11:05:39,  7.41s/it]
 86%|████████▌ | 32571/37963 [78:09:31<11:07:44,  7.43s/it]
 86%|████████▌ | 32572/37963 [78:09:38<11:10:17,  7.46s/it]
 86%|████████▌ | 32573/37963 [78:09:46<11:13:50,  7.50s/it]
 86%|████████▌ | 32574/37963 [78:09:53<11:15:43,  7.52s/it]
 86%|████████▌ | 32575/37963 [78:10:01<11:12:00,  7.48s/it]
 86%|████████▌ | 32576/37963 [78:10:08<11:11:33,  7.48s/it]
 86%|████████▌ | 32577/37963 [78:10:16<11:14:16,  7.51s/it]
 86%|████████▌ | 32578/37963 [78:10:23<11:16:35,  7.54s/it]
 86%|████████▌ | 32579/37963 [78:10:31<11:14:34,  7.52s/it]
 86%|████████▌ | 32580/37963 [78:10:45<14:08:18,  9.46s/it]
                                                           
{'loss': '0.09467', 'grad_norm': '4.529', 'learning_rate': '1.036e-06', 'epoch': '0.8582'}

 86%|████████▌ | 32580/37963 [78:10:45<14:08:18,  9.46s/it]
 86%|████████▌ | 32581/37963 [78:10:52<13:16:15,  8.88s/it]
 86%|████████▌ | 32582/37963 [78:11:00<12:35:11,  8.42s/it]
 86%|████████▌ | 32583/37963 [78:11:07<12:11:26,  8.16s/it]
 86%|████████▌ | 32584/37963 [78:11:21<14:46:06,  9.88s/it]
 86%|████████▌ | 32585/37963 [78:11:29<13:45:02,  9.20s/it]
 86%|████████▌ | 32586/37963 [78:11:36<13:00:03,  8.70s/it]
 86%|████████▌ | 32587/37963 [78:11:50<15:27:24, 10.35s/it]
 86%|████████▌ | 32588/37963 [78:11:58<14:11:44,  9.51s/it]
 86%|████████▌ | 32589/37963 [78:12:05<13:16:51,  8.90s/it]
 86%|████████▌ | 32590/37963 [78:12:13<12:39:57,  8.49s/it]
                                                           
{'loss': '0.09445', 'grad_norm': '3.871', 'learning_rate': '1.033e-06', 'epoch': '0.8585'}

 86%|████████▌ | 32590/37963 [78:12:13<12:39:57,  8.49s/it]
 86%|████████▌ | 32591/37963 [78:12:33<17:48:05, 11.93s/it]
 86%|████████▌ | 32592/37963 [78:12:41<15:54:51, 10.67s/it]
 86%|████████▌ | 32593/37963 [78:12:48<14:28:58,  9.71s/it]
 86%|████████▌ | 32594/37963 [78:12:56<13:31:10,  9.07s/it]
 86%|████████▌ | 32595/37963 [78:13:03<12:44:13,  8.54s/it]
 86%|████████▌ | 32596/37963 [78:13:10<12:07:57,  8.14s/it]
 86%|████████▌ | 32597/37963 [78:13:24<14:43:50,  9.88s/it]
 86%|████████▌ | 32598/37963 [78:13:32<13:41:46,  9.19s/it]
 86%|████████▌ | 32599/37963 [78:13:46<15:46:24, 10.59s/it]
 86%|████████▌ | 32600/37963 [78:13:53<14:23:55,  9.67s/it]
                                                           
{'loss': '0.102', 'grad_norm': '2.751', 'learning_rate': '1.029e-06', 'epoch': '0.8587'}

 86%|████████▌ | 32600/37963 [78:13:53<14:23:55,  9.67s/it]
 86%|████████▌ | 32601/37963 [78:14:01<13:28:11,  9.04s/it]
 86%|████████▌ | 32602/37963 [78:14:08<12:49:08,  8.61s/it]
 86%|████████▌ | 32603/37963 [78:14:16<12:20:21,  8.29s/it]
 86%|████████▌ | 32604/37963 [78:14:23<12:00:45,  8.07s/it]
 86%|████████▌ | 32605/37963 [78:14:31<11:37:01,  7.81s/it]
 86%|████████▌ | 32606/37963 [78:14:38<11:20:21,  7.62s/it]
 86%|████████▌ | 32607/37963 [78:14:45<11:17:48,  7.59s/it]
 86%|████████▌ | 32608/37963 [78:14:59<14:09:05,  9.51s/it]
 86%|████████▌ | 32609/37963 [78:15:07<13:20:24,  8.97s/it]
 86%|████████▌ | 32610/37963 [78:15:15<12:41:59,  8.54s/it]
                                                           
{'loss': '0.08807', 'grad_norm': '3.622', 'learning_rate': '1.025e-06', 'epoch': '0.859'}

 86%|████████▌ | 32610/37963 [78:15:15<12:41:59,  8.54s/it]
 86%|████████▌ | 32611/37963 [78:15:22<12:15:37,  8.25s/it]
 86%|████████▌ | 32612/37963 [78:15:29<11:50:49,  7.97s/it]
 86%|████████▌ | 32613/37963 [78:15:37<11:38:05,  7.83s/it]
 86%|████████▌ | 32614/37963 [78:15:44<11:29:26,  7.73s/it]
 86%|████████▌ | 32615/37963 [78:15:52<11:24:36,  7.68s/it]
 86%|████████▌ | 32616/37963 [78:16:00<11:20:44,  7.64s/it]
 86%|████████▌ | 32617/37963 [78:16:07<11:17:37,  7.61s/it]
 86%|████████▌ | 32618/37963 [78:16:15<11:15:06,  7.58s/it]
 86%|████████▌ | 32619/37963 [78:16:22<11:10:37,  7.53s/it]
 86%|████████▌ | 32620/37963 [78:16:29<11:06:35,  7.49s/it]
                                                           
{'loss': '0.07426', 'grad_norm': '2.152', 'learning_rate': '1.021e-06', 'epoch': '0.8593'}

 86%|████████▌ | 32620/37963 [78:16:29<11:06:35,  7.49s/it]
 86%|████████▌ | 32621/37963 [78:16:37<11:05:52,  7.48s/it]
 86%|████████▌ | 32622/37963 [78:16:44<10:57:13,  7.38s/it]
 86%|████████▌ | 32623/37963 [78:16:52<11:02:30,  7.44s/it]
 86%|████████▌ | 32624/37963 [78:16:59<11:03:53,  7.46s/it]
 86%|████████▌ | 32625/37963 [78:17:07<11:07:59,  7.51s/it]
 86%|████████▌ | 32626/37963 [78:17:14<11:06:44,  7.50s/it]
 86%|████████▌ | 32627/37963 [78:17:22<11:08:02,  7.51s/it]
 86%|████████▌ | 32628/37963 [78:17:29<11:03:07,  7.46s/it]
 86%|████████▌ | 32629/37963 [78:17:37<11:07:47,  7.51s/it]
 86%|████████▌ | 32630/37963 [78:17:44<11:07:53,  7.51s/it]
                                                           
{'loss': '0.09618', 'grad_norm': '2.625', 'learning_rate': '1.018e-06', 'epoch': '0.8595'}

 86%|████████▌ | 32630/37963 [78:17:44<11:07:53,  7.51s/it]
 86%|████████▌ | 32631/37963 [78:17:58<13:54:18,  9.39s/it]
 86%|████████▌ | 32632/37963 [78:18:06<13:07:03,  8.86s/it]
 86%|████████▌ | 32633/37963 [78:18:13<12:34:36,  8.49s/it]
 86%|████████▌ | 32634/37963 [78:18:21<12:09:20,  8.21s/it]
 86%|████████▌ | 32635/37963 [78:18:28<11:50:13,  8.00s/it]
 86%|████████▌ | 32636/37963 [78:18:42<14:26:37,  9.76s/it]
 86%|████████▌ | 32637/37963 [78:18:50<13:28:17,  9.11s/it]
 86%|████████▌ | 32638/37963 [78:18:57<12:45:53,  8.63s/it]
 86%|████████▌ | 32639/37963 [78:19:05<12:12:52,  8.26s/it]
 86%|████████▌ | 32640/37963 [78:19:12<11:52:50,  8.04s/it]
                                                           
{'loss': '0.09197', 'grad_norm': '2.518', 'learning_rate': '1.014e-06', 'epoch': '0.8598'}

 86%|████████▌ | 32640/37963 [78:19:12<11:52:50,  8.04s/it]
 86%|████████▌ | 32641/37963 [78:19:33<17:32:44, 11.87s/it]
 86%|████████▌ | 32642/37963 [78:19:41<15:37:36, 10.57s/it]
 86%|████████▌ | 32643/37963 [78:19:48<14:14:06,  9.63s/it]
 86%|████████▌ | 32644/37963 [78:19:55<13:16:40,  8.99s/it]
 86%|████████▌ | 32645/37963 [78:20:03<12:38:26,  8.56s/it]
 86%|████████▌ | 32646/37963 [78:20:17<14:50:17, 10.05s/it]
 86%|████████▌ | 32647/37963 [78:20:31<16:34:57, 11.23s/it]
 86%|████████▌ | 32648/37963 [78:20:38<14:56:50, 10.12s/it]
 86%|████████▌ | 32649/37963 [78:20:46<13:50:38,  9.38s/it]
 86%|████████▌ | 32650/37963 [78:20:53<13:03:20,  8.85s/it]
                                                           
{'loss': '0.09571', 'grad_norm': '3.149', 'learning_rate': '1.01e-06', 'epoch': '0.8601'}

 86%|████████▌ | 32650/37963 [78:20:53<13:03:20,  8.85s/it]
 86%|████████▌ | 32651/37963 [78:21:01<12:24:36,  8.41s/it]
 86%|████████▌ | 32652/37963 [78:21:08<12:02:29,  8.16s/it]
 86%|████████▌ | 32653/37963 [78:21:16<11:45:29,  7.97s/it]
 86%|████████▌ | 32654/37963 [78:21:23<11:32:36,  7.83s/it]
 86%|████████▌ | 32655/37963 [78:21:31<11:19:24,  7.68s/it]
 86%|████████▌ | 32656/37963 [78:21:38<11:13:55,  7.62s/it]
 86%|████████▌ | 32657/37963 [78:21:45<11:06:32,  7.54s/it]
 86%|████████▌ | 32658/37963 [78:21:53<11:01:22,  7.48s/it]
 86%|████████▌ | 32659/37963 [78:22:07<14:00:10,  9.50s/it]
 86%|████████▌ | 32660/37963 [78:22:14<13:01:50,  8.85s/it]
                                                           
{'loss': '0.09307', 'grad_norm': '3.107', 'learning_rate': '1.006e-06', 'epoch': '0.8603'}

 86%|████████▌ | 32660/37963 [78:22:14<13:01:50,  8.85s/it]
 86%|████████▌ | 32661/37963 [78:22:22<12:24:28,  8.42s/it]
 86%|████████▌ | 32662/37963 [78:22:29<11:57:30,  8.12s/it]
 86%|████████▌ | 32663/37963 [78:22:37<11:43:38,  7.97s/it]
 86%|████████▌ | 32664/37963 [78:22:44<11:32:13,  7.84s/it]
 86%|████████▌ | 32665/37963 [78:22:52<11:26:26,  7.77s/it]
 86%|████████▌ | 32666/37963 [78:23:00<11:20:00,  7.70s/it]
 86%|████████▌ | 32667/37963 [78:23:07<11:07:01,  7.56s/it]
 86%|████████▌ | 32668/37963 [78:23:14<11:08:44,  7.58s/it]
 86%|████████▌ | 32669/37963 [78:23:22<11:05:06,  7.54s/it]
 86%|████████▌ | 32670/37963 [78:23:29<11:05:12,  7.54s/it]
                                                           
{'loss': '0.08463', 'grad_norm': '2.313', 'learning_rate': '1.003e-06', 'epoch': '0.8606'}

 86%|████████▌ | 32670/37963 [78:23:29<11:05:12,  7.54s/it]
 86%|████████▌ | 32671/37963 [78:23:37<10:59:48,  7.48s/it]
 86%|████████▌ | 32672/37963 [78:23:44<10:59:54,  7.48s/it]
 86%|████████▌ | 32673/37963 [78:23:52<10:59:20,  7.48s/it]
 86%|████████▌ | 32674/37963 [78:24:06<13:47:51,  9.39s/it]
 86%|████████▌ | 32675/37963 [78:24:13<12:55:50,  8.80s/it]
 86%|████████▌ | 32676/37963 [78:24:21<12:23:36,  8.44s/it]
 86%|████████▌ | 32677/37963 [78:24:28<11:58:57,  8.16s/it]
 86%|████████▌ | 32678/37963 [78:24:36<11:42:48,  7.98s/it]
 86%|████████▌ | 32679/37963 [78:24:49<14:11:35,  9.67s/it]
 86%|████████▌ | 32680/37963 [78:24:57<13:13:49,  9.02s/it]
                                                           
{'loss': '0.08213', 'grad_norm': '3.012', 'learning_rate': '9.99e-07', 'epoch': '0.8608'}

 86%|████████▌ | 32680/37963 [78:24:57<13:13:49,  9.02s/it]
 86%|████████▌ | 32681/37963 [78:25:04<12:32:19,  8.55s/it]
 86%|████████▌ | 32682/37963 [78:25:11<11:58:38,  8.16s/it]
 86%|████████▌ | 32683/37963 [78:25:19<11:42:38,  7.98s/it]
 86%|████████▌ | 32684/37963 [78:25:33<14:19:49,  9.77s/it]
 86%|████████▌ | 32685/37963 [78:25:40<13:20:39,  9.10s/it]
 86%|████████▌ | 32686/37963 [78:25:54<15:28:59, 10.56s/it]
 86%|████████▌ | 32687/37963 [78:26:02<14:11:13,  9.68s/it]
 86%|████████▌ | 32688/37963 [78:26:10<13:13:24,  9.02s/it]
 86%|████████▌ | 32689/37963 [78:26:17<12:29:24,  8.53s/it]
 86%|████████▌ | 32690/37963 [78:26:24<12:02:59,  8.23s/it]
                                                           
{'loss': '0.08425', 'grad_norm': '2.667', 'learning_rate': '9.953e-07', 'epoch': '0.8611'}

 86%|████████▌ | 32690/37963 [78:26:24<12:02:59,  8.23s/it]
 86%|████████▌ | 32691/37963 [78:26:32<11:45:04,  8.02s/it]
 86%|████████▌ | 32692/37963 [78:26:40<11:35:53,  7.92s/it]
 86%|████████▌ | 32693/37963 [78:26:47<11:21:27,  7.76s/it]
 86%|████████▌ | 32694/37963 [78:26:55<11:15:55,  7.70s/it]
 86%|████████▌ | 32695/37963 [78:27:15<16:52:55, 11.54s/it]
 86%|████████▌ | 32696/37963 [78:27:23<15:06:43, 10.33s/it]
 86%|████████▌ | 32697/37963 [78:27:30<13:52:08,  9.48s/it]
 86%|████████▌ | 32698/37963 [78:27:38<12:59:15,  8.88s/it]
 86%|████████▌ | 32699/37963 [78:27:45<12:22:33,  8.46s/it]
 86%|████████▌ | 32700/37963 [78:27:53<11:57:25,  8.18s/it]
                                                           
{'loss': '0.08348', 'grad_norm': '3.645', 'learning_rate': '9.916e-07', 'epoch': '0.8614'}

 86%|████████▌ | 32700/37963 [78:27:53<11:57:25,  8.18s/it]
 86%|████████▌ | 32701/37963 [78:28:00<11:41:01,  7.99s/it]
 86%|████████▌ | 32702/37963 [78:28:08<11:30:12,  7.87s/it]
 86%|████████▌ | 32703/37963 [78:28:15<11:19:20,  7.75s/it]
 86%|████████▌ | 32704/37963 [78:28:22<11:05:35,  7.59s/it]
 86%|████████▌ | 32705/37963 [78:28:30<11:02:17,  7.56s/it]
 86%|████████▌ | 32706/37963 [78:28:37<11:00:58,  7.54s/it]
 86%|████████▌ | 32707/37963 [78:28:45<10:59:24,  7.53s/it]
 86%|████████▌ | 32708/37963 [78:28:53<11:00:25,  7.54s/it]
 86%|████████▌ | 32709/37963 [78:29:07<13:56:14,  9.55s/it]
 86%|████████▌ | 32710/37963 [78:29:14<13:03:08,  8.95s/it]
                                                           
{'loss': '0.08834', 'grad_norm': '3.789', 'learning_rate': '9.879e-07', 'epoch': '0.8616'}

 86%|████████▌ | 32710/37963 [78:29:14<13:03:08,  8.95s/it]
 86%|████████▌ | 32711/37963 [78:29:22<12:23:53,  8.50s/it]
 86%|████████▌ | 32712/37963 [78:29:29<12:00:32,  8.23s/it]
 86%|████████▌ | 32713/37963 [78:29:37<11:40:03,  8.00s/it]
 86%|████████▌ | 32714/37963 [78:29:44<11:27:06,  7.85s/it]
 86%|████████▌ | 32715/37963 [78:29:52<11:12:43,  7.69s/it]
 86%|████████▌ | 32716/37963 [78:29:59<11:05:55,  7.61s/it]
 86%|████████▌ | 32717/37963 [78:30:07<11:02:48,  7.58s/it]
 86%|████████▌ | 32718/37963 [78:30:14<11:01:59,  7.57s/it]
 86%|████████▌ | 32719/37963 [78:30:22<10:57:03,  7.52s/it]
 86%|████████▌ | 32720/37963 [78:30:29<10:55:21,  7.50s/it]
                                                           
{'loss': '0.09155', 'grad_norm': '3.275', 'learning_rate': '9.842e-07', 'epoch': '0.8619'}

 86%|████████▌ | 32720/37963 [78:30:29<10:55:21,  7.50s/it]
 86%|████████▌ | 32721/37963 [78:30:36<10:53:47,  7.48s/it]
 86%|████████▌ | 32722/37963 [78:30:44<10:56:47,  7.52s/it]
 86%|████████▌ | 32723/37963 [78:30:51<10:55:07,  7.50s/it]
 86%|████████▌ | 32724/37963 [78:31:12<16:32:55, 11.37s/it]
 86%|████████▌ | 32725/37963 [78:31:19<14:53:36, 10.24s/it]
 86%|████████▌ | 32726/37963 [78:31:27<13:40:35,  9.40s/it]
 86%|████████▌ | 32727/37963 [78:31:34<12:51:42,  8.84s/it]
 86%|████████▌ | 32728/37963 [78:31:42<12:15:38,  8.43s/it]
 86%|████████▌ | 32729/37963 [78:31:49<11:52:24,  8.17s/it]
 86%|████████▌ | 32730/37963 [78:31:57<11:29:40,  7.91s/it]
                                                           
{'loss': '0.08069', 'grad_norm': '2.776', 'learning_rate': '9.805e-07', 'epoch': '0.8622'}

 86%|████████▌ | 32730/37963 [78:31:57<11:29:40,  7.91s/it]
 86%|████████▌ | 32731/37963 [78:32:04<11:19:06,  7.79s/it]
 86%|████████▌ | 32732/37963 [78:32:18<14:04:47,  9.69s/it]
 86%|████████▌ | 32733/37963 [78:32:26<13:09:51,  9.06s/it]
 86%|████████▌ | 32734/37963 [78:32:34<12:29:53,  8.60s/it]
 86%|████████▌ | 32735/37963 [78:32:47<14:49:13, 10.21s/it]
 86%|████████▌ | 32736/37963 [78:32:55<13:39:47,  9.41s/it]
 86%|████████▌ | 32737/37963 [78:33:02<12:46:25,  8.80s/it]
 86%|████████▌ | 32738/37963 [78:33:10<12:13:40,  8.42s/it]
 86%|████████▌ | 32739/37963 [78:33:24<14:35:01, 10.05s/it]
 86%|████████▌ | 32740/37963 [78:33:38<16:16:06, 11.21s/it]
                                                           
{'loss': '0.09519', 'grad_norm': '2.661', 'learning_rate': '9.768e-07', 'epoch': '0.8624'}

 86%|████████▌ | 32740/37963 [78:33:38<16:16:06, 11.21s/it]
 86%|████████▌ | 32741/37963 [78:33:45<14:38:14, 10.09s/it]
 86%|████████▌ | 32742/37963 [78:33:59<16:20:35, 11.27s/it]
 86%|████████▌ | 32743/37963 [78:34:07<14:44:26, 10.17s/it]
 86%|████████▋ | 32744/37963 [78:34:14<13:35:21,  9.37s/it]
 86%|████████▋ | 32745/37963 [78:34:22<12:50:46,  8.86s/it]
 86%|████████▋ | 32746/37963 [78:34:30<12:14:56,  8.45s/it]
 86%|████████▋ | 32747/37963 [78:34:37<11:51:03,  8.18s/it]
 86%|████████▋ | 32748/37963 [78:34:45<11:35:26,  8.00s/it]
 86%|████████▋ | 32749/37963 [78:34:52<11:23:50,  7.87s/it]
 86%|████████▋ | 32750/37963 [78:35:00<11:17:56,  7.80s/it]
                                                           
{'loss': '0.09113', 'grad_norm': '2.514', 'learning_rate': '9.731e-07', 'epoch': '0.8627'}

 86%|████████▋ | 32750/37963 [78:35:00<11:17:56,  7.80s/it]
 86%|████████▋ | 32751/37963 [78:35:07<11:12:08,  7.74s/it]
 86%|████████▋ | 32752/37963 [78:35:15<11:07:31,  7.69s/it]
 86%|████████▋ | 32753/37963 [78:35:29<13:53:19,  9.60s/it]
 86%|████████▋ | 32754/37963 [78:35:37<13:00:44,  8.99s/it]
 86%|████████▋ | 32755/37963 [78:35:44<12:18:41,  8.51s/it]
 86%|████████▋ | 32756/37963 [78:35:52<11:53:22,  8.22s/it]
 86%|████████▋ | 32757/37963 [78:35:59<11:36:06,  8.02s/it]
 86%|████████▋ | 32758/37963 [78:36:07<11:24:43,  7.89s/it]
 86%|████████▋ | 32759/37963 [78:36:14<11:15:15,  7.79s/it]
 86%|████████▋ | 32760/37963 [78:36:22<11:08:50,  7.71s/it]
                                                           
{'loss': '0.09384', 'grad_norm': '2.6', 'learning_rate': '9.695e-07', 'epoch': '0.8629'}

 86%|████████▋ | 32760/37963 [78:36:22<11:08:50,  7.71s/it]
 86%|████████▋ | 32761/37963 [78:36:29<11:04:34,  7.67s/it]
 86%|████████▋ | 32762/37963 [78:36:37<11:04:07,  7.66s/it]
 86%|████████▋ | 32763/37963 [78:36:45<11:00:21,  7.62s/it]
 86%|████████▋ | 32764/37963 [78:36:52<11:01:10,  7.63s/it]
 86%|████████▋ | 32765/37963 [78:37:00<10:59:54,  7.62s/it]
 86%|████████▋ | 32766/37963 [78:37:07<10:56:39,  7.58s/it]
 86%|████████▋ | 32767/37963 [78:37:14<10:46:20,  7.46s/it]
 86%|████████▋ | 32768/37963 [78:37:22<10:48:56,  7.49s/it]
 86%|████████▋ | 32769/37963 [78:37:30<10:49:08,  7.50s/it]
 86%|████████▋ | 32770/37963 [78:37:37<10:40:28,  7.40s/it]
                                                           
{'loss': '0.0916', 'grad_norm': '2.369', 'learning_rate': '9.658e-07', 'epoch': '0.8632'}

 86%|████████▋ | 32770/37963 [78:37:37<10:40:28,  7.40s/it]
 86%|████████▋ | 32771/37963 [78:37:44<10:46:26,  7.47s/it]
 86%|████████▋ | 32772/37963 [78:38:05<16:23:11, 11.36s/it]
 86%|████████▋ | 32773/37963 [78:38:12<14:46:10, 10.24s/it]
 86%|████████▋ | 32774/37963 [78:38:20<13:34:47,  9.42s/it]
 86%|████████▋ | 32775/37963 [78:38:27<12:45:26,  8.85s/it]
 86%|████████▋ | 32776/37963 [78:38:35<12:09:58,  8.44s/it]
 86%|████████▋ | 32777/37963 [78:38:42<11:44:53,  8.16s/it]
 86%|████████▋ | 32778/37963 [78:38:50<11:20:05,  7.87s/it]
 86%|████████▋ | 32779/37963 [78:38:57<11:11:23,  7.77s/it]
 86%|████████▋ | 32780/37963 [78:39:05<11:06:13,  7.71s/it]
                                                           
{'loss': '0.09866', 'grad_norm': '4.031', 'learning_rate': '9.622e-07', 'epoch': '0.8635'}

 86%|████████▋ | 32780/37963 [78:39:05<11:06:13,  7.71s/it]
 86%|████████▋ | 32781/37963 [78:39:12<11:06:57,  7.72s/it]
 86%|████████▋ | 32782/37963 [78:39:20<10:52:36,  7.56s/it]
 86%|████████▋ | 32783/37963 [78:39:34<13:39:30,  9.49s/it]
 86%|████████▋ | 32784/37963 [78:39:41<12:49:05,  8.91s/it]
 86%|████████▋ | 32785/37963 [78:39:55<14:54:03, 10.36s/it]
 86%|████████▋ | 32786/37963 [78:40:16<19:19:28, 13.44s/it]
 86%|████████▋ | 32787/37963 [78:40:23<16:48:16, 11.69s/it]
 86%|████████▋ | 32788/37963 [78:40:31<15:00:38, 10.44s/it]
 86%|████████▋ | 32789/37963 [78:40:45<16:32:31, 11.51s/it]
 86%|████████▋ | 32790/37963 [78:40:52<14:47:13, 10.29s/it]
                                                           
{'loss': '0.09908', 'grad_norm': '3.072', 'learning_rate': '9.585e-07', 'epoch': '0.8637'}

 86%|████████▋ | 32790/37963 [78:40:52<14:47:13, 10.29s/it]
 86%|████████▋ | 32791/37963 [78:41:00<13:36:12,  9.47s/it]
 86%|████████▋ | 32792/37963 [78:41:07<12:46:16,  8.89s/it]
 86%|████████▋ | 32793/37963 [78:41:15<12:12:03,  8.50s/it]
 86%|████████▋ | 32794/37963 [78:41:22<11:47:36,  8.21s/it]
 86%|████████▋ | 32795/37963 [78:41:30<11:30:53,  8.02s/it]
 86%|████████▋ | 32796/37963 [78:41:38<11:20:49,  7.91s/it]
 86%|████████▋ | 32797/37963 [78:41:52<14:03:28,  9.80s/it]
 86%|████████▋ | 32798/37963 [78:41:59<13:02:12,  9.09s/it]
 86%|████████▋ | 32799/37963 [78:42:07<12:18:14,  8.58s/it]
 86%|████████▋ | 32800/37963 [78:42:14<11:53:47,  8.30s/it]
                                                           
{'loss': '0.09222', 'grad_norm': '3.14', 'learning_rate': '9.549e-07', 'epoch': '0.864'}

 86%|████████▋ | 32800/37963 [78:42:14<11:53:47,  8.30s/it]
 86%|████████▋ | 32801/37963 [78:42:22<11:31:56,  8.04s/it]
 86%|████████▋ | 32802/37963 [78:42:29<11:18:08,  7.88s/it]
 86%|████████▋ | 32803/37963 [78:42:37<11:11:22,  7.81s/it]
 86%|████████▋ | 32804/37963 [78:42:44<11:03:47,  7.72s/it]
 86%|████████▋ | 32805/37963 [78:42:52<11:00:21,  7.68s/it]
 86%|████████▋ | 32806/37963 [78:43:00<10:58:34,  7.66s/it]
 86%|████████▋ | 32807/37963 [78:43:07<10:58:11,  7.66s/it]
 86%|████████▋ | 32808/37963 [78:43:15<10:53:32,  7.61s/it]
 86%|████████▋ | 32809/37963 [78:43:22<10:55:20,  7.63s/it]
 86%|████████▋ | 32810/37963 [78:43:30<10:50:10,  7.57s/it]
                                                           
{'loss': '0.09139', 'grad_norm': '4.034', 'learning_rate': '9.512e-07', 'epoch': '0.8643'}

 86%|████████▋ | 32810/37963 [78:43:30<10:50:10,  7.57s/it]
 86%|████████▋ | 32811/37963 [78:43:37<10:50:30,  7.58s/it]
 86%|████████▋ | 32812/37963 [78:43:45<10:43:55,  7.50s/it]
 86%|████████▋ | 32813/37963 [78:43:53<10:50:42,  7.58s/it]
 86%|████████▋ | 32814/37963 [78:44:00<10:49:19,  7.57s/it]
 86%|████████▋ | 32815/37963 [78:44:08<10:50:13,  7.58s/it]
 86%|████████▋ | 32816/37963 [78:44:15<10:47:40,  7.55s/it]
 86%|████████▋ | 32817/37963 [78:44:29<13:32:58,  9.48s/it]
 86%|████████▋ | 32818/37963 [78:44:37<12:43:10,  8.90s/it]
 86%|████████▋ | 32819/37963 [78:44:44<12:09:18,  8.51s/it]
 86%|████████▋ | 32820/37963 [78:44:58<14:34:30, 10.20s/it]
                                                           
{'loss': '0.1008', 'grad_norm': '2.857', 'learning_rate': '9.476e-07', 'epoch': '0.8645'}

 86%|████████▋ | 32820/37963 [78:44:58<14:34:30, 10.20s/it]
 86%|████████▋ | 32821/37963 [78:45:06<13:33:19,  9.49s/it]
 86%|████████▋ | 32822/37963 [78:45:14<12:43:34,  8.91s/it]
 86%|████████▋ | 32823/37963 [78:45:21<12:06:53,  8.49s/it]
 86%|████████▋ | 32824/37963 [78:45:29<11:41:52,  8.19s/it]
 86%|████████▋ | 32825/37963 [78:45:36<11:24:14,  7.99s/it]
 86%|████████▋ | 32826/37963 [78:45:44<11:14:10,  7.87s/it]
 86%|████████▋ | 32827/37963 [78:45:51<10:59:01,  7.70s/it]
 86%|████████▋ | 32828/37963 [78:45:59<10:53:52,  7.64s/it]
 86%|████████▋ | 32829/37963 [78:46:06<10:54:18,  7.65s/it]
 86%|████████▋ | 32830/37963 [78:46:20<13:35:40,  9.53s/it]
                                                           
{'loss': '0.08975', 'grad_norm': '4.983', 'learning_rate': '9.44e-07', 'epoch': '0.8648'}

 86%|████████▋ | 32830/37963 [78:46:20<13:35:40,  9.53s/it]
 86%|████████▋ | 32831/37963 [78:46:28<12:46:04,  8.96s/it]
 86%|████████▋ | 32832/37963 [78:46:48<17:31:35, 12.30s/it]
 86%|████████▋ | 32833/37963 [78:46:56<15:30:37, 10.88s/it]
 86%|████████▋ | 32834/37963 [78:47:10<16:52:40, 11.85s/it]
 86%|████████▋ | 32835/37963 [78:47:17<15:03:56, 10.58s/it]
 86%|████████▋ | 32836/37963 [78:47:31<16:29:07, 11.58s/it]
 86%|████████▋ | 32837/37963 [78:47:39<14:47:02, 10.38s/it]
 87%|████████▋ | 32838/37963 [78:47:46<13:30:48,  9.49s/it]
 87%|████████▋ | 32839/37963 [78:47:54<12:43:30,  8.94s/it]
 87%|████████▋ | 32840/37963 [78:48:01<12:06:06,  8.50s/it]
                                                           
{'loss': '0.09127', 'grad_norm': '3.122', 'learning_rate': '9.404e-07', 'epoch': '0.8651'}

 87%|████████▋ | 32840/37963 [78:48:01<12:06:06,  8.50s/it]
 87%|████████▋ | 32841/37963 [78:48:09<11:41:04,  8.21s/it]
 87%|████████▋ | 32842/37963 [78:48:16<11:24:43,  8.02s/it]
 87%|████████▋ | 32843/37963 [78:48:24<11:07:36,  7.82s/it]
 87%|████████▋ | 32844/37963 [78:48:31<10:59:47,  7.73s/it]
 87%|████████▋ | 32845/37963 [78:48:39<10:52:53,  7.65s/it]
 87%|████████▋ | 32846/37963 [78:48:46<10:48:37,  7.61s/it]
 87%|████████▋ | 32847/37963 [78:48:54<10:45:39,  7.57s/it]
 87%|████████▋ | 32848/37963 [78:49:01<10:44:07,  7.56s/it]
 87%|████████▋ | 32849/37963 [78:49:09<10:44:20,  7.56s/it]
 87%|████████▋ | 32850/37963 [78:49:17<10:46:35,  7.59s/it]
                                                           
{'loss': '0.1003', 'grad_norm': '3.65', 'learning_rate': '9.368e-07', 'epoch': '0.8653'}

 87%|████████▋ | 32850/37963 [78:49:17<10:46:35,  7.59s/it]
 87%|████████▋ | 32851/37963 [78:49:30<13:25:36,  9.46s/it]
 87%|████████▋ | 32852/37963 [78:49:38<12:39:29,  8.92s/it]
 87%|████████▋ | 32853/37963 [78:49:45<12:01:41,  8.47s/it]
 87%|████████▋ | 32854/37963 [78:49:53<11:33:44,  8.15s/it]
 87%|████████▋ | 32855/37963 [78:50:01<11:22:37,  8.02s/it]
 87%|████████▋ | 32856/37963 [78:50:08<11:13:52,  7.92s/it]
 87%|████████▋ | 32857/37963 [78:50:16<11:05:57,  7.83s/it]
 87%|████████▋ | 32858/37963 [78:50:23<10:58:39,  7.74s/it]
 87%|████████▋ | 32859/37963 [78:50:31<10:54:07,  7.69s/it]
 87%|████████▋ | 32860/37963 [78:50:39<10:54:30,  7.70s/it]
                                                           
{'loss': '0.09931', 'grad_norm': '2.691', 'learning_rate': '9.332e-07', 'epoch': '0.8656'}

 87%|████████▋ | 32860/37963 [78:50:39<10:54:30,  7.70s/it]
 87%|████████▋ | 32861/37963 [78:50:46<10:50:23,  7.65s/it]
 87%|████████▋ | 32862/37963 [78:50:54<10:49:55,  7.64s/it]
 87%|████████▋ | 32863/37963 [78:51:02<10:49:32,  7.64s/it]
 87%|████████▋ | 32864/37963 [78:51:15<13:19:37,  9.41s/it]
 87%|████████▋ | 32865/37963 [78:51:23<12:32:48,  8.86s/it]
 87%|████████▋ | 32866/37963 [78:51:30<11:58:53,  8.46s/it]
 87%|████████▋ | 32867/37963 [78:51:38<11:37:23,  8.21s/it]
 87%|████████▋ | 32868/37963 [78:51:52<14:05:06,  9.95s/it]
 87%|████████▋ | 32869/37963 [78:51:59<13:04:21,  9.24s/it]
 87%|████████▋ | 32870/37963 [78:52:07<12:20:44,  8.73s/it]
                                                           
{'loss': '0.08624', 'grad_norm': '2.751', 'learning_rate': '9.296e-07', 'epoch': '0.8658'}

 87%|████████▋ | 32870/37963 [78:52:07<12:20:44,  8.73s/it]
 87%|████████▋ | 32871/37963 [78:52:14<11:50:32,  8.37s/it]
 87%|████████▋ | 32872/37963 [78:52:22<11:31:23,  8.15s/it]
 87%|████████▋ | 32873/37963 [78:52:30<11:18:16,  8.00s/it]
 87%|████████▋ | 32874/37963 [78:52:37<11:08:23,  7.88s/it]
 87%|████████▋ | 32875/37963 [78:52:45<11:03:57,  7.83s/it]
 87%|████████▋ | 32876/37963 [78:52:53<10:57:08,  7.75s/it]
 87%|████████▋ | 32877/37963 [78:53:00<10:50:29,  7.67s/it]
 87%|████████▋ | 32878/37963 [78:53:14<13:30:24,  9.56s/it]
 87%|████████▋ | 32879/37963 [78:53:22<12:41:47,  8.99s/it]
 87%|████████▋ | 32880/37963 [78:53:29<12:05:50,  8.57s/it]
                                                           
{'loss': '0.08358', 'grad_norm': '3.211', 'learning_rate': '9.26e-07', 'epoch': '0.8661'}

 87%|████████▋ | 32880/37963 [78:53:29<12:05:50,  8.57s/it]
 87%|████████▋ | 32881/37963 [78:53:37<11:37:53,  8.24s/it]
 87%|████████▋ | 32882/37963 [78:53:51<14:10:31, 10.04s/it]
 87%|████████▋ | 32883/37963 [78:54:11<18:30:06, 13.11s/it]
 87%|████████▋ | 32884/37963 [78:54:19<16:01:11, 11.35s/it]
 87%|████████▋ | 32885/37963 [78:54:26<14:23:23, 10.20s/it]
 87%|████████▋ | 32886/37963 [78:54:40<15:56:04, 11.30s/it]
 87%|████████▋ | 32887/37963 [78:54:47<14:15:39, 10.11s/it]
 87%|████████▋ | 32888/37963 [78:54:55<13:08:03,  9.32s/it]
 87%|████████▋ | 32889/37963 [78:55:02<12:20:30,  8.76s/it]
 87%|████████▋ | 32890/37963 [78:55:10<11:53:13,  8.44s/it]
                                                           
{'loss': '0.08719', 'grad_norm': '2.95', 'learning_rate': '9.224e-07', 'epoch': '0.8664'}

 87%|████████▋ | 32890/37963 [78:55:10<11:53:13,  8.44s/it]
 87%|████████▋ | 32891/37963 [78:55:17<11:31:11,  8.18s/it]
 87%|████████▋ | 32892/37963 [78:55:25<11:09:36,  7.92s/it]
 87%|████████▋ | 32893/37963 [78:55:32<10:54:29,  7.75s/it]
 87%|████████▋ | 32894/37963 [78:55:40<10:50:24,  7.70s/it]
 87%|████████▋ | 32895/37963 [78:55:54<13:34:15,  9.64s/it]
 87%|████████▋ | 32896/37963 [78:56:01<12:41:33,  9.02s/it]
 87%|████████▋ | 32897/37963 [78:56:09<12:05:53,  8.60s/it]
 87%|████████▋ | 32898/37963 [78:56:16<11:35:59,  8.24s/it]
 87%|████████▋ | 32899/37963 [78:56:24<11:20:58,  8.07s/it]
 87%|████████▋ | 32900/37963 [78:56:32<11:11:08,  7.95s/it]
                                                           
{'loss': '0.08136', 'grad_norm': '2.428', 'learning_rate': '9.188e-07', 'epoch': '0.8666'}

 87%|████████▋ | 32900/37963 [78:56:32<11:11:08,  7.95s/it]
 87%|████████▋ | 32901/37963 [78:56:39<11:00:39,  7.83s/it]
 87%|████████▋ | 32902/37963 [78:56:47<10:53:23,  7.75s/it]
 87%|████████▋ | 32903/37963 [78:56:54<10:46:16,  7.66s/it]
 87%|████████▋ | 32904/37963 [78:57:02<10:42:53,  7.62s/it]
 87%|████████▋ | 32905/37963 [78:57:09<10:41:42,  7.61s/it]
 87%|████████▋ | 32906/37963 [78:57:17<10:40:30,  7.60s/it]
 87%|████████▋ | 32907/37963 [78:57:25<10:39:36,  7.59s/it]
 87%|████████▋ | 32908/37963 [78:57:32<10:34:04,  7.53s/it]
 87%|████████▋ | 32909/37963 [78:57:39<10:32:56,  7.51s/it]
 87%|████████▋ | 32910/37963 [78:57:47<10:34:26,  7.53s/it]
                                                           
{'loss': '0.08043', 'grad_norm': '2.584', 'learning_rate': '9.152e-07', 'epoch': '0.8669'}

 87%|████████▋ | 32910/37963 [78:57:47<10:34:26,  7.53s/it]
 87%|████████▋ | 32911/37963 [78:57:54<10:31:48,  7.50s/it]
 87%|████████▋ | 32912/37963 [78:58:02<10:29:06,  7.47s/it]
 87%|████████▋ | 32913/37963 [78:58:09<10:23:43,  7.41s/it]
 87%|████████▋ | 32914/37963 [78:58:23<13:04:37,  9.32s/it]
 87%|████████▋ | 32915/37963 [78:58:30<12:04:12,  8.61s/it]
 87%|████████▋ | 32916/37963 [78:58:37<11:28:18,  8.18s/it]
 87%|████████▋ | 32917/37963 [78:58:45<11:13:16,  8.01s/it]
 87%|████████▋ | 32918/37963 [78:58:52<11:02:16,  7.88s/it]
 87%|████████▋ | 32919/37963 [78:59:00<10:52:51,  7.77s/it]
 87%|████████▋ | 32920/37963 [78:59:14<13:26:01,  9.59s/it]
                                                           
{'loss': '0.0938', 'grad_norm': '3.03', 'learning_rate': '9.117e-07', 'epoch': '0.8672'}

 87%|████████▋ | 32920/37963 [78:59:14<13:26:01,  9.59s/it]
 87%|████████▋ | 32921/37963 [78:59:21<12:31:57,  8.95s/it]
 87%|████████▋ | 32922/37963 [78:59:28<11:53:58,  8.50s/it]
 87%|████████▋ | 32923/37963 [78:59:36<11:28:10,  8.19s/it]
 87%|████████▋ | 32924/37963 [78:59:44<11:11:41,  8.00s/it]
 87%|████████▋ | 32925/37963 [78:59:51<10:59:47,  7.86s/it]
 87%|████████▋ | 32926/37963 [78:59:59<10:51:36,  7.76s/it]
 87%|████████▋ | 32927/37963 [79:00:13<13:33:23,  9.69s/it]
 87%|████████▋ | 32928/37963 [79:00:20<12:43:06,  9.09s/it]
 87%|████████▋ | 32929/37963 [79:00:28<12:05:05,  8.64s/it]
 87%|████████▋ | 32930/37963 [79:00:36<11:36:41,  8.31s/it]
                                                           
{'loss': '0.08826', 'grad_norm': '2.47', 'learning_rate': '9.081e-07', 'epoch': '0.8674'}

 87%|████████▋ | 32930/37963 [79:00:36<11:36:41,  8.31s/it]
 87%|████████▋ | 32931/37963 [79:00:50<13:59:34, 10.01s/it]
 87%|████████▋ | 32932/37963 [79:00:57<12:58:05,  9.28s/it]
 87%|████████▋ | 32933/37963 [79:01:18<17:47:23, 12.73s/it]
 87%|████████▋ | 32934/37963 [79:01:35<19:43:42, 14.12s/it]
 87%|████████▋ | 32935/37963 [79:01:43<16:56:08, 12.13s/it]
 87%|████████▋ | 32936/37963 [79:01:50<15:03:31, 10.78s/it]
 87%|████████▋ | 32937/37963 [79:01:58<13:41:10,  9.80s/it]
 87%|████████▋ | 32938/37963 [79:02:05<12:41:30,  9.09s/it]
 87%|████████▋ | 32939/37963 [79:02:13<11:58:05,  8.58s/it]
 87%|████████▋ | 32940/37963 [79:02:20<11:29:56,  8.24s/it]
                                                           
{'loss': '0.09444', 'grad_norm': '2.609', 'learning_rate': '9.046e-07', 'epoch': '0.8677'}

 87%|████████▋ | 32940/37963 [79:02:20<11:29:56,  8.24s/it]
 87%|████████▋ | 32941/37963 [79:02:27<11:04:52,  7.94s/it]
 87%|████████▋ | 32942/37963 [79:02:35<10:52:41,  7.80s/it]
 87%|████████▋ | 32943/37963 [79:02:43<10:47:01,  7.73s/it]
 87%|████████▋ | 32944/37963 [79:02:50<10:42:23,  7.68s/it]
 87%|████████▋ | 32945/37963 [79:03:04<13:24:25,  9.62s/it]
 87%|████████▋ | 32946/37963 [79:03:12<12:30:33,  8.98s/it]
 87%|████████▋ | 32947/37963 [79:03:19<11:53:44,  8.54s/it]
 87%|████████▋ | 32948/37963 [79:03:27<11:29:01,  8.24s/it]
 87%|████████▋ | 32949/37963 [79:03:34<11:13:44,  8.06s/it]
 87%|████████▋ | 32950/37963 [79:03:42<11:03:46,  7.94s/it]
                                                           
{'loss': '0.09817', 'grad_norm': '2.576', 'learning_rate': '9.01e-07', 'epoch': '0.868'}

 87%|████████▋ | 32950/37963 [79:03:42<11:03:46,  7.94s/it]
 87%|████████▋ | 32951/37963 [79:03:49<10:49:45,  7.78s/it]
 87%|████████▋ | 32952/37963 [79:03:57<10:46:50,  7.74s/it]
 87%|████████▋ | 32953/37963 [79:04:04<10:35:06,  7.61s/it]
 87%|████████▋ | 32954/37963 [79:04:12<10:33:32,  7.59s/it]
 87%|████████▋ | 32955/37963 [79:04:20<10:33:30,  7.59s/it]
 87%|████████▋ | 32956/37963 [79:04:27<10:32:21,  7.58s/it]
 87%|████████▋ | 32957/37963 [79:04:35<10:30:40,  7.56s/it]
 87%|████████▋ | 32958/37963 [79:04:42<10:31:21,  7.57s/it]
 87%|████████▋ | 32959/37963 [79:04:50<10:27:26,  7.52s/it]
 87%|████████▋ | 32960/37963 [79:04:57<10:28:55,  7.54s/it]
                                                           
{'loss': '0.1056', 'grad_norm': '2.943', 'learning_rate': '8.975e-07', 'epoch': '0.8682'}

 87%|████████▋ | 32960/37963 [79:04:57<10:28:55,  7.54s/it]
 87%|████████▋ | 32961/37963 [79:05:05<10:31:32,  7.58s/it]
 87%|████████▋ | 32962/37963 [79:05:12<10:24:24,  7.49s/it]
 87%|████████▋ | 32963/37963 [79:05:20<10:24:06,  7.49s/it]
 87%|████████▋ | 32964/37963 [79:05:27<10:29:37,  7.56s/it]
 87%|████████▋ | 32965/37963 [79:05:35<10:27:22,  7.53s/it]
 87%|████████▋ | 32966/37963 [79:05:42<10:26:34,  7.52s/it]
 87%|████████▋ | 32967/37963 [79:05:50<10:27:46,  7.54s/it]
 87%|████████▋ | 32968/37963 [79:06:04<13:06:22,  9.45s/it]
 87%|████████▋ | 32969/37963 [79:06:18<15:00:47, 10.82s/it]
 87%|████████▋ | 32970/37963 [79:06:25<13:40:13,  9.86s/it]
                                                           
{'loss': '0.1004', 'grad_norm': '3.631', 'learning_rate': '8.94e-07', 'epoch': '0.8685'}

 87%|████████▋ | 32970/37963 [79:06:25<13:40:13,  9.86s/it]
 87%|████████▋ | 32971/37963 [79:06:33<12:45:34,  9.20s/it]
 87%|████████▋ | 32972/37963 [79:06:41<12:10:12,  8.78s/it]
 87%|████████▋ | 32973/37963 [79:06:48<11:36:22,  8.37s/it]
 87%|████████▋ | 32974/37963 [79:06:56<11:18:26,  8.16s/it]
 87%|████████▋ | 32975/37963 [79:07:10<13:49:11,  9.97s/it]
 87%|████████▋ | 32976/37963 [79:07:18<12:43:27,  9.19s/it]
 87%|████████▋ | 32977/37963 [79:07:33<15:14:25, 11.00s/it]
 87%|████████▋ | 32978/37963 [79:07:40<13:48:05,  9.97s/it]
 87%|████████▋ | 32979/37963 [79:07:48<12:52:14,  9.30s/it]
 87%|████████▋ | 32980/37963 [79:08:02<14:52:50, 10.75s/it]
                                                           
{'loss': '0.08032', 'grad_norm': '2.546', 'learning_rate': '8.905e-07', 'epoch': '0.8687'}

 87%|████████▋ | 32980/37963 [79:08:02<14:52:50, 10.75s/it]
 87%|████████▋ | 32981/37963 [79:08:23<18:52:35, 13.64s/it]
 87%|████████▋ | 32982/37963 [79:08:30<16:23:32, 11.85s/it]
 87%|████████▋ | 32983/37963 [79:08:38<14:36:30, 10.56s/it]
 87%|████████▋ | 32984/37963 [79:08:45<13:20:59,  9.65s/it]
 87%|████████▋ | 32985/37963 [79:08:53<12:22:28,  8.95s/it]
 87%|████████▋ | 32986/37963 [79:09:00<11:46:31,  8.52s/it]
 87%|████████▋ | 32987/37963 [79:09:08<11:24:44,  8.26s/it]
 87%|████████▋ | 32988/37963 [79:09:15<11:08:22,  8.06s/it]
 87%|████████▋ | 32989/37963 [79:09:23<10:58:10,  7.94s/it]
 87%|████████▋ | 32990/37963 [79:09:31<10:47:47,  7.82s/it]
                                                           
{'loss': '0.08482', 'grad_norm': '2.304', 'learning_rate': '8.869e-07', 'epoch': '0.869'}

 87%|████████▋ | 32990/37963 [79:09:31<10:47:47,  7.82s/it]
 87%|████████▋ | 32991/37963 [79:09:38<10:41:06,  7.74s/it]
 87%|████████▋ | 32992/37963 [79:09:46<10:35:30,  7.67s/it]
 87%|████████▋ | 32993/37963 [79:09:53<10:29:19,  7.60s/it]
 87%|████████▋ | 32994/37963 [79:10:00<10:22:53,  7.52s/it]
 87%|████████▋ | 32995/37963 [79:10:15<13:08:35,  9.52s/it]
 87%|████████▋ | 32996/37963 [79:10:22<12:14:05,  8.87s/it]
 87%|████████▋ | 32997/37963 [79:10:30<11:41:28,  8.48s/it]
 87%|████████▋ | 32998/37963 [79:10:37<11:19:27,  8.21s/it]
 87%|████████▋ | 32999/37963 [79:10:45<11:02:12,  8.00s/it]
 87%|████████▋ | 33000/37963 [79:10:52<10:51:29,  7.88s/it]
                                                           
{'loss': '0.09782', 'grad_norm': '2.479', 'learning_rate': '8.834e-07', 'epoch': '0.8693'}

 87%|████████▋ | 33000/37963 [79:10:52<10:51:29,  7.88s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.91s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.91s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 87%|████████▋ | 33001/37963 [79:11:51<31:57:59, 23.19s/it]
 87%|████████▋ | 33002/37963 [79:11:59<25:27:09, 18.47s/it]
 87%|████████▋ | 33003/37963 [79:12:06<20:49:44, 15.12s/it]
 87%|████████▋ | 33004/37963 [79:12:13<17:41:30, 12.84s/it]
 87%|████████▋ | 33005/37963 [79:12:21<15:31:08, 11.27s/it]
 87%|████████▋ | 33006/37963 [79:12:28<13:53:03, 10.08s/it]
 87%|████████▋ | 33007/37963 [79:12:36<12:47:22,  9.29s/it]
 87%|████████▋ | 33008/37963 [79:12:43<12:02:21,  8.75s/it]
 87%|████████▋ | 33009/37963 [79:12:51<11:29:11,  8.35s/it]
 87%|████████▋ | 33010/37963 [79:12:58<11:06:21,  8.07s/it]
                                                           
{'loss': '0.09236', 'grad_norm': '2.364', 'learning_rate': '8.799e-07', 'epoch': '0.8695'}

 87%|████████▋ | 33010/37963 [79:12:58<11:06:21,  8.07s/it]
 87%|████████▋ | 33011/37963 [79:13:06<10:54:38,  7.93s/it]
 87%|████████▋ | 33012/37963 [79:13:13<10:46:12,  7.83s/it]
 87%|████████▋ | 33013/37963 [79:13:21<10:37:42,  7.73s/it]
 87%|████████▋ | 33014/37963 [79:13:28<10:31:20,  7.65s/it]
 87%|████████▋ | 33015/37963 [79:13:42<13:05:32,  9.53s/it]
 87%|████████▋ | 33016/37963 [79:13:50<12:14:26,  8.91s/it]
 87%|████████▋ | 33017/37963 [79:13:57<11:42:49,  8.53s/it]
 87%|████████▋ | 33018/37963 [79:14:05<11:18:30,  8.23s/it]
 87%|████████▋ | 33019/37963 [79:14:12<10:54:06,  7.94s/it]
 87%|████████▋ | 33020/37963 [79:14:33<16:24:03, 11.94s/it]
                                                           
{'loss': '0.09265', 'grad_norm': '2.258', 'learning_rate': '8.764e-07', 'epoch': '0.8698'}

 87%|████████▋ | 33020/37963 [79:14:33<16:24:03, 11.94s/it]
 87%|████████▋ | 33021/37963 [79:14:41<14:40:44, 10.69s/it]
 87%|████████▋ | 33022/37963 [79:14:49<13:24:08,  9.76s/it]
 87%|████████▋ | 33023/37963 [79:14:56<12:27:47,  9.08s/it]
 87%|████████▋ | 33024/37963 [79:15:04<11:48:27,  8.61s/it]
 87%|████████▋ | 33025/37963 [79:15:24<16:39:38, 12.15s/it]
 87%|████████▋ | 33026/37963 [79:15:32<14:48:05, 10.79s/it]
 87%|████████▋ | 33027/37963 [79:15:39<13:27:16,  9.81s/it]
 87%|████████▋ | 33028/37963 [79:15:53<15:08:45, 11.05s/it]
 87%|████████▋ | 33029/37963 [79:16:07<16:19:10, 11.91s/it]
 87%|████████▋ | 33030/37963 [79:16:15<14:34:25, 10.64s/it]
                                                           
{'loss': '0.09438', 'grad_norm': '3.299', 'learning_rate': '8.729e-07', 'epoch': '0.8701'}

 87%|████████▋ | 33030/37963 [79:16:15<14:34:25, 10.64s/it]
 87%|████████▋ | 33031/37963 [79:16:22<13:20:35,  9.74s/it]
 87%|████████▋ | 33032/37963 [79:16:30<12:27:43,  9.10s/it]
 87%|████████▋ | 33033/37963 [79:16:38<11:51:02,  8.65s/it]
 87%|████████▋ | 33034/37963 [79:16:45<11:21:49,  8.30s/it]
 87%|████████▋ | 33035/37963 [79:16:53<11:01:07,  8.05s/it]
 87%|████████▋ | 33036/37963 [79:17:00<10:49:18,  7.91s/it]
 87%|████████▋ | 33037/37963 [79:17:08<10:40:00,  7.80s/it]
 87%|████████▋ | 33038/37963 [79:17:15<10:33:24,  7.72s/it]
 87%|████████▋ | 33039/37963 [79:17:23<10:30:29,  7.68s/it]
 87%|████████▋ | 33040/37963 [79:17:30<10:28:57,  7.67s/it]
                                                           
{'loss': '0.09034', 'grad_norm': '2.622', 'learning_rate': '8.695e-07', 'epoch': '0.8703'}

 87%|████████▋ | 33040/37963 [79:17:30<10:28:57,  7.67s/it]
 87%|████████▋ | 33041/37963 [79:17:38<10:24:37,  7.61s/it]
 87%|████████▋ | 33042/37963 [79:17:45<10:14:17,  7.49s/it]
 87%|████████▋ | 33043/37963 [79:17:59<12:50:31,  9.40s/it]
 87%|████████▋ | 33044/37963 [79:18:07<12:04:18,  8.83s/it]
 87%|████████▋ | 33045/37963 [79:18:14<11:31:13,  8.43s/it]
 87%|████████▋ | 33046/37963 [79:18:21<11:03:19,  8.09s/it]
 87%|████████▋ | 33047/37963 [79:18:29<10:41:57,  7.84s/it]
 87%|████████▋ | 33048/37963 [79:18:36<10:33:23,  7.73s/it]
 87%|████████▋ | 33049/37963 [79:18:43<10:25:26,  7.64s/it]
 87%|████████▋ | 33050/37963 [79:18:51<10:23:29,  7.61s/it]
                                                           
{'loss': '0.09435', 'grad_norm': '3.365', 'learning_rate': '8.66e-07', 'epoch': '0.8706'}

 87%|████████▋ | 33050/37963 [79:18:51<10:23:29,  7.61s/it]
 87%|████████▋ | 33051/37963 [79:18:58<10:17:38,  7.54s/it]
 87%|████████▋ | 33052/37963 [79:19:06<10:18:04,  7.55s/it]
 87%|████████▋ | 33053/37963 [79:19:14<10:19:09,  7.57s/it]
 87%|████████▋ | 33054/37963 [79:19:21<10:17:00,  7.54s/it]
 87%|████████▋ | 33055/37963 [79:19:28<10:12:11,  7.48s/it]
 87%|████████▋ | 33056/37963 [79:19:36<10:13:40,  7.50s/it]
 87%|████████▋ | 33057/37963 [79:19:44<10:15:23,  7.53s/it]
 87%|████████▋ | 33058/37963 [79:19:51<10:15:37,  7.53s/it]
 87%|████████▋ | 33059/37963 [79:20:06<13:09:50,  9.66s/it]
 87%|████████▋ | 33060/37963 [79:20:13<12:21:07,  9.07s/it]
                                                           
{'loss': '0.08284', 'grad_norm': '2.303', 'learning_rate': '8.625e-07', 'epoch': '0.8709'}

 87%|████████▋ | 33060/37963 [79:20:13<12:21:07,  9.07s/it]
 87%|████████▋ | 33061/37963 [79:20:21<11:44:44,  8.63s/it]
 87%|████████▋ | 33062/37963 [79:20:29<11:19:42,  8.32s/it]
 87%|████████▋ | 33063/37963 [79:20:36<11:00:42,  8.09s/it]
 87%|████████▋ | 33064/37963 [79:20:43<10:40:13,  7.84s/it]
 87%|████████▋ | 33065/37963 [79:20:51<10:32:05,  7.74s/it]
 87%|████████▋ | 33066/37963 [79:20:58<10:25:31,  7.66s/it]
 87%|████████▋ | 33067/37963 [79:21:12<12:55:47,  9.51s/it]
 87%|████████▋ | 33068/37963 [79:21:20<12:12:09,  8.97s/it]
 87%|████████▋ | 33069/37963 [79:21:34<14:14:23, 10.47s/it]
 87%|████████▋ | 33070/37963 [79:21:42<13:04:05,  9.61s/it]
                                                           
{'loss': '0.0928', 'grad_norm': '3.262', 'learning_rate': '8.59e-07', 'epoch': '0.8711'}

 87%|████████▋ | 33070/37963 [79:21:42<13:04:05,  9.61s/it]
 87%|████████▋ | 33071/37963 [79:21:49<12:16:05,  9.03s/it]
 87%|████████▋ | 33072/37963 [79:21:57<11:35:08,  8.53s/it]
 87%|████████▋ | 33073/37963 [79:22:04<11:09:45,  8.22s/it]
 87%|████████▋ | 33074/37963 [79:22:18<13:38:29, 10.04s/it]
 87%|████████▋ | 33075/37963 [79:22:26<12:34:04,  9.26s/it]
 87%|████████▋ | 33076/37963 [79:22:33<11:51:25,  8.73s/it]
 87%|████████▋ | 33077/37963 [79:22:47<14:04:32, 10.37s/it]
 87%|████████▋ | 33078/37963 [79:23:01<15:32:12, 11.45s/it]
 87%|████████▋ | 33079/37963 [79:23:09<13:59:52, 10.32s/it]
 87%|████████▋ | 33080/37963 [79:23:17<12:52:49,  9.50s/it]
                                                           
{'loss': '0.09194', 'grad_norm': '2.759', 'learning_rate': '8.556e-07', 'epoch': '0.8714'}

 87%|████████▋ | 33080/37963 [79:23:17<12:52:49,  9.50s/it]
 87%|████████▋ | 33081/37963 [79:23:24<12:04:59,  8.91s/it]
 87%|████████▋ | 33082/37963 [79:23:32<11:30:28,  8.49s/it]
 87%|████████▋ | 33083/37963 [79:23:39<11:10:08,  8.24s/it]
 87%|████████▋ | 33084/37963 [79:23:47<10:45:28,  7.94s/it]
 87%|████████▋ | 33085/37963 [79:23:54<10:36:01,  7.82s/it]
 87%|████████▋ | 33086/37963 [79:24:02<10:30:14,  7.75s/it]
 87%|████████▋ | 33087/37963 [79:24:16<13:01:38,  9.62s/it]
 87%|████████▋ | 33088/37963 [79:24:23<12:05:19,  8.93s/it]
 87%|████████▋ | 33089/37963 [79:24:31<11:29:59,  8.49s/it]
 87%|████████▋ | 33090/37963 [79:24:38<11:03:31,  8.17s/it]
                                                           
{'loss': '0.09571', 'grad_norm': '2.324', 'learning_rate': '8.521e-07', 'epoch': '0.8716'}

 87%|████████▋ | 33090/37963 [79:24:38<11:03:31,  8.17s/it]
 87%|████████▋ | 33091/37963 [79:24:46<10:47:32,  7.97s/it]
 87%|████████▋ | 33092/37963 [79:24:53<10:36:28,  7.84s/it]
 87%|████████▋ | 33093/37963 [79:25:00<10:23:35,  7.68s/it]
 87%|████████▋ | 33094/37963 [79:25:08<10:17:04,  7.60s/it]
 87%|████████▋ | 33095/37963 [79:25:15<10:17:24,  7.61s/it]
 87%|████████▋ | 33096/37963 [79:25:23<10:06:47,  7.48s/it]
 87%|████████▋ | 33097/37963 [79:25:30<10:08:17,  7.50s/it]
 87%|████████▋ | 33098/37963 [79:25:38<10:12:45,  7.56s/it]
 87%|████████▋ | 33099/37963 [79:25:45<10:11:12,  7.54s/it]
 87%|████████▋ | 33100/37963 [79:25:53<10:12:47,  7.56s/it]
                                                           
{'loss': '0.0855', 'grad_norm': '3.145', 'learning_rate': '8.487e-07', 'epoch': '0.8719'}

 87%|████████▋ | 33100/37963 [79:25:53<10:12:47,  7.56s/it]
 87%|████████▋ | 33101/37963 [79:26:00<10:09:40,  7.52s/it]
 87%|████████▋ | 33102/37963 [79:26:08<10:09:38,  7.52s/it]
 87%|████████▋ | 33103/37963 [79:26:22<12:48:25,  9.49s/it]
 87%|████████▋ | 33104/37963 [79:26:30<12:02:36,  8.92s/it]
 87%|████████▋ | 33105/37963 [79:26:37<11:27:16,  8.49s/it]
 87%|████████▋ | 33106/37963 [79:26:45<11:03:10,  8.19s/it]
 87%|████████▋ | 33107/37963 [79:26:52<10:42:13,  7.94s/it]
 87%|████████▋ | 33108/37963 [79:26:59<10:29:43,  7.78s/it]
 87%|████████▋ | 33109/37963 [79:27:07<10:22:45,  7.70s/it]
 87%|████████▋ | 33110/37963 [79:27:14<10:20:04,  7.67s/it]
                                                           
{'loss': '0.07902', 'grad_norm': '2.906', 'learning_rate': '8.453e-07', 'epoch': '0.8722'}

 87%|████████▋ | 33110/37963 [79:27:14<10:20:04,  7.67s/it]
 87%|████████▋ | 33111/37963 [79:27:22<10:19:38,  7.66s/it]
 87%|████████▋ | 33112/37963 [79:27:30<10:17:10,  7.63s/it]
 87%|████████▋ | 33113/37963 [79:27:37<10:12:23,  7.58s/it]
 87%|████████▋ | 33114/37963 [79:27:45<10:11:20,  7.56s/it]
 87%|████████▋ | 33115/37963 [79:27:52<10:09:37,  7.54s/it]
 87%|████████▋ | 33116/37963 [79:28:00<10:11:21,  7.57s/it]
 87%|████████▋ | 33117/37963 [79:28:14<12:48:56,  9.52s/it]
 87%|████████▋ | 33118/37963 [79:28:21<11:55:52,  8.87s/it]
 87%|████████▋ | 33119/37963 [79:28:29<11:23:49,  8.47s/it]
 87%|████████▋ | 33120/37963 [79:28:36<11:02:36,  8.21s/it]
                                                           
{'loss': '0.09458', 'grad_norm': '3.763', 'learning_rate': '8.418e-07', 'epoch': '0.8724'}

 87%|████████▋ | 33120/37963 [79:28:36<11:02:36,  8.21s/it]
 87%|████████▋ | 33121/37963 [79:28:50<13:18:20,  9.89s/it]
 87%|████████▋ | 33122/37963 [79:28:58<12:22:55,  9.21s/it]
 87%|████████▋ | 33123/37963 [79:29:12<14:22:54, 10.70s/it]
 87%|████████▋ | 33124/37963 [79:29:26<15:46:46, 11.74s/it]
 87%|████████▋ | 33125/37963 [79:29:34<14:04:14, 10.47s/it]
 87%|████████▋ | 33126/37963 [79:29:41<12:53:39,  9.60s/it]
 87%|████████▋ | 33127/37963 [79:29:49<12:03:07,  8.97s/it]
 87%|████████▋ | 33128/37963 [79:30:02<13:52:30, 10.33s/it]
 87%|████████▋ | 33129/37963 [79:30:10<12:48:52,  9.54s/it]
 87%|████████▋ | 33130/37963 [79:30:17<11:55:12,  8.88s/it]
                                                           
{'loss': '0.0927', 'grad_norm': '2.768', 'learning_rate': '8.384e-07', 'epoch': '0.8727'}

 87%|████████▋ | 33130/37963 [79:30:17<11:55:12,  8.88s/it]
 87%|████████▋ | 33131/37963 [79:30:31<13:49:44, 10.30s/it]
 87%|████████▋ | 33132/37963 [79:30:45<15:23:34, 11.47s/it]
 87%|████████▋ | 33133/37963 [79:30:52<13:44:52, 10.25s/it]
 87%|████████▋ | 33134/37963 [79:31:00<12:40:24,  9.45s/it]
 87%|████████▋ | 33135/37963 [79:31:07<11:51:55,  8.85s/it]
 87%|████████▋ | 33136/37963 [79:31:15<11:20:54,  8.46s/it]
 87%|████████▋ | 33137/37963 [79:31:23<11:03:23,  8.25s/it]
 87%|████████▋ | 33138/37963 [79:31:31<10:53:06,  8.12s/it]
 87%|████████▋ | 33139/37963 [79:31:38<10:38:11,  7.94s/it]
 87%|████████▋ | 33140/37963 [79:31:45<10:22:11,  7.74s/it]
                                                           
{'loss': '0.08282', 'grad_norm': '2.638', 'learning_rate': '8.35e-07', 'epoch': '0.873'}

 87%|████████▋ | 33140/37963 [79:31:45<10:22:11,  7.74s/it]
 87%|████████▋ | 33141/37963 [79:31:53<10:19:19,  7.71s/it]
 87%|████████▋ | 33142/37963 [79:32:00<10:12:36,  7.62s/it]
 87%|████████▋ | 33143/37963 [79:32:08<10:03:54,  7.52s/it]
 87%|████████▋ | 33144/37963 [79:32:15<10:04:57,  7.53s/it]
 87%|████████▋ | 33145/37963 [79:32:23<10:02:27,  7.50s/it]
 87%|████████▋ | 33146/37963 [79:32:30<9:57:38,  7.44s/it] 
 87%|████████▋ | 33147/37963 [79:32:38<10:01:20,  7.49s/it]
 87%|████████▋ | 33148/37963 [79:32:45<10:06:25,  7.56s/it]
 87%|████████▋ | 33149/37963 [79:32:53<10:06:13,  7.56s/it]
 87%|████████▋ | 33150/37963 [79:33:00<9:58:05,  7.46s/it] 
                                                          
{'loss': '0.1014', 'grad_norm': '2.602', 'learning_rate': '8.316e-07', 'epoch': '0.8732'}

 87%|████████▋ | 33150/37963 [79:33:00<9:58:05,  7.46s/it]
 87%|████████▋ | 33151/37963 [79:33:14<12:31:36,  9.37s/it]
 87%|████████▋ | 33152/37963 [79:33:22<11:49:36,  8.85s/it]
 87%|████████▋ | 33153/37963 [79:33:29<11:20:17,  8.49s/it]
 87%|████████▋ | 33154/37963 [79:33:37<10:56:08,  8.19s/it]
 87%|████████▋ | 33155/37963 [79:33:44<10:38:29,  7.97s/it]
 87%|████████▋ | 33156/37963 [79:33:52<10:27:30,  7.83s/it]
 87%|████████▋ | 33157/37963 [79:33:59<10:16:00,  7.69s/it]
 87%|████████▋ | 33158/37963 [79:34:07<10:12:26,  7.65s/it]
 87%|████████▋ | 33159/37963 [79:34:14<10:07:37,  7.59s/it]
 87%|████████▋ | 33160/37963 [79:34:22<10:06:14,  7.57s/it]
                                                           
{'loss': '0.09693', 'grad_norm': '2.572', 'learning_rate': '8.282e-07', 'epoch': '0.8735'}

 87%|████████▋ | 33160/37963 [79:34:22<10:06:14,  7.57s/it]
 87%|████████▋ | 33161/37963 [79:34:29<10:02:21,  7.53s/it]
 87%|████████▋ | 33162/37963 [79:34:36<10:02:47,  7.53s/it]
 87%|████████▋ | 33163/37963 [79:34:44<9:59:37,  7.50s/it] 
 87%|████████▋ | 33164/37963 [79:34:51<10:00:01,  7.50s/it]
 87%|████████▋ | 33165/37963 [79:35:12<15:06:22, 11.33s/it]
 87%|████████▋ | 33166/37963 [79:35:19<13:35:15, 10.20s/it]
 87%|████████▋ | 33167/37963 [79:35:27<12:32:28,  9.41s/it]
 87%|████████▋ | 33168/37963 [79:35:34<11:46:56,  8.85s/it]
 87%|████████▋ | 33169/37963 [79:35:42<11:16:39,  8.47s/it]
 87%|████████▋ | 33170/37963 [79:35:49<10:48:14,  8.11s/it]
                                                           
{'loss': '0.086', 'grad_norm': '2.587', 'learning_rate': '8.248e-07', 'epoch': '0.8737'}

 87%|████████▋ | 33170/37963 [79:35:49<10:48:14,  8.11s/it]
 87%|████████▋ | 33171/37963 [79:35:57<10:32:22,  7.92s/it]
 87%|████████▋ | 33172/37963 [79:36:11<13:00:31,  9.77s/it]
 87%|████████▋ | 33173/37963 [79:36:18<12:07:10,  9.11s/it]
 87%|████████▋ | 33174/37963 [79:36:26<11:26:53,  8.61s/it]
 87%|████████▋ | 33175/37963 [79:36:46<16:05:25, 12.10s/it]
 87%|████████▋ | 33176/37963 [79:36:54<14:15:16, 10.72s/it]
 87%|████████▋ | 33177/37963 [79:37:07<15:31:57, 11.68s/it]
 87%|████████▋ | 33178/37963 [79:37:15<13:44:30, 10.34s/it]
 87%|████████▋ | 33179/37963 [79:37:22<12:36:52,  9.49s/it]
 87%|████████▋ | 33180/37963 [79:37:30<11:52:40,  8.94s/it]
                                                           
{'loss': '0.0792', 'grad_norm': '2.676', 'learning_rate': '8.214e-07', 'epoch': '0.874'}

 87%|████████▋ | 33180/37963 [79:37:30<11:52:40,  8.94s/it]
 87%|████████▋ | 33181/37963 [79:37:44<13:49:19, 10.41s/it]
 87%|████████▋ | 33182/37963 [79:37:51<12:41:39,  9.56s/it]
 87%|████████▋ | 33183/37963 [79:37:59<11:52:10,  8.94s/it]
 87%|████████▋ | 33184/37963 [79:38:06<11:18:25,  8.52s/it]
 87%|████████▋ | 33185/37963 [79:38:14<10:52:37,  8.20s/it]
 87%|████████▋ | 33186/37963 [79:38:21<10:36:31,  7.99s/it]
 87%|████████▋ | 33187/37963 [79:38:29<10:31:48,  7.94s/it]
 87%|████████▋ | 33188/37963 [79:38:37<10:23:57,  7.84s/it]
 87%|████████▋ | 33189/37963 [79:38:44<10:18:50,  7.78s/it]
 87%|████████▋ | 33190/37963 [79:38:52<10:14:30,  7.72s/it]
                                                           
{'loss': '0.09355', 'grad_norm': '2.78', 'learning_rate': '8.18e-07', 'epoch': '0.8743'}

 87%|████████▋ | 33190/37963 [79:38:52<10:14:30,  7.72s/it]
 87%|████████▋ | 33191/37963 [79:38:59<10:10:26,  7.68s/it]
 87%|████████▋ | 33192/37963 [79:39:07<10:02:06,  7.57s/it]
 87%|████████▋ | 33193/37963 [79:39:14<10:03:40,  7.59s/it]
 87%|████████▋ | 33194/37963 [79:39:22<9:59:31,  7.54s/it] 
 87%|████████▋ | 33195/37963 [79:39:29<9:56:56,  7.51s/it]
 87%|████████▋ | 33196/37963 [79:39:37<9:57:58,  7.53s/it]
 87%|████████▋ | 33197/37963 [79:39:44<10:00:46,  7.56s/it]
 87%|████████▋ | 33198/37963 [79:39:52<9:58:57,  7.54s/it] 
 87%|████████▋ | 33199/37963 [79:40:06<12:30:02,  9.45s/it]
 87%|████████▋ | 33200/37963 [79:40:13<11:42:53,  8.85s/it]
                                                           
{'loss': '0.09206', 'grad_norm': '3.777', 'learning_rate': '8.146e-07', 'epoch': '0.8745'}

 87%|████████▋ | 33200/37963 [79:40:13<11:42:53,  8.85s/it]
 87%|████████▋ | 33201/37963 [79:40:21<11:13:23,  8.48s/it]
 87%|████████▋ | 33202/37963 [79:40:28<10:48:36,  8.17s/it]
 87%|████████▋ | 33203/37963 [79:40:36<10:32:52,  7.98s/it]
 87%|████████▋ | 33204/37963 [79:40:43<10:17:03,  7.78s/it]
 87%|████████▋ | 33205/37963 [79:40:51<10:06:14,  7.64s/it]
 87%|████████▋ | 33206/37963 [79:40:58<10:03:25,  7.61s/it]
 87%|████████▋ | 33207/37963 [79:41:06<10:01:34,  7.59s/it]
 87%|████████▋ | 33208/37963 [79:41:13<9:53:53,  7.49s/it] 
 87%|████████▋ | 33209/37963 [79:41:20<9:49:54,  7.45s/it]
 87%|████████▋ | 33210/37963 [79:41:28<9:50:44,  7.46s/it]
                                                          
{'loss': '0.08489', 'grad_norm': '3.737', 'learning_rate': '8.113e-07', 'epoch': '0.8748'}

 87%|████████▋ | 33210/37963 [79:41:28<9:50:44,  7.46s/it]
 87%|████████▋ | 33211/37963 [79:41:35<9:45:58,  7.40s/it]
 87%|████████▋ | 33212/37963 [79:41:42<9:47:22,  7.42s/it]
 87%|████████▋ | 33213/37963 [79:41:50<9:50:57,  7.46s/it]
 87%|████████▋ | 33214/37963 [79:41:58<9:52:45,  7.49s/it]
 87%|████████▋ | 33215/37963 [79:42:05<9:54:45,  7.52s/it]
 87%|████████▋ | 33216/37963 [79:42:13<9:55:35,  7.53s/it]
 87%|████████▋ | 33217/37963 [79:42:27<12:32:56,  9.52s/it]
 88%|████████▊ | 33218/37963 [79:42:41<14:16:15, 10.83s/it]
 88%|████████▊ | 33219/37963 [79:42:48<12:58:45,  9.85s/it]
 88%|████████▊ | 33220/37963 [79:42:56<12:02:54,  9.14s/it]
                                                           
{'loss': '0.08893', 'grad_norm': '2.478', 'learning_rate': '8.079e-07', 'epoch': '0.8751'}

 88%|████████▊ | 33220/37963 [79:42:56<12:02:54,  9.14s/it]
 88%|████████▊ | 33221/37963 [79:43:03<11:23:51,  8.65s/it]
 88%|████████▊ | 33222/37963 [79:43:24<16:13:17, 12.32s/it]
 88%|████████▊ | 33223/37963 [79:43:32<14:19:25, 10.88s/it]
 88%|████████▊ | 33224/37963 [79:43:39<12:59:24,  9.87s/it]
 88%|████████▊ | 33225/37963 [79:43:47<12:04:47,  9.18s/it]
 88%|████████▊ | 33226/37963 [79:43:54<11:28:21,  8.72s/it]
 88%|████████▊ | 33227/37963 [79:44:02<10:56:26,  8.32s/it]
 88%|████████▊ | 33228/37963 [79:44:16<13:06:08,  9.96s/it]
 88%|████████▊ | 33229/37963 [79:44:23<12:10:37,  9.26s/it]
 88%|████████▊ | 33230/37963 [79:44:31<11:32:26,  8.78s/it]
                                                           
{'loss': '0.08778', 'grad_norm': '2.939', 'learning_rate': '8.045e-07', 'epoch': '0.8753'}

 88%|████████▊ | 33230/37963 [79:44:31<11:32:26,  8.78s/it]
 88%|████████▊ | 33231/37963 [79:44:38<11:03:00,  8.41s/it]
 88%|████████▊ | 33232/37963 [79:44:46<10:37:35,  8.09s/it]
 88%|████████▊ | 33233/37963 [79:44:53<10:18:16,  7.84s/it]
 88%|████████▊ | 33234/37963 [79:45:01<10:10:01,  7.74s/it]
 88%|████████▊ | 33235/37963 [79:45:15<12:40:42,  9.65s/it]
 88%|████████▊ | 33236/37963 [79:45:22<11:52:07,  9.04s/it]
 88%|████████▊ | 33237/37963 [79:45:30<11:15:01,  8.57s/it]
 88%|████████▊ | 33238/37963 [79:45:37<10:44:29,  8.18s/it]
 88%|████████▊ | 33239/37963 [79:45:44<10:23:35,  7.92s/it]
 88%|████████▊ | 33240/37963 [79:45:52<10:12:15,  7.78s/it]
                                                           
{'loss': '0.09183', 'grad_norm': '4.216', 'learning_rate': '8.012e-07', 'epoch': '0.8756'}

 88%|████████▊ | 33240/37963 [79:45:52<10:12:15,  7.78s/it]
 88%|████████▊ | 33241/37963 [79:45:59<10:04:37,  7.68s/it]
 88%|████████▊ | 33242/37963 [79:46:07<10:01:37,  7.65s/it]
 88%|████████▊ | 33243/37963 [79:46:14<9:51:50,  7.52s/it] 
 88%|████████▊ | 33244/37963 [79:46:22<9:57:03,  7.59s/it]
 88%|████████▊ | 33245/37963 [79:46:29<9:54:56,  7.57s/it]
 88%|████████▊ | 33246/37963 [79:46:37<9:54:29,  7.56s/it]
 88%|████████▊ | 33247/37963 [79:46:44<9:50:41,  7.52s/it]
 88%|████████▊ | 33248/37963 [79:46:52<9:52:02,  7.53s/it]
 88%|████████▊ | 33249/37963 [79:46:59<9:51:11,  7.52s/it]
 88%|████████▊ | 33250/37963 [79:47:07<9:44:56,  7.45s/it]
                                                          
{'loss': '0.09114', 'grad_norm': '3.215', 'learning_rate': '7.979e-07', 'epoch': '0.8759'}

 88%|████████▊ | 33250/37963 [79:47:07<9:44:56,  7.45s/it]
 88%|████████▊ | 33251/37963 [79:47:21<12:19:00,  9.41s/it]
 88%|████████▊ | 33252/37963 [79:47:28<11:34:01,  8.84s/it]
 88%|████████▊ | 33253/37963 [79:47:36<11:02:54,  8.44s/it]
 88%|████████▊ | 33254/37963 [79:47:43<10:45:03,  8.22s/it]
 88%|████████▊ | 33255/37963 [79:47:50<10:19:22,  7.89s/it]
 88%|████████▊ | 33256/37963 [79:47:58<10:12:54,  7.81s/it]
 88%|████████▊ | 33257/37963 [79:48:05<10:00:19,  7.65s/it]
 88%|████████▊ | 33258/37963 [79:48:13<9:57:04,  7.61s/it] 
 88%|████████▊ | 33259/37963 [79:48:20<9:54:51,  7.59s/it]
 88%|████████▊ | 33260/37963 [79:48:28<9:48:32,  7.51s/it]
                                                          
{'loss': '0.08468', 'grad_norm': '2.417', 'learning_rate': '7.945e-07', 'epoch': '0.8761'}

 88%|████████▊ | 33260/37963 [79:48:28<9:48:32,  7.51s/it]
 88%|████████▊ | 33261/37963 [79:48:35<9:45:35,  7.47s/it]
 88%|████████▊ | 33262/37963 [79:48:43<9:48:03,  7.51s/it]
 88%|████████▊ | 33263/37963 [79:48:50<9:48:14,  7.51s/it]
 88%|████████▊ | 33264/37963 [79:48:58<9:48:02,  7.51s/it]
 88%|████████▊ | 33265/37963 [79:49:12<12:21:27,  9.47s/it]
 88%|████████▊ | 33266/37963 [79:49:26<14:01:55, 10.75s/it]
 88%|████████▊ | 33267/37963 [79:49:39<15:10:05, 11.63s/it]
 88%|████████▊ | 33268/37963 [79:49:53<16:09:07, 12.38s/it]
 88%|████████▊ | 33269/37963 [79:50:01<14:14:38, 10.92s/it]
 88%|████████▊ | 33270/37963 [79:50:08<12:57:03,  9.93s/it]
                                                           
{'loss': '0.07963', 'grad_norm': '2.282', 'learning_rate': '7.912e-07', 'epoch': '0.8764'}

 88%|████████▊ | 33270/37963 [79:50:08<12:57:03,  9.93s/it]
 88%|████████▊ | 33271/37963 [79:50:22<14:30:35, 11.13s/it]
 88%|████████▊ | 33272/37963 [79:50:30<13:07:03, 10.07s/it]
 88%|████████▊ | 33273/37963 [79:50:38<12:08:34,  9.32s/it]
 88%|████████▊ | 33274/37963 [79:50:45<11:24:57,  8.76s/it]
 88%|████████▊ | 33275/37963 [79:50:53<10:55:26,  8.39s/it]
 88%|████████▊ | 33276/37963 [79:51:00<10:36:50,  8.15s/it]
 88%|████████▊ | 33277/37963 [79:51:08<10:22:56,  7.98s/it]
 88%|████████▊ | 33278/37963 [79:51:15<10:12:47,  7.85s/it]
 88%|████████▊ | 33279/37963 [79:51:23<10:04:21,  7.74s/it]
 88%|████████▊ | 33280/37963 [79:51:30<9:58:34,  7.67s/it] 
                                                          
{'loss': '0.0891', 'grad_norm': '2.806', 'learning_rate': '7.879e-07', 'epoch': '0.8766'}

 88%|████████▊ | 33280/37963 [79:51:30<9:58:34,  7.67s/it]
 88%|████████▊ | 33281/37963 [79:51:38<9:55:03,  7.63s/it]
 88%|████████▊ | 33282/37963 [79:51:45<9:55:20,  7.63s/it]
 88%|████████▊ | 33283/37963 [79:51:59<12:25:50,  9.56s/it]
 88%|████████▊ | 33284/37963 [79:52:07<11:41:21,  8.99s/it]
 88%|████████▊ | 33285/37963 [79:52:15<11:07:29,  8.56s/it]
 88%|████████▊ | 33286/37963 [79:52:22<10:34:52,  8.14s/it]
 88%|████████▊ | 33287/37963 [79:52:29<10:13:44,  7.88s/it]
 88%|████████▊ | 33288/37963 [79:52:37<10:04:38,  7.76s/it]
 88%|████████▊ | 33289/37963 [79:52:44<10:00:47,  7.71s/it]
 88%|████████▊ | 33290/37963 [79:52:52<9:56:51,  7.66s/it] 
                                                          
{'loss': '0.08091', 'grad_norm': '3.588', 'learning_rate': '7.846e-07', 'epoch': '0.8769'}

 88%|████████▊ | 33290/37963 [79:52:52<9:56:51,  7.66s/it]
 88%|████████▊ | 33291/37963 [79:52:59<9:43:51,  7.50s/it]
 88%|████████▊ | 33292/37963 [79:53:07<9:47:26,  7.55s/it]
 88%|████████▊ | 33293/37963 [79:53:14<9:47:27,  7.55s/it]
 88%|████████▊ | 33294/37963 [79:53:21<9:42:11,  7.48s/it]
 88%|████████▊ | 33295/37963 [79:53:29<9:45:20,  7.52s/it]
 88%|████████▊ | 33296/37963 [79:53:37<9:50:29,  7.59s/it]
 88%|████████▊ | 33297/37963 [79:53:44<9:49:16,  7.58s/it]
 88%|████████▊ | 33298/37963 [79:53:58<12:16:01,  9.47s/it]
 88%|████████▊ | 33299/37963 [79:54:06<11:27:59,  8.85s/it]
 88%|████████▊ | 33300/37963 [79:54:13<10:49:33,  8.36s/it]
                                                           
{'loss': '0.07898', 'grad_norm': '3.042', 'learning_rate': '7.812e-07', 'epoch': '0.8772'}

 88%|████████▊ | 33300/37963 [79:54:13<10:49:33,  8.36s/it]
 88%|████████▊ | 33301/37963 [79:54:20<10:30:23,  8.11s/it]
 88%|████████▊ | 33302/37963 [79:54:28<10:10:20,  7.86s/it]
 88%|████████▊ | 33303/37963 [79:54:35<10:06:08,  7.80s/it]
 88%|████████▊ | 33304/37963 [79:54:43<9:58:57,  7.71s/it] 
 88%|████████▊ | 33305/37963 [79:54:50<9:55:50,  7.68s/it]
 88%|████████▊ | 33306/37963 [79:54:58<9:48:28,  7.58s/it]
 88%|████████▊ | 33307/37963 [79:55:05<9:45:45,  7.55s/it]
 88%|████████▊ | 33308/37963 [79:55:13<9:46:56,  7.57s/it]
 88%|████████▊ | 33309/37963 [79:55:20<9:46:33,  7.56s/it]
 88%|████████▊ | 33310/37963 [79:55:28<9:45:29,  7.55s/it]
                                                          
{'loss': '0.07945', 'grad_norm': '3.722', 'learning_rate': '7.779e-07', 'epoch': '0.8774'}

 88%|████████▊ | 33310/37963 [79:55:28<9:45:29,  7.55s/it]
 88%|████████▊ | 33311/37963 [79:55:35<9:45:17,  7.55s/it]
 88%|████████▊ | 33312/37963 [79:55:50<12:16:17,  9.50s/it]
 88%|████████▊ | 33313/37963 [79:56:10<16:31:35, 12.79s/it]
 88%|████████▊ | 33314/37963 [79:56:17<14:25:53, 11.18s/it]
 88%|████████▊ | 33315/37963 [79:56:25<13:03:34, 10.12s/it]
 88%|████████▊ | 33316/37963 [79:56:33<12:03:05,  9.34s/it]
 88%|████████▊ | 33317/37963 [79:56:40<11:18:45,  8.77s/it]
 88%|████████▊ | 33318/37963 [79:56:47<10:48:01,  8.37s/it]
 88%|████████▊ | 33319/37963 [79:57:01<12:56:56, 10.04s/it]
 88%|████████▊ | 33320/37963 [79:57:15<14:27:29, 11.21s/it]
                                                           
{'loss': '0.08434', 'grad_norm': '2.621', 'learning_rate': '7.746e-07', 'epoch': '0.8777'}

 88%|████████▊ | 33320/37963 [79:57:15<14:27:29, 11.21s/it]
 88%|████████▊ | 33321/37963 [79:57:23<13:00:49, 10.09s/it]
 88%|████████▊ | 33322/37963 [79:57:30<12:00:18,  9.31s/it]
 88%|████████▊ | 33323/37963 [79:57:38<11:18:18,  8.77s/it]
 88%|████████▊ | 33324/37963 [79:57:45<10:46:04,  8.36s/it]
 88%|████████▊ | 33325/37963 [79:57:53<10:26:54,  8.11s/it]
 88%|████████▊ | 33326/37963 [79:58:00<10:08:32,  7.87s/it]
 88%|████████▊ | 33327/37963 [79:58:07<9:58:23,  7.74s/it] 
 88%|████████▊ | 33328/37963 [79:58:15<9:53:46,  7.69s/it]
 88%|████████▊ | 33329/37963 [79:58:23<9:52:03,  7.67s/it]
 88%|████████▊ | 33330/37963 [79:58:30<9:49:49,  7.64s/it]
                                                          
{'loss': '0.09527', 'grad_norm': '2.521', 'learning_rate': '7.714e-07', 'epoch': '0.878'}

 88%|████████▊ | 33330/37963 [79:58:30<9:49:49,  7.64s/it]
 88%|████████▊ | 33331/37963 [79:58:38<9:46:31,  7.60s/it]
 88%|████████▊ | 33332/37963 [79:58:52<12:10:47,  9.47s/it]
 88%|████████▊ | 33333/37963 [79:58:59<11:25:39,  8.89s/it]
 88%|████████▊ | 33334/37963 [79:59:07<10:53:49,  8.47s/it]
 88%|████████▊ | 33335/37963 [79:59:14<10:33:55,  8.22s/it]
 88%|████████▊ | 33336/37963 [79:59:22<10:21:48,  8.06s/it]
 88%|████████▊ | 33337/37963 [79:59:29<10:08:25,  7.89s/it]
 88%|████████▊ | 33338/37963 [79:59:37<10:06:04,  7.86s/it]
 88%|████████▊ | 33339/37963 [79:59:45<9:57:46,  7.76s/it] 
 88%|████████▊ | 33340/37963 [79:59:52<9:53:53,  7.71s/it]
                                                          
{'loss': '0.08381', 'grad_norm': '2.926', 'learning_rate': '7.681e-07', 'epoch': '0.8782'}

 88%|████████▊ | 33340/37963 [79:59:52<9:53:53,  7.71s/it]
 88%|████████▊ | 33341/37963 [80:00:00<9:50:16,  7.66s/it]
 88%|████████▊ | 33342/37963 [80:00:07<9:41:24,  7.55s/it]
 88%|████████▊ | 33343/37963 [80:00:15<9:40:07,  7.53s/it]
 88%|████████▊ | 33344/37963 [80:00:22<9:40:57,  7.55s/it]
 88%|████████▊ | 33345/37963 [80:00:30<9:41:48,  7.56s/it]
 88%|████████▊ | 33346/37963 [80:00:37<9:42:07,  7.57s/it]
 88%|████████▊ | 33347/37963 [80:00:51<12:08:32,  9.47s/it]
 88%|████████▊ | 33348/37963 [80:00:59<11:25:36,  8.91s/it]
 88%|████████▊ | 33349/37963 [80:01:07<10:54:16,  8.51s/it]
 88%|████████▊ | 33350/37963 [80:01:14<10:35:26,  8.27s/it]
                                                           
{'loss': '0.09531', 'grad_norm': '3.436', 'learning_rate': '7.648e-07', 'epoch': '0.8785'}

 88%|████████▊ | 33350/37963 [80:01:14<10:35:26,  8.27s/it]
 88%|████████▊ | 33351/37963 [80:01:22<10:23:09,  8.11s/it]
 88%|████████▊ | 33352/37963 [80:01:30<10:12:08,  7.97s/it]
 88%|████████▊ | 33353/37963 [80:01:37<10:01:42,  7.83s/it]
 88%|████████▊ | 33354/37963 [80:01:45<9:53:52,  7.73s/it] 
 88%|████████▊ | 33355/37963 [80:01:52<9:49:41,  7.68s/it]
 88%|████████▊ | 33356/37963 [80:02:00<9:45:34,  7.63s/it]
 88%|████████▊ | 33357/37963 [80:02:14<12:15:54,  9.59s/it]
 88%|████████▊ | 33358/37963 [80:02:21<11:29:23,  8.98s/it]
 88%|████████▊ | 33359/37963 [80:02:29<10:56:53,  8.56s/it]
 88%|████████▊ | 33360/37963 [80:02:43<13:07:57, 10.27s/it]
                                                           
{'loss': '0.07659', 'grad_norm': '3.215', 'learning_rate': '7.615e-07', 'epoch': '0.8788'}

 88%|████████▊ | 33360/37963 [80:02:43<13:07:57, 10.27s/it]
 88%|████████▊ | 33361/37963 [80:02:51<12:08:12,  9.49s/it]
 88%|████████▊ | 33362/37963 [80:02:58<11:22:00,  8.89s/it]
 88%|████████▊ | 33363/37963 [80:03:12<13:15:39, 10.38s/it]
 88%|████████▊ | 33364/37963 [80:03:20<12:12:37,  9.56s/it]
 88%|████████▊ | 33365/37963 [80:03:27<11:22:35,  8.91s/it]
 88%|████████▊ | 33366/37963 [80:03:48<15:45:44, 12.34s/it]
 88%|████████▊ | 33367/37963 [80:03:55<14:01:36, 10.99s/it]
 88%|████████▊ | 33368/37963 [80:04:03<12:42:22,  9.95s/it]
 88%|████████▊ | 33369/37963 [80:04:11<11:47:32,  9.24s/it]
 88%|████████▊ | 33370/37963 [80:04:18<11:09:34,  8.75s/it]
                                                           
{'loss': '0.08508', 'grad_norm': '4.521', 'learning_rate': '7.583e-07', 'epoch': '0.879'}

 88%|████████▊ | 33370/37963 [80:04:18<11:09:34,  8.75s/it]
 88%|████████▊ | 33371/37963 [80:04:26<10:37:41,  8.33s/it]
 88%|████████▊ | 33372/37963 [80:04:33<10:22:47,  8.14s/it]
 88%|████████▊ | 33373/37963 [80:04:47<12:32:33,  9.84s/it]
 88%|████████▊ | 33374/37963 [80:04:54<11:34:14,  9.08s/it]
 88%|████████▊ | 33375/37963 [80:05:02<10:57:16,  8.60s/it]
 88%|████████▊ | 33376/37963 [80:05:09<10:36:27,  8.33s/it]
 88%|████████▊ | 33377/37963 [80:05:23<12:43:45,  9.99s/it]
 88%|████████▊ | 33378/37963 [80:05:31<11:47:57,  9.26s/it]
 88%|████████▊ | 33379/37963 [80:05:38<11:08:40,  8.75s/it]
 88%|████████▊ | 33380/37963 [80:05:46<10:36:09,  8.33s/it]
                                                           
{'loss': '0.08681', 'grad_norm': '3.084', 'learning_rate': '7.55e-07', 'epoch': '0.8793'}

 88%|████████▊ | 33380/37963 [80:05:46<10:36:09,  8.33s/it]
 88%|████████▊ | 33381/37963 [80:05:53<10:19:02,  8.11s/it]
 88%|████████▊ | 33382/37963 [80:06:01<10:08:24,  7.97s/it]
 88%|████████▊ | 33383/37963 [80:06:09<10:00:51,  7.87s/it]
 88%|████████▊ | 33384/37963 [80:06:16<9:54:23,  7.79s/it] 
 88%|████████▊ | 33385/37963 [80:06:24<9:46:44,  7.69s/it]
 88%|████████▊ | 33386/37963 [80:06:31<9:43:46,  7.65s/it]
 88%|████████▊ | 33387/37963 [80:06:39<9:43:11,  7.65s/it]
 88%|████████▊ | 33388/37963 [80:06:47<9:43:01,  7.65s/it]
 88%|████████▊ | 33389/37963 [80:06:54<9:42:39,  7.64s/it]
 88%|████████▊ | 33390/37963 [80:07:02<9:43:41,  7.66s/it]
                                                          
{'loss': '0.08053', 'grad_norm': '3.04', 'learning_rate': '7.518e-07', 'epoch': '0.8795'}

 88%|████████▊ | 33390/37963 [80:07:02<9:43:41,  7.66s/it]
 88%|████████▊ | 33391/37963 [80:07:09<9:37:48,  7.58s/it]
 88%|████████▊ | 33392/37963 [80:07:17<9:37:53,  7.59s/it]
 88%|████████▊ | 33393/37963 [80:07:24<9:32:42,  7.52s/it]
 88%|████████▊ | 33394/37963 [80:07:32<9:35:53,  7.56s/it]
 88%|████████▊ | 33395/37963 [80:07:40<9:35:27,  7.56s/it]
 88%|████████▊ | 33396/37963 [80:07:47<9:31:00,  7.50s/it]
 88%|████████▊ | 33397/37963 [80:07:54<9:24:16,  7.41s/it]
 88%|████████▊ | 33398/37963 [80:08:08<11:52:27,  9.36s/it]
 88%|████████▊ | 33399/37963 [80:08:16<11:10:27,  8.81s/it]
 88%|████████▊ | 33400/37963 [80:08:23<10:38:38,  8.40s/it]
                                                           
{'loss': '0.07598', 'grad_norm': '3.097', 'learning_rate': '7.485e-07', 'epoch': '0.8798'}

 88%|████████▊ | 33400/37963 [80:08:23<10:38:38,  8.40s/it]
 88%|████████▊ | 33401/37963 [80:08:30<10:17:36,  8.12s/it]
 88%|████████▊ | 33402/37963 [80:08:38<10:03:55,  7.94s/it]
 88%|████████▊ | 33403/37963 [80:08:45<9:53:47,  7.81s/it] 
 88%|████████▊ | 33404/37963 [80:08:53<9:44:26,  7.69s/it]
 88%|████████▊ | 33405/37963 [80:09:07<12:08:35,  9.59s/it]
 88%|████████▊ | 33406/37963 [80:09:14<11:20:26,  8.96s/it]
 88%|████████▊ | 33407/37963 [80:09:22<10:49:00,  8.55s/it]
 88%|████████▊ | 33408/37963 [80:09:30<10:25:22,  8.24s/it]
 88%|████████▊ | 33409/37963 [80:09:37<10:09:26,  8.03s/it]
 88%|████████▊ | 33410/37963 [80:09:45<9:58:43,  7.89s/it] 
                                                          
{'loss': '0.0858', 'grad_norm': '3.703', 'learning_rate': '7.453e-07', 'epoch': '0.8801'}

 88%|████████▊ | 33410/37963 [80:09:45<9:58:43,  7.89s/it]
 88%|████████▊ | 33411/37963 [80:09:52<9:51:02,  7.79s/it]
 88%|████████▊ | 33412/37963 [80:10:13<14:41:25, 11.62s/it]
 88%|████████▊ | 33413/37963 [80:10:20<13:11:50, 10.44s/it]
 88%|████████▊ | 33414/37963 [80:10:34<14:32:44, 11.51s/it]
 88%|████████▊ | 33415/37963 [80:10:42<13:03:40, 10.34s/it]
 88%|████████▊ | 33416/37963 [80:10:49<11:57:51,  9.47s/it]
 88%|████████▊ | 33417/37963 [80:11:03<13:38:15, 10.80s/it]
 88%|████████▊ | 33418/37963 [80:11:11<12:27:39,  9.87s/it]
 88%|████████▊ | 33419/37963 [80:11:19<11:34:03,  9.16s/it]
 88%|████████▊ | 33420/37963 [80:11:32<13:20:05, 10.57s/it]
                                                           
{'loss': '0.08848', 'grad_norm': '3.056', 'learning_rate': '7.421e-07', 'epoch': '0.8803'}

 88%|████████▊ | 33420/37963 [80:11:32<13:20:05, 10.57s/it]
 88%|████████▊ | 33421/37963 [80:11:40<12:12:33,  9.68s/it]
 88%|████████▊ | 33422/37963 [80:11:48<11:25:51,  9.06s/it]
 88%|████████▊ | 33423/37963 [80:11:55<10:50:50,  8.60s/it]
 88%|████████▊ | 33424/37963 [80:12:03<10:26:34,  8.28s/it]
 88%|████████▊ | 33425/37963 [80:12:10<10:09:05,  8.05s/it]
 88%|████████▊ | 33426/37963 [80:12:18<9:52:18,  7.83s/it] 
 88%|████████▊ | 33427/37963 [80:12:25<9:48:00,  7.78s/it]
 88%|████████▊ | 33428/37963 [80:12:32<9:35:49,  7.62s/it]
 88%|████████▊ | 33429/37963 [80:12:40<9:33:49,  7.59s/it]
 88%|████████▊ | 33430/37963 [80:12:54<12:03:07,  9.57s/it]
                                                           
{'loss': '0.09383', 'grad_norm': '3.195', 'learning_rate': '7.388e-07', 'epoch': '0.8806'}

 88%|████████▊ | 33430/37963 [80:12:54<12:03:07,  9.57s/it]
 88%|████████▊ | 33431/37963 [80:13:02<11:15:47,  8.95s/it]
 88%|████████▊ | 33432/37963 [80:13:09<10:42:53,  8.51s/it]
 88%|████████▊ | 33433/37963 [80:13:17<10:19:25,  8.20s/it]
 88%|████████▊ | 33434/37963 [80:13:24<10:03:22,  7.99s/it]
 88%|████████▊ | 33435/37963 [80:13:32<9:52:40,  7.85s/it] 
 88%|████████▊ | 33436/37963 [80:13:39<9:47:14,  7.78s/it]
 88%|████████▊ | 33437/37963 [80:13:47<9:36:55,  7.65s/it]
 88%|████████▊ | 33438/37963 [80:13:54<9:33:37,  7.61s/it]
 88%|████████▊ | 33439/37963 [80:14:02<9:30:52,  7.57s/it]
 88%|████████▊ | 33440/37963 [80:14:09<9:33:28,  7.61s/it]
                                                          
{'loss': '0.08586', 'grad_norm': '2.187', 'learning_rate': '7.356e-07', 'epoch': '0.8809'}

 88%|████████▊ | 33440/37963 [80:14:09<9:33:28,  7.61s/it]
 88%|████████▊ | 33441/37963 [80:14:17<9:25:21,  7.50s/it]
 88%|████████▊ | 33442/37963 [80:14:24<9:24:05,  7.49s/it]
 88%|████████▊ | 33443/37963 [80:14:32<9:24:01,  7.49s/it]
 88%|████████▊ | 33444/37963 [80:14:39<9:18:55,  7.42s/it]
 88%|████████▊ | 33445/37963 [80:14:46<9:21:28,  7.46s/it]
 88%|████████▊ | 33446/37963 [80:15:00<11:50:15,  9.43s/it]
 88%|████████▊ | 33447/37963 [80:15:08<11:08:15,  8.88s/it]
 88%|████████▊ | 33448/37963 [80:15:15<10:32:37,  8.41s/it]
 88%|████████▊ | 33449/37963 [80:15:23<10:13:26,  8.15s/it]
 88%|████████▊ | 33450/37963 [80:15:30<10:00:07,  7.98s/it]
                                                           
{'loss': '0.07982', 'grad_norm': '2.935', 'learning_rate': '7.324e-07', 'epoch': '0.8811'}

 88%|████████▊ | 33450/37963 [80:15:30<10:00:07,  7.98s/it]
 88%|████████▊ | 33451/37963 [80:15:38<9:51:01,  7.86s/it] 
 88%|████████▊ | 33452/37963 [80:15:46<9:43:47,  7.76s/it]
 88%|████████▊ | 33453/37963 [80:15:53<9:38:08,  7.69s/it]
 88%|████████▊ | 33454/37963 [80:16:00<9:30:51,  7.60s/it]
 88%|████████▊ | 33455/37963 [80:16:08<9:29:00,  7.57s/it]
 88%|████████▊ | 33456/37963 [80:16:16<9:28:39,  7.57s/it]
 88%|████████▊ | 33457/37963 [80:16:23<9:32:50,  7.63s/it]
 88%|████████▊ | 33458/37963 [80:16:31<9:28:29,  7.57s/it]
 88%|████████▊ | 33459/37963 [80:16:38<9:27:48,  7.56s/it]
 88%|████████▊ | 33460/37963 [80:16:59<14:15:16, 11.40s/it]
                                                           
{'loss': '0.07878', 'grad_norm': '2.882', 'learning_rate': '7.292e-07', 'epoch': '0.8814'}

 88%|████████▊ | 33460/37963 [80:16:59<14:15:16, 11.40s/it]
 88%|████████▊ | 33461/37963 [80:17:13<15:16:04, 12.21s/it]
 88%|████████▊ | 33462/37963 [80:17:27<15:55:52, 12.74s/it]
 88%|████████▊ | 33463/37963 [80:17:34<13:57:47, 11.17s/it]
 88%|████████▊ | 33464/37963 [80:17:48<15:00:11, 12.01s/it]
 88%|████████▊ | 33465/37963 [80:17:56<13:21:00, 10.68s/it]
 88%|████████▊ | 33466/37963 [80:18:03<12:12:38,  9.78s/it]
 88%|████████▊ | 33467/37963 [80:18:11<11:24:26,  9.13s/it]
 88%|████████▊ | 33468/37963 [80:18:19<10:49:05,  8.66s/it]
 88%|████████▊ | 33469/37963 [80:18:26<10:22:49,  8.32s/it]
 88%|████████▊ | 33470/37963 [80:18:34<10:04:49,  8.08s/it]
                                                           
{'loss': '0.08899', 'grad_norm': '2.708', 'learning_rate': '7.26e-07', 'epoch': '0.8817'}

 88%|████████▊ | 33470/37963 [80:18:34<10:04:49,  8.08s/it]
 88%|████████▊ | 33471/37963 [80:18:41<9:55:54,  7.96s/it] 
 88%|████████▊ | 33472/37963 [80:18:55<12:13:41,  9.80s/it]
 88%|████████▊ | 33473/37963 [80:19:03<11:26:44,  9.18s/it]
 88%|████████▊ | 33474/37963 [80:19:11<10:51:20,  8.71s/it]
 88%|████████▊ | 33475/37963 [80:19:18<10:22:36,  8.32s/it]
 88%|████████▊ | 33476/37963 [80:19:26<10:08:00,  8.13s/it]
 88%|████████▊ | 33477/37963 [80:19:33<9:54:21,  7.95s/it] 
 88%|████████▊ | 33478/37963 [80:19:41<9:44:44,  7.82s/it]
 88%|████████▊ | 33479/37963 [80:19:48<9:33:55,  7.68s/it]
 88%|████████▊ | 33480/37963 [80:20:02<11:50:57,  9.52s/it]
                                                           
{'loss': '0.09589', 'grad_norm': '3.327', 'learning_rate': '7.228e-07', 'epoch': '0.8819'}

 88%|████████▊ | 33480/37963 [80:20:02<11:50:57,  9.52s/it]
 88%|████████▊ | 33481/37963 [80:20:09<11:04:37,  8.90s/it]
 88%|████████▊ | 33482/37963 [80:20:17<10:23:26,  8.35s/it]
 88%|████████▊ | 33483/37963 [80:20:24<10:04:32,  8.10s/it]
 88%|████████▊ | 33484/37963 [80:20:31<9:49:16,  7.89s/it] 
 88%|████████▊ | 33485/37963 [80:20:39<9:41:21,  7.79s/it]
 88%|████████▊ | 33486/37963 [80:20:47<9:37:51,  7.74s/it]
 88%|████████▊ | 33487/37963 [80:20:54<9:33:35,  7.69s/it]
 88%|████████▊ | 33488/37963 [80:21:02<9:29:49,  7.64s/it]
 88%|████████▊ | 33489/37963 [80:21:09<9:28:32,  7.62s/it]
 88%|████████▊ | 33490/37963 [80:21:17<9:25:48,  7.59s/it]
                                                          
{'loss': '0.09544', 'grad_norm': '3.192', 'learning_rate': '7.196e-07', 'epoch': '0.8822'}

 88%|████████▊ | 33490/37963 [80:21:17<9:25:48,  7.59s/it]
 88%|████████▊ | 33491/37963 [80:21:25<9:27:19,  7.61s/it]
 88%|████████▊ | 33492/37963 [80:21:32<9:26:53,  7.61s/it]
 88%|████████▊ | 33493/37963 [80:21:40<9:25:03,  7.58s/it]
 88%|████████▊ | 33494/37963 [80:21:47<9:25:05,  7.59s/it]
 88%|████████▊ | 33495/37963 [80:22:01<11:44:30,  9.46s/it]
 88%|████████▊ | 33496/37963 [80:22:09<11:00:49,  8.88s/it]
 88%|████████▊ | 33497/37963 [80:22:16<10:32:11,  8.49s/it]
 88%|████████▊ | 33498/37963 [80:22:24<10:11:33,  8.22s/it]
 88%|████████▊ | 33499/37963 [80:22:31<9:56:14,  8.01s/it] 
 88%|████████▊ | 33500/37963 [80:22:39<9:47:05,  7.89s/it]
                                                          
{'loss': '0.07534', 'grad_norm': '4.234', 'learning_rate': '7.165e-07', 'epoch': '0.8824'}

 88%|████████▊ | 33500/37963 [80:22:39<9:47:05,  7.89s/it]
 88%|████████▊ | 33501/37963 [80:22:46<9:37:08,  7.76s/it]
 88%|████████▊ | 33502/37963 [80:22:54<9:34:55,  7.73s/it]
 88%|████████▊ | 33503/37963 [80:23:02<9:35:31,  7.74s/it]
 88%|████████▊ | 33504/37963 [80:23:09<9:31:51,  7.69s/it]
 88%|████████▊ | 33505/37963 [80:23:17<9:25:04,  7.61s/it]
 88%|████████▊ | 33506/37963 [80:23:25<9:29:34,  7.67s/it]
 88%|████████▊ | 33507/37963 [80:23:32<9:24:07,  7.60s/it]
 88%|████████▊ | 33508/37963 [80:23:40<9:23:10,  7.58s/it]
 88%|████████▊ | 33509/37963 [80:23:54<11:50:49,  9.58s/it]
 88%|████████▊ | 33510/37963 [80:24:08<13:33:41, 10.96s/it]
                                                           
{'loss': '0.08881', 'grad_norm': '2.636', 'learning_rate': '7.133e-07', 'epoch': '0.8827'}

 88%|████████▊ | 33510/37963 [80:24:08<13:33:41, 10.96s/it]
 88%|████████▊ | 33511/37963 [80:24:16<12:18:56,  9.96s/it]
 88%|████████▊ | 33512/37963 [80:24:29<13:42:49, 11.09s/it]
 88%|████████▊ | 33513/37963 [80:24:37<12:25:28, 10.05s/it]
 88%|████████▊ | 33514/37963 [80:24:57<16:12:57, 13.12s/it]
 88%|████████▊ | 33515/37963 [80:25:05<14:07:31, 11.43s/it]
 88%|████████▊ | 33516/37963 [80:25:12<12:39:12, 10.24s/it]
 88%|████████▊ | 33517/37963 [80:25:20<11:39:15,  9.44s/it]
 88%|████████▊ | 33518/37963 [80:25:28<11:02:44,  8.95s/it]
 88%|████████▊ | 33519/37963 [80:25:35<10:31:51,  8.53s/it]
 88%|████████▊ | 33520/37963 [80:25:43<10:10:13,  8.24s/it]
                                                           
{'loss': '0.09275', 'grad_norm': '2.959', 'learning_rate': '7.101e-07', 'epoch': '0.883'}

 88%|████████▊ | 33520/37963 [80:25:43<10:10:13,  8.24s/it]
 88%|████████▊ | 33521/37963 [80:25:50<9:54:12,  8.03s/it] 
 88%|████████▊ | 33522/37963 [80:25:58<9:43:21,  7.88s/it]
 88%|████████▊ | 33523/37963 [80:26:12<11:56:14,  9.68s/it]
 88%|████████▊ | 33524/37963 [80:26:19<11:10:38,  9.06s/it]
 88%|████████▊ | 33525/37963 [80:26:27<10:36:07,  8.60s/it]
 88%|████████▊ | 33526/37963 [80:26:34<10:11:52,  8.27s/it]
 88%|████████▊ | 33527/37963 [80:26:42<9:57:07,  8.08s/it] 
 88%|████████▊ | 33528/37963 [80:26:50<9:48:30,  7.96s/it]
 88%|████████▊ | 33529/37963 [80:26:57<9:40:05,  7.85s/it]
 88%|████████▊ | 33530/37963 [80:27:11<11:55:09,  9.68s/it]
                                                           
{'loss': '0.08992', 'grad_norm': '2.722', 'learning_rate': '7.07e-07', 'epoch': '0.8832'}

 88%|████████▊ | 33530/37963 [80:27:11<11:55:09,  9.68s/it]
 88%|████████▊ | 33531/37963 [80:27:19<11:08:50,  9.05s/it]
 88%|████████▊ | 33532/37963 [80:27:26<10:37:02,  8.63s/it]
 88%|████████▊ | 33533/37963 [80:27:34<10:12:14,  8.29s/it]
 88%|████████▊ | 33534/37963 [80:27:41<9:50:51,  8.00s/it] 
 88%|████████▊ | 33535/37963 [80:27:49<9:41:14,  7.88s/it]
 88%|████████▊ | 33536/37963 [80:27:56<9:25:31,  7.66s/it]
 88%|████████▊ | 33537/37963 [80:28:03<9:19:55,  7.59s/it]
 88%|████████▊ | 33538/37963 [80:28:11<9:18:36,  7.57s/it]
 88%|████████▊ | 33539/37963 [80:28:18<9:17:54,  7.57s/it]
 88%|████████▊ | 33540/37963 [80:28:26<9:13:11,  7.50s/it]
                                                          
{'loss': '0.08602', 'grad_norm': '2.636', 'learning_rate': '7.038e-07', 'epoch': '0.8835'}

 88%|████████▊ | 33540/37963 [80:28:26<9:13:11,  7.50s/it]
 88%|████████▊ | 33541/37963 [80:28:33<9:11:27,  7.48s/it]
 88%|████████▊ | 33542/37963 [80:28:41<9:12:10,  7.49s/it]
 88%|████████▊ | 33543/37963 [80:28:55<11:36:04,  9.45s/it]
 88%|████████▊ | 33544/37963 [80:29:02<10:48:54,  8.81s/it]
 88%|████████▊ | 33545/37963 [80:29:10<10:19:58,  8.42s/it]
 88%|████████▊ | 33546/37963 [80:29:17<9:57:27,  8.12s/it] 
 88%|████████▊ | 33547/37963 [80:29:25<9:46:25,  7.97s/it]
 88%|████████▊ | 33548/37963 [80:29:32<9:34:47,  7.81s/it]
 88%|████████▊ | 33549/37963 [80:29:40<9:27:12,  7.71s/it]
 88%|████████▊ | 33550/37963 [80:29:47<9:24:20,  7.67s/it]
                                                          
{'loss': '0.09192', 'grad_norm': '2.915', 'learning_rate': '7.007e-07', 'epoch': '0.8838'}

 88%|████████▊ | 33550/37963 [80:29:47<9:24:20,  7.67s/it]
 88%|████████▊ | 33551/37963 [80:29:55<9:24:23,  7.68s/it]
 88%|████████▊ | 33552/37963 [80:30:02<9:20:14,  7.62s/it]
 88%|████████▊ | 33553/37963 [80:30:10<9:17:55,  7.59s/it]
 88%|████████▊ | 33554/37963 [80:30:17<9:13:06,  7.53s/it]
 88%|████████▊ | 33555/37963 [80:30:25<9:08:42,  7.47s/it]
 88%|████████▊ | 33556/37963 [80:30:39<11:33:38,  9.44s/it]
 88%|████████▊ | 33557/37963 [80:30:53<13:12:32, 10.79s/it]
 88%|████████▊ | 33558/37963 [80:31:00<12:01:13,  9.82s/it]
 88%|████████▊ | 33559/37963 [80:31:14<13:36:16, 11.12s/it]
 88%|████████▊ | 33560/37963 [80:31:22<12:19:44, 10.08s/it]
                                                           
{'loss': '0.08838', 'grad_norm': '2.608', 'learning_rate': '6.976e-07', 'epoch': '0.884'}

 88%|████████▊ | 33560/37963 [80:31:22<12:19:44, 10.08s/it]
 88%|████████▊ | 33561/37963 [80:31:29<11:22:43,  9.31s/it]
 88%|████████▊ | 33562/37963 [80:31:43<13:05:34, 10.71s/it]
 88%|████████▊ | 33563/37963 [80:31:51<11:53:00,  9.72s/it]
 88%|████████▊ | 33564/37963 [80:31:58<11:00:44,  9.01s/it]
 88%|████████▊ | 33565/37963 [80:32:06<10:27:24,  8.56s/it]
 88%|████████▊ | 33566/37963 [80:32:13<10:05:46,  8.27s/it]
 88%|████████▊ | 33567/37963 [80:32:21<9:51:03,  8.07s/it] 
 88%|████████▊ | 33568/37963 [80:32:35<12:01:42,  9.85s/it]
 88%|████████▊ | 33569/37963 [80:32:42<11:11:44,  9.17s/it]
 88%|████████▊ | 33570/37963 [80:32:50<10:39:04,  8.73s/it]
                                                           
{'loss': '0.08375', 'grad_norm': '3.448', 'learning_rate': '6.944e-07', 'epoch': '0.8843'}

 88%|████████▊ | 33570/37963 [80:32:50<10:39:04,  8.73s/it]
 88%|████████▊ | 33571/37963 [80:32:58<10:17:07,  8.43s/it]
 88%|████████▊ | 33572/37963 [80:33:05<9:57:09,  8.16s/it] 
 88%|████████▊ | 33573/37963 [80:33:13<9:42:57,  7.97s/it]
 88%|████████▊ | 33574/37963 [80:33:21<9:34:30,  7.85s/it]
 88%|████████▊ | 33575/37963 [80:33:28<9:28:59,  7.78s/it]
 88%|████████▊ | 33576/37963 [80:33:36<9:25:14,  7.73s/it]
 88%|████████▊ | 33577/37963 [80:33:50<11:47:09,  9.67s/it]
 88%|████████▊ | 33578/37963 [80:33:57<10:56:20,  8.98s/it]
 88%|████████▊ | 33579/37963 [80:34:05<10:23:43,  8.54s/it]
 88%|████████▊ | 33580/37963 [80:34:12<10:01:53,  8.24s/it]
                                                           
{'loss': '0.0946', 'grad_norm': '2.473', 'learning_rate': '6.913e-07', 'epoch': '0.8845'}

 88%|████████▊ | 33580/37963 [80:34:12<10:01:53,  8.24s/it]
 88%|████████▊ | 33581/37963 [80:34:20<9:47:17,  8.04s/it] 
 88%|████████▊ | 33582/37963 [80:34:34<11:52:52,  9.76s/it]
 88%|████████▊ | 33583/37963 [80:34:41<11:05:41,  9.12s/it]
 88%|████████▊ | 33584/37963 [80:34:49<10:33:31,  8.68s/it]
 88%|████████▊ | 33585/37963 [80:34:56<10:05:56,  8.30s/it]
 88%|████████▊ | 33586/37963 [80:35:04<9:47:46,  8.06s/it] 
 88%|████████▊ | 33587/37963 [80:35:12<9:42:17,  7.98s/it]
 88%|████████▊ | 33588/37963 [80:35:19<9:31:20,  7.84s/it]
 88%|████████▊ | 33589/37963 [80:35:33<11:46:06,  9.69s/it]
 88%|████████▊ | 33590/37963 [80:35:41<10:59:31,  9.05s/it]
                                                           
{'loss': '0.08915', 'grad_norm': '2.96', 'learning_rate': '6.882e-07', 'epoch': '0.8848'}

 88%|████████▊ | 33590/37963 [80:35:41<10:59:31,  9.05s/it]
 88%|████████▊ | 33591/37963 [80:35:48<10:22:10,  8.54s/it]
 88%|████████▊ | 33592/37963 [80:35:56<10:02:36,  8.27s/it]
 88%|████████▊ | 33593/37963 [80:36:03<9:42:34,  8.00s/it] 
 88%|████████▊ | 33594/37963 [80:36:11<9:32:39,  7.86s/it]
 88%|████████▊ | 33595/37963 [80:36:18<9:26:52,  7.79s/it]
 88%|████████▊ | 33596/37963 [80:36:26<9:23:09,  7.74s/it]
 88%|████████▊ | 33597/37963 [80:36:33<9:18:50,  7.68s/it]
 89%|████████▊ | 33598/37963 [80:36:41<9:14:41,  7.62s/it]
 89%|████████▊ | 33599/37963 [80:36:49<9:12:59,  7.60s/it]
 89%|████████▊ | 33600/37963 [80:36:56<9:11:04,  7.58s/it]
                                                          
{'loss': '0.07959', 'grad_norm': '2.185', 'learning_rate': '6.851e-07', 'epoch': '0.8851'}

 89%|████████▊ | 33600/37963 [80:36:56<9:11:04,  7.58s/it]
 89%|████████▊ | 33601/37963 [80:37:10<11:21:26,  9.37s/it]
 89%|████████▊ | 33602/37963 [80:37:17<10:43:37,  8.86s/it]
 89%|████████▊ | 33603/37963 [80:37:24<10:08:26,  8.37s/it]
 89%|████████▊ | 33604/37963 [80:37:38<12:05:38,  9.99s/it]
 89%|████████▊ | 33605/37963 [80:37:52<13:22:00, 11.04s/it]
 89%|████████▊ | 33606/37963 [80:37:59<12:05:27,  9.99s/it]
 89%|████████▊ | 33607/37963 [80:38:07<11:14:20,  9.29s/it]
 89%|████████▊ | 33608/37963 [80:38:14<10:31:36,  8.70s/it]
 89%|████████▊ | 33609/37963 [80:38:22<10:05:08,  8.34s/it]
 89%|████████▊ | 33610/37963 [80:38:29<9:48:57,  8.12s/it] 
                                                          
{'loss': '0.08699', 'grad_norm': '3.328', 'learning_rate': '6.82e-07', 'epoch': '0.8853'}

 89%|████████▊ | 33610/37963 [80:38:29<9:48:57,  8.12s/it]
 89%|████████▊ | 33611/37963 [80:38:37<9:31:04,  7.87s/it]
 89%|████████▊ | 33612/37963 [80:38:44<9:25:34,  7.80s/it]
 89%|████████▊ | 33613/37963 [80:38:52<9:21:29,  7.74s/it]
 89%|████████▊ | 33614/37963 [80:38:59<9:16:12,  7.67s/it]
 89%|████████▊ | 33615/37963 [80:39:13<11:32:09,  9.55s/it]
 89%|████████▊ | 33616/37963 [80:39:27<13:09:09, 10.89s/it]
 89%|████████▊ | 33617/37963 [80:39:35<11:55:29,  9.88s/it]
 89%|████████▊ | 33618/37963 [80:39:42<11:03:29,  9.16s/it]
 89%|████████▊ | 33619/37963 [80:39:50<10:26:50,  8.66s/it]
 89%|████████▊ | 33620/37963 [80:39:57<9:56:16,  8.24s/it] 
                                                          
{'loss': '0.08777', 'grad_norm': '3.404', 'learning_rate': '6.789e-07', 'epoch': '0.8856'}

 89%|████████▊ | 33620/37963 [80:39:57<9:56:16,  8.24s/it]
 89%|████████▊ | 33621/37963 [80:40:05<9:41:00,  8.03s/it]
 89%|████████▊ | 33622/37963 [80:40:12<9:24:31,  7.80s/it]
 89%|████████▊ | 33623/37963 [80:40:19<9:14:12,  7.66s/it]
 89%|████████▊ | 33624/37963 [80:40:27<9:10:41,  7.62s/it]
 89%|████████▊ | 33625/37963 [80:40:34<9:07:48,  7.58s/it]
 89%|████████▊ | 33626/37963 [80:40:42<9:07:05,  7.57s/it]
 89%|████████▊ | 33627/37963 [80:40:56<11:29:31,  9.54s/it]
 89%|████████▊ | 33628/37963 [80:41:04<10:49:53,  8.99s/it]
 89%|████████▊ | 33629/37963 [80:41:11<10:17:06,  8.54s/it]
 89%|████████▊ | 33630/37963 [80:41:25<12:09:17, 10.10s/it]
                                                           
{'loss': '0.09475', 'grad_norm': '3.136', 'learning_rate': '6.758e-07', 'epoch': '0.8859'}

 89%|████████▊ | 33630/37963 [80:41:25<12:09:17, 10.10s/it]
 89%|████████▊ | 33631/37963 [80:41:32<11:14:28,  9.34s/it]
 89%|████████▊ | 33632/37963 [80:41:40<10:28:40,  8.71s/it]
 89%|████████▊ | 33633/37963 [80:41:47<10:02:22,  8.35s/it]
 89%|████████▊ | 33634/37963 [80:41:55<9:45:35,  8.12s/it] 
 89%|████████▊ | 33635/37963 [80:42:09<11:55:55,  9.92s/it]
 89%|████████▊ | 33636/37963 [80:42:16<11:03:09,  9.20s/it]
 89%|████████▊ | 33637/37963 [80:42:24<10:26:41,  8.69s/it]
 89%|████████▊ | 33638/37963 [80:42:32<10:04:08,  8.38s/it]
 89%|████████▊ | 33639/37963 [80:42:39<9:43:04,  8.09s/it] 
 89%|████████▊ | 33640/37963 [80:42:47<9:30:12,  7.91s/it]
                                                          
{'loss': '0.09659', 'grad_norm': '3.337', 'learning_rate': '6.727e-07', 'epoch': '0.8861'}

 89%|████████▊ | 33640/37963 [80:42:47<9:30:12,  7.91s/it]
 89%|████████▊ | 33641/37963 [80:42:54<9:21:51,  7.80s/it]
 89%|████████▊ | 33642/37963 [80:43:02<9:17:40,  7.74s/it]
 89%|████████▊ | 33643/37963 [80:43:09<9:14:37,  7.70s/it]
 89%|████████▊ | 33644/37963 [80:43:17<9:08:42,  7.62s/it]
 89%|████████▊ | 33645/37963 [80:43:24<9:06:06,  7.59s/it]
 89%|████████▊ | 33646/37963 [80:43:32<9:04:49,  7.57s/it]
 89%|████████▊ | 33647/37963 [80:43:39<9:00:08,  7.51s/it]
 89%|████████▊ | 33648/37963 [80:43:53<11:21:22,  9.47s/it]
 89%|████████▊ | 33649/37963 [80:44:01<10:42:33,  8.94s/it]
 89%|████████▊ | 33650/37963 [80:44:15<12:25:02, 10.36s/it]
                                                           
{'loss': '0.09005', 'grad_norm': '2.915', 'learning_rate': '6.697e-07', 'epoch': '0.8864'}

 89%|████████▊ | 33650/37963 [80:44:15<12:25:02, 10.36s/it]
 89%|████████▊ | 33651/37963 [80:44:29<13:42:40, 11.45s/it]
 89%|████████▊ | 33652/37963 [80:44:36<12:18:33, 10.28s/it]
 89%|████████▊ | 33653/37963 [80:44:44<11:17:59,  9.44s/it]
 89%|████████▊ | 33654/37963 [80:44:51<10:37:03,  8.87s/it]
 89%|████████▊ | 33655/37963 [80:44:59<10:08:30,  8.47s/it]
 89%|████████▊ | 33656/37963 [80:45:06<9:47:09,  8.18s/it] 
 89%|████████▊ | 33657/37963 [80:45:14<9:33:13,  7.99s/it]
 89%|████████▊ | 33658/37963 [80:45:21<9:24:50,  7.87s/it]
 89%|████████▊ | 33659/37963 [80:45:29<9:15:42,  7.75s/it]
 89%|████████▊ | 33660/37963 [80:45:36<9:11:40,  7.69s/it]
                                                          
{'loss': '0.09494', 'grad_norm': '2.282', 'learning_rate': '6.666e-07', 'epoch': '0.8867'}

 89%|████████▊ | 33660/37963 [80:45:36<9:11:40,  7.69s/it]
 89%|████████▊ | 33661/37963 [80:45:43<8:59:32,  7.53s/it]
 89%|████████▊ | 33662/37963 [80:45:51<9:00:24,  7.54s/it]
 89%|████████▊ | 33663/37963 [80:45:59<9:00:57,  7.55s/it]
 89%|████████▊ | 33664/37963 [80:46:06<9:00:42,  7.55s/it]
 89%|████████▊ | 33665/37963 [80:46:14<9:03:13,  7.58s/it]
 89%|████████▊ | 33666/37963 [80:46:21<9:05:18,  7.61s/it]
 89%|████████▊ | 33667/37963 [80:46:35<11:17:59,  9.47s/it]
 89%|████████▊ | 33668/37963 [80:46:43<10:39:43,  8.94s/it]
 89%|████████▊ | 33669/37963 [80:46:50<10:09:29,  8.52s/it]
 89%|████████▊ | 33670/37963 [80:46:58<9:51:12,  8.26s/it] 
                                                          
{'loss': '0.08898', 'grad_norm': '2.021', 'learning_rate': '6.635e-07', 'epoch': '0.8869'}

 89%|████████▊ | 33670/37963 [80:46:58<9:51:12,  8.26s/it]
 89%|████████▊ | 33671/37963 [80:47:12<11:56:57, 10.02s/it]
 89%|████████▊ | 33672/37963 [80:47:20<11:03:29,  9.28s/it]
 89%|████████▊ | 33673/37963 [80:47:27<10:26:01,  8.76s/it]
 89%|████████▊ | 33674/37963 [80:47:35<9:59:21,  8.38s/it] 
 89%|████████▊ | 33675/37963 [80:47:49<11:59:45, 10.07s/it]
 89%|████████▊ | 33676/37963 [80:47:56<10:59:44,  9.23s/it]
 89%|████████▊ | 33677/37963 [80:48:04<10:22:40,  8.72s/it]
 89%|████████▊ | 33678/37963 [80:48:18<12:15:55, 10.30s/it]
 89%|████████▊ | 33679/37963 [80:48:32<13:30:57, 11.36s/it]
 89%|████████▊ | 33680/37963 [80:48:39<12:11:08, 10.24s/it]
                                                           
{'loss': '0.08333', 'grad_norm': '3.247', 'learning_rate': '6.605e-07', 'epoch': '0.8872'}

 89%|████████▊ | 33680/37963 [80:48:39<12:11:08, 10.24s/it]
 89%|████████▊ | 33681/37963 [80:48:47<11:12:39,  9.43s/it]
 89%|████████▊ | 33682/37963 [80:48:54<10:32:13,  8.86s/it]
 89%|████████▊ | 33683/37963 [80:49:02<10:04:02,  8.47s/it]
 89%|████████▊ | 33684/37963 [80:49:09<9:42:07,  8.16s/it] 
 89%|████████▊ | 33685/37963 [80:49:17<9:30:49,  8.01s/it]
 89%|████████▊ | 33686/37963 [80:49:24<9:19:51,  7.85s/it]
 89%|████████▊ | 33687/37963 [80:49:32<9:11:56,  7.74s/it]
 89%|████████▊ | 33688/37963 [80:49:39<9:07:09,  7.68s/it]
 89%|████████▊ | 33689/37963 [80:49:47<9:03:02,  7.62s/it]
 89%|████████▊ | 33690/37963 [80:49:54<9:01:08,  7.60s/it]
                                                          
{'loss': '0.08591', 'grad_norm': '2.99', 'learning_rate': '6.574e-07', 'epoch': '0.8874'}

 89%|████████▊ | 33690/37963 [80:49:54<9:01:08,  7.60s/it]
 89%|████████▊ | 33691/37963 [80:50:02<8:50:26,  7.45s/it]
 89%|████████▊ | 33692/37963 [80:50:09<8:45:37,  7.38s/it]
 89%|████████▉ | 33693/37963 [80:50:16<8:49:28,  7.44s/it]
 89%|████████▉ | 33694/37963 [80:50:24<8:50:34,  7.46s/it]
 89%|████████▉ | 33695/37963 [80:50:38<11:11:52,  9.45s/it]
 89%|████████▉ | 33696/37963 [80:50:46<10:33:00,  8.90s/it]
 89%|████████▉ | 33697/37963 [80:50:53<10:04:44,  8.51s/it]
 89%|████████▉ | 33698/37963 [80:51:01<9:44:36,  8.22s/it] 
 89%|████████▉ | 33699/37963 [80:51:08<9:35:34,  8.10s/it]
 89%|████████▉ | 33700/37963 [80:51:16<9:24:46,  7.95s/it]
                                                          
{'loss': '0.08978', 'grad_norm': '3.471', 'learning_rate': '6.544e-07', 'epoch': '0.8877'}

 89%|████████▉ | 33700/37963 [80:51:16<9:24:46,  7.95s/it]
 89%|████████▉ | 33701/37963 [80:51:24<9:15:24,  7.82s/it]
 89%|████████▉ | 33702/37963 [80:51:38<11:25:02,  9.65s/it]
 89%|████████▉ | 33703/37963 [80:51:45<10:46:19,  9.10s/it]
 89%|████████▉ | 33704/37963 [80:51:59<12:23:13, 10.47s/it]
 89%|████████▉ | 33705/37963 [80:52:07<11:20:41,  9.59s/it]
 89%|████████▉ | 33706/37963 [80:52:14<10:35:47,  8.96s/it]
 89%|████████▉ | 33707/37963 [80:52:21<10:02:03,  8.49s/it]
 89%|████████▉ | 33708/37963 [80:52:29<9:44:06,  8.24s/it] 
 89%|████████▉ | 33709/37963 [80:52:37<9:29:07,  8.03s/it]
 89%|████████▉ | 33710/37963 [80:52:44<9:18:33,  7.88s/it]
                                                          
{'loss': '0.07896', 'grad_norm': '3.193', 'learning_rate': '6.514e-07', 'epoch': '0.888'}

 89%|████████▉ | 33710/37963 [80:52:44<9:18:33,  7.88s/it]
 89%|████████▉ | 33711/37963 [80:52:52<9:10:45,  7.77s/it]
 89%|████████▉ | 33712/37963 [80:52:59<9:07:11,  7.72s/it]
 89%|████████▉ | 33713/37963 [80:53:13<11:20:11,  9.60s/it]
 89%|████████▉ | 33714/37963 [80:53:21<10:39:50,  9.04s/it]
 89%|████████▉ | 33715/37963 [80:53:28<10:06:47,  8.57s/it]
 89%|████████▉ | 33716/37963 [80:53:36<9:44:37,  8.26s/it] 
 89%|████████▉ | 33717/37963 [80:53:44<9:29:20,  8.05s/it]
 89%|████████▉ | 33718/37963 [80:53:51<9:19:55,  7.91s/it]
 89%|████████▉ | 33719/37963 [80:53:59<9:12:29,  7.81s/it]
 89%|████████▉ | 33720/37963 [80:54:06<9:06:21,  7.73s/it]
                                                          
{'loss': '0.09403', 'grad_norm': '3.579', 'learning_rate': '6.483e-07', 'epoch': '0.8882'}

 89%|████████▉ | 33720/37963 [80:54:06<9:06:21,  7.73s/it]
 89%|████████▉ | 33721/37963 [80:54:20<11:20:02,  9.62s/it]
 89%|████████▉ | 33722/37963 [80:54:28<10:35:14,  8.99s/it]
 89%|████████▉ | 33723/37963 [80:54:35<9:59:06,  8.48s/it] 
 89%|████████▉ | 33724/37963 [80:54:43<9:39:06,  8.20s/it]
 89%|████████▉ | 33725/37963 [80:54:57<11:40:26,  9.92s/it]
 89%|████████▉ | 33726/37963 [80:55:11<13:06:40, 11.14s/it]
 89%|████████▉ | 33727/37963 [80:55:18<11:50:24, 10.06s/it]
 89%|████████▉ | 33728/37963 [80:55:26<10:55:32,  9.29s/it]
 89%|████████▉ | 33729/37963 [80:55:39<12:33:34, 10.68s/it]
 89%|████████▉ | 33730/37963 [80:55:47<11:27:38,  9.75s/it]
                                                           
{'loss': '0.07547', 'grad_norm': '2.689', 'learning_rate': '6.453e-07', 'epoch': '0.8885'}

 89%|████████▉ | 33730/37963 [80:55:47<11:27:38,  9.75s/it]
 89%|████████▉ | 33731/37963 [80:55:55<10:45:15,  9.15s/it]
 89%|████████▉ | 33732/37963 [80:56:02<10:13:32,  8.70s/it]
 89%|████████▉ | 33733/37963 [80:56:10<9:53:44,  8.42s/it] 
 89%|████████▉ | 33734/37963 [80:56:18<9:31:07,  8.10s/it]
 89%|████████▉ | 33735/37963 [80:56:25<9:19:58,  7.95s/it]
 89%|████████▉ | 33736/37963 [80:56:33<9:09:42,  7.80s/it]
 89%|████████▉ | 33737/37963 [80:56:40<9:05:11,  7.74s/it]
 89%|████████▉ | 33738/37963 [80:56:48<9:00:18,  7.67s/it]
 89%|████████▉ | 33739/37963 [80:56:55<8:54:49,  7.60s/it]
 89%|████████▉ | 33740/37963 [80:57:03<8:53:24,  7.58s/it]
                                                          
{'loss': '0.08161', 'grad_norm': '2.458', 'learning_rate': '6.423e-07', 'epoch': '0.8888'}

 89%|████████▉ | 33740/37963 [80:57:03<8:53:24,  7.58s/it]
 89%|████████▉ | 33741/37963 [80:57:10<8:50:39,  7.54s/it]
 89%|████████▉ | 33742/37963 [80:57:24<11:07:52,  9.49s/it]
 89%|████████▉ | 33743/37963 [80:57:32<10:28:51,  8.94s/it]
 89%|████████▉ | 33744/37963 [80:57:39<9:58:57,  8.52s/it] 
 89%|████████▉ | 33745/37963 [80:57:47<9:41:15,  8.27s/it]
 89%|████████▉ | 33746/37963 [80:57:55<9:27:47,  8.08s/it]
 89%|████████▉ | 33747/37963 [80:58:02<9:18:39,  7.95s/it]
 89%|████████▉ | 33748/37963 [80:58:10<9:05:32,  7.77s/it]
 89%|████████▉ | 33749/37963 [80:58:17<8:59:21,  7.68s/it]
 89%|████████▉ | 33750/37963 [80:58:25<8:52:22,  7.58s/it]
                                                          
{'loss': '0.08621', 'grad_norm': '2.684', 'learning_rate': '6.393e-07', 'epoch': '0.889'}

 89%|████████▉ | 33750/37963 [80:58:25<8:52:22,  7.58s/it]
 89%|████████▉ | 33751/37963 [80:58:39<11:08:23,  9.52s/it]
 89%|████████▉ | 33752/37963 [80:58:46<10:18:45,  8.82s/it]
 89%|████████▉ | 33753/37963 [80:58:53<9:50:18,  8.41s/it] 
 89%|████████▉ | 33754/37963 [80:59:00<9:21:43,  8.01s/it]
 89%|████████▉ | 33755/37963 [80:59:08<9:11:47,  7.87s/it]
 89%|████████▉ | 33756/37963 [80:59:15<9:04:56,  7.77s/it]
 89%|████████▉ | 33757/37963 [80:59:29<11:14:58,  9.63s/it]
 89%|████████▉ | 33758/37963 [80:59:37<10:32:46,  9.03s/it]
 89%|████████▉ | 33759/37963 [80:59:45<10:01:32,  8.59s/it]
 89%|████████▉ | 33760/37963 [80:59:52<9:43:10,  8.33s/it] 
                                                          
{'loss': '0.09627', 'grad_norm': '2.623', 'learning_rate': '6.363e-07', 'epoch': '0.8893'}

 89%|████████▉ | 33760/37963 [80:59:52<9:43:10,  8.33s/it]
 89%|████████▉ | 33761/37963 [81:00:00<9:28:52,  8.12s/it]
 89%|████████▉ | 33762/37963 [81:00:08<9:19:12,  7.99s/it]
 89%|████████▉ | 33763/37963 [81:00:15<9:09:16,  7.85s/it]
 89%|████████▉ | 33764/37963 [81:00:29<11:18:32,  9.70s/it]
 89%|████████▉ | 33765/37963 [81:00:37<10:33:15,  9.05s/it]
 89%|████████▉ | 33766/37963 [81:00:44<10:02:34,  8.61s/it]
 89%|████████▉ | 33767/37963 [81:00:58<11:54:23, 10.22s/it]
 89%|████████▉ | 33768/37963 [81:01:06<10:58:15,  9.41s/it]
 89%|████████▉ | 33769/37963 [81:01:13<10:22:27,  8.90s/it]
 89%|████████▉ | 33770/37963 [81:01:21<9:54:15,  8.50s/it] 
                                                          
{'loss': '0.08655', 'grad_norm': '4.06', 'learning_rate': '6.333e-07', 'epoch': '0.8896'}

 89%|████████▉ | 33770/37963 [81:01:21<9:54:15,  8.50s/it]
 89%|████████▉ | 33771/37963 [81:01:28<9:28:51,  8.14s/it]
 89%|████████▉ | 33772/37963 [81:01:36<9:15:26,  7.95s/it]
 89%|████████▉ | 33773/37963 [81:01:49<11:10:16,  9.60s/it]
 89%|████████▉ | 33774/37963 [81:01:57<10:26:58,  8.98s/it]
 89%|████████▉ | 33775/37963 [81:02:11<12:07:59, 10.43s/it]
 89%|████████▉ | 33776/37963 [81:02:18<11:06:40,  9.55s/it]
 89%|████████▉ | 33777/37963 [81:02:26<10:26:02,  8.97s/it]
 89%|████████▉ | 33778/37963 [81:02:33<9:55:46,  8.54s/it] 
 89%|████████▉ | 33779/37963 [81:02:47<11:48:31, 10.16s/it]
 89%|████████▉ | 33780/37963 [81:02:55<10:57:04,  9.42s/it]
                                                           
{'loss': '0.08326', 'grad_norm': '2.094', 'learning_rate': '6.303e-07', 'epoch': '0.8898'}

 89%|████████▉ | 33780/37963 [81:02:55<10:57:04,  9.42s/it]
 89%|████████▉ | 33781/37963 [81:03:03<10:20:38,  8.90s/it]
 89%|████████▉ | 33782/37963 [81:03:10<9:56:10,  8.56s/it] 
 89%|████████▉ | 33783/37963 [81:03:18<9:33:39,  8.23s/it]
 89%|████████▉ | 33784/37963 [81:03:25<9:15:11,  7.97s/it]
 89%|████████▉ | 33785/37963 [81:03:33<9:06:22,  7.85s/it]
 89%|████████▉ | 33786/37963 [81:03:40<9:02:21,  7.79s/it]
 89%|████████▉ | 33787/37963 [81:03:48<9:00:07,  7.76s/it]
 89%|████████▉ | 33788/37963 [81:03:56<8:55:11,  7.69s/it]
 89%|████████▉ | 33789/37963 [81:04:03<8:51:44,  7.64s/it]
 89%|████████▉ | 33790/37963 [81:04:11<8:45:13,  7.55s/it]
                                                          
{'loss': '0.08215', 'grad_norm': '2.775', 'learning_rate': '6.274e-07', 'epoch': '0.8901'}

 89%|████████▉ | 33790/37963 [81:04:11<8:45:13,  7.55s/it]
 89%|████████▉ | 33791/37963 [81:04:18<8:44:34,  7.54s/it]
 89%|████████▉ | 33792/37963 [81:04:26<8:46:56,  7.58s/it]
 89%|████████▉ | 33793/37963 [81:04:33<8:41:35,  7.50s/it]
 89%|████████▉ | 33794/37963 [81:04:47<10:52:36,  9.39s/it]
 89%|████████▉ | 33795/37963 [81:04:54<10:14:30,  8.85s/it]
 89%|████████▉ | 33796/37963 [81:05:02<9:46:10,  8.44s/it] 
 89%|████████▉ | 33797/37963 [81:05:09<9:28:02,  8.18s/it]
 89%|████████▉ | 33798/37963 [81:05:17<9:08:47,  7.91s/it]
 89%|████████▉ | 33799/37963 [81:05:24<9:02:49,  7.82s/it]
 89%|████████▉ | 33800/37963 [81:05:32<8:59:56,  7.78s/it]
                                                          
{'loss': '0.08282', 'grad_norm': '2.684', 'learning_rate': '6.244e-07', 'epoch': '0.8903'}

 89%|████████▉ | 33800/37963 [81:05:32<8:59:56,  7.78s/it]
 89%|████████▉ | 33801/37963 [81:05:40<8:56:44,  7.74s/it]
 89%|████████▉ | 33802/37963 [81:05:47<8:54:33,  7.71s/it]
 89%|████████▉ | 33803/37963 [81:05:54<8:43:26,  7.55s/it]
 89%|████████▉ | 33804/37963 [81:06:02<8:39:28,  7.49s/it]
 89%|████████▉ | 33805/37963 [81:06:16<10:52:19,  9.41s/it]
 89%|████████▉ | 33806/37963 [81:06:30<12:26:36, 10.78s/it]
 89%|████████▉ | 33807/37963 [81:06:37<11:21:40,  9.84s/it]
 89%|████████▉ | 33808/37963 [81:06:45<10:27:42,  9.06s/it]
 89%|████████▉ | 33809/37963 [81:06:52<9:55:43,  8.60s/it] 
 89%|████████▉ | 33810/37963 [81:07:00<9:29:43,  8.23s/it]
                                                          
{'loss': '0.07611', 'grad_norm': '2.499', 'learning_rate': '6.214e-07', 'epoch': '0.8906'}

 89%|████████▉ | 33810/37963 [81:07:00<9:29:43,  8.23s/it]
 89%|████████▉ | 33811/37963 [81:07:07<9:06:10,  7.89s/it]
 89%|████████▉ | 33812/37963 [81:07:20<11:06:13,  9.63s/it]
 89%|████████▉ | 33813/37963 [81:07:28<10:22:04,  8.99s/it]
 89%|████████▉ | 33814/37963 [81:07:35<9:50:36,  8.54s/it] 
 89%|████████▉ | 33815/37963 [81:07:43<9:26:23,  8.19s/it]
 89%|████████▉ | 33816/37963 [81:07:50<9:12:48,  8.00s/it]
 89%|████████▉ | 33817/37963 [81:08:04<11:15:36,  9.78s/it]
 89%|████████▉ | 33818/37963 [81:08:12<10:29:53,  9.12s/it]
 89%|████████▉ | 33819/37963 [81:08:19<9:54:47,  8.61s/it] 
 89%|████████▉ | 33820/37963 [81:08:27<9:32:24,  8.29s/it]
                                                          
{'loss': '0.07554', 'grad_norm': '3.095', 'learning_rate': '6.185e-07', 'epoch': '0.8909'}

 89%|████████▉ | 33820/37963 [81:08:27<9:32:24,  8.29s/it]
 89%|████████▉ | 33821/37963 [81:08:40<11:25:38,  9.93s/it]
 89%|████████▉ | 33822/37963 [81:08:48<10:36:26,  9.22s/it]
 89%|████████▉ | 33823/37963 [81:09:02<12:10:11, 10.58s/it]
 89%|████████▉ | 33824/37963 [81:09:09<11:08:51,  9.70s/it]
 89%|████████▉ | 33825/37963 [81:09:17<10:25:45,  9.07s/it]
 89%|████████▉ | 33826/37963 [81:09:24<9:50:33,  8.57s/it] 
 89%|████████▉ | 33827/37963 [81:09:32<9:31:02,  8.28s/it]
 89%|████████▉ | 33828/37963 [81:09:39<9:11:20,  8.00s/it]
 89%|████████▉ | 33829/37963 [81:09:47<8:56:37,  7.79s/it]
 89%|████████▉ | 33830/37963 [81:09:54<8:52:38,  7.73s/it]
                                                          
{'loss': '0.09477', 'grad_norm': '3.628', 'learning_rate': '6.155e-07', 'epoch': '0.8911'}

 89%|████████▉ | 33830/37963 [81:09:54<8:52:38,  7.73s/it]
 89%|████████▉ | 33831/37963 [81:10:02<8:49:35,  7.69s/it]
 89%|████████▉ | 33832/37963 [81:10:16<10:59:56,  9.59s/it]
 89%|████████▉ | 33833/37963 [81:10:23<10:19:14,  9.00s/it]
 89%|████████▉ | 33834/37963 [81:10:31<9:43:28,  8.48s/it] 
 89%|████████▉ | 33835/37963 [81:10:38<9:25:43,  8.22s/it]
 89%|████████▉ | 33836/37963 [81:10:46<9:11:27,  8.02s/it]
 89%|████████▉ | 33837/37963 [81:10:53<9:02:04,  7.88s/it]
 89%|████████▉ | 33838/37963 [81:11:01<8:56:31,  7.80s/it]
 89%|████████▉ | 33839/37963 [81:11:09<8:53:51,  7.77s/it]
 89%|████████▉ | 33840/37963 [81:11:16<8:49:50,  7.71s/it]
                                                          
{'loss': '0.0821', 'grad_norm': '2.687', 'learning_rate': '6.126e-07', 'epoch': '0.8914'}

 89%|████████▉ | 33840/37963 [81:11:16<8:49:50,  7.71s/it]
 89%|████████▉ | 33841/37963 [81:11:24<8:47:46,  7.68s/it]
 89%|████████▉ | 33842/37963 [81:11:38<10:56:28,  9.56s/it]
 89%|████████▉ | 33843/37963 [81:11:45<10:14:36,  8.95s/it]
 89%|████████▉ | 33844/37963 [81:11:53<9:45:32,  8.53s/it] 
 89%|████████▉ | 33845/37963 [81:12:00<9:23:10,  8.21s/it]
 89%|████████▉ | 33846/37963 [81:12:08<9:08:09,  7.99s/it]
 89%|████████▉ | 33847/37963 [81:12:15<8:52:55,  7.77s/it]
 89%|████████▉ | 33848/37963 [81:12:23<8:47:36,  7.69s/it]
 89%|████████▉ | 33849/37963 [81:12:30<8:42:54,  7.63s/it]
 89%|████████▉ | 33850/37963 [81:12:38<8:40:32,  7.59s/it]
                                                          
{'loss': '0.09254', 'grad_norm': '3.206', 'learning_rate': '6.096e-07', 'epoch': '0.8917'}

 89%|████████▉ | 33850/37963 [81:12:38<8:40:32,  7.59s/it]
 89%|████████▉ | 33851/37963 [81:12:45<8:37:25,  7.55s/it]
 89%|████████▉ | 33852/37963 [81:12:59<10:47:49,  9.46s/it]
 89%|████████▉ | 33853/37963 [81:13:13<12:18:27, 10.78s/it]
 89%|████████▉ | 33854/37963 [81:13:20<11:07:53,  9.75s/it]
 89%|████████▉ | 33855/37963 [81:13:28<10:24:00,  9.11s/it]
 89%|████████▉ | 33856/37963 [81:13:35<9:47:39,  8.59s/it] 
 89%|████████▉ | 33857/37963 [81:13:43<9:27:28,  8.29s/it]
 89%|████████▉ | 33858/37963 [81:13:50<9:11:05,  8.05s/it]
 89%|████████▉ | 33859/37963 [81:13:58<8:56:36,  7.85s/it]
 89%|████████▉ | 33860/37963 [81:14:05<8:51:53,  7.78s/it]
                                                          
{'loss': '0.08597', 'grad_norm': '3.437', 'learning_rate': '6.067e-07', 'epoch': '0.8919'}

 89%|████████▉ | 33860/37963 [81:14:05<8:51:53,  7.78s/it]
 89%|████████▉ | 33861/37963 [81:14:19<10:57:29,  9.62s/it]
 89%|████████▉ | 33862/37963 [81:14:27<10:15:46,  9.01s/it]
 89%|████████▉ | 33863/37963 [81:14:34<9:40:04,  8.49s/it] 
 89%|████████▉ | 33864/37963 [81:14:42<9:19:40,  8.19s/it]
 89%|████████▉ | 33865/37963 [81:14:49<9:05:28,  7.99s/it]
 89%|████████▉ | 33866/37963 [81:14:56<8:52:46,  7.80s/it]
 89%|████████▉ | 33867/37963 [81:15:04<8:46:59,  7.72s/it]
 89%|████████▉ | 33868/37963 [81:15:18<10:53:27,  9.57s/it]
 89%|████████▉ | 33869/37963 [81:15:26<10:13:25,  8.99s/it]
 89%|████████▉ | 33870/37963 [81:15:33<9:46:21,  8.60s/it] 
                                                          
{'loss': '0.08052', 'grad_norm': '3.45', 'learning_rate': '6.038e-07', 'epoch': '0.8922'}

 89%|████████▉ | 33870/37963 [81:15:33<9:46:21,  8.60s/it]
 89%|████████▉ | 33871/37963 [81:15:47<11:35:44, 10.20s/it]
 89%|████████▉ | 33872/37963 [81:16:01<12:47:16, 11.25s/it]
 89%|████████▉ | 33873/37963 [81:16:08<11:32:52, 10.16s/it]
 89%|████████▉ | 33874/37963 [81:16:16<10:32:30,  9.28s/it]
 89%|████████▉ | 33875/37963 [81:16:23<9:55:23,  8.74s/it] 
 89%|████████▉ | 33876/37963 [81:16:31<9:30:02,  8.37s/it]
 89%|████████▉ | 33877/37963 [81:16:38<9:09:41,  8.07s/it]
 89%|████████▉ | 33878/37963 [81:16:45<8:55:16,  7.86s/it]
 89%|████████▉ | 33879/37963 [81:16:53<8:48:56,  7.77s/it]
 89%|████████▉ | 33880/37963 [81:17:07<10:58:09,  9.67s/it]
                                                           
{'loss': '0.08291', 'grad_norm': '3.485', 'learning_rate': '6.009e-07', 'epoch': '0.8925'}

 89%|████████▉ | 33880/37963 [81:17:07<10:58:09,  9.67s/it]
 89%|████████▉ | 33881/37963 [81:17:15<10:14:18,  9.03s/it]
 89%|████████▉ | 33882/37963 [81:17:22<9:43:06,  8.57s/it] 
 89%|████████▉ | 33883/37963 [81:17:30<9:20:39,  8.25s/it]
 89%|████████▉ | 33884/37963 [81:17:37<9:03:29,  7.99s/it]
 89%|████████▉ | 33885/37963 [81:17:45<8:52:55,  7.84s/it]
 89%|████████▉ | 33886/37963 [81:17:52<8:41:12,  7.67s/it]
 89%|████████▉ | 33887/37963 [81:17:59<8:37:11,  7.61s/it]
 89%|████████▉ | 33888/37963 [81:18:07<8:31:46,  7.54s/it]
 89%|████████▉ | 33889/37963 [81:18:14<8:34:27,  7.58s/it]
 89%|████████▉ | 33890/37963 [81:18:22<8:33:38,  7.57s/it]
                                                          
{'loss': '0.07942', 'grad_norm': '3.422', 'learning_rate': '5.98e-07', 'epoch': '0.8927'}

 89%|████████▉ | 33890/37963 [81:18:22<8:33:38,  7.57s/it]
 89%|████████▉ | 33891/37963 [81:18:29<8:33:07,  7.56s/it]
 89%|████████▉ | 33892/37963 [81:18:37<8:31:55,  7.55s/it]
 89%|████████▉ | 33893/37963 [81:18:44<8:26:01,  7.46s/it]
 89%|████████▉ | 33894/37963 [81:18:52<8:27:30,  7.48s/it]
 89%|████████▉ | 33895/37963 [81:18:59<8:27:15,  7.48s/it]
 89%|████████▉ | 33896/37963 [81:19:13<10:39:04,  9.43s/it]
 89%|████████▉ | 33897/37963 [81:19:27<12:09:15, 10.76s/it]
 89%|████████▉ | 33898/37963 [81:19:35<11:06:24,  9.84s/it]
 89%|████████▉ | 33899/37963 [81:19:42<10:16:20,  9.10s/it]
 89%|████████▉ | 33900/37963 [81:19:49<9:38:39,  8.55s/it] 
                                                          
{'loss': '0.08566', 'grad_norm': '3.139', 'learning_rate': '5.951e-07', 'epoch': '0.893'}

 89%|████████▉ | 33900/37963 [81:19:49<9:38:39,  8.55s/it]
 89%|████████▉ | 33901/37963 [81:19:57<9:18:22,  8.25s/it]
 89%|████████▉ | 33902/37963 [81:20:04<8:57:41,  7.94s/it]
 89%|████████▉ | 33903/37963 [81:20:12<8:49:46,  7.83s/it]
 89%|████████▉ | 33904/37963 [81:20:19<8:43:51,  7.74s/it]
 89%|████████▉ | 33905/37963 [81:20:40<13:08:03, 11.65s/it]
 89%|████████▉ | 33906/37963 [81:20:48<11:48:08, 10.47s/it]
 89%|████████▉ | 33907/37963 [81:20:55<10:45:42,  9.55s/it]
 89%|████████▉ | 33908/37963 [81:21:03<10:07:07,  8.98s/it]
 89%|████████▉ | 33909/37963 [81:21:10<9:36:11,  8.53s/it] 
 89%|████████▉ | 33910/37963 [81:21:18<9:17:08,  8.25s/it]
                                                          
{'loss': '0.08048', 'grad_norm': '2.783', 'learning_rate': '5.922e-07', 'epoch': '0.8932'}

 89%|████████▉ | 33910/37963 [81:21:18<9:17:08,  8.25s/it]
 89%|████████▉ | 33911/37963 [81:21:32<11:15:56, 10.01s/it]
 89%|████████▉ | 33912/37963 [81:21:40<10:30:55,  9.34s/it]
 89%|████████▉ | 33913/37963 [81:21:47<9:53:22,  8.79s/it] 
 89%|████████▉ | 33914/37963 [81:21:55<9:27:10,  8.40s/it]
 89%|████████▉ | 33915/37963 [81:22:02<9:13:30,  8.20s/it]
 89%|████████▉ | 33916/37963 [81:22:10<9:00:00,  8.01s/it]
 89%|████████▉ | 33917/37963 [81:22:18<8:49:41,  7.85s/it]
 89%|████████▉ | 33918/37963 [81:22:31<10:51:03,  9.66s/it]
 89%|████████▉ | 33919/37963 [81:22:45<12:13:29, 10.88s/it]
 89%|████████▉ | 33920/37963 [81:22:53<11:05:07,  9.87s/it]
                                                           
{'loss': '0.08324', 'grad_norm': '2.939', 'learning_rate': '5.893e-07', 'epoch': '0.8935'}

 89%|████████▉ | 33920/37963 [81:22:53<11:05:07,  9.87s/it]
 89%|████████▉ | 33921/37963 [81:23:00<10:20:16,  9.21s/it]
 89%|████████▉ | 33922/37963 [81:23:08<9:44:35,  8.68s/it] 
 89%|████████▉ | 33923/37963 [81:23:15<9:17:39,  8.28s/it]
 89%|████████▉ | 33924/37963 [81:23:23<9:03:46,  8.08s/it]
 89%|████████▉ | 33925/37963 [81:23:30<8:52:53,  7.92s/it]
 89%|████████▉ | 33926/37963 [81:23:38<8:45:24,  7.81s/it]
 89%|████████▉ | 33927/37963 [81:23:45<8:37:06,  7.69s/it]
 89%|████████▉ | 33928/37963 [81:23:53<8:33:40,  7.64s/it]
 89%|████████▉ | 33929/37963 [81:24:07<10:37:53,  9.49s/it]
 89%|████████▉ | 33930/37963 [81:24:14<9:57:42,  8.89s/it] 
                                                          
{'loss': '0.07793', 'grad_norm': '2.571', 'learning_rate': '5.864e-07', 'epoch': '0.8938'}

 89%|████████▉ | 33930/37963 [81:24:14<9:57:42,  8.89s/it]
 89%|████████▉ | 33931/37963 [81:24:22<9:29:34,  8.48s/it]
 89%|████████▉ | 33932/37963 [81:24:29<9:06:54,  8.14s/it]
 89%|████████▉ | 33933/37963 [81:24:36<8:53:40,  7.95s/it]
 89%|████████▉ | 33934/37963 [81:24:44<8:40:09,  7.75s/it]
 89%|████████▉ | 33935/37963 [81:24:51<8:37:05,  7.70s/it]
 89%|████████▉ | 33936/37963 [81:24:59<8:35:59,  7.69s/it]
 89%|████████▉ | 33937/37963 [81:25:06<8:32:29,  7.64s/it]
 89%|████████▉ | 33938/37963 [81:25:14<8:26:54,  7.56s/it]
 89%|████████▉ | 33939/37963 [81:25:21<8:26:12,  7.55s/it]
 89%|████████▉ | 33940/37963 [81:25:29<8:25:13,  7.54s/it]
                                                          
{'loss': '0.08614', 'grad_norm': '3.926', 'learning_rate': '5.835e-07', 'epoch': '0.894'}

 89%|████████▉ | 33940/37963 [81:25:29<8:25:13,  7.54s/it]
 89%|████████▉ | 33941/37963 [81:25:36<8:24:43,  7.53s/it]
 89%|████████▉ | 33942/37963 [81:25:44<8:27:47,  7.58s/it]
 89%|████████▉ | 33943/37963 [81:25:58<10:38:32,  9.53s/it]
 89%|████████▉ | 33944/37963 [81:26:06<9:56:08,  8.90s/it] 
 89%|████████▉ | 33945/37963 [81:26:20<11:37:37, 10.42s/it]
 89%|████████▉ | 33946/37963 [81:26:27<10:44:14,  9.62s/it]
 89%|████████▉ | 33947/37963 [81:26:35<10:03:26,  9.02s/it]
 89%|████████▉ | 33948/37963 [81:26:43<9:35:02,  8.59s/it] 
 89%|████████▉ | 33949/37963 [81:26:50<9:12:14,  8.25s/it]
 89%|████████▉ | 33950/37963 [81:26:58<8:59:46,  8.07s/it]
                                                          
{'loss': '0.07096', 'grad_norm': '2.721', 'learning_rate': '5.806e-07', 'epoch': '0.8943'}

 89%|████████▉ | 33950/37963 [81:26:58<8:59:46,  8.07s/it]
 89%|████████▉ | 33951/37963 [81:27:05<8:47:57,  7.90s/it]
 89%|████████▉ | 33952/37963 [81:27:13<8:41:47,  7.81s/it]
 89%|████████▉ | 33953/37963 [81:27:27<10:44:35,  9.64s/it]
 89%|████████▉ | 33954/37963 [81:27:34<10:02:20,  9.01s/it]
 89%|████████▉ | 33955/37963 [81:27:42<9:32:53,  8.58s/it] 
 89%|████████▉ | 33956/37963 [81:27:49<9:12:49,  8.28s/it]
 89%|████████▉ | 33957/37963 [81:27:57<8:56:17,  8.03s/it]
 89%|████████▉ | 33958/37963 [81:28:11<10:51:46,  9.76s/it]
 89%|████████▉ | 33959/37963 [81:28:18<10:08:03,  9.11s/it]
 89%|████████▉ | 33960/37963 [81:28:32<11:43:54, 10.55s/it]
                                                           
{'loss': '0.08015', 'grad_norm': '2.717', 'learning_rate': '5.778e-07', 'epoch': '0.8946'}

 89%|████████▉ | 33960/37963 [81:28:32<11:43:54, 10.55s/it]
 89%|████████▉ | 33961/37963 [81:28:39<10:35:38,  9.53s/it]
 89%|████████▉ | 33962/37963 [81:28:47<9:56:29,  8.95s/it] 
 89%|████████▉ | 33963/37963 [81:28:54<9:28:20,  8.53s/it]
 89%|████████▉ | 33964/37963 [81:29:02<9:04:12,  8.17s/it]
 89%|████████▉ | 33965/37963 [81:29:16<11:01:16,  9.92s/it]
 89%|████████▉ | 33966/37963 [81:29:23<10:11:54,  9.19s/it]
 89%|████████▉ | 33967/37963 [81:29:31<9:39:31,  8.70s/it] 
 89%|████████▉ | 33968/37963 [81:29:44<11:17:29, 10.18s/it]
 89%|████████▉ | 33969/37963 [81:29:52<10:24:20,  9.38s/it]
 89%|████████▉ | 33970/37963 [81:29:59<9:45:14,  8.79s/it] 
                                                          
{'loss': '0.07082', 'grad_norm': '2.638', 'learning_rate': '5.749e-07', 'epoch': '0.8948'}

 89%|████████▉ | 33970/37963 [81:29:59<9:45:14,  8.79s/it]
 89%|████████▉ | 33971/37963 [81:30:07<9:19:54,  8.42s/it]
 89%|████████▉ | 33972/37963 [81:30:14<9:01:34,  8.14s/it]
 89%|████████▉ | 33973/37963 [81:30:22<8:49:15,  7.96s/it]
 89%|████████▉ | 33974/37963 [81:30:29<8:40:08,  7.82s/it]
 89%|████████▉ | 33975/37963 [81:30:37<8:35:24,  7.75s/it]
 89%|████████▉ | 33976/37963 [81:30:45<8:31:48,  7.70s/it]
 90%|████████▉ | 33977/37963 [81:30:52<8:27:22,  7.64s/it]
 90%|████████▉ | 33978/37963 [81:30:59<8:19:51,  7.53s/it]
 90%|████████▉ | 33979/37963 [81:31:13<10:30:00,  9.49s/it]
 90%|████████▉ | 33980/37963 [81:31:21<9:50:32,  8.90s/it] 
                                                          
{'loss': '0.09453', 'grad_norm': '3.664', 'learning_rate': '5.721e-07', 'epoch': '0.8951'}

 90%|████████▉ | 33980/37963 [81:31:21<9:50:32,  8.90s/it]
 90%|████████▉ | 33981/37963 [81:31:28<9:17:54,  8.41s/it]
 90%|████████▉ | 33982/37963 [81:31:36<9:00:53,  8.15s/it]
 90%|████████▉ | 33983/37963 [81:31:43<8:47:46,  7.96s/it]
 90%|████████▉ | 33984/37963 [81:31:51<8:42:07,  7.87s/it]
 90%|████████▉ | 33985/37963 [81:31:58<8:36:43,  7.79s/it]
 90%|████████▉ | 33986/37963 [81:32:06<8:31:43,  7.72s/it]
 90%|████████▉ | 33987/37963 [81:32:14<8:27:27,  7.66s/it]
 90%|████████▉ | 33988/37963 [81:32:21<8:25:41,  7.63s/it]
 90%|████████▉ | 33989/37963 [81:32:29<8:23:25,  7.60s/it]
 90%|████████▉ | 33990/37963 [81:32:36<8:14:09,  7.46s/it]
                                                          
{'loss': '0.07849', 'grad_norm': '3.181', 'learning_rate': '5.692e-07', 'epoch': '0.8953'}

 90%|████████▉ | 33990/37963 [81:32:36<8:14:09,  7.46s/it]
 90%|████████▉ | 33991/37963 [81:32:43<8:15:50,  7.49s/it]
 90%|████████▉ | 33992/37963 [81:32:51<8:16:41,  7.50s/it]
 90%|████████▉ | 33993/37963 [81:33:12<12:40:06, 11.49s/it]
 90%|████████▉ | 33994/37963 [81:33:19<11:18:16, 10.25s/it]
 90%|████████▉ | 33995/37963 [81:33:27<10:23:40,  9.43s/it]
 90%|████████▉ | 33996/37963 [81:33:34<9:46:22,  8.87s/it] 
 90%|████████▉ | 33997/37963 [81:33:42<9:20:42,  8.48s/it]
 90%|████████▉ | 33998/37963 [81:33:49<9:04:27,  8.24s/it]
 90%|████████▉ | 33999/37963 [81:33:57<8:51:05,  8.04s/it]
 90%|████████▉ | 34000/37963 [81:34:11<10:40:30,  9.70s/it]
                                                           
{'loss': '0.07547', 'grad_norm': '2.417', 'learning_rate': '5.664e-07', 'epoch': '0.8956'}

 90%|████████▉ | 34000/37963 [81:34:11<10:40:30,  9.70s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.54s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 90%|████████▉ | 34001/37963 [81:35:08<26:33:02, 24.12s/it]
 90%|████████▉ | 34002/37963 [81:35:16<21:03:40, 19.14s/it]
 90%|████████▉ | 34003/37963 [81:35:23<17:15:13, 15.69s/it]
 90%|████████▉ | 34004/37963 [81:35:31<14:33:40, 13.24s/it]
 90%|████████▉ | 34005/37963 [81:35:45<14:46:41, 13.44s/it]
 90%|████████▉ | 34006/37963 [81:35:52<12:50:02, 11.68s/it]
 90%|████████▉ | 34007/37963 [81:36:06<13:35:27, 12.37s/it]
 90%|████████▉ | 34008/37963 [81:36:14<12:01:26, 10.94s/it]
 90%|████████▉ | 34009/37963 [81:36:28<13:02:11, 11.87s/it]
 90%|████████▉ | 34010/37963 [81:36:36<11:37:42, 10.59s/it]
                                                           
{'loss': '0.08857', 'grad_norm': '3.066', 'learning_rate': '5.636e-07', 'epoch': '0.8959'}

 90%|████████▉ | 34010/37963 [81:36:36<11:37:42, 10.59s/it]
 90%|████████▉ | 34011/37963 [81:36:43<10:37:04,  9.67s/it]
 90%|████████▉ | 34012/37963 [81:36:51<9:54:18,  9.03s/it] 
 90%|████████▉ | 34013/37963 [81:36:58<9:23:21,  8.56s/it]
 90%|████████▉ | 34014/37963 [81:37:06<9:02:37,  8.24s/it]
 90%|████████▉ | 34015/37963 [81:37:19<10:52:10,  9.91s/it]
 90%|████████▉ | 34016/37963 [81:37:27<10:01:03,  9.14s/it]
 90%|████████▉ | 34017/37963 [81:37:34<9:30:11,  8.67s/it] 
 90%|████████▉ | 34018/37963 [81:37:42<9:07:42,  8.33s/it]
 90%|████████▉ | 34019/37963 [81:37:49<8:49:35,  8.06s/it]
 90%|████████▉ | 34020/37963 [81:37:57<8:41:59,  7.94s/it]
                                                          
{'loss': '0.07696', 'grad_norm': '3.134', 'learning_rate': '5.608e-07', 'epoch': '0.8961'}

 90%|████████▉ | 34020/37963 [81:37:57<8:41:59,  7.94s/it]
 90%|████████▉ | 34021/37963 [81:38:04<8:29:56,  7.76s/it]
 90%|████████▉ | 34022/37963 [81:38:12<8:23:09,  7.66s/it]
 90%|████████▉ | 34023/37963 [81:38:19<8:20:53,  7.63s/it]
 90%|████████▉ | 34024/37963 [81:38:33<10:23:19,  9.49s/it]
 90%|████████▉ | 34025/37963 [81:38:41<9:44:22,  8.90s/it] 
 90%|████████▉ | 34026/37963 [81:38:48<9:15:57,  8.47s/it]
 90%|████████▉ | 34027/37963 [81:38:56<8:54:41,  8.15s/it]
 90%|████████▉ | 34028/37963 [81:39:03<8:42:04,  7.96s/it]
 90%|████████▉ | 34029/37963 [81:39:11<8:35:06,  7.86s/it]
 90%|████████▉ | 34030/37963 [81:39:18<8:28:06,  7.75s/it]
                                                          
{'loss': '0.08148', 'grad_norm': '3.223', 'learning_rate': '5.58e-07', 'epoch': '0.8964'}

 90%|████████▉ | 34030/37963 [81:39:18<8:28:06,  7.75s/it]
 90%|████████▉ | 34031/37963 [81:39:26<8:23:05,  7.68s/it]
 90%|████████▉ | 34032/37963 [81:39:33<8:19:20,  7.62s/it]
 90%|████████▉ | 34033/37963 [81:39:40<8:12:16,  7.52s/it]
 90%|████████▉ | 34034/37963 [81:39:48<8:13:44,  7.54s/it]
 90%|████████▉ | 34035/37963 [81:39:56<8:13:14,  7.53s/it]
 90%|████████▉ | 34036/37963 [81:40:03<8:14:25,  7.55s/it]
 90%|████████▉ | 34037/37963 [81:40:11<8:15:36,  7.57s/it]
 90%|████████▉ | 34038/37963 [81:40:18<8:13:44,  7.55s/it]
 90%|████████▉ | 34039/37963 [81:40:26<8:12:36,  7.53s/it]
 90%|████████▉ | 34040/37963 [81:40:33<8:07:28,  7.46s/it]
                                                          
{'loss': '0.08031', 'grad_norm': '2.545', 'learning_rate': '5.551e-07', 'epoch': '0.8967'}

 90%|████████▉ | 34040/37963 [81:40:33<8:07:28,  7.46s/it]
 90%|████████▉ | 34041/37963 [81:40:41<8:14:18,  7.56s/it]
 90%|████████▉ | 34042/37963 [81:40:48<8:14:05,  7.56s/it]
 90%|████████▉ | 34043/37963 [81:40:56<8:14:24,  7.57s/it]
 90%|████████▉ | 34044/37963 [81:41:04<8:13:43,  7.56s/it]
 90%|████████▉ | 34045/37963 [81:41:18<10:20:18,  9.50s/it]
 90%|████████▉ | 34046/37963 [81:41:32<11:48:58, 10.86s/it]
 90%|████████▉ | 34047/37963 [81:41:39<10:44:30,  9.88s/it]
 90%|████████▉ | 34048/37963 [81:41:47<9:56:55,  9.15s/it] 
 90%|████████▉ | 34049/37963 [81:42:01<11:30:10, 10.58s/it]
 90%|████████▉ | 34050/37963 [81:42:08<10:34:55,  9.74s/it]
                                                           
{'loss': '0.108', 'grad_norm': '4.32', 'learning_rate': '5.523e-07', 'epoch': '0.8969'}

 90%|████████▉ | 34050/37963 [81:42:08<10:34:55,  9.74s/it]
 90%|████████▉ | 34051/37963 [81:42:16<9:52:22,  9.09s/it] 
 90%|████████▉ | 34052/37963 [81:42:24<9:22:53,  8.64s/it]
 90%|████████▉ | 34053/37963 [81:42:38<11:09:46, 10.28s/it]
 90%|████████▉ | 34054/37963 [81:42:45<10:15:41,  9.45s/it]
 90%|████████▉ | 34055/37963 [81:42:53<9:35:15,  8.83s/it] 
 90%|████████▉ | 34056/37963 [81:43:07<11:16:28, 10.39s/it]
 90%|████████▉ | 34057/37963 [81:43:14<10:21:17,  9.54s/it]
 90%|████████▉ | 34058/37963 [81:43:21<9:37:52,  8.88s/it] 
 90%|████████▉ | 34059/37963 [81:43:35<11:08:38, 10.28s/it]
 90%|████████▉ | 34060/37963 [81:43:43<10:17:22,  9.49s/it]
                                                           
{'loss': '0.08125', 'grad_norm': '2.53', 'learning_rate': '5.496e-07', 'epoch': '0.8972'}

 90%|████████▉ | 34060/37963 [81:43:43<10:17:22,  9.49s/it]
 90%|████████▉ | 34061/37963 [81:43:57<11:42:39, 10.80s/it]
 90%|████████▉ | 34062/37963 [81:44:04<10:39:33,  9.84s/it]
 90%|████████▉ | 34063/37963 [81:44:11<9:48:35,  9.06s/it] 
 90%|████████▉ | 34064/37963 [81:44:19<9:18:56,  8.60s/it]
 90%|████████▉ | 34065/37963 [81:44:26<8:58:50,  8.29s/it]
 90%|████████▉ | 34066/37963 [81:44:34<8:44:06,  8.07s/it]
 90%|████████▉ | 34067/37963 [81:44:41<8:32:41,  7.90s/it]
 90%|████████▉ | 34068/37963 [81:44:49<8:24:59,  7.78s/it]
 90%|████████▉ | 34069/37963 [81:44:57<8:20:43,  7.72s/it]
 90%|████████▉ | 34070/37963 [81:45:04<8:17:24,  7.67s/it]
                                                          
{'loss': '0.07939', 'grad_norm': '2.967', 'learning_rate': '5.468e-07', 'epoch': '0.8975'}

 90%|████████▉ | 34070/37963 [81:45:04<8:17:24,  7.67s/it]
 90%|████████▉ | 34071/37963 [81:45:12<8:13:50,  7.61s/it]
 90%|████████▉ | 34072/37963 [81:45:19<8:11:04,  7.57s/it]
 90%|████████▉ | 34073/37963 [81:45:27<8:09:11,  7.55s/it]
 90%|████████▉ | 34074/37963 [81:45:41<10:14:55,  9.49s/it]
 90%|████████▉ | 34075/37963 [81:45:48<9:41:04,  8.97s/it] 
 90%|████████▉ | 34076/37963 [81:45:56<9:13:25,  8.54s/it]
 90%|████████▉ | 34077/37963 [81:46:03<8:48:56,  8.17s/it]
 90%|████████▉ | 34078/37963 [81:46:11<8:36:02,  7.97s/it]
 90%|████████▉ | 34079/37963 [81:46:18<8:29:21,  7.87s/it]
 90%|████████▉ | 34080/37963 [81:46:26<8:21:35,  7.75s/it]
                                                          
{'loss': '0.0889', 'grad_norm': '2.871', 'learning_rate': '5.44e-07', 'epoch': '0.8977'}

 90%|████████▉ | 34080/37963 [81:46:26<8:21:35,  7.75s/it]
 90%|████████▉ | 34081/37963 [81:46:33<8:17:34,  7.69s/it]
 90%|████████▉ | 34082/37963 [81:46:41<8:14:29,  7.64s/it]
 90%|████████▉ | 34083/37963 [81:46:49<8:14:56,  7.65s/it]
 90%|████████▉ | 34084/37963 [81:46:56<8:11:26,  7.60s/it]
 90%|████████▉ | 34085/37963 [81:47:03<8:08:26,  7.56s/it]
 90%|████████▉ | 34086/37963 [81:47:11<8:05:00,  7.51s/it]
 90%|████████▉ | 34087/37963 [81:47:18<8:01:41,  7.46s/it]
 90%|████████▉ | 34088/37963 [81:47:26<8:01:13,  7.45s/it]
 90%|████████▉ | 34089/37963 [81:47:33<8:02:06,  7.47s/it]
 90%|████████▉ | 34090/37963 [81:47:41<8:02:29,  7.47s/it]
                                                          
{'loss': '0.06996', 'grad_norm': '2.96', 'learning_rate': '5.412e-07', 'epoch': '0.898'}

 90%|████████▉ | 34090/37963 [81:47:41<8:02:29,  7.47s/it]
 90%|████████▉ | 34091/37963 [81:47:48<8:02:41,  7.48s/it]
 90%|████████▉ | 34092/37963 [81:48:02<10:12:52,  9.50s/it]
 90%|████████▉ | 34093/37963 [81:48:10<9:37:09,  8.95s/it] 
 90%|████████▉ | 34094/37963 [81:48:18<9:10:15,  8.53s/it]
 90%|████████▉ | 34095/37963 [81:48:25<8:53:07,  8.27s/it]
 90%|████████▉ | 34096/37963 [81:48:39<10:44:00,  9.99s/it]
 90%|████████▉ | 34097/37963 [81:48:47<9:55:36,  9.24s/it] 
 90%|████████▉ | 34098/37963 [81:49:01<11:28:25, 10.69s/it]
 90%|████████▉ | 34099/37963 [81:49:08<10:25:09,  9.71s/it]
 90%|████████▉ | 34100/37963 [81:49:16<9:42:17,  9.04s/it] 
                                                          
{'loss': '0.08956', 'grad_norm': '2.992', 'learning_rate': '5.385e-07', 'epoch': '0.8982'}

 90%|████████▉ | 34100/37963 [81:49:16<9:42:17,  9.04s/it]
 90%|████████▉ | 34101/37963 [81:49:23<9:15:38,  8.63s/it]
 90%|████████▉ | 34102/37963 [81:49:31<8:53:20,  8.29s/it]
 90%|████████▉ | 34103/37963 [81:49:38<8:34:43,  8.00s/it]
 90%|████████▉ | 34104/37963 [81:49:52<10:30:00,  9.80s/it]
 90%|████████▉ | 34105/37963 [81:50:13<14:00:14, 13.07s/it]
 90%|████████▉ | 34106/37963 [81:50:20<12:14:10, 11.42s/it]
 90%|████████▉ | 34107/37963 [81:50:28<10:59:31, 10.26s/it]
 90%|████████▉ | 34108/37963 [81:50:36<10:07:44,  9.46s/it]
 90%|████████▉ | 34109/37963 [81:50:43<9:30:32,  8.88s/it] 
 90%|████████▉ | 34110/37963 [81:50:57<11:08:26, 10.41s/it]
                                                           
{'loss': '0.09561', 'grad_norm': '2.893', 'learning_rate': '5.357e-07', 'epoch': '0.8985'}

 90%|████████▉ | 34110/37963 [81:50:57<11:08:26, 10.41s/it]
 90%|████████▉ | 34111/37963 [81:51:05<10:12:35,  9.54s/it]
 90%|████████▉ | 34112/37963 [81:51:12<9:26:49,  8.83s/it] 
 90%|████████▉ | 34113/37963 [81:51:19<9:00:58,  8.43s/it]
 90%|████████▉ | 34114/37963 [81:51:27<8:42:53,  8.15s/it]
 90%|████████▉ | 34115/37963 [81:51:34<8:30:36,  7.96s/it]
 90%|████████▉ | 34116/37963 [81:51:42<8:25:32,  7.88s/it]
 90%|████████▉ | 34117/37963 [81:51:50<8:17:45,  7.77s/it]
 90%|████████▉ | 34118/37963 [81:51:57<8:12:51,  7.69s/it]
 90%|████████▉ | 34119/37963 [81:52:05<8:09:10,  7.64s/it]
 90%|████████▉ | 34120/37963 [81:52:12<8:06:07,  7.59s/it]
                                                          
{'loss': '0.09434', 'grad_norm': '3.77', 'learning_rate': '5.329e-07', 'epoch': '0.8988'}

 90%|████████▉ | 34120/37963 [81:52:12<8:06:07,  7.59s/it]
 90%|████████▉ | 34121/37963 [81:52:20<8:05:21,  7.58s/it]
 90%|████████▉ | 34122/37963 [81:52:27<8:04:28,  7.57s/it]
 90%|████████▉ | 34123/37963 [81:52:35<8:02:56,  7.55s/it]
 90%|████████▉ | 34124/37963 [81:52:42<8:00:04,  7.50s/it]
 90%|████████▉ | 34125/37963 [81:52:50<8:00:07,  7.51s/it]
 90%|████████▉ | 34126/37963 [81:52:57<8:00:41,  7.52s/it]
 90%|████████▉ | 34127/37963 [81:53:05<8:02:53,  7.55s/it]
 90%|████████▉ | 34128/37963 [81:53:19<10:04:26,  9.46s/it]
 90%|████████▉ | 34129/37963 [81:53:26<9:30:42,  8.93s/it] 
 90%|████████▉ | 34130/37963 [81:53:34<9:03:30,  8.51s/it]
                                                          
{'loss': '0.07978', 'grad_norm': '3.601', 'learning_rate': '5.302e-07', 'epoch': '0.899'}

 90%|████████▉ | 34130/37963 [81:53:34<9:03:30,  8.51s/it]
 90%|████████▉ | 34131/37963 [81:53:41<8:41:32,  8.17s/it]
 90%|████████▉ | 34132/37963 [81:53:49<8:27:39,  7.95s/it]
 90%|████████▉ | 34133/37963 [81:53:56<8:18:51,  7.82s/it]
 90%|████████▉ | 34134/37963 [81:54:04<8:14:01,  7.74s/it]
 90%|████████▉ | 34135/37963 [81:54:11<8:08:37,  7.66s/it]
 90%|████████▉ | 34136/37963 [81:54:19<8:05:45,  7.62s/it]
 90%|████████▉ | 34137/37963 [81:54:26<8:04:21,  7.60s/it]
 90%|████████▉ | 34138/37963 [81:54:34<8:00:16,  7.53s/it]
 90%|████████▉ | 34139/37963 [81:54:41<8:02:35,  7.57s/it]
 90%|████████▉ | 34140/37963 [81:54:49<8:00:50,  7.55s/it]
                                                          
{'loss': '0.0891', 'grad_norm': '3', 'learning_rate': '5.275e-07', 'epoch': '0.8993'}

 90%|████████▉ | 34140/37963 [81:54:49<8:00:50,  7.55s/it]
 90%|████████▉ | 34141/37963 [81:55:02<9:56:12,  9.36s/it]
 90%|████████▉ | 34142/37963 [81:55:10<9:24:11,  8.86s/it]
 90%|████████▉ | 34143/37963 [81:55:24<11:05:55, 10.46s/it]
 90%|████████▉ | 34144/37963 [81:55:32<10:13:31,  9.64s/it]
 90%|████████▉ | 34145/37963 [81:55:40<9:33:48,  9.02s/it] 
 90%|████████▉ | 34146/37963 [81:55:47<9:06:28,  8.59s/it]
 90%|████████▉ | 34147/37963 [81:55:55<8:46:02,  8.27s/it]
 90%|████████▉ | 34148/37963 [81:56:09<10:35:13,  9.99s/it]
 90%|████████▉ | 34149/37963 [81:56:23<11:57:26, 11.29s/it]
 90%|████████▉ | 34150/37963 [81:56:31<10:46:59, 10.18s/it]
                                                           
{'loss': '0.07693', 'grad_norm': '3.623', 'learning_rate': '5.247e-07', 'epoch': '0.8996'}

 90%|████████▉ | 34150/37963 [81:56:31<10:46:59, 10.18s/it]
 90%|████████▉ | 34151/37963 [81:56:38<9:55:59,  9.38s/it] 
 90%|████████▉ | 34152/37963 [81:56:46<9:20:07,  8.82s/it]
 90%|████████▉ | 34153/37963 [81:56:53<8:55:04,  8.43s/it]
 90%|████████▉ | 34154/37963 [81:57:07<10:42:09, 10.12s/it]
 90%|████████▉ | 34155/37963 [81:57:15<9:53:30,  9.35s/it] 
 90%|████████▉ | 34156/37963 [81:57:29<11:21:25, 10.74s/it]
 90%|████████▉ | 34157/37963 [81:57:36<10:21:11,  9.79s/it]
 90%|████████▉ | 34158/37963 [81:57:44<9:38:43,  9.13s/it] 
 90%|████████▉ | 34159/37963 [81:57:51<9:08:18,  8.65s/it]
 90%|████████▉ | 34160/37963 [81:57:59<8:47:31,  8.32s/it]
                                                          
{'loss': '0.08639', 'grad_norm': '3.894', 'learning_rate': '5.22e-07', 'epoch': '0.8998'}

 90%|████████▉ | 34160/37963 [81:57:59<8:47:31,  8.32s/it]
 90%|████████▉ | 34161/37963 [81:58:06<8:29:59,  8.05s/it]
 90%|████████▉ | 34162/37963 [81:58:20<10:22:29,  9.83s/it]
 90%|████████▉ | 34163/37963 [81:58:28<9:36:55,  9.11s/it] 
 90%|████████▉ | 34164/37963 [81:58:35<9:06:19,  8.63s/it]
 90%|████████▉ | 34165/37963 [81:58:43<8:45:23,  8.30s/it]
 90%|████████▉ | 34166/37963 [81:58:50<8:30:21,  8.06s/it]
 90%|█████████ | 34167/37963 [81:58:58<8:19:09,  7.89s/it]
 90%|█████████ | 34168/37963 [81:59:05<8:11:30,  7.77s/it]
 90%|█████████ | 34169/37963 [81:59:13<8:02:47,  7.64s/it]
 90%|█████████ | 34170/37963 [81:59:20<8:02:33,  7.63s/it]
                                                          
{'loss': '0.07947', 'grad_norm': '2.626', 'learning_rate': '5.193e-07', 'epoch': '0.9001'}

 90%|█████████ | 34170/37963 [81:59:20<8:02:33,  7.63s/it]
 90%|█████████ | 34171/37963 [81:59:28<7:59:08,  7.58s/it]
 90%|█████████ | 34172/37963 [81:59:35<7:57:46,  7.56s/it]
 90%|█████████ | 34173/37963 [81:59:49<10:00:29,  9.51s/it]
 90%|█████████ | 34174/37963 [81:59:57<9:28:11,  9.00s/it] 
 90%|█████████ | 34175/37963 [82:00:05<9:00:43,  8.56s/it]
 90%|█████████ | 34176/37963 [82:00:12<8:42:21,  8.28s/it]
 90%|█████████ | 34177/37963 [82:00:20<8:27:31,  8.04s/it]
 90%|█████████ | 34178/37963 [82:00:27<8:18:37,  7.90s/it]
 90%|█████████ | 34179/37963 [82:00:35<8:12:29,  7.81s/it]
 90%|█████████ | 34180/37963 [82:00:42<8:07:20,  7.73s/it]
                                                          
{'loss': '0.08526', 'grad_norm': '2.353', 'learning_rate': '5.166e-07', 'epoch': '0.9004'}

 90%|█████████ | 34180/37963 [82:00:42<8:07:20,  7.73s/it]
 90%|█████████ | 34181/37963 [82:00:50<8:04:22,  7.68s/it]
 90%|█████████ | 34182/37963 [82:00:58<8:00:35,  7.63s/it]
 90%|█████████ | 34183/37963 [82:01:05<7:50:45,  7.47s/it]
 90%|█████████ | 34184/37963 [82:01:12<7:52:13,  7.50s/it]
 90%|█████████ | 34185/37963 [82:01:20<7:55:32,  7.55s/it]
 90%|█████████ | 34186/37963 [82:01:34<10:00:13,  9.54s/it]
 90%|█████████ | 34187/37963 [82:01:42<9:24:04,  8.96s/it] 
 90%|█████████ | 34188/37963 [82:01:49<9:00:01,  8.58s/it]
 90%|█████████ | 34189/37963 [82:01:56<8:31:29,  8.13s/it]
 90%|█████████ | 34190/37963 [82:02:04<8:21:34,  7.98s/it]
                                                          
{'loss': '0.08011', 'grad_norm': '2.845', 'learning_rate': '5.139e-07', 'epoch': '0.9006'}

 90%|█████████ | 34190/37963 [82:02:04<8:21:34,  7.98s/it]
 90%|█████████ | 34191/37963 [82:02:11<8:09:46,  7.79s/it]
 90%|█████████ | 34192/37963 [82:02:19<7:59:55,  7.64s/it]
 90%|█████████ | 34193/37963 [82:02:26<8:00:08,  7.64s/it]
 90%|█████████ | 34194/37963 [82:02:34<7:57:10,  7.60s/it]
 90%|█████████ | 34195/37963 [82:02:47<9:50:48,  9.41s/it]
 90%|█████████ | 34196/37963 [82:02:55<9:14:25,  8.83s/it]
 90%|█████████ | 34197/37963 [82:03:09<10:49:51, 10.35s/it]
 90%|█████████ | 34198/37963 [82:03:16<9:58:14,  9.53s/it] 
 90%|█████████ | 34199/37963 [82:03:24<9:21:32,  8.95s/it]
 90%|█████████ | 34200/37963 [82:03:38<10:54:11, 10.43s/it]
                                                           
{'loss': '0.09717', 'grad_norm': '3.059', 'learning_rate': '5.112e-07', 'epoch': '0.9009'}

 90%|█████████ | 34200/37963 [82:03:38<10:54:11, 10.43s/it]
 90%|█████████ | 34201/37963 [82:03:45<9:55:57,  9.50s/it] 
 90%|█████████ | 34202/37963 [82:03:59<11:21:14, 10.87s/it]
 90%|█████████ | 34203/37963 [82:04:07<10:18:35,  9.87s/it]
 90%|█████████ | 34204/37963 [82:04:21<11:33:15, 11.07s/it]
 90%|█████████ | 34205/37963 [82:04:28<10:29:11, 10.05s/it]
 90%|█████████ | 34206/37963 [82:04:36<9:38:42,  9.24s/it] 
 90%|█████████ | 34207/37963 [82:04:43<9:05:33,  8.72s/it]
 90%|█████████ | 34208/37963 [82:04:51<8:45:43,  8.40s/it]
 90%|█████████ | 34209/37963 [82:04:59<8:32:27,  8.19s/it]
 90%|█████████ | 34210/37963 [82:05:06<8:13:52,  7.90s/it]
                                                          
{'loss': '0.06965', 'grad_norm': '2.96', 'learning_rate': '5.085e-07', 'epoch': '0.9011'}

 90%|█████████ | 34210/37963 [82:05:06<8:13:52,  7.90s/it]
 90%|█████████ | 34211/37963 [82:05:13<8:06:59,  7.79s/it]
 90%|█████████ | 34212/37963 [82:05:21<8:01:52,  7.71s/it]
 90%|█████████ | 34213/37963 [82:05:28<7:59:01,  7.66s/it]
 90%|█████████ | 34214/37963 [82:05:36<7:52:26,  7.56s/it]
 90%|█████████ | 34215/37963 [82:05:43<7:49:52,  7.52s/it]
 90%|█████████ | 34216/37963 [82:05:57<9:50:11,  9.45s/it]
 90%|█████████ | 34217/37963 [82:06:05<9:14:19,  8.88s/it]
 90%|█████████ | 34218/37963 [82:06:12<8:50:42,  8.50s/it]
 90%|█████████ | 34219/37963 [82:06:20<8:34:41,  8.25s/it]
 90%|█████████ | 34220/37963 [82:06:34<10:26:45, 10.05s/it]
                                                           
{'loss': '0.08041', 'grad_norm': '2.991', 'learning_rate': '5.058e-07', 'epoch': '0.9014'}

 90%|█████████ | 34220/37963 [82:06:34<10:26:45, 10.05s/it]
 90%|█████████ | 34221/37963 [82:06:42<9:40:20,  9.31s/it] 
 90%|█████████ | 34222/37963 [82:06:49<9:06:34,  8.77s/it]
 90%|█████████ | 34223/37963 [82:06:57<8:44:47,  8.42s/it]
 90%|█████████ | 34224/37963 [82:07:05<8:31:08,  8.20s/it]
 90%|█████████ | 34225/37963 [82:07:12<8:17:42,  7.99s/it]
 90%|█████████ | 34226/37963 [82:07:20<8:10:58,  7.88s/it]
 90%|█████████ | 34227/37963 [82:07:27<8:06:50,  7.82s/it]
 90%|█████████ | 34228/37963 [82:07:35<8:01:12,  7.73s/it]
 90%|█████████ | 34229/37963 [82:07:42<7:55:55,  7.65s/it]
 90%|█████████ | 34230/37963 [82:07:50<7:51:28,  7.58s/it]
                                                          
{'loss': '0.08988', 'grad_norm': '2.859', 'learning_rate': '5.031e-07', 'epoch': '0.9017'}

 90%|█████████ | 34230/37963 [82:07:50<7:51:28,  7.58s/it]
 90%|█████████ | 34231/37963 [82:07:57<7:51:21,  7.58s/it]
 90%|█████████ | 34232/37963 [82:08:05<7:52:41,  7.60s/it]
 90%|█████████ | 34233/37963 [82:08:13<7:49:57,  7.56s/it]
 90%|█████████ | 34234/37963 [82:08:20<7:50:34,  7.57s/it]
 90%|█████████ | 34235/37963 [82:08:28<7:51:32,  7.59s/it]
 90%|█████████ | 34236/37963 [82:08:42<9:48:48,  9.48s/it]
 90%|█████████ | 34237/37963 [82:08:49<9:12:13,  8.89s/it]
 90%|█████████ | 34238/37963 [82:08:56<8:41:06,  8.39s/it]
 90%|█████████ | 34239/37963 [82:09:04<8:18:39,  8.03s/it]
 90%|█████████ | 34240/37963 [82:09:11<8:08:49,  7.88s/it]
                                                          
{'loss': '0.1037', 'grad_norm': '4.03', 'learning_rate': '5.005e-07', 'epoch': '0.9019'}

 90%|█████████ | 34240/37963 [82:09:11<8:08:49,  7.88s/it]
 90%|█████████ | 34241/37963 [82:09:25<9:59:35,  9.67s/it]
 90%|█████████ | 34242/37963 [82:09:39<11:23:57, 11.03s/it]
 90%|█████████ | 34243/37963 [82:09:47<10:19:15,  9.99s/it]
 90%|█████████ | 34244/37963 [82:09:54<9:33:59,  9.26s/it] 
 90%|█████████ | 34245/37963 [82:10:02<9:04:36,  8.79s/it]
 90%|█████████ | 34246/37963 [82:10:10<8:41:47,  8.42s/it]
 90%|█████████ | 34247/37963 [82:10:17<8:23:56,  8.14s/it]
 90%|█████████ | 34248/37963 [82:10:25<8:14:44,  7.99s/it]
 90%|█████████ | 34249/37963 [82:10:45<12:09:28, 11.78s/it]
 90%|█████████ | 34250/37963 [82:10:53<10:52:20, 10.54s/it]
                                                           
{'loss': '0.08299', 'grad_norm': '2.807', 'learning_rate': '4.978e-07', 'epoch': '0.9022'}

 90%|█████████ | 34250/37963 [82:10:53<10:52:20, 10.54s/it]
 90%|█████████ | 34251/37963 [82:11:00<9:54:27,  9.61s/it] 
 90%|█████████ | 34252/37963 [82:11:14<11:17:19, 10.95s/it]
 90%|█████████ | 34253/37963 [82:11:22<10:13:20,  9.92s/it]
 90%|█████████ | 34254/37963 [82:11:30<9:29:37,  9.21s/it] 
 90%|█████████ | 34255/37963 [82:11:37<9:00:33,  8.75s/it]
 90%|█████████ | 34256/37963 [82:11:45<8:34:26,  8.33s/it]
 90%|█████████ | 34257/37963 [82:11:52<8:20:24,  8.10s/it]
 90%|█████████ | 34258/37963 [82:12:00<8:10:58,  7.95s/it]
 90%|█████████ | 34259/37963 [82:12:07<8:04:25,  7.85s/it]
 90%|█████████ | 34260/37963 [82:12:15<7:58:56,  7.76s/it]
                                                          
{'loss': '0.08494', 'grad_norm': '2.935', 'learning_rate': '4.951e-07', 'epoch': '0.9025'}

 90%|█████████ | 34260/37963 [82:12:15<7:58:56,  7.76s/it]
 90%|█████████ | 34261/37963 [82:12:22<7:54:04,  7.68s/it]
 90%|█████████ | 34262/37963 [82:12:30<7:49:35,  7.61s/it]
 90%|█████████ | 34263/37963 [82:12:37<7:48:10,  7.59s/it]
 90%|█████████ | 34264/37963 [82:12:51<9:42:05,  9.44s/it]
 90%|█████████ | 34265/37963 [82:12:59<9:06:27,  8.87s/it]
 90%|█████████ | 34266/37963 [82:13:06<8:40:39,  8.45s/it]
 90%|█████████ | 34267/37963 [82:13:14<8:22:01,  8.15s/it]
 90%|█████████ | 34268/37963 [82:13:27<10:06:53,  9.85s/it]
 90%|█████████ | 34269/37963 [82:13:35<9:23:59,  9.16s/it] 
 90%|█████████ | 34270/37963 [82:13:42<8:53:08,  8.66s/it]
                                                          
{'loss': '0.08023', 'grad_norm': '3.026', 'learning_rate': '4.925e-07', 'epoch': '0.9027'}

 90%|█████████ | 34270/37963 [82:13:43<8:53:08,  8.66s/it]
 90%|█████████ | 34271/37963 [82:13:50<8:33:13,  8.34s/it]
 90%|█████████ | 34272/37963 [82:13:58<8:21:17,  8.15s/it]
 90%|█████████ | 34273/37963 [82:14:05<8:07:06,  7.92s/it]
 90%|█████████ | 34274/37963 [82:14:13<7:59:09,  7.79s/it]
 90%|█████████ | 34275/37963 [82:14:20<7:51:51,  7.68s/it]
 90%|█████████ | 34276/37963 [82:14:28<7:48:34,  7.63s/it]
 90%|█████████ | 34277/37963 [82:14:35<7:45:04,  7.57s/it]
 90%|█████████ | 34278/37963 [82:14:42<7:40:05,  7.49s/it]
 90%|█████████ | 34279/37963 [82:14:50<7:38:48,  7.47s/it]
 90%|█████████ | 34280/37963 [82:14:57<7:38:43,  7.47s/it]
                                                          
{'loss': '0.07554', 'grad_norm': '4.52', 'learning_rate': '4.899e-07', 'epoch': '0.903'}

 90%|█████████ | 34280/37963 [82:14:57<7:38:43,  7.47s/it]
 90%|█████████ | 34281/37963 [82:15:11<9:42:08,  9.49s/it]
 90%|█████████ | 34282/37963 [82:15:19<9:00:47,  8.81s/it]
 90%|█████████ | 34283/37963 [82:15:26<8:34:15,  8.38s/it]
 90%|█████████ | 34284/37963 [82:15:34<8:19:01,  8.14s/it]
 90%|█████████ | 34285/37963 [82:15:41<8:09:36,  7.99s/it]
 90%|█████████ | 34286/37963 [82:15:49<8:00:29,  7.84s/it]
 90%|█████████ | 34287/37963 [82:15:56<7:49:50,  7.67s/it]
 90%|█████████ | 34288/37963 [82:16:10<9:39:12,  9.46s/it]
 90%|█████████ | 34289/37963 [82:16:17<9:04:27,  8.89s/it]
 90%|█████████ | 34290/37963 [82:16:25<8:39:58,  8.49s/it]
                                                          
{'loss': '0.07536', 'grad_norm': '3.538', 'learning_rate': '4.872e-07', 'epoch': '0.9033'}

 90%|█████████ | 34290/37963 [82:16:25<8:39:58,  8.49s/it]
 90%|█████████ | 34291/37963 [82:16:32<8:21:20,  8.19s/it]
 90%|█████████ | 34292/37963 [82:16:39<8:04:34,  7.92s/it]
 90%|█████████ | 34293/37963 [82:16:53<9:47:09,  9.60s/it]
 90%|█████████ | 34294/37963 [82:17:01<9:12:11,  9.03s/it]
 90%|█████████ | 34295/37963 [82:17:08<8:48:30,  8.65s/it]
 90%|█████████ | 34296/37963 [82:17:22<10:25:10, 10.23s/it]
 90%|█████████ | 34297/37963 [82:17:43<13:28:33, 13.23s/it]
 90%|█████████ | 34298/37963 [82:17:50<11:46:18, 11.56s/it]
 90%|█████████ | 34299/37963 [82:17:58<10:32:22, 10.36s/it]
 90%|█████████ | 34300/37963 [82:18:05<9:40:09,  9.50s/it] 
                                                          
{'loss': '0.08181', 'grad_norm': '3.261', 'learning_rate': '4.846e-07', 'epoch': '0.9035'}

 90%|█████████ | 34300/37963 [82:18:05<9:40:09,  9.50s/it]
 90%|█████████ | 34301/37963 [82:18:13<9:04:22,  8.92s/it]
 90%|█████████ | 34302/37963 [82:18:20<8:38:55,  8.50s/it]
 90%|█████████ | 34303/37963 [82:18:28<8:21:43,  8.22s/it]
 90%|█████████ | 34304/37963 [82:18:36<8:08:44,  8.01s/it]
 90%|█████████ | 34305/37963 [82:18:43<7:59:32,  7.87s/it]
 90%|█████████ | 34306/37963 [82:18:51<7:54:39,  7.79s/it]
 90%|█████████ | 34307/37963 [82:19:05<9:50:08,  9.68s/it]
 90%|█████████ | 34308/37963 [82:19:12<9:13:49,  9.09s/it]
 90%|█████████ | 34309/37963 [82:19:20<8:43:06,  8.59s/it]
 90%|█████████ | 34310/37963 [82:19:27<8:24:07,  8.28s/it]
                                                          
{'loss': '0.07974', 'grad_norm': '4.154', 'learning_rate': '4.82e-07', 'epoch': '0.9038'}

 90%|█████████ | 34310/37963 [82:19:27<8:24:07,  8.28s/it]
 90%|█████████ | 34311/37963 [82:19:35<8:12:57,  8.10s/it]
 90%|█████████ | 34312/37963 [82:19:43<8:02:11,  7.92s/it]
 90%|█████████ | 34313/37963 [82:19:50<7:55:45,  7.82s/it]
 90%|█████████ | 34314/37963 [82:19:58<7:49:32,  7.72s/it]
 90%|█████████ | 34315/37963 [82:20:12<9:44:47,  9.62s/it]
 90%|█████████ | 34316/37963 [82:20:19<9:09:08,  9.03s/it]
 90%|█████████ | 34317/37963 [82:20:27<8:41:16,  8.58s/it]
 90%|█████████ | 34318/37963 [82:20:35<8:22:53,  8.28s/it]
 90%|█████████ | 34319/37963 [82:20:42<8:07:38,  8.03s/it]
 90%|█████████ | 34320/37963 [82:20:49<7:57:37,  7.87s/it]
                                                          
{'loss': '0.08374', 'grad_norm': '2.96', 'learning_rate': '4.794e-07', 'epoch': '0.904'}

 90%|█████████ | 34320/37963 [82:20:49<7:57:37,  7.87s/it]
 90%|█████████ | 34321/37963 [82:20:57<7:48:02,  7.71s/it]
 90%|█████████ | 34322/37963 [82:21:04<7:44:10,  7.65s/it]
 90%|█████████ | 34323/37963 [82:21:12<7:43:26,  7.64s/it]
 90%|█████████ | 34324/37963 [82:21:19<7:38:58,  7.57s/it]
 90%|█████████ | 34325/37963 [82:21:27<7:37:42,  7.55s/it]
 90%|█████████ | 34326/37963 [82:21:34<7:38:21,  7.56s/it]
 90%|█████████ | 34327/37963 [82:21:48<9:29:14,  9.39s/it]
 90%|█████████ | 34328/37963 [82:21:56<8:56:13,  8.85s/it]
 90%|█████████ | 34329/37963 [82:22:03<8:31:34,  8.45s/it]
 90%|█████████ | 34330/37963 [82:22:11<8:16:58,  8.21s/it]
                                                          
{'loss': '0.08346', 'grad_norm': '4.555', 'learning_rate': '4.768e-07', 'epoch': '0.9043'}

 90%|█████████ | 34330/37963 [82:22:11<8:16:58,  8.21s/it]
 90%|█████████ | 34331/37963 [82:22:18<8:04:32,  8.00s/it]
 90%|█████████ | 34332/37963 [82:22:26<7:57:35,  7.89s/it]
 90%|█████████ | 34333/37963 [82:22:34<7:52:42,  7.81s/it]
 90%|█████████ | 34334/37963 [82:22:41<7:45:59,  7.70s/it]
 90%|█████████ | 34335/37963 [82:22:54<9:28:42,  9.41s/it]
 90%|█████████ | 34336/37963 [82:23:02<8:51:38,  8.79s/it]
 90%|█████████ | 34337/37963 [82:23:09<8:22:51,  8.32s/it]
 90%|█████████ | 34338/37963 [82:23:17<8:10:02,  8.11s/it]
 90%|█████████ | 34339/37963 [82:23:24<8:00:24,  7.95s/it]
 90%|█████████ | 34340/37963 [82:23:32<7:53:51,  7.85s/it]
                                                          
{'loss': '0.07992', 'grad_norm': '5.843', 'learning_rate': '4.742e-07', 'epoch': '0.9046'}

 90%|█████████ | 34340/37963 [82:23:32<7:53:51,  7.85s/it]
 90%|█████████ | 34341/37963 [82:23:46<9:42:15,  9.65s/it]
 90%|█████████ | 34342/37963 [82:23:53<9:03:30,  9.01s/it]
 90%|█████████ | 34343/37963 [82:24:07<10:35:47, 10.54s/it]
 90%|█████████ | 34344/37963 [82:24:15<9:42:08,  9.65s/it] 
 90%|█████████ | 34345/37963 [82:24:23<9:05:19,  9.04s/it]
 90%|█████████ | 34346/37963 [82:24:37<10:34:33, 10.53s/it]
 90%|█████████ | 34347/37963 [82:24:50<11:35:02, 11.53s/it]
 90%|█████████ | 34348/37963 [82:24:58<10:23:06, 10.34s/it]
 90%|█████████ | 34349/37963 [82:25:05<9:30:56,  9.48s/it] 
 90%|█████████ | 34350/37963 [82:25:13<8:57:25,  8.92s/it]
                                                          
{'loss': '0.08436', 'grad_norm': '3.13', 'learning_rate': '4.716e-07', 'epoch': '0.9048'}

 90%|█████████ | 34350/37963 [82:25:13<8:57:25,  8.92s/it]
 90%|█████████ | 34351/37963 [82:25:21<8:32:47,  8.52s/it]
 90%|█████████ | 34352/37963 [82:25:28<8:15:15,  8.23s/it]
 90%|█████████ | 34353/37963 [82:25:36<8:04:18,  8.05s/it]
 90%|█████████ | 34354/37963 [82:25:43<7:54:22,  7.89s/it]
 90%|█████████ | 34355/37963 [82:25:51<7:45:53,  7.75s/it]
 90%|█████████ | 34356/37963 [82:25:58<7:42:48,  7.70s/it]
 91%|█████████ | 34357/37963 [82:26:06<7:39:52,  7.65s/it]
 91%|█████████ | 34358/37963 [82:26:20<9:35:21,  9.58s/it]
 91%|█████████ | 34359/37963 [82:26:28<8:59:52,  8.99s/it]
 91%|█████████ | 34360/37963 [82:26:35<8:30:37,  8.50s/it]
                                                          
{'loss': '0.07513', 'grad_norm': '3.038', 'learning_rate': '4.69e-07', 'epoch': '0.9051'}

 91%|█████████ | 34360/37963 [82:26:35<8:30:37,  8.50s/it]
 91%|█████████ | 34361/37963 [82:26:42<8:08:10,  8.13s/it]
 91%|█████████ | 34362/37963 [82:26:50<7:58:29,  7.97s/it]
 91%|█████████ | 34363/37963 [82:26:57<7:48:11,  7.80s/it]
 91%|█████████ | 34364/37963 [82:27:05<7:40:16,  7.67s/it]
 91%|█████████ | 34365/37963 [82:27:12<7:38:18,  7.64s/it]
 91%|█████████ | 34366/37963 [82:27:26<9:30:58,  9.52s/it]
 91%|█████████ | 34367/37963 [82:27:34<8:56:02,  8.94s/it]
 91%|█████████ | 34368/37963 [82:27:41<8:25:43,  8.44s/it]
 91%|█████████ | 34369/37963 [82:27:48<8:09:03,  8.16s/it]
 91%|█████████ | 34370/37963 [82:27:56<7:54:38,  7.93s/it]
                                                          
{'loss': '0.0847', 'grad_norm': '3.307', 'learning_rate': '4.664e-07', 'epoch': '0.9054'}

 91%|█████████ | 34370/37963 [82:27:56<7:54:38,  7.93s/it]
 91%|█████████ | 34371/37963 [82:28:03<7:45:44,  7.78s/it]
 91%|█████████ | 34372/37963 [82:28:11<7:41:35,  7.71s/it]
 91%|█████████ | 34373/37963 [82:28:18<7:38:04,  7.66s/it]
 91%|█████████ | 34374/37963 [82:28:32<9:23:33,  9.42s/it]
 91%|█████████ | 34375/37963 [82:28:39<8:50:05,  8.86s/it]
 91%|█████████ | 34376/37963 [82:28:47<8:25:51,  8.46s/it]
 91%|█████████ | 34377/37963 [82:28:54<8:08:50,  8.18s/it]
 91%|█████████ | 34378/37963 [82:29:02<7:59:00,  8.02s/it]
 91%|█████████ | 34379/37963 [82:29:10<7:51:54,  7.90s/it]
 91%|█████████ | 34380/37963 [82:29:24<9:37:28,  9.67s/it]
                                                          
{'loss': '0.08587', 'grad_norm': '3.556', 'learning_rate': '4.638e-07', 'epoch': '0.9056'}

 91%|█████████ | 34380/37963 [82:29:24<9:37:28,  9.67s/it]
 91%|█████████ | 34381/37963 [82:29:31<9:00:49,  9.06s/it]
 91%|█████████ | 34382/37963 [82:29:39<8:34:35,  8.62s/it]
 91%|█████████ | 34383/37963 [82:29:46<8:14:31,  8.29s/it]
 91%|█████████ | 34384/37963 [82:29:54<7:58:39,  8.02s/it]
 91%|█████████ | 34385/37963 [82:30:01<7:49:53,  7.88s/it]
 91%|█████████ | 34386/37963 [82:30:09<7:44:29,  7.79s/it]
 91%|█████████ | 34387/37963 [82:30:16<7:39:12,  7.70s/it]
 91%|█████████ | 34388/37963 [82:30:24<7:35:04,  7.64s/it]
 91%|█████████ | 34389/37963 [82:30:38<9:26:53,  9.52s/it]
 91%|█████████ | 34390/37963 [82:30:45<8:47:18,  8.85s/it]
                                                          
{'loss': '0.08496', 'grad_norm': '3.276', 'learning_rate': '4.613e-07', 'epoch': '0.9059'}

 91%|█████████ | 34390/37963 [82:30:45<8:47:18,  8.85s/it]
 91%|█████████ | 34391/37963 [82:30:53<8:23:15,  8.45s/it]
 91%|█████████ | 34392/37963 [82:31:07<10:08:26, 10.22s/it]
 91%|█████████ | 34393/37963 [82:31:14<9:15:32,  9.34s/it] 
 91%|█████████ | 34394/37963 [82:31:22<8:40:41,  8.75s/it]
 91%|█████████ | 34395/37963 [82:31:29<8:20:02,  8.41s/it]
 91%|█████████ | 34396/37963 [82:31:43<10:01:22, 10.12s/it]
 91%|█████████ | 34397/37963 [82:31:57<11:11:00, 11.29s/it]
 91%|█████████ | 34398/37963 [82:32:05<10:04:11, 10.17s/it]
 91%|█████████ | 34399/37963 [82:32:12<9:16:51,  9.37s/it] 
 91%|█████████ | 34400/37963 [82:32:20<8:38:00,  8.72s/it]
                                                          
{'loss': '0.08583', 'grad_norm': '3.126', 'learning_rate': '4.587e-07', 'epoch': '0.9061'}

 91%|█████████ | 34400/37963 [82:32:20<8:38:00,  8.72s/it]
 91%|█████████ | 34401/37963 [82:32:27<8:18:22,  8.39s/it]
 91%|█████████ | 34402/37963 [82:32:35<8:01:46,  8.12s/it]
 91%|█████████ | 34403/37963 [82:32:42<7:52:34,  7.96s/it]
 91%|█████████ | 34404/37963 [82:32:50<7:42:29,  7.80s/it]
 91%|█████████ | 34405/37963 [82:32:57<7:38:28,  7.73s/it]
 91%|█████████ | 34406/37963 [82:33:05<7:34:30,  7.67s/it]
 91%|█████████ | 34407/37963 [82:33:19<9:30:09,  9.62s/it]
 91%|█████████ | 34408/37963 [82:33:27<8:58:50,  9.09s/it]
 91%|█████████ | 34409/37963 [82:33:34<8:31:46,  8.64s/it]
 91%|█████████ | 34410/37963 [82:33:42<8:12:11,  8.31s/it]
                                                          
{'loss': '0.08127', 'grad_norm': '2.563', 'learning_rate': '4.562e-07', 'epoch': '0.9064'}

 91%|█████████ | 34410/37963 [82:33:42<8:12:11,  8.31s/it]
 91%|█████████ | 34411/37963 [82:33:49<7:55:35,  8.03s/it]
 91%|█████████ | 34412/37963 [82:33:57<7:45:20,  7.86s/it]
 91%|█████████ | 34413/37963 [82:34:04<7:33:42,  7.67s/it]
 91%|█████████ | 34414/37963 [82:34:12<7:31:03,  7.63s/it]
 91%|█████████ | 34415/37963 [82:34:19<7:29:32,  7.60s/it]
 91%|█████████ | 34416/37963 [82:34:33<9:23:05,  9.53s/it]
 91%|█████████ | 34417/37963 [82:34:41<8:47:58,  8.93s/it]
 91%|█████████ | 34418/37963 [82:34:48<8:17:57,  8.43s/it]
 91%|█████████ | 34419/37963 [82:34:55<8:02:05,  8.16s/it]
 91%|█████████ | 34420/37963 [82:35:03<7:47:18,  7.91s/it]
                                                          
{'loss': '0.08552', 'grad_norm': '3.133', 'learning_rate': '4.536e-07', 'epoch': '0.9067'}

 91%|█████████ | 34420/37963 [82:35:03<7:47:18,  7.91s/it]
 91%|█████████ | 34421/37963 [82:35:10<7:42:03,  7.83s/it]
 91%|█████████ | 34422/37963 [82:35:24<9:30:01,  9.66s/it]
 91%|█████████ | 34423/37963 [82:35:32<8:52:10,  9.02s/it]
 91%|█████████ | 34424/37963 [82:35:39<8:24:52,  8.56s/it]
 91%|█████████ | 34425/37963 [82:35:47<8:05:54,  8.24s/it]
 91%|█████████ | 34426/37963 [82:35:55<7:56:41,  8.09s/it]
 91%|█████████ | 34427/37963 [82:36:02<7:47:42,  7.94s/it]
 91%|█████████ | 34428/37963 [82:36:10<7:40:12,  7.81s/it]
 91%|█████████ | 34429/37963 [82:36:17<7:34:45,  7.72s/it]
 91%|█████████ | 34430/37963 [82:36:31<9:22:38,  9.56s/it]
                                                          
{'loss': '0.07888', 'grad_norm': '2.972', 'learning_rate': '4.511e-07', 'epoch': '0.9069'}

 91%|█████████ | 34430/37963 [82:36:31<9:22:38,  9.56s/it]
 91%|█████████ | 34431/37963 [82:36:38<8:42:29,  8.88s/it]
 91%|█████████ | 34432/37963 [82:36:46<8:13:53,  8.39s/it]
 91%|█████████ | 34433/37963 [82:37:00<9:55:07, 10.12s/it]
 91%|█████████ | 34434/37963 [82:37:07<9:12:26,  9.39s/it]
 91%|█████████ | 34435/37963 [82:37:15<8:37:16,  8.80s/it]
 91%|█████████ | 34436/37963 [82:37:22<8:15:36,  8.43s/it]
 91%|█████████ | 34437/37963 [82:37:30<8:00:41,  8.18s/it]
 91%|█████████ | 34438/37963 [82:37:37<7:49:04,  7.98s/it]
 91%|█████████ | 34439/37963 [82:37:45<7:41:52,  7.86s/it]
 91%|█████████ | 34440/37963 [82:37:53<7:36:15,  7.77s/it]
                                                          
{'loss': '0.08284', 'grad_norm': '2.824', 'learning_rate': '4.485e-07', 'epoch': '0.9072'}

 91%|█████████ | 34440/37963 [82:37:53<7:36:15,  7.77s/it]
 91%|█████████ | 34441/37963 [82:38:00<7:33:20,  7.72s/it]
 91%|█████████ | 34442/37963 [82:38:08<7:27:54,  7.63s/it]
 91%|█████████ | 34443/37963 [82:38:22<9:24:14,  9.62s/it]
 91%|█████████ | 34444/37963 [82:38:29<8:48:21,  9.01s/it]
 91%|█████████ | 34445/37963 [82:38:37<8:21:24,  8.55s/it]
 91%|█████████ | 34446/37963 [82:38:51<9:58:10, 10.20s/it]
 91%|█████████ | 34447/37963 [82:39:05<11:04:46, 11.34s/it]
 91%|█████████ | 34448/37963 [82:39:13<9:59:21, 10.23s/it] 
 91%|█████████ | 34449/37963 [82:39:20<9:08:17,  9.36s/it]
 91%|█████████ | 34450/37963 [82:39:27<8:34:27,  8.79s/it]
                                                          
{'loss': '0.07457', 'grad_norm': '3.501', 'learning_rate': '4.46e-07', 'epoch': '0.9075'}

 91%|█████████ | 34450/37963 [82:39:27<8:34:27,  8.79s/it]
 91%|█████████ | 34451/37963 [82:39:35<8:15:07,  8.46s/it]
 91%|█████████ | 34452/37963 [82:39:43<7:55:49,  8.13s/it]
 91%|█████████ | 34453/37963 [82:39:50<7:45:45,  7.96s/it]
 91%|█████████ | 34454/37963 [82:39:58<7:38:55,  7.85s/it]
 91%|█████████ | 34455/37963 [82:40:05<7:34:19,  7.77s/it]
 91%|█████████ | 34456/37963 [82:40:13<7:29:00,  7.68s/it]
 91%|█████████ | 34457/37963 [82:40:20<7:26:17,  7.64s/it]
 91%|█████████ | 34458/37963 [82:40:28<7:20:57,  7.55s/it]
 91%|█████████ | 34459/37963 [82:40:35<7:21:58,  7.57s/it]
 91%|█████████ | 34460/37963 [82:40:56<11:06:54, 11.42s/it]
                                                           
{'loss': '0.07897', 'grad_norm': '3.009', 'learning_rate': '4.435e-07', 'epoch': '0.9077'}

 91%|█████████ | 34460/37963 [82:40:56<11:06:54, 11.42s/it]
 91%|█████████ | 34461/37963 [82:41:03<9:58:58, 10.26s/it] 
 91%|█████████ | 34462/37963 [82:41:11<9:12:06,  9.46s/it]
 91%|█████████ | 34463/37963 [82:41:18<8:36:02,  8.85s/it]
 91%|█████████ | 34464/37963 [82:41:26<8:15:08,  8.49s/it]
 91%|█████████ | 34465/37963 [82:41:33<7:58:09,  8.20s/it]
 91%|█████████ | 34466/37963 [82:41:41<7:42:57,  7.94s/it]
 91%|█████████ | 34467/37963 [82:41:48<7:34:55,  7.81s/it]
 91%|█████████ | 34468/37963 [82:41:56<7:29:13,  7.71s/it]
 91%|█████████ | 34469/37963 [82:42:03<7:27:05,  7.68s/it]
 91%|█████████ | 34470/37963 [82:42:17<9:15:10,  9.54s/it]
                                                          
{'loss': '0.08807', 'grad_norm': '4.348', 'learning_rate': '4.41e-07', 'epoch': '0.908'}

 91%|█████████ | 34470/37963 [82:42:17<9:15:10,  9.54s/it]
 91%|█████████ | 34471/37963 [82:42:25<8:41:58,  8.97s/it]
 91%|█████████ | 34472/37963 [82:42:32<8:16:26,  8.53s/it]
 91%|█████████ | 34473/37963 [82:42:39<7:52:09,  8.12s/it]
 91%|█████████ | 34474/37963 [82:42:47<7:43:06,  7.96s/it]
 91%|█████████ | 34475/37963 [82:42:54<7:31:14,  7.76s/it]
 91%|█████████ | 34476/37963 [82:43:02<7:27:13,  7.70s/it]
 91%|█████████ | 34477/37963 [82:43:09<7:24:27,  7.65s/it]
 91%|█████████ | 34478/37963 [82:43:23<9:09:24,  9.46s/it]
 91%|█████████ | 34479/37963 [82:43:31<8:35:15,  8.87s/it]
 91%|█████████ | 34480/37963 [82:43:38<8:11:58,  8.48s/it]
                                                          
{'loss': '0.08393', 'grad_norm': '3.034', 'learning_rate': '4.385e-07', 'epoch': '0.9083'}

 91%|█████████ | 34480/37963 [82:43:38<8:11:58,  8.48s/it]
 91%|█████████ | 34481/37963 [82:43:46<7:55:17,  8.19s/it]
 91%|█████████ | 34482/37963 [82:43:53<7:44:02,  8.00s/it]
 91%|█████████ | 34483/37963 [82:44:01<7:37:41,  7.89s/it]
 91%|█████████ | 34484/37963 [82:44:08<7:29:30,  7.75s/it]
 91%|█████████ | 34485/37963 [82:44:16<7:24:08,  7.66s/it]
 91%|█████████ | 34486/37963 [82:44:23<7:20:07,  7.59s/it]
 91%|█████████ | 34487/37963 [82:44:37<9:12:56,  9.54s/it]
 91%|█████████ | 34488/37963 [82:44:45<8:38:17,  8.95s/it]
 91%|█████████ | 34489/37963 [82:44:52<8:13:38,  8.53s/it]
 91%|█████████ | 34490/37963 [82:45:00<7:56:07,  8.23s/it]
                                                          
{'loss': '0.07647', 'grad_norm': '3.408', 'learning_rate': '4.36e-07', 'epoch': '0.9085'}

 91%|█████████ | 34490/37963 [82:45:00<7:56:07,  8.23s/it]
 91%|█████████ | 34491/37963 [82:45:14<9:40:24, 10.03s/it]
 91%|█████████ | 34492/37963 [82:45:22<8:55:06,  9.25s/it]
 91%|█████████ | 34493/37963 [82:45:29<8:24:54,  8.73s/it]
 91%|█████████ | 34494/37963 [82:45:37<8:06:33,  8.42s/it]
 91%|█████████ | 34495/37963 [82:45:44<7:51:40,  8.16s/it]
 91%|█████████ | 34496/37963 [82:45:59<9:34:51,  9.95s/it]
 91%|█████████ | 34497/37963 [82:46:06<8:53:31,  9.24s/it]
 91%|█████████ | 34498/37963 [82:46:14<8:23:26,  8.72s/it]
 91%|█████████ | 34499/37963 [82:46:28<9:53:55, 10.29s/it]
 91%|█████████ | 34500/37963 [82:46:35<9:06:06,  9.46s/it]
                                                          
{'loss': '0.08956', 'grad_norm': '3.496', 'learning_rate': '4.335e-07', 'epoch': '0.9088'}

 91%|█████████ | 34500/37963 [82:46:35<9:06:06,  9.46s/it]
 91%|█████████ | 34501/37963 [82:46:43<8:32:05,  8.88s/it]
 91%|█████████ | 34502/37963 [82:46:50<8:06:25,  8.43s/it]
 91%|█████████ | 34503/37963 [82:46:57<7:50:18,  8.16s/it]
 91%|█████████ | 34504/37963 [82:47:05<7:39:11,  7.97s/it]
 91%|█████████ | 34505/37963 [82:47:13<7:31:59,  7.84s/it]
 91%|█████████ | 34506/37963 [82:47:20<7:25:26,  7.73s/it]
 91%|█████████ | 34507/37963 [82:47:28<7:23:36,  7.70s/it]
 91%|█████████ | 34508/37963 [82:47:48<11:03:26, 11.52s/it]
 91%|█████████ | 34509/37963 [82:47:56<9:53:59, 10.32s/it] 
 91%|█████████ | 34510/37963 [82:48:03<9:02:35,  9.43s/it]
                                                          
{'loss': '0.07467', 'grad_norm': '3.981', 'learning_rate': '4.31e-07', 'epoch': '0.909'}

 91%|█████████ | 34510/37963 [82:48:03<9:02:35,  9.43s/it]
 91%|█████████ | 34511/37963 [82:48:10<8:24:41,  8.77s/it]
 91%|█████████ | 34512/37963 [82:48:18<8:00:29,  8.35s/it]
 91%|█████████ | 34513/37963 [82:48:25<7:45:32,  8.10s/it]
 91%|█████████ | 34514/37963 [82:48:39<9:32:06,  9.95s/it]
 91%|█████████ | 34515/37963 [82:48:47<8:51:48,  9.25s/it]
 91%|█████████ | 34516/37963 [82:48:55<8:25:04,  8.79s/it]
 91%|█████████ | 34517/37963 [82:49:02<8:04:46,  8.44s/it]
 91%|█████████ | 34518/37963 [82:49:10<7:50:50,  8.20s/it]
 91%|█████████ | 34519/37963 [82:49:17<7:36:15,  7.95s/it]
 91%|█████████ | 34520/37963 [82:49:25<7:30:19,  7.85s/it]
                                                          
{'loss': '0.08634', 'grad_norm': '3.825', 'learning_rate': '4.286e-07', 'epoch': '0.9093'}

 91%|█████████ | 34520/37963 [82:49:25<7:30:19,  7.85s/it]
 91%|█████████ | 34521/37963 [82:49:32<7:23:32,  7.73s/it]
 91%|█████████ | 34522/37963 [82:49:46<9:12:06,  9.63s/it]
 91%|█████████ | 34523/37963 [82:49:54<8:40:31,  9.08s/it]
 91%|█████████ | 34524/37963 [82:50:02<8:14:29,  8.63s/it]
 91%|█████████ | 34525/37963 [82:50:09<7:56:31,  8.32s/it]
 91%|█████████ | 34526/37963 [82:50:17<7:41:39,  8.06s/it]
 91%|█████████ | 34527/37963 [82:50:24<7:33:26,  7.92s/it]
 91%|█████████ | 34528/37963 [82:50:32<7:25:51,  7.79s/it]
 91%|█████████ | 34529/37963 [82:50:39<7:17:26,  7.64s/it]
 91%|█████████ | 34530/37963 [82:50:47<7:15:09,  7.61s/it]
                                                          
{'loss': '0.0742', 'grad_norm': '2.663', 'learning_rate': '4.261e-07', 'epoch': '0.9096'}

 91%|█████████ | 34530/37963 [82:50:47<7:15:09,  7.61s/it]
 91%|█████████ | 34531/37963 [82:50:54<7:13:57,  7.59s/it]
 91%|█████████ | 34532/37963 [82:51:02<7:15:01,  7.61s/it]
 91%|█████████ | 34533/37963 [82:51:10<7:16:15,  7.63s/it]
 91%|█████████ | 34534/37963 [82:51:24<9:06:53,  9.57s/it]
 91%|█████████ | 34535/37963 [82:51:31<8:31:25,  8.95s/it]
 91%|█████████ | 34536/37963 [82:51:39<8:03:39,  8.47s/it]
 91%|█████████ | 34537/37963 [82:51:46<7:48:02,  8.20s/it]
 91%|█████████ | 34538/37963 [82:51:54<7:36:13,  7.99s/it]
 91%|█████████ | 34539/37963 [82:52:01<7:27:20,  7.84s/it]
 91%|█████████ | 34540/37963 [82:52:08<7:17:37,  7.67s/it]
                                                          
{'loss': '0.08206', 'grad_norm': '2.899', 'learning_rate': '4.236e-07', 'epoch': '0.9098'}

 91%|█████████ | 34540/37963 [82:52:08<7:17:37,  7.67s/it]
 91%|█████████ | 34541/37963 [82:52:29<10:53:02, 11.45s/it]
 91%|█████████ | 34542/37963 [82:52:36<9:48:22, 10.32s/it] 
 91%|█████████ | 34543/37963 [82:52:44<9:03:06,  9.53s/it]
 91%|█████████ | 34544/37963 [82:52:52<8:29:05,  8.93s/it]
 91%|█████████ | 34545/37963 [82:53:06<9:56:08, 10.46s/it]
 91%|█████████ | 34546/37963 [82:53:13<9:07:30,  9.61s/it]
 91%|█████████ | 34547/37963 [82:53:21<8:30:51,  8.97s/it]
 91%|█████████ | 34548/37963 [82:53:28<8:06:18,  8.54s/it]
 91%|█████████ | 34549/37963 [82:53:36<7:49:09,  8.25s/it]
 91%|█████████ | 34550/37963 [82:53:43<7:36:59,  8.03s/it]
                                                          
{'loss': '0.08913', 'grad_norm': '2.51', 'learning_rate': '4.212e-07', 'epoch': '0.9101'}

 91%|█████████ | 34550/37963 [82:53:43<7:36:59,  8.03s/it]
 91%|█████████ | 34551/37963 [82:53:51<7:28:23,  7.88s/it]
 91%|█████████ | 34552/37963 [82:53:58<7:17:55,  7.70s/it]
 91%|█████████ | 34553/37963 [82:54:12<9:04:53,  9.59s/it]
 91%|█████████ | 34554/37963 [82:54:20<8:27:55,  8.94s/it]
 91%|█████████ | 34555/37963 [82:54:34<9:56:51, 10.51s/it]
 91%|█████████ | 34556/37963 [82:54:41<9:06:57,  9.63s/it]
 91%|█████████ | 34557/37963 [82:54:49<8:29:04,  8.97s/it]
 91%|█████████ | 34558/37963 [82:54:56<7:58:56,  8.44s/it]
 91%|█████████ | 34559/37963 [82:55:04<7:45:46,  8.21s/it]
 91%|█████████ | 34560/37963 [82:55:18<9:28:09, 10.02s/it]
                                                          
{'loss': '0.0808', 'grad_norm': '4.466', 'learning_rate': '4.187e-07', 'epoch': '0.9104'}

 91%|█████████ | 34560/37963 [82:55:18<9:28:09, 10.02s/it]
 91%|█████████ | 34561/37963 [82:55:26<8:46:57,  9.29s/it]
 91%|█████████ | 34562/37963 [82:55:33<8:15:21,  8.74s/it]
 91%|█████████ | 34563/37963 [82:55:40<7:54:56,  8.38s/it]
 91%|█████████ | 34564/37963 [82:55:48<7:37:48,  8.08s/it]
 91%|█████████ | 34565/37963 [82:55:55<7:29:22,  7.93s/it]
 91%|█████████ | 34566/37963 [82:56:03<7:22:10,  7.81s/it]
 91%|█████████ | 34567/37963 [82:56:10<7:15:58,  7.70s/it]
 91%|█████████ | 34568/37963 [82:56:18<7:08:09,  7.57s/it]
 91%|█████████ | 34569/37963 [82:56:25<7:05:34,  7.52s/it]
 91%|█████████ | 34570/37963 [82:56:33<7:06:57,  7.55s/it]
                                                          
{'loss': '0.07859', 'grad_norm': '3.521', 'learning_rate': '4.163e-07', 'epoch': '0.9106'}

 91%|█████████ | 34570/37963 [82:56:33<7:06:57,  7.55s/it]
 91%|█████████ | 34571/37963 [82:56:40<7:08:24,  7.58s/it]
 91%|█████████ | 34572/37963 [82:56:54<8:54:28,  9.46s/it]
 91%|█████████ | 34573/37963 [82:57:02<8:23:07,  8.90s/it]
 91%|█████████ | 34574/37963 [82:57:10<8:02:10,  8.54s/it]
 91%|█████████ | 34575/37963 [82:57:17<7:46:39,  8.26s/it]
 91%|█████████ | 34576/37963 [82:57:25<7:34:42,  8.06s/it]
 91%|█████████ | 34577/37963 [82:57:32<7:26:38,  7.91s/it]
 91%|█████████ | 34578/37963 [82:57:40<7:23:39,  7.86s/it]
 91%|█████████ | 34579/37963 [82:57:48<7:18:11,  7.77s/it]
 91%|█████████ | 34580/37963 [82:57:55<7:10:25,  7.63s/it]
                                                          
{'loss': '0.09663', 'grad_norm': '3.238', 'learning_rate': '4.139e-07', 'epoch': '0.9109'}

 91%|█████████ | 34580/37963 [82:57:55<7:10:25,  7.63s/it]
 91%|█████████ | 34581/37963 [82:58:02<7:03:14,  7.51s/it]
 91%|█████████ | 34582/37963 [82:58:09<6:58:11,  7.42s/it]
 91%|█████████ | 34583/37963 [82:58:23<8:50:12,  9.41s/it]
 91%|█████████ | 34584/37963 [82:58:31<8:19:06,  8.86s/it]
 91%|█████████ | 34585/37963 [82:58:45<9:46:15, 10.41s/it]
 91%|█████████ | 34586/37963 [82:58:53<8:59:12,  9.58s/it]
 91%|█████████ | 34587/37963 [82:59:07<10:13:20, 10.90s/it]
 91%|█████████ | 34588/37963 [82:59:14<9:18:22,  9.93s/it] 
 91%|█████████ | 34589/37963 [82:59:22<8:37:18,  9.20s/it]
 91%|█████████ | 34590/37963 [82:59:29<8:08:22,  8.69s/it]
                                                          
{'loss': '0.07686', 'grad_norm': '3.476', 'learning_rate': '4.114e-07', 'epoch': '0.9112'}

 91%|█████████ | 34590/37963 [82:59:29<8:08:22,  8.69s/it]
 91%|█████████ | 34591/37963 [82:59:37<7:49:32,  8.35s/it]
 91%|█████████ | 34592/37963 [82:59:44<7:35:20,  8.10s/it]
 91%|█████████ | 34593/37963 [82:59:59<9:21:38, 10.00s/it]
 91%|█████████ | 34594/37963 [83:00:06<8:41:09,  9.28s/it]
 91%|█████████ | 34595/37963 [83:00:14<8:11:47,  8.76s/it]
 91%|█████████ | 34596/37963 [83:00:21<7:46:43,  8.32s/it]
 91%|█████████ | 34597/37963 [83:00:29<7:31:01,  8.04s/it]
 91%|█████████ | 34598/37963 [83:00:36<7:24:18,  7.92s/it]
 91%|█████████ | 34599/37963 [83:00:50<9:04:41,  9.72s/it]
 91%|█████████ | 34600/37963 [83:00:58<8:30:44,  9.11s/it]
                                                          
{'loss': '0.08702', 'grad_norm': '3.864', 'learning_rate': '4.09e-07', 'epoch': '0.9114'}

 91%|█████████ | 34600/37963 [83:00:58<8:30:44,  9.11s/it]
 91%|█████████ | 34601/37963 [83:01:12<9:51:55, 10.56s/it]
 91%|█████████ | 34602/37963 [83:01:19<9:00:50,  9.66s/it]
 91%|█████████ | 34603/37963 [83:01:27<8:24:05,  9.00s/it]
 91%|█████████ | 34604/37963 [83:01:34<7:56:51,  8.52s/it]
 91%|█████████ | 34605/37963 [83:01:42<7:36:44,  8.16s/it]
 91%|█████████ | 34606/37963 [83:01:49<7:27:41,  8.00s/it]
 91%|█████████ | 34607/37963 [83:01:57<7:18:00,  7.83s/it]
 91%|█████████ | 34608/37963 [83:02:04<7:12:34,  7.74s/it]
 91%|█████████ | 34609/37963 [83:02:18<8:56:57,  9.61s/it]
 91%|█████████ | 34610/37963 [83:02:26<8:22:57,  9.00s/it]
                                                          
{'loss': '0.09444', 'grad_norm': '3.042', 'learning_rate': '4.066e-07', 'epoch': '0.9117'}

 91%|█████████ | 34610/37963 [83:02:26<8:22:57,  9.00s/it]
 91%|█████████ | 34611/37963 [83:02:33<7:58:53,  8.57s/it]
 91%|█████████ | 34612/37963 [83:02:41<7:42:15,  8.28s/it]
 91%|█████████ | 34613/37963 [83:02:48<7:31:10,  8.08s/it]
 91%|█████████ | 34614/37963 [83:02:56<7:21:21,  7.91s/it]
 91%|█████████ | 34615/37963 [83:03:03<7:14:24,  7.79s/it]
 91%|█████████ | 34616/37963 [83:03:11<7:11:22,  7.73s/it]
 91%|█████████ | 34617/37963 [83:03:18<7:05:03,  7.62s/it]
 91%|█████████ | 34618/37963 [83:03:26<7:05:56,  7.64s/it]
 91%|█████████ | 34619/37963 [83:03:34<7:03:26,  7.60s/it]
 91%|█████████ | 34620/37963 [83:03:47<8:46:19,  9.45s/it]
                                                          
{'loss': '0.09005', 'grad_norm': '3.093', 'learning_rate': '4.042e-07', 'epoch': '0.9119'}

 91%|█████████ | 34620/37963 [83:03:47<8:46:19,  9.45s/it]
 91%|█████████ | 34621/37963 [83:03:55<8:15:06,  8.89s/it]
 91%|█████████ | 34622/37963 [83:04:03<7:52:20,  8.48s/it]
 91%|█████████ | 34623/37963 [83:04:10<7:36:18,  8.20s/it]
 91%|█████████ | 34624/37963 [83:04:18<7:26:31,  8.02s/it]
 91%|█████████ | 34625/37963 [83:04:25<7:17:58,  7.87s/it]
 91%|█████████ | 34626/37963 [83:04:33<7:11:19,  7.76s/it]
 91%|█████████ | 34627/37963 [83:04:40<7:07:43,  7.69s/it]
 91%|█████████ | 34628/37963 [83:04:54<8:48:47,  9.51s/it]
 91%|█████████ | 34629/37963 [83:05:08<10:02:10, 10.84s/it]
 91%|█████████ | 34630/37963 [83:05:15<9:07:56,  9.86s/it] 
                                                          
{'loss': '0.07922', 'grad_norm': '3.158', 'learning_rate': '4.018e-07', 'epoch': '0.9122'}

 91%|█████████ | 34630/37963 [83:05:15<9:07:56,  9.86s/it]
 91%|█████████ | 34631/37963 [83:05:23<8:30:48,  9.20s/it]
 91%|█████████ | 34632/37963 [83:05:31<8:01:45,  8.68s/it]
 91%|█████████ | 34633/37963 [83:05:38<7:43:06,  8.34s/it]
 91%|█████████ | 34634/37963 [83:05:46<7:29:05,  8.09s/it]
 91%|█████████ | 34635/37963 [83:06:00<9:10:44,  9.93s/it]
 91%|█████████ | 34636/37963 [83:06:07<8:30:22,  9.20s/it]
 91%|█████████ | 34637/37963 [83:06:15<8:01:00,  8.68s/it]
 91%|█████████ | 34638/37963 [83:06:22<7:43:08,  8.36s/it]
 91%|█████████ | 34639/37963 [83:06:30<7:24:11,  8.02s/it]
 91%|█████████ | 34640/37963 [83:06:37<7:14:49,  7.85s/it]
                                                          
{'loss': '0.09035', 'grad_norm': '4.281', 'learning_rate': '3.994e-07', 'epoch': '0.9125'}

 91%|█████████ | 34640/37963 [83:06:37<7:14:49,  7.85s/it]
 91%|█████████ | 34641/37963 [83:06:45<7:10:38,  7.78s/it]
 91%|█████████▏| 34642/37963 [83:06:52<7:05:19,  7.68s/it]
 91%|█████████▏| 34643/37963 [83:07:06<8:48:50,  9.56s/it]
 91%|█████████▏| 34644/37963 [83:07:14<8:17:36,  9.00s/it]
 91%|█████████▏| 34645/37963 [83:07:21<7:55:17,  8.59s/it]
 91%|█████████▏| 34646/37963 [83:07:29<7:37:14,  8.27s/it]
 91%|█████████▏| 34647/37963 [83:07:37<7:25:41,  8.06s/it]
 91%|█████████▏| 34648/37963 [83:07:44<7:18:22,  7.93s/it]
 91%|█████████▏| 34649/37963 [83:08:05<10:46:48, 11.71s/it]
 91%|█████████▏| 34650/37963 [83:08:12<9:36:54, 10.45s/it] 
                                                          
{'loss': '0.09784', 'grad_norm': '4.008', 'learning_rate': '3.97e-07', 'epoch': '0.9127'}

 91%|█████████▏| 34650/37963 [83:08:12<9:36:54, 10.45s/it]
 91%|█████████▏| 34651/37963 [83:08:20<8:46:15,  9.53s/it]
 91%|█████████▏| 34652/37963 [83:08:27<8:14:39,  8.96s/it]
 91%|█████████▏| 34653/37963 [83:08:35<7:50:38,  8.53s/it]
 91%|█████████▏| 34654/37963 [83:08:42<7:33:36,  8.22s/it]
 91%|█████████▏| 34655/37963 [83:08:49<7:15:33,  7.90s/it]
 91%|█████████▏| 34656/37963 [83:08:57<7:09:22,  7.79s/it]
 91%|█████████▏| 34657/37963 [83:09:04<7:04:30,  7.70s/it]
 91%|█████████▏| 34658/37963 [83:09:12<7:03:58,  7.70s/it]
 91%|█████████▏| 34659/37963 [83:09:19<6:56:24,  7.56s/it]
 91%|█████████▏| 34660/37963 [83:09:34<8:47:43,  9.59s/it]
                                                          
{'loss': '0.08409', 'grad_norm': '3.167', 'learning_rate': '3.946e-07', 'epoch': '0.913'}

 91%|█████████▏| 34660/37963 [83:09:34<8:47:43,  9.59s/it]
 91%|█████████▏| 34661/37963 [83:09:41<8:14:07,  8.98s/it]
 91%|█████████▏| 34662/37963 [83:09:49<7:49:29,  8.53s/it]
 91%|█████████▏| 34663/37963 [83:09:56<7:33:03,  8.24s/it]
 91%|█████████▏| 34664/37963 [83:10:04<7:21:35,  8.03s/it]
 91%|█████████▏| 34665/37963 [83:10:11<7:13:54,  7.89s/it]
 91%|█████████▏| 34666/37963 [83:10:19<7:04:28,  7.72s/it]
 91%|█████████▏| 34667/37963 [83:10:26<7:01:29,  7.67s/it]
 91%|█████████▏| 34668/37963 [83:10:34<6:59:39,  7.64s/it]
 91%|█████████▏| 34669/37963 [83:10:41<6:57:55,  7.61s/it]
 91%|█████████▏| 34670/37963 [83:10:55<8:41:49,  9.51s/it]
                                                          
{'loss': '0.08482', 'grad_norm': '2.746', 'learning_rate': '3.923e-07', 'epoch': '0.9133'}

 91%|█████████▏| 34670/37963 [83:10:55<8:41:49,  9.51s/it]
 91%|█████████▏| 34671/37963 [83:11:03<8:10:03,  8.93s/it]
 91%|█████████▏| 34672/37963 [83:11:10<7:46:21,  8.50s/it]
 91%|█████████▏| 34673/37963 [83:11:18<7:29:55,  8.21s/it]
 91%|█████████▏| 34674/37963 [83:11:25<7:18:15,  7.99s/it]
 91%|█████████▏| 34675/37963 [83:11:33<7:08:51,  7.83s/it]
 91%|█████████▏| 34676/37963 [83:11:40<7:02:54,  7.72s/it]
 91%|█████████▏| 34677/37963 [83:11:48<7:01:17,  7.69s/it]
 91%|█████████▏| 34678/37963 [83:11:56<6:58:34,  7.65s/it]
 91%|█████████▏| 34679/37963 [83:12:10<8:42:48,  9.55s/it]
 91%|█████████▏| 34680/37963 [83:12:17<8:09:37,  8.95s/it]
                                                          
{'loss': '0.08786', 'grad_norm': '3.489', 'learning_rate': '3.899e-07', 'epoch': '0.9135'}

 91%|█████████▏| 34680/37963 [83:12:17<8:09:37,  8.95s/it]
 91%|█████████▏| 34681/37963 [83:12:24<7:42:59,  8.46s/it]
 91%|█████████▏| 34682/37963 [83:12:38<9:14:49, 10.15s/it]
 91%|█████████▏| 34683/37963 [83:12:46<8:28:53,  9.31s/it]
 91%|█████████▏| 34684/37963 [83:12:53<7:59:21,  8.77s/it]
 91%|█████████▏| 34685/37963 [83:13:01<7:38:33,  8.39s/it]
 91%|█████████▏| 34686/37963 [83:13:08<7:24:43,  8.14s/it]
 91%|█████████▏| 34687/37963 [83:13:22<8:59:02,  9.87s/it]
 91%|█████████▏| 34688/37963 [83:13:30<8:17:48,  9.12s/it]
 91%|█████████▏| 34689/37963 [83:13:37<7:49:51,  8.61s/it]
 91%|█████████▏| 34690/37963 [83:13:45<7:32:42,  8.30s/it]
                                                          
{'loss': '0.08536', 'grad_norm': '2.467', 'learning_rate': '3.876e-07', 'epoch': '0.9138'}

 91%|█████████▏| 34690/37963 [83:13:45<7:32:42,  8.30s/it]
 91%|█████████▏| 34691/37963 [83:13:59<9:06:31, 10.02s/it]
 91%|█████████▏| 34692/37963 [83:14:06<8:26:17,  9.29s/it]
 91%|█████████▏| 34693/37963 [83:14:14<7:53:45,  8.69s/it]
 91%|█████████▏| 34694/37963 [83:14:21<7:34:20,  8.34s/it]
 91%|█████████▏| 34695/37963 [83:14:29<7:20:47,  8.09s/it]
 91%|█████████▏| 34696/37963 [83:14:36<7:11:52,  7.93s/it]
 91%|█████████▏| 34697/37963 [83:14:50<8:49:10,  9.72s/it]
 91%|█████████▏| 34698/37963 [83:14:58<8:12:42,  9.05s/it]
 91%|█████████▏| 34699/37963 [83:15:05<7:47:29,  8.59s/it]
 91%|█████████▏| 34700/37963 [83:15:13<7:29:27,  8.26s/it]
                                                          
{'loss': '0.09076', 'grad_norm': '2.686', 'learning_rate': '3.852e-07', 'epoch': '0.9141'}

 91%|█████████▏| 34700/37963 [83:15:13<7:29:27,  8.26s/it]
 91%|█████████▏| 34701/37963 [83:15:20<7:15:21,  8.01s/it]
 91%|█████████▏| 34702/37963 [83:15:27<7:05:46,  7.83s/it]
 91%|█████████▏| 34703/37963 [83:15:41<8:44:52,  9.66s/it]
 91%|█████████▏| 34704/37963 [83:15:49<8:10:00,  9.02s/it]
 91%|█████████▏| 34705/37963 [83:15:56<7:45:39,  8.58s/it]
 91%|█████████▏| 34706/37963 [83:16:10<9:13:47, 10.20s/it]
 91%|█████████▏| 34707/37963 [83:16:18<8:29:41,  9.39s/it]
 91%|█████████▏| 34708/37963 [83:16:26<8:00:28,  8.86s/it]
 91%|█████████▏| 34709/37963 [83:16:33<7:38:56,  8.46s/it]
 91%|█████████▏| 34710/37963 [83:16:41<7:23:35,  8.18s/it]
                                                          
{'loss': '0.079', 'grad_norm': '2.802', 'learning_rate': '3.829e-07', 'epoch': '0.9143'}

 91%|█████████▏| 34710/37963 [83:16:41<7:23:35,  8.18s/it]
 91%|█████████▏| 34711/37963 [83:16:48<7:13:53,  8.01s/it]
 91%|█████████▏| 34712/37963 [83:16:56<7:05:39,  7.86s/it]
 91%|█████████▏| 34713/37963 [83:17:03<7:00:23,  7.76s/it]
 91%|█████████▏| 34714/37963 [83:17:11<6:59:30,  7.75s/it]
 91%|█████████▏| 34715/37963 [83:17:18<6:53:29,  7.64s/it]
 91%|█████████▏| 34716/37963 [83:17:26<6:53:22,  7.64s/it]
 91%|█████████▏| 34717/37963 [83:17:34<6:51:06,  7.60s/it]
 91%|█████████▏| 34718/37963 [83:17:41<6:50:31,  7.59s/it]
 91%|█████████▏| 34719/37963 [83:17:49<6:49:37,  7.58s/it]
 91%|█████████▏| 34720/37963 [83:18:02<8:27:28,  9.39s/it]
                                                          
{'loss': '0.0816', 'grad_norm': '2.583', 'learning_rate': '3.805e-07', 'epoch': '0.9146'}

 91%|█████████▏| 34720/37963 [83:18:02<8:27:28,  9.39s/it]
 91%|█████████▏| 34721/37963 [83:18:10<7:56:16,  8.81s/it]
 91%|█████████▏| 34722/37963 [83:18:17<7:35:15,  8.43s/it]
 91%|█████████▏| 34723/37963 [83:18:25<7:16:33,  8.08s/it]
 91%|█████████▏| 34724/37963 [83:18:32<7:07:11,  7.91s/it]
 91%|█████████▏| 34725/37963 [83:18:40<7:01:40,  7.81s/it]
 91%|█████████▏| 34726/37963 [83:18:47<6:58:56,  7.77s/it]
 91%|█████████▏| 34727/37963 [83:18:55<6:56:28,  7.72s/it]
 91%|█████████▏| 34728/37963 [83:19:02<6:52:31,  7.65s/it]
 91%|█████████▏| 34729/37963 [83:19:10<6:46:32,  7.54s/it]
 91%|█████████▏| 34730/37963 [83:19:24<8:30:02,  9.47s/it]
                                                          
{'loss': '0.08199', 'grad_norm': '3.715', 'learning_rate': '3.782e-07', 'epoch': '0.9148'}

 91%|█████████▏| 34730/37963 [83:19:24<8:30:02,  9.47s/it]
 91%|█████████▏| 34731/37963 [83:19:31<7:53:01,  8.78s/it]
 91%|█████████▏| 34732/37963 [83:19:45<9:13:48, 10.28s/it]
 91%|█████████▏| 34733/37963 [83:19:59<10:14:11, 11.41s/it]
 91%|█████████▏| 34734/37963 [83:20:06<9:10:59, 10.24s/it] 
 91%|█████████▏| 34735/37963 [83:20:14<8:30:21,  9.49s/it]
 91%|█████████▏| 34736/37963 [83:20:21<7:59:47,  8.92s/it]
 92%|█████████▏| 34737/37963 [83:20:29<7:37:40,  8.51s/it]
 92%|█████████▏| 34738/37963 [83:20:37<7:21:43,  8.22s/it]
 92%|█████████▏| 34739/37963 [83:20:44<7:11:56,  8.04s/it]
 92%|█████████▏| 34740/37963 [83:20:51<6:59:41,  7.81s/it]
                                                          
{'loss': '0.08095', 'grad_norm': '2.966', 'learning_rate': '3.759e-07', 'epoch': '0.9151'}

 92%|█████████▏| 34740/37963 [83:20:51<6:59:41,  7.81s/it]
 92%|█████████▏| 34741/37963 [83:21:05<8:38:04,  9.65s/it]
 92%|█████████▏| 34742/37963 [83:21:13<8:04:17,  9.02s/it]
 92%|█████████▏| 34743/37963 [83:21:20<7:37:29,  8.52s/it]
 92%|█████████▏| 34744/37963 [83:21:28<7:23:04,  8.26s/it]
 92%|█████████▏| 34745/37963 [83:21:35<7:07:49,  7.98s/it]
 92%|█████████▏| 34746/37963 [83:21:43<7:00:01,  7.83s/it]
 92%|█████████▏| 34747/37963 [83:21:57<8:37:22,  9.65s/it]
 92%|█████████▏| 34748/37963 [83:22:04<8:03:12,  9.02s/it]
 92%|█████████▏| 34749/37963 [83:22:12<7:39:05,  8.57s/it]
 92%|█████████▏| 34750/37963 [83:22:19<7:20:16,  8.22s/it]
                                                          
{'loss': '0.08364', 'grad_norm': '3.336', 'learning_rate': '3.736e-07', 'epoch': '0.9154'}

 92%|█████████▏| 34750/37963 [83:22:19<7:20:16,  8.22s/it]
 92%|█████████▏| 34751/37963 [83:22:27<7:09:43,  8.03s/it]
 92%|█████████▏| 34752/37963 [83:22:34<7:01:25,  7.87s/it]
 92%|█████████▏| 34753/37963 [83:22:48<8:38:34,  9.69s/it]
 92%|█████████▏| 34754/37963 [83:22:56<8:05:03,  9.07s/it]
 92%|█████████▏| 34755/37963 [83:23:03<7:39:27,  8.59s/it]
 92%|█████████▏| 34756/37963 [83:23:11<7:23:12,  8.29s/it]
 92%|█████████▏| 34757/37963 [83:23:25<8:51:09,  9.94s/it]
 92%|█████████▏| 34758/37963 [83:23:32<8:14:16,  9.25s/it]
 92%|█████████▏| 34759/37963 [83:23:40<7:48:09,  8.77s/it]
 92%|█████████▏| 34760/37963 [83:23:47<7:27:58,  8.39s/it]
                                                          
{'loss': '0.07779', 'grad_norm': '2.073', 'learning_rate': '3.713e-07', 'epoch': '0.9156'}

 92%|█████████▏| 34760/37963 [83:23:47<7:27:58,  8.39s/it]
 92%|█████████▏| 34761/37963 [83:23:55<7:15:12,  8.16s/it]
 92%|█████████▏| 34762/37963 [83:24:02<7:01:19,  7.90s/it]
 92%|█████████▏| 34763/37963 [83:24:10<6:50:21,  7.69s/it]
 92%|█████████▏| 34764/37963 [83:24:17<6:46:42,  7.63s/it]
 92%|█████████▏| 34765/37963 [83:24:25<6:45:38,  7.61s/it]
 92%|█████████▏| 34766/37963 [83:24:39<8:28:30,  9.54s/it]
 92%|█████████▏| 34767/37963 [83:24:46<7:56:20,  8.94s/it]
 92%|█████████▏| 34768/37963 [83:24:54<7:33:39,  8.52s/it]
 92%|█████████▏| 34769/37963 [83:25:01<7:18:03,  8.23s/it]
 92%|█████████▏| 34770/37963 [83:25:09<7:06:33,  8.02s/it]
                                                          
{'loss': '0.08318', 'grad_norm': '3.467', 'learning_rate': '3.69e-07', 'epoch': '0.9159'}

 92%|█████████▏| 34770/37963 [83:25:09<7:06:33,  8.02s/it]
 92%|█████████▏| 34771/37963 [83:25:16<6:59:00,  7.88s/it]
 92%|█████████▏| 34772/37963 [83:25:24<6:53:12,  7.77s/it]
 92%|█████████▏| 34773/37963 [83:25:32<6:50:53,  7.73s/it]
 92%|█████████▏| 34774/37963 [83:25:39<6:48:53,  7.69s/it]
 92%|█████████▏| 34775/37963 [83:25:47<6:47:55,  7.68s/it]
 92%|█████████▏| 34776/37963 [83:25:54<6:45:44,  7.64s/it]
 92%|█████████▏| 34777/37963 [83:26:02<6:43:29,  7.60s/it]
 92%|█████████▏| 34778/37963 [83:26:16<8:23:27,  9.48s/it]
 92%|█████████▏| 34779/37963 [83:26:30<9:33:47, 10.81s/it]
 92%|█████████▏| 34780/37963 [83:26:37<8:37:27,  9.75s/it]
                                                          
{'loss': '0.07207', 'grad_norm': '2.329', 'learning_rate': '3.667e-07', 'epoch': '0.9162'}

 92%|█████████▏| 34780/37963 [83:26:37<8:37:27,  9.75s/it]
 92%|█████████▏| 34781/37963 [83:26:44<7:58:54,  9.03s/it]
 92%|█████████▏| 34782/37963 [83:26:52<7:35:43,  8.60s/it]
 92%|█████████▏| 34783/37963 [83:26:59<7:19:10,  8.29s/it]
 92%|█████████▏| 34784/37963 [83:27:07<7:07:25,  8.07s/it]
 92%|█████████▏| 34785/37963 [83:27:14<6:58:41,  7.90s/it]
 92%|█████████▏| 34786/37963 [83:27:22<6:50:29,  7.75s/it]
 92%|█████████▏| 34787/37963 [83:27:29<6:45:01,  7.65s/it]
 92%|█████████▏| 34788/37963 [83:27:37<6:40:49,  7.57s/it]
 92%|█████████▏| 34789/37963 [83:27:44<6:40:31,  7.57s/it]
 92%|█████████▏| 34790/37963 [83:27:51<6:34:30,  7.46s/it]
                                                          
{'loss': '0.09104', 'grad_norm': '3.135', 'learning_rate': '3.644e-07', 'epoch': '0.9164'}

 92%|█████████▏| 34790/37963 [83:27:51<6:34:30,  7.46s/it]
 92%|█████████▏| 34791/37963 [83:28:05<8:17:55,  9.42s/it]
 92%|█████████▏| 34792/37963 [83:28:19<9:23:40, 10.67s/it]
 92%|█████████▏| 34793/37963 [83:28:27<8:34:52,  9.75s/it]
 92%|█████████▏| 34794/37963 [83:28:34<8:00:32,  9.10s/it]
 92%|█████████▏| 34795/37963 [83:28:42<7:33:07,  8.58s/it]
 92%|█████████▏| 34796/37963 [83:28:49<7:17:07,  8.28s/it]
 92%|█████████▏| 34797/37963 [83:28:57<7:05:02,  8.06s/it]
 92%|█████████▏| 34798/37963 [83:29:04<6:55:59,  7.89s/it]
 92%|█████████▏| 34799/37963 [83:29:12<6:50:18,  7.78s/it]
 92%|█████████▏| 34800/37963 [83:29:26<8:28:11,  9.64s/it]
                                                          
{'loss': '0.08314', 'grad_norm': '4.093', 'learning_rate': '3.621e-07', 'epoch': '0.9167'}

 92%|█████████▏| 34800/37963 [83:29:26<8:28:11,  9.64s/it]
 92%|█████████▏| 34801/37963 [83:29:33<7:55:22,  9.02s/it]
 92%|█████████▏| 34802/37963 [83:29:41<7:30:24,  8.55s/it]
 92%|█████████▏| 34803/37963 [83:29:48<7:13:26,  8.23s/it]
 92%|█████████▏| 34804/37963 [83:29:56<7:03:27,  8.04s/it]
 92%|█████████▏| 34805/37963 [83:30:03<6:54:11,  7.87s/it]
 92%|█████████▏| 34806/37963 [83:30:17<8:32:29,  9.74s/it]
 92%|█████████▏| 34807/37963 [83:30:25<7:57:36,  9.08s/it]
 92%|█████████▏| 34808/37963 [83:30:32<7:31:55,  8.59s/it]
 92%|█████████▏| 34809/37963 [83:30:40<7:14:47,  8.27s/it]
 92%|█████████▏| 34810/37963 [83:30:47<6:56:40,  7.93s/it]
                                                          
{'loss': '0.08637', 'grad_norm': '3.837', 'learning_rate': '3.598e-07', 'epoch': '0.9169'}

 92%|█████████▏| 34810/37963 [83:30:47<6:56:40,  7.93s/it]
 92%|█████████▏| 34811/37963 [83:30:54<6:45:12,  7.71s/it]
 92%|█████████▏| 34812/37963 [83:31:02<6:43:03,  7.67s/it]
 92%|█████████▏| 34813/37963 [83:31:09<6:40:49,  7.63s/it]
 92%|█████████▏| 34814/37963 [83:31:23<8:21:41,  9.56s/it]
 92%|█████████▏| 34815/37963 [83:31:31<7:49:51,  8.96s/it]
 92%|█████████▏| 34816/37963 [83:31:39<7:29:17,  8.57s/it]
 92%|█████████▏| 34817/37963 [83:31:46<7:13:30,  8.27s/it]
 92%|█████████▏| 34818/37963 [83:31:54<7:01:24,  8.04s/it]
 92%|█████████▏| 34819/37963 [83:32:01<6:54:36,  7.91s/it]
 92%|█████████▏| 34820/37963 [83:32:09<6:48:11,  7.79s/it]
                                                          
{'loss': '0.07688', 'grad_norm': '2.844', 'learning_rate': '3.576e-07', 'epoch': '0.9172'}

 92%|█████████▏| 34820/37963 [83:32:09<6:48:11,  7.79s/it]
 92%|█████████▏| 34821/37963 [83:32:16<6:43:52,  7.71s/it]
 92%|█████████▏| 34822/37963 [83:32:24<6:40:17,  7.65s/it]
 92%|█████████▏| 34823/37963 [83:32:38<8:19:10,  9.54s/it]
 92%|█████████▏| 34824/37963 [83:32:45<7:49:29,  8.97s/it]
 92%|█████████▏| 34825/37963 [83:32:53<7:26:39,  8.54s/it]
 92%|█████████▏| 34826/37963 [83:33:07<8:45:54, 10.06s/it]
 92%|█████████▏| 34827/37963 [83:33:14<8:08:14,  9.34s/it]
 92%|█████████▏| 34828/37963 [83:33:22<7:37:52,  8.76s/it]
 92%|█████████▏| 34829/37963 [83:33:29<7:20:50,  8.44s/it]
 92%|█████████▏| 34830/37963 [83:33:37<7:05:41,  8.15s/it]
                                                          
{'loss': '0.08333', 'grad_norm': '3.146', 'learning_rate': '3.553e-07', 'epoch': '0.9175'}

 92%|█████████▏| 34830/37963 [83:33:37<7:05:41,  8.15s/it]
 92%|█████████▏| 34831/37963 [83:33:44<6:55:45,  7.96s/it]
 92%|█████████▏| 34832/37963 [83:33:52<6:51:14,  7.88s/it]
 92%|█████████▏| 34833/37963 [83:34:06<8:24:31,  9.67s/it]
 92%|█████████▏| 34834/37963 [83:34:13<7:51:09,  9.03s/it]
 92%|█████████▏| 34835/37963 [83:34:21<7:29:11,  8.62s/it]
 92%|█████████▏| 34836/37963 [83:34:29<7:13:09,  8.31s/it]
 92%|█████████▏| 34837/37963 [83:34:36<7:01:12,  8.08s/it]
 92%|█████████▏| 34838/37963 [83:34:43<6:47:48,  7.83s/it]
 92%|█████████▏| 34839/37963 [83:34:51<6:43:01,  7.74s/it]
 92%|█████████▏| 34840/37963 [83:35:05<8:19:07,  9.59s/it]
                                                          
{'loss': '0.07141', 'grad_norm': '2.488', 'learning_rate': '3.531e-07', 'epoch': '0.9177'}

 92%|█████████▏| 34840/37963 [83:35:05<8:19:07,  9.59s/it]
 92%|█████████▏| 34841/37963 [83:35:13<7:50:05,  9.03s/it]
 92%|█████████▏| 34842/37963 [83:35:20<7:25:53,  8.57s/it]
 92%|█████████▏| 34843/37963 [83:35:28<7:11:04,  8.29s/it]
 92%|█████████▏| 34844/37963 [83:35:35<7:00:41,  8.09s/it]
 92%|█████████▏| 34845/37963 [83:35:50<8:36:41,  9.94s/it]
 92%|█████████▏| 34846/37963 [83:35:57<8:00:19,  9.25s/it]
 92%|█████████▏| 34847/37963 [83:36:05<7:33:23,  8.73s/it]
 92%|█████████▏| 34848/37963 [83:36:13<7:18:58,  8.46s/it]
 92%|█████████▏| 34849/37963 [83:36:20<7:05:58,  8.21s/it]
 92%|█████████▏| 34850/37963 [83:36:34<8:37:10,  9.97s/it]
                                                          
{'loss': '0.08734', 'grad_norm': '2.985', 'learning_rate': '3.508e-07', 'epoch': '0.918'}

 92%|█████████▏| 34850/37963 [83:36:34<8:37:10,  9.97s/it]
 92%|█████████▏| 34851/37963 [83:36:42<7:56:38,  9.19s/it]
 92%|█████████▏| 34852/37963 [83:36:49<7:27:33,  8.63s/it]
 92%|█████████▏| 34853/37963 [83:36:57<7:09:48,  8.29s/it]
 92%|█████████▏| 34854/37963 [83:37:04<6:59:01,  8.09s/it]
 92%|█████████▏| 34855/37963 [83:37:12<6:48:43,  7.89s/it]
 92%|█████████▏| 34856/37963 [83:37:19<6:45:15,  7.83s/it]
 92%|█████████▏| 34857/37963 [83:37:27<6:40:55,  7.74s/it]
 92%|█████████▏| 34858/37963 [83:37:41<8:16:33,  9.60s/it]
 92%|█████████▏| 34859/37963 [83:37:54<9:20:53, 10.84s/it]
 92%|█████████▏| 34860/37963 [83:38:02<8:30:29,  9.87s/it]
                                                          
{'loss': '0.08316', 'grad_norm': '2.613', 'learning_rate': '3.486e-07', 'epoch': '0.9183'}

 92%|█████████▏| 34860/37963 [83:38:02<8:30:29,  9.87s/it]
 92%|█████████▏| 34861/37963 [83:38:10<7:54:13,  9.17s/it]
 92%|█████████▏| 34862/37963 [83:38:17<7:29:35,  8.70s/it]
 92%|█████████▏| 34863/37963 [83:38:25<7:11:48,  8.36s/it]
 92%|█████████▏| 34864/37963 [83:38:32<6:59:55,  8.13s/it]
 92%|█████████▏| 34865/37963 [83:38:40<6:50:52,  7.96s/it]
 92%|█████████▏| 34866/37963 [83:38:47<6:44:43,  7.84s/it]
 92%|█████████▏| 34867/37963 [83:39:01<8:15:08,  9.60s/it]
 92%|█████████▏| 34868/37963 [83:39:09<7:43:12,  8.98s/it]
 92%|█████████▏| 34869/37963 [83:39:16<7:22:33,  8.58s/it]
 92%|█████████▏| 34870/37963 [83:39:31<8:49:59, 10.28s/it]
                                                          
{'loss': '0.08322', 'grad_norm': '3.546', 'learning_rate': '3.464e-07', 'epoch': '0.9185'}

 92%|█████████▏| 34870/37963 [83:39:31<8:49:59, 10.28s/it]
 92%|█████████▏| 34871/37963 [83:39:38<8:04:57,  9.41s/it]
 92%|█████████▏| 34872/37963 [83:39:45<7:35:09,  8.84s/it]
 92%|█████████▏| 34873/37963 [83:39:53<7:14:47,  8.44s/it]
 92%|█████████▏| 34874/37963 [83:40:01<7:00:08,  8.16s/it]
 92%|█████████▏| 34875/37963 [83:40:08<6:49:58,  7.97s/it]
 92%|█████████▏| 34876/37963 [83:40:15<6:42:15,  7.82s/it]
 92%|█████████▏| 34877/37963 [83:40:23<6:37:30,  7.73s/it]
 92%|█████████▏| 34878/37963 [83:40:31<6:34:18,  7.67s/it]
 92%|█████████▏| 34879/37963 [83:40:38<6:30:23,  7.60s/it]
 92%|█████████▏| 34880/37963 [83:40:52<8:07:53,  9.50s/it]
                                                          
{'loss': '0.08205', 'grad_norm': '3.148', 'learning_rate': '3.441e-07', 'epoch': '0.9188'}

 92%|█████████▏| 34880/37963 [83:40:52<8:07:53,  9.50s/it]
 92%|█████████▏| 34881/37963 [83:40:59<7:37:33,  8.91s/it]
 92%|█████████▏| 34882/37963 [83:41:07<7:16:43,  8.50s/it]
 92%|█████████▏| 34883/37963 [83:41:14<6:56:42,  8.12s/it]
 92%|█████████▏| 34884/37963 [83:41:21<6:43:30,  7.86s/it]
 92%|█████████▏| 34885/37963 [83:41:29<6:38:05,  7.76s/it]
 92%|█████████▏| 34886/37963 [83:41:37<6:35:34,  7.71s/it]
 92%|█████████▏| 34887/37963 [83:41:51<8:11:38,  9.59s/it]
 92%|█████████▏| 34888/37963 [83:41:58<7:40:35,  8.99s/it]
 92%|█████████▏| 34889/37963 [83:42:06<7:19:51,  8.59s/it]
 92%|█████████▏| 34890/37963 [83:42:14<7:07:15,  8.34s/it]
                                                          
{'loss': '0.08772', 'grad_norm': '3.51', 'learning_rate': '3.419e-07', 'epoch': '0.9191'}

 92%|█████████▏| 34890/37963 [83:42:14<7:07:15,  8.34s/it]
 92%|█████████▏| 34891/37963 [83:42:21<6:55:14,  8.11s/it]
 92%|█████████▏| 34892/37963 [83:42:29<6:45:39,  7.93s/it]
 92%|█████████▏| 34893/37963 [83:42:36<6:37:36,  7.77s/it]
 92%|█████████▏| 34894/37963 [83:42:43<6:28:48,  7.60s/it]
 92%|█████████▏| 34895/37963 [83:42:57<8:06:59,  9.52s/it]
 92%|█████████▏| 34896/37963 [83:43:05<7:34:42,  8.90s/it]
 92%|█████████▏| 34897/37963 [83:43:12<7:13:29,  8.48s/it]
 92%|█████████▏| 34898/37963 [83:43:20<6:59:41,  8.22s/it]
 92%|█████████▏| 34899/37963 [83:43:34<8:31:21, 10.01s/it]
 92%|█████████▏| 34900/37963 [83:43:42<7:53:44,  9.28s/it]
                                                          
{'loss': '0.0785', 'grad_norm': '3.253', 'learning_rate': '3.397e-07', 'epoch': '0.9193'}

 92%|█████████▏| 34900/37963 [83:43:42<7:53:44,  9.28s/it]
 92%|█████████▏| 34901/37963 [83:43:49<7:27:14,  8.76s/it]
 92%|█████████▏| 34902/37963 [83:43:57<7:08:22,  8.40s/it]
 92%|█████████▏| 34903/37963 [83:44:04<6:51:11,  8.06s/it]
 92%|█████████▏| 34904/37963 [83:44:12<6:43:53,  7.92s/it]
 92%|█████████▏| 34905/37963 [83:44:25<8:15:37,  9.72s/it]
 92%|█████████▏| 34906/37963 [83:44:33<7:43:24,  9.10s/it]
 92%|█████████▏| 34907/37963 [83:44:41<7:19:19,  8.63s/it]
 92%|█████████▏| 34908/37963 [83:44:55<8:41:14, 10.24s/it]
 92%|█████████▏| 34909/37963 [83:45:02<7:57:53,  9.39s/it]
 92%|█████████▏| 34910/37963 [83:45:10<7:29:05,  8.83s/it]
                                                          
{'loss': '0.07955', 'grad_norm': '3.113', 'learning_rate': '3.375e-07', 'epoch': '0.9196'}

 92%|█████████▏| 34910/37963 [83:45:10<7:29:05,  8.83s/it]
 92%|█████████▏| 34911/37963 [83:45:17<7:09:39,  8.45s/it]
 92%|█████████▏| 34912/37963 [83:45:25<6:55:33,  8.17s/it]
 92%|█████████▏| 34913/37963 [83:45:32<6:49:17,  8.05s/it]
 92%|█████████▏| 34914/37963 [83:45:40<6:40:53,  7.89s/it]
 92%|█████████▏| 34915/37963 [83:45:54<8:12:17,  9.69s/it]
 92%|█████████▏| 34916/37963 [83:46:01<7:37:06,  9.00s/it]
 92%|█████████▏| 34917/37963 [83:46:09<7:14:22,  8.56s/it]
 92%|█████████▏| 34918/37963 [83:46:16<6:54:54,  8.18s/it]
 92%|█████████▏| 34919/37963 [83:46:23<6:40:49,  7.90s/it]
 92%|█████████▏| 34920/37963 [83:46:31<6:35:44,  7.80s/it]
                                                          
{'loss': '0.08786', 'grad_norm': '3.558', 'learning_rate': '3.353e-07', 'epoch': '0.9198'}

 92%|█████████▏| 34920/37963 [83:46:31<6:35:44,  7.80s/it]
 92%|█████████▏| 34921/37963 [83:46:38<6:26:23,  7.62s/it]
 92%|█████████▏| 34922/37963 [83:46:45<6:21:25,  7.53s/it]
 92%|█████████▏| 34923/37963 [83:46:59<7:59:03,  9.46s/it]
 92%|█████████▏| 34924/37963 [83:47:07<7:27:29,  8.83s/it]
 92%|█████████▏| 34925/37963 [83:47:14<7:08:25,  8.46s/it]
 92%|█████████▏| 34926/37963 [83:47:22<6:53:43,  8.17s/it]
 92%|█████████▏| 34927/37963 [83:47:29<6:43:49,  7.98s/it]
 92%|█████████▏| 34928/37963 [83:47:43<8:13:27,  9.76s/it]
 92%|█████████▏| 34929/37963 [83:47:51<7:40:20,  9.10s/it]
 92%|█████████▏| 34930/37963 [83:47:58<7:15:48,  8.62s/it]
                                                          
{'loss': '0.08113', 'grad_norm': '4.126', 'learning_rate': '3.331e-07', 'epoch': '0.9201'}

 92%|█████████▏| 34930/37963 [83:47:58<7:15:48,  8.62s/it]
 92%|█████████▏| 34931/37963 [83:48:06<6:59:17,  8.30s/it]
 92%|█████████▏| 34932/37963 [83:48:14<6:49:39,  8.11s/it]
 92%|█████████▏| 34933/37963 [83:48:21<6:41:40,  7.95s/it]
 92%|█████████▏| 34934/37963 [83:48:28<6:31:58,  7.76s/it]
 92%|█████████▏| 34935/37963 [83:48:43<8:09:01,  9.69s/it]
 92%|█████████▏| 34936/37963 [83:48:50<7:35:41,  9.03s/it]
 92%|█████████▏| 34937/37963 [83:48:58<7:14:30,  8.62s/it]
 92%|█████████▏| 34938/37963 [83:49:05<6:58:51,  8.31s/it]
 92%|█████████▏| 34939/37963 [83:49:13<6:48:56,  8.11s/it]
 92%|█████████▏| 34940/37963 [83:49:21<6:42:19,  7.99s/it]
                                                          
{'loss': '0.08605', 'grad_norm': '4.083', 'learning_rate': '3.309e-07', 'epoch': '0.9204'}

 92%|█████████▏| 34940/37963 [83:49:21<6:42:19,  7.99s/it]
 92%|█████████▏| 34941/37963 [83:49:28<6:35:06,  7.84s/it]
 92%|█████████▏| 34942/37963 [83:49:42<8:01:17,  9.56s/it]
 92%|█████████▏| 34943/37963 [83:49:50<7:34:14,  9.02s/it]
 92%|█████████▏| 34944/37963 [83:49:57<7:06:37,  8.48s/it]
 92%|█████████▏| 34945/37963 [83:50:04<6:50:47,  8.17s/it]
 92%|█████████▏| 34946/37963 [83:50:12<6:41:22,  7.98s/it]
 92%|█████████▏| 34947/37963 [83:50:26<8:13:18,  9.81s/it]
 92%|█████████▏| 34948/37963 [83:50:33<7:39:45,  9.15s/it]
 92%|█████████▏| 34949/37963 [83:50:41<7:17:17,  8.71s/it]
 92%|█████████▏| 34950/37963 [83:50:49<6:59:11,  8.35s/it]
                                                          
{'loss': '0.07866', 'grad_norm': '3.716', 'learning_rate': '3.288e-07', 'epoch': '0.9206'}

 92%|█████████▏| 34950/37963 [83:50:49<6:59:11,  8.35s/it]
 92%|█████████▏| 34951/37963 [83:50:56<6:47:31,  8.12s/it]
 92%|█████████▏| 34952/37963 [83:51:04<6:39:35,  7.96s/it]
 92%|█████████▏| 34953/37963 [83:51:18<8:13:03,  9.83s/it]
 92%|█████████▏| 34954/37963 [83:51:26<7:43:14,  9.24s/it]
 92%|█████████▏| 34955/37963 [83:51:33<7:19:03,  8.76s/it]
 92%|█████████▏| 34956/37963 [83:51:41<7:00:32,  8.39s/it]
 92%|█████████▏| 34957/37963 [83:51:55<8:18:59,  9.96s/it]
 92%|█████████▏| 34958/37963 [83:52:02<7:38:23,  9.15s/it]
 92%|█████████▏| 34959/37963 [83:52:09<7:14:27,  8.68s/it]
 92%|█████████▏| 34960/37963 [83:52:17<6:58:59,  8.37s/it]
                                                          
{'loss': '0.08406', 'grad_norm': '3.095', 'learning_rate': '3.266e-07', 'epoch': '0.9209'}

 92%|█████████▏| 34960/37963 [83:52:17<6:58:59,  8.37s/it]
 92%|█████████▏| 34961/37963 [83:52:25<6:46:17,  8.12s/it]
 92%|█████████▏| 34962/37963 [83:52:32<6:40:42,  8.01s/it]
 92%|█████████▏| 34963/37963 [83:52:40<6:36:32,  7.93s/it]
 92%|█████████▏| 34964/37963 [83:52:54<8:04:35,  9.69s/it]
 92%|█████████▏| 34965/37963 [83:53:01<7:31:24,  9.03s/it]
 92%|█████████▏| 34966/37963 [83:53:09<7:10:36,  8.62s/it]
 92%|█████████▏| 34967/37963 [83:53:17<6:53:01,  8.27s/it]
 92%|█████████▏| 34968/37963 [83:53:24<6:41:51,  8.05s/it]
 92%|█████████▏| 34969/37963 [83:53:38<8:07:23,  9.77s/it]
 92%|█████████▏| 34970/37963 [83:53:45<7:33:01,  9.08s/it]
                                                          
{'loss': '0.07518', 'grad_norm': '2.333', 'learning_rate': '3.245e-07', 'epoch': '0.9212'}

 92%|█████████▏| 34970/37963 [83:53:45<7:33:01,  9.08s/it]
 92%|█████████▏| 34971/37963 [83:53:53<7:04:56,  8.52s/it]
 92%|█████████▏| 34972/37963 [83:54:00<6:51:11,  8.25s/it]
 92%|█████████▏| 34973/37963 [83:54:08<6:40:40,  8.04s/it]
 92%|█████████▏| 34974/37963 [83:54:15<6:33:00,  7.89s/it]
 92%|█████████▏| 34975/37963 [83:54:29<7:58:08,  9.60s/it]
 92%|█████████▏| 34976/37963 [83:54:36<7:26:33,  8.97s/it]
 92%|█████████▏| 34977/37963 [83:54:44<7:04:10,  8.52s/it]
 92%|█████████▏| 34978/37963 [83:54:51<6:48:58,  8.22s/it]
 92%|█████████▏| 34979/37963 [83:54:59<6:37:31,  7.99s/it]
 92%|█████████▏| 34980/37963 [83:55:06<6:31:08,  7.87s/it]
                                                          
{'loss': '0.08439', 'grad_norm': '3.404', 'learning_rate': '3.223e-07', 'epoch': '0.9214'}

 92%|█████████▏| 34980/37963 [83:55:06<6:31:08,  7.87s/it]
 92%|█████████▏| 34981/37963 [83:55:14<6:26:19,  7.77s/it]
 92%|█████████▏| 34982/37963 [83:55:21<6:22:24,  7.70s/it]
 92%|█████████▏| 34983/37963 [83:55:29<6:20:22,  7.66s/it]
 92%|█████████▏| 34984/37963 [83:55:37<6:17:21,  7.60s/it]
 92%|█████████▏| 34985/37963 [83:55:50<7:51:35,  9.50s/it]
 92%|█████████▏| 34986/37963 [83:55:58<7:18:42,  8.84s/it]
 92%|█████████▏| 34987/37963 [83:56:11<8:27:56, 10.24s/it]
 92%|█████████▏| 34988/37963 [83:56:19<7:47:16,  9.42s/it]
 92%|█████████▏| 34989/37963 [83:56:26<7:18:46,  8.85s/it]
 92%|█████████▏| 34990/37963 [83:56:34<6:54:21,  8.36s/it]
                                                          
{'loss': '0.091', 'grad_norm': '3.208', 'learning_rate': '3.202e-07', 'epoch': '0.9217'}

 92%|█████████▏| 34990/37963 [83:56:34<6:54:21,  8.36s/it]
 92%|█████████▏| 34991/37963 [83:56:41<6:44:14,  8.16s/it]
 92%|█████████▏| 34992/37963 [83:56:55<8:09:37,  9.89s/it]
 92%|█████████▏| 34993/37963 [83:57:03<7:35:38,  9.20s/it]
 92%|█████████▏| 34994/37963 [83:57:10<7:07:34,  8.64s/it]
 92%|█████████▏| 34995/37963 [83:57:18<6:51:42,  8.32s/it]
 92%|█████████▏| 34996/37963 [83:57:25<6:39:40,  8.08s/it]
 92%|█████████▏| 34997/37963 [83:57:39<8:08:53,  9.89s/it]
 92%|█████████▏| 34998/37963 [83:57:47<7:34:07,  9.19s/it]
 92%|█████████▏| 34999/37963 [83:57:54<7:09:43,  8.70s/it]
 92%|█████████▏| 35000/37963 [83:58:02<6:52:12,  8.35s/it]
                                                          
{'loss': '0.07687', 'grad_norm': '2.77', 'learning_rate': '3.18e-07', 'epoch': '0.922'}

 92%|█████████▏| 35000/37963 [83:58:02<6:52:12,  8.35s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.59s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.59s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 92%|█████████▏| 35001/37963 [83:59:00<19:08:15, 23.26s/it]
 92%|█████████▏| 35002/37963 [83:59:08<15:15:09, 18.54s/it]
 92%|█████████▏| 35003/37963 [83:59:15<12:33:18, 15.27s/it]
 92%|█████████▏| 35004/37963 [83:59:29<12:14:35, 14.90s/it]
 92%|█████████▏| 35005/37963 [83:59:37<10:27:00, 12.72s/it]
 92%|█████████▏| 35006/37963 [83:59:44<9:05:10, 11.06s/it] 
 92%|█████████▏| 35007/37963 [83:59:51<8:11:35,  9.98s/it]
 92%|█████████▏| 35008/37963 [83:59:59<7:35:16,  9.24s/it]
 92%|█████████▏| 35009/37963 [84:00:06<7:06:08,  8.66s/it]
 92%|█████████▏| 35010/37963 [84:00:20<8:25:27, 10.27s/it]
                                                          
{'loss': '0.08369', 'grad_norm': '3.04', 'learning_rate': '3.159e-07', 'epoch': '0.9222'}

 92%|█████████▏| 35010/37963 [84:00:20<8:25:27, 10.27s/it]
 92%|█████████▏| 35011/37963 [84:00:28<7:45:38,  9.46s/it]
 92%|█████████▏| 35012/37963 [84:00:35<7:16:59,  8.89s/it]
 92%|█████████▏| 35013/37963 [84:00:43<6:56:58,  8.48s/it]
 92%|█████████▏| 35014/37963 [84:00:50<6:42:31,  8.19s/it]
 92%|█████████▏| 35015/37963 [84:00:58<6:32:59,  8.00s/it]
 92%|█████████▏| 35016/37963 [84:01:05<6:21:10,  7.76s/it]
 92%|█████████▏| 35017/37963 [84:01:13<6:17:18,  7.68s/it]
 92%|█████████▏| 35018/37963 [84:01:20<6:14:17,  7.63s/it]
 92%|█████████▏| 35019/37963 [84:01:28<6:13:46,  7.62s/it]
 92%|█████████▏| 35020/37963 [84:01:35<6:10:59,  7.56s/it]
                                                          
{'loss': '0.09613', 'grad_norm': '3.017', 'learning_rate': '3.138e-07', 'epoch': '0.9225'}

 92%|█████████▏| 35020/37963 [84:01:35<6:10:59,  7.56s/it]
 92%|█████████▏| 35021/37963 [84:01:43<6:07:05,  7.49s/it]
 92%|█████████▏| 35022/37963 [84:01:50<6:07:26,  7.50s/it]
 92%|█████████▏| 35023/37963 [84:02:04<7:41:37,  9.42s/it]
 92%|█████████▏| 35024/37963 [84:02:12<7:15:22,  8.89s/it]
 92%|█████████▏| 35025/37963 [84:02:19<6:55:16,  8.48s/it]
 92%|█████████▏| 35026/37963 [84:02:27<6:41:14,  8.20s/it]
 92%|█████████▏| 35027/37963 [84:02:41<8:04:24,  9.90s/it]
 92%|█████████▏| 35028/37963 [84:02:48<7:29:36,  9.19s/it]
 92%|█████████▏| 35029/37963 [84:03:02<8:41:41, 10.67s/it]
 92%|█████████▏| 35030/37963 [84:03:10<7:53:29,  9.69s/it]
                                                          
{'loss': '0.07598', 'grad_norm': '2.75', 'learning_rate': '3.116e-07', 'epoch': '0.9227'}

 92%|█████████▏| 35030/37963 [84:03:10<7:53:29,  9.69s/it]
 92%|█████████▏| 35031/37963 [84:03:17<7:18:45,  8.98s/it]
 92%|█████████▏| 35032/37963 [84:03:25<6:57:57,  8.56s/it]
 92%|█████████▏| 35033/37963 [84:03:32<6:41:33,  8.22s/it]
 92%|█████████▏| 35034/37963 [84:03:39<6:31:17,  8.02s/it]
 92%|█████████▏| 35035/37963 [84:03:47<6:24:10,  7.87s/it]
 92%|█████████▏| 35036/37963 [84:03:55<6:20:22,  7.80s/it]
 92%|█████████▏| 35037/37963 [84:04:02<6:15:26,  7.70s/it]
 92%|█████████▏| 35038/37963 [84:04:16<7:46:33,  9.57s/it]
 92%|█████████▏| 35039/37963 [84:04:30<8:50:57, 10.90s/it]
 92%|█████████▏| 35040/37963 [84:04:44<9:34:18, 11.79s/it]
                                                          
{'loss': '0.07973', 'grad_norm': '4.709', 'learning_rate': '3.095e-07', 'epoch': '0.923'}

 92%|█████████▏| 35040/37963 [84:04:44<9:34:18, 11.79s/it]
 92%|█████████▏| 35041/37963 [84:04:51<8:29:53, 10.47s/it]
 92%|█████████▏| 35042/37963 [84:04:59<7:46:59,  9.59s/it]
 92%|█████████▏| 35043/37963 [84:05:06<7:16:05,  8.96s/it]
 92%|█████████▏| 35044/37963 [84:05:14<6:55:25,  8.54s/it]
 92%|█████████▏| 35045/37963 [84:05:21<6:40:42,  8.24s/it]
 92%|█████████▏| 35046/37963 [84:05:29<6:26:36,  7.95s/it]
 92%|█████████▏| 35047/37963 [84:05:36<6:21:45,  7.85s/it]
 92%|█████████▏| 35048/37963 [84:05:44<6:16:47,  7.76s/it]
 92%|█████████▏| 35049/37963 [84:05:51<6:13:16,  7.69s/it]
 92%|█████████▏| 35050/37963 [84:05:59<6:11:23,  7.65s/it]
                                                          
{'loss': '0.09412', 'grad_norm': '3.08', 'learning_rate': '3.074e-07', 'epoch': '0.9233'}

 92%|█████████▏| 35050/37963 [84:05:59<6:11:23,  7.65s/it]
 92%|█████████▏| 35051/37963 [84:06:06<6:09:06,  7.61s/it]
 92%|█████████▏| 35052/37963 [84:06:21<7:45:10,  9.59s/it]
 92%|█████████▏| 35053/37963 [84:06:28<7:17:10,  9.01s/it]
 92%|█████████▏| 35054/37963 [84:06:42<8:29:06, 10.50s/it]
 92%|█████████▏| 35055/37963 [84:06:50<7:47:17,  9.64s/it]
 92%|█████████▏| 35056/37963 [84:06:58<7:17:59,  9.04s/it]
 92%|█████████▏| 35057/37963 [84:07:05<6:56:29,  8.60s/it]
 92%|█████████▏| 35058/37963 [84:07:13<6:39:25,  8.25s/it]
 92%|█████████▏| 35059/37963 [84:07:20<6:28:50,  8.03s/it]
 92%|█████████▏| 35060/37963 [84:07:28<6:22:25,  7.90s/it]
                                                          
{'loss': '0.09231', 'grad_norm': '3.512', 'learning_rate': '3.053e-07', 'epoch': '0.9235'}

 92%|█████████▏| 35060/37963 [84:07:28<6:22:25,  7.90s/it]
 92%|█████████▏| 35061/37963 [84:07:35<6:17:01,  7.80s/it]
 92%|█████████▏| 35062/37963 [84:07:43<6:14:04,  7.74s/it]
 92%|█████████▏| 35063/37963 [84:07:50<6:10:56,  7.67s/it]
 92%|█████████▏| 35064/37963 [84:07:58<6:07:12,  7.60s/it]
 92%|█████████▏| 35065/37963 [84:08:05<6:01:53,  7.49s/it]
 92%|█████████▏| 35066/37963 [84:08:13<6:01:47,  7.49s/it]
 92%|█████████▏| 35067/37963 [84:08:27<7:35:27,  9.44s/it]
 92%|█████████▏| 35068/37963 [84:08:34<7:08:57,  8.89s/it]
 92%|█████████▏| 35069/37963 [84:08:42<6:48:48,  8.48s/it]
 92%|█████████▏| 35070/37963 [84:08:49<6:32:26,  8.14s/it]
                                                          
{'loss': '0.07381', 'grad_norm': '4.462', 'learning_rate': '3.032e-07', 'epoch': '0.9238'}

 92%|█████████▏| 35070/37963 [84:08:49<6:32:26,  8.14s/it]
 92%|█████████▏| 35071/37963 [84:08:56<6:21:20,  7.91s/it]
 92%|█████████▏| 35072/37963 [84:09:04<6:15:07,  7.79s/it]
 92%|█████████▏| 35073/37963 [84:09:11<6:11:34,  7.71s/it]
 92%|█████████▏| 35074/37963 [84:09:19<6:07:25,  7.63s/it]
 92%|█████████▏| 35075/37963 [84:09:33<7:41:58,  9.60s/it]
 92%|█████████▏| 35076/37963 [84:09:41<7:11:47,  8.97s/it]
 92%|█████████▏| 35077/37963 [84:09:55<8:24:45, 10.49s/it]
 92%|█████████▏| 35078/37963 [84:10:02<7:40:04,  9.57s/it]
 92%|█████████▏| 35079/37963 [84:10:10<7:12:17,  8.99s/it]
 92%|█████████▏| 35080/37963 [84:10:17<6:50:20,  8.54s/it]
                                                          
{'loss': '0.09282', 'grad_norm': '3.525', 'learning_rate': '3.012e-07', 'epoch': '0.9241'}

 92%|█████████▏| 35080/37963 [84:10:17<6:50:20,  8.54s/it]
 92%|█████████▏| 35081/37963 [84:10:25<6:36:20,  8.25s/it]
 92%|█████████▏| 35082/37963 [84:10:32<6:23:04,  7.98s/it]
 92%|█████████▏| 35083/37963 [84:10:40<6:15:51,  7.83s/it]
 92%|█████████▏| 35084/37963 [84:10:47<6:11:24,  7.74s/it]
 92%|█████████▏| 35085/37963 [84:11:01<7:40:00,  9.59s/it]
 92%|█████████▏| 35086/37963 [84:11:15<8:41:19, 10.87s/it]
 92%|█████████▏| 35087/37963 [84:11:22<7:53:05,  9.87s/it]
 92%|█████████▏| 35088/37963 [84:11:30<7:19:31,  9.17s/it]
 92%|█████████▏| 35089/37963 [84:11:43<8:20:50, 10.46s/it]
 92%|█████████▏| 35090/37963 [84:11:51<7:38:43,  9.58s/it]
                                                          
{'loss': '0.08315', 'grad_norm': '2.784', 'learning_rate': '2.991e-07', 'epoch': '0.9243'}

 92%|█████████▏| 35090/37963 [84:11:51<7:38:43,  9.58s/it]
 92%|█████████▏| 35091/37963 [84:11:58<7:07:12,  8.92s/it]
 92%|█████████▏| 35092/37963 [84:12:06<6:47:08,  8.51s/it]
 92%|█████████▏| 35093/37963 [84:12:13<6:27:30,  8.10s/it]
 92%|█████████▏| 35094/37963 [84:12:21<6:20:03,  7.95s/it]
 92%|█████████▏| 35095/37963 [84:12:28<6:13:30,  7.81s/it]
 92%|█████████▏| 35096/37963 [84:12:36<6:09:06,  7.72s/it]
 92%|█████████▏| 35097/37963 [84:12:43<6:05:38,  7.65s/it]
 92%|█████████▏| 35098/37963 [84:12:51<6:04:52,  7.64s/it]
 92%|█████████▏| 35099/37963 [84:13:05<7:34:54,  9.53s/it]
 92%|█████████▏| 35100/37963 [84:13:12<7:07:11,  8.95s/it]
                                                          
{'loss': '0.08882', 'grad_norm': '3.828', 'learning_rate': '2.97e-07', 'epoch': '0.9246'}

 92%|█████████▏| 35100/37963 [84:13:12<7:07:11,  8.95s/it]
 92%|█████████▏| 35101/37963 [84:13:20<6:45:01,  8.49s/it]
 92%|█████████▏| 35102/37963 [84:13:27<6:31:25,  8.21s/it]
 92%|█████████▏| 35103/37963 [84:13:35<6:18:14,  7.94s/it]
 92%|█████████▏| 35104/37963 [84:13:42<6:15:18,  7.88s/it]
 92%|█████████▏| 35105/37963 [84:13:56<7:43:23,  9.73s/it]
 92%|█████████▏| 35106/37963 [84:14:04<7:14:12,  9.12s/it]
 92%|█████████▏| 35107/37963 [84:14:12<6:52:16,  8.66s/it]
 92%|█████████▏| 35108/37963 [84:14:19<6:36:40,  8.34s/it]
 92%|█████████▏| 35109/37963 [84:14:27<6:24:39,  8.09s/it]
 92%|█████████▏| 35110/37963 [84:14:34<6:18:45,  7.97s/it]
                                                          
{'loss': '0.07325', 'grad_norm': '3.296', 'learning_rate': '2.95e-07', 'epoch': '0.9249'}

 92%|█████████▏| 35110/37963 [84:14:34<6:18:45,  7.97s/it]
 92%|█████████▏| 35111/37963 [84:14:42<6:13:47,  7.86s/it]
 92%|█████████▏| 35112/37963 [84:14:50<6:08:59,  7.77s/it]
 92%|█████████▏| 35113/37963 [84:14:57<6:04:34,  7.68s/it]
 92%|█████████▏| 35114/37963 [84:15:05<6:02:32,  7.64s/it]
 92%|█████████▏| 35115/37963 [84:15:18<7:30:39,  9.49s/it]
 93%|█████████▎| 35116/37963 [84:15:26<7:03:47,  8.93s/it]
 93%|█████████▎| 35117/37963 [84:15:34<6:43:45,  8.51s/it]
 93%|█████████▎| 35118/37963 [84:15:41<6:31:54,  8.27s/it]
 93%|█████████▎| 35119/37963 [84:15:49<6:22:50,  8.08s/it]
 93%|█████████▎| 35120/37963 [84:15:56<6:15:17,  7.92s/it]
                                                          
{'loss': '0.0857', 'grad_norm': '3.532', 'learning_rate': '2.929e-07', 'epoch': '0.9251'}

 93%|█████████▎| 35120/37963 [84:15:56<6:15:17,  7.92s/it]
 93%|█████████▎| 35121/37963 [84:16:04<6:08:01,  7.77s/it]
 93%|█████████▎| 35122/37963 [84:16:18<7:36:24,  9.64s/it]
 93%|█████████▎| 35123/37963 [84:16:25<7:07:16,  9.03s/it]
 93%|█████████▎| 35124/37963 [84:16:33<6:45:58,  8.58s/it]
 93%|█████████▎| 35125/37963 [84:16:40<6:27:55,  8.20s/it]
 93%|█████████▎| 35126/37963 [84:16:48<6:14:25,  7.92s/it]
 93%|█████████▎| 35127/37963 [84:16:55<6:08:08,  7.79s/it]
 93%|█████████▎| 35128/37963 [84:17:09<7:29:50,  9.52s/it]
 93%|█████████▎| 35129/37963 [84:17:16<7:04:31,  8.99s/it]
 93%|█████████▎| 35130/37963 [84:17:30<8:14:27, 10.47s/it]
                                                          
{'loss': '0.0808', 'grad_norm': '3.789', 'learning_rate': '2.909e-07', 'epoch': '0.9254'}

 93%|█████████▎| 35130/37963 [84:17:30<8:14:27, 10.47s/it]
 93%|█████████▎| 35131/37963 [84:17:38<7:35:22,  9.65s/it]
 93%|█████████▎| 35132/37963 [84:17:52<8:38:27, 10.99s/it]
 93%|█████████▎| 35133/37963 [84:18:00<7:48:58,  9.94s/it]
 93%|█████████▎| 35134/37963 [84:18:07<7:14:20,  9.21s/it]
 93%|█████████▎| 35135/37963 [84:18:15<6:50:24,  8.71s/it]
 93%|█████████▎| 35136/37963 [84:18:22<6:35:01,  8.38s/it]
 93%|█████████▎| 35137/37963 [84:18:30<6:20:29,  8.08s/it]
 93%|█████████▎| 35138/37963 [84:18:37<6:09:56,  7.86s/it]
 93%|█████████▎| 35139/37963 [84:18:44<6:03:11,  7.72s/it]
 93%|█████████▎| 35140/37963 [84:18:59<7:37:23,  9.72s/it]
                                                          
{'loss': '0.07443', 'grad_norm': '3.351', 'learning_rate': '2.888e-07', 'epoch': '0.9256'}

 93%|█████████▎| 35140/37963 [84:18:59<7:37:23,  9.72s/it]
 93%|█████████▎| 35141/37963 [84:19:06<7:08:34,  9.11s/it]
 93%|█████████▎| 35142/37963 [84:19:14<6:42:37,  8.56s/it]
 93%|█████████▎| 35143/37963 [84:19:21<6:27:31,  8.25s/it]
 93%|█████████▎| 35144/37963 [84:19:29<6:14:51,  7.98s/it]
 93%|█████████▎| 35145/37963 [84:19:36<6:08:00,  7.84s/it]
 93%|█████████▎| 35146/37963 [84:19:44<6:03:33,  7.74s/it]
 93%|█████████▎| 35147/37963 [84:19:51<6:00:28,  7.68s/it]
 93%|█████████▎| 35148/37963 [84:19:59<5:59:55,  7.67s/it]
 93%|█████████▎| 35149/37963 [84:20:06<5:56:34,  7.60s/it]
 93%|█████████▎| 35150/37963 [84:20:20<7:26:16,  9.52s/it]
                                                          
{'loss': '0.09037', 'grad_norm': '2.829', 'learning_rate': '2.868e-07', 'epoch': '0.9259'}

 93%|█████████▎| 35150/37963 [84:20:20<7:26:16,  9.52s/it]
 93%|█████████▎| 35151/37963 [84:20:28<7:00:20,  8.97s/it]
 93%|█████████▎| 35152/37963 [84:20:36<6:42:12,  8.59s/it]
 93%|█████████▎| 35153/37963 [84:20:49<7:54:53, 10.14s/it]
 93%|█████████▎| 35154/37963 [84:20:57<7:19:25,  9.39s/it]
 93%|█████████▎| 35155/37963 [84:21:05<6:52:51,  8.82s/it]
 93%|█████████▎| 35156/37963 [84:21:12<6:35:04,  8.44s/it]
 93%|█████████▎| 35157/37963 [84:21:20<6:21:36,  8.16s/it]
 93%|█████████▎| 35158/37963 [84:21:27<6:12:13,  7.96s/it]
 93%|█████████▎| 35159/37963 [84:21:35<6:06:51,  7.85s/it]
 93%|█████████▎| 35160/37963 [84:21:42<6:04:01,  7.79s/it]
                                                          
{'loss': '0.08214', 'grad_norm': '4.091', 'learning_rate': '2.848e-07', 'epoch': '0.9262'}

 93%|█████████▎| 35160/37963 [84:21:42<6:04:01,  7.79s/it]
 93%|█████████▎| 35161/37963 [84:21:50<5:59:37,  7.70s/it]
 93%|█████████▎| 35162/37963 [84:21:57<5:57:05,  7.65s/it]
 93%|█████████▎| 35163/37963 [84:22:05<5:55:11,  7.61s/it]
 93%|█████████▎| 35164/37963 [84:22:13<5:55:37,  7.62s/it]
 93%|█████████▎| 35165/37963 [84:22:26<7:23:13,  9.50s/it]
 93%|█████████▎| 35166/37963 [84:22:34<6:56:38,  8.94s/it]
 93%|█████████▎| 35167/37963 [84:22:42<6:38:01,  8.54s/it]
 93%|█████████▎| 35168/37963 [84:22:49<6:25:07,  8.27s/it]
 93%|█████████▎| 35169/37963 [84:22:57<6:14:11,  8.04s/it]
 93%|█████████▎| 35170/37963 [84:23:04<6:07:30,  7.90s/it]
                                                          
{'loss': '0.07638', 'grad_norm': '3.248', 'learning_rate': '2.828e-07', 'epoch': '0.9264'}

 93%|█████████▎| 35170/37963 [84:23:04<6:07:30,  7.90s/it]
 93%|█████████▎| 35171/37963 [84:23:12<5:58:31,  7.70s/it]
 93%|█████████▎| 35172/37963 [84:23:25<7:24:43,  9.56s/it]
 93%|█████████▎| 35173/37963 [84:23:33<6:57:56,  8.99s/it]
 93%|█████████▎| 35174/37963 [84:23:41<6:36:38,  8.53s/it]
 93%|█████████▎| 35175/37963 [84:23:54<7:50:03, 10.12s/it]
 93%|█████████▎| 35176/37963 [84:24:02<7:14:50,  9.36s/it]
 93%|█████████▎| 35177/37963 [84:24:10<6:49:05,  8.81s/it]
 93%|█████████▎| 35178/37963 [84:24:24<8:00:50, 10.36s/it]
 93%|█████████▎| 35179/37963 [84:24:31<7:20:02,  9.48s/it]
 93%|█████████▎| 35180/37963 [84:24:39<6:53:47,  8.92s/it]
                                                          
{'loss': '0.09528', 'grad_norm': '3.021', 'learning_rate': '2.807e-07', 'epoch': '0.9267'}

 93%|█████████▎| 35180/37963 [84:24:39<6:53:47,  8.92s/it]
 93%|█████████▎| 35181/37963 [84:24:53<8:04:15, 10.44s/it]
 93%|█████████▎| 35182/37963 [84:25:00<7:22:53,  9.56s/it]
 93%|█████████▎| 35183/37963 [84:25:08<6:54:10,  8.94s/it]
 93%|█████████▎| 35184/37963 [84:25:15<6:36:03,  8.55s/it]
 93%|█████████▎| 35185/37963 [84:25:23<6:22:50,  8.27s/it]
 93%|█████████▎| 35186/37963 [84:25:37<7:43:19, 10.01s/it]
 93%|█████████▎| 35187/37963 [84:25:45<7:11:28,  9.33s/it]
 93%|█████████▎| 35188/37963 [84:25:52<6:47:07,  8.80s/it]
 93%|█████████▎| 35189/37963 [84:25:59<6:25:54,  8.35s/it]
 93%|█████████▎| 35190/37963 [84:26:07<6:15:09,  8.12s/it]
                                                          
{'loss': '0.08795', 'grad_norm': '3.743', 'learning_rate': '2.787e-07', 'epoch': '0.927'}

 93%|█████████▎| 35190/37963 [84:26:07<6:15:09,  8.12s/it]
 93%|█████████▎| 35191/37963 [84:26:15<6:08:51,  7.98s/it]
 93%|█████████▎| 35192/37963 [84:26:22<6:02:05,  7.84s/it]
 93%|█████████▎| 35193/37963 [84:26:30<5:58:27,  7.76s/it]
 93%|█████████▎| 35194/37963 [84:26:37<5:55:36,  7.71s/it]
 93%|█████████▎| 35195/37963 [84:26:45<5:54:55,  7.69s/it]
 93%|█████████▎| 35196/37963 [84:26:53<5:53:49,  7.67s/it]
 93%|█████████▎| 35197/37963 [84:27:00<5:51:34,  7.63s/it]
 93%|█████████▎| 35198/37963 [84:27:08<5:49:14,  7.58s/it]
 93%|█████████▎| 35199/37963 [84:27:22<7:15:56,  9.46s/it]
 93%|█████████▎| 35200/37963 [84:27:29<6:50:47,  8.92s/it]
                                                          
{'loss': '0.06944', 'grad_norm': '2.179', 'learning_rate': '2.767e-07', 'epoch': '0.9272'}

 93%|█████████▎| 35200/37963 [84:27:29<6:50:47,  8.92s/it]
 93%|█████████▎| 35201/37963 [84:27:37<6:32:10,  8.52s/it]
 93%|█████████▎| 35202/37963 [84:27:44<6:18:17,  8.22s/it]
 93%|█████████▎| 35203/37963 [84:27:52<6:08:18,  8.01s/it]
 93%|█████████▎| 35204/37963 [84:28:06<7:29:08,  9.77s/it]
 93%|█████████▎| 35205/37963 [84:28:13<6:57:44,  9.09s/it]
 93%|█████████▎| 35206/37963 [84:28:21<6:35:37,  8.61s/it]
 93%|█████████▎| 35207/37963 [84:28:28<6:22:30,  8.33s/it]
 93%|█████████▎| 35208/37963 [84:28:36<6:08:32,  8.03s/it]
 93%|█████████▎| 35209/37963 [84:28:43<6:03:01,  7.91s/it]
 93%|█████████▎| 35210/37963 [84:28:51<5:57:52,  7.80s/it]
                                                          
{'loss': '0.07838', 'grad_norm': '3.679', 'learning_rate': '2.747e-07', 'epoch': '0.9275'}

 93%|█████████▎| 35210/37963 [84:28:51<5:57:52,  7.80s/it]
 93%|█████████▎| 35211/37963 [84:28:58<5:54:31,  7.73s/it]
 93%|█████████▎| 35212/37963 [84:29:06<5:52:16,  7.68s/it]
 93%|█████████▎| 35213/37963 [84:29:20<7:18:11,  9.56s/it]
 93%|█████████▎| 35214/37963 [84:29:27<6:50:55,  8.97s/it]
 93%|█████████▎| 35215/37963 [84:29:35<6:30:29,  8.53s/it]
 93%|█████████▎| 35216/37963 [84:29:42<6:15:14,  8.20s/it]
 93%|█████████▎| 35217/37963 [84:29:50<6:06:39,  8.01s/it]
 93%|█████████▎| 35218/37963 [84:29:57<5:55:44,  7.78s/it]
 93%|█████████▎| 35219/37963 [84:30:05<5:51:34,  7.69s/it]
 93%|█████████▎| 35220/37963 [84:30:12<5:48:39,  7.63s/it]
                                                          
{'loss': '0.08624', 'grad_norm': '2.914', 'learning_rate': '2.728e-07', 'epoch': '0.9277'}

 93%|█████████▎| 35220/37963 [84:30:12<5:48:39,  7.63s/it]
 93%|█████████▎| 35221/37963 [84:30:20<5:47:16,  7.60s/it]
 93%|█████████▎| 35222/37963 [84:30:27<5:43:51,  7.53s/it]
 93%|█████████▎| 35223/37963 [84:30:35<5:44:55,  7.55s/it]
 93%|█████████▎| 35224/37963 [84:30:42<5:42:06,  7.49s/it]
 93%|█████████▎| 35225/37963 [84:31:03<8:41:18, 11.42s/it]
 93%|█████████▎| 35226/37963 [84:31:17<9:18:40, 12.25s/it]
 93%|█████████▎| 35227/37963 [84:31:24<8:15:49, 10.87s/it]
 93%|█████████▎| 35228/37963 [84:31:32<7:30:20,  9.88s/it]
 93%|█████████▎| 35229/37963 [84:31:40<6:58:25,  9.18s/it]
 93%|█████████▎| 35230/37963 [84:31:47<6:35:27,  8.68s/it]
                                                          
{'loss': '0.08726', 'grad_norm': '3.389', 'learning_rate': '2.708e-07', 'epoch': '0.928'}

 93%|█████████▎| 35230/37963 [84:31:47<6:35:27,  8.68s/it]
 93%|█████████▎| 35231/37963 [84:31:55<6:20:50,  8.36s/it]
 93%|█████████▎| 35232/37963 [84:32:09<7:37:06, 10.04s/it]
 93%|█████████▎| 35233/37963 [84:32:16<7:03:49,  9.31s/it]
 93%|█████████▎| 35234/37963 [84:32:31<8:11:37, 10.81s/it]
 93%|█████████▎| 35235/37963 [84:32:38<7:28:01,  9.85s/it]
 93%|█████████▎| 35236/37963 [84:32:46<6:55:29,  9.14s/it]
 93%|█████████▎| 35237/37963 [84:32:53<6:33:06,  8.65s/it]
 93%|█████████▎| 35238/37963 [84:33:01<6:18:04,  8.32s/it]
 93%|█████████▎| 35239/37963 [84:33:08<6:08:45,  8.12s/it]
 93%|█████████▎| 35240/37963 [84:33:16<6:00:48,  7.95s/it]
                                                          
{'loss': '0.06634', 'grad_norm': '2.634', 'learning_rate': '2.688e-07', 'epoch': '0.9283'}

 93%|█████████▎| 35240/37963 [84:33:16<6:00:48,  7.95s/it]
 93%|█████████▎| 35241/37963 [84:33:23<5:52:28,  7.77s/it]
 93%|█████████▎| 35242/37963 [84:33:31<5:47:42,  7.67s/it]
 93%|█████████▎| 35243/37963 [84:33:38<5:46:39,  7.65s/it]
 93%|█████████▎| 35244/37963 [84:33:46<5:43:11,  7.57s/it]
 93%|█████████▎| 35245/37963 [84:33:53<5:43:26,  7.58s/it]
 93%|█████████▎| 35246/37963 [84:34:01<5:42:17,  7.56s/it]
 93%|█████████▎| 35247/37963 [84:34:15<7:06:53,  9.43s/it]
 93%|█████████▎| 35248/37963 [84:34:22<6:40:17,  8.85s/it]
 93%|█████████▎| 35249/37963 [84:34:30<6:21:39,  8.44s/it]
 93%|█████████▎| 35250/37963 [84:34:37<6:07:29,  8.13s/it]
                                                          
{'loss': '0.077', 'grad_norm': '2.757', 'learning_rate': '2.669e-07', 'epoch': '0.9285'}

 93%|█████████▎| 35250/37963 [84:34:37<6:07:29,  8.13s/it]
 93%|█████████▎| 35251/37963 [84:34:45<5:59:18,  7.95s/it]
 93%|█████████▎| 35252/37963 [84:34:52<5:55:39,  7.87s/it]
 93%|█████████▎| 35253/37963 [84:35:00<5:50:07,  7.75s/it]
 93%|█████████▎| 35254/37963 [84:35:07<5:45:42,  7.66s/it]
 93%|█████████▎| 35255/37963 [84:35:15<5:42:39,  7.59s/it]
 93%|█████████▎| 35256/37963 [84:35:22<5:38:56,  7.51s/it]
 93%|█████████▎| 35257/37963 [84:35:36<7:08:24,  9.50s/it]
 93%|█████████▎| 35258/37963 [84:35:44<6:42:13,  8.92s/it]
 93%|█████████▎| 35259/37963 [84:35:58<7:48:49, 10.40s/it]
 93%|█████████▎| 35260/37963 [84:36:05<7:11:44,  9.58s/it]
                                                          
{'loss': '0.07826', 'grad_norm': '3.206', 'learning_rate': '2.649e-07', 'epoch': '0.9288'}

 93%|█████████▎| 35260/37963 [84:36:05<7:11:44,  9.58s/it]
 93%|█████████▎| 35261/37963 [84:36:13<6:44:42,  8.99s/it]
 93%|█████████▎| 35262/37963 [84:36:20<6:24:29,  8.54s/it]
 93%|█████████▎| 35263/37963 [84:36:28<6:09:45,  8.22s/it]
 93%|█████████▎| 35264/37963 [84:36:35<5:57:02,  7.94s/it]
 93%|█████████▎| 35265/37963 [84:36:43<5:51:40,  7.82s/it]
 93%|█████████▎| 35266/37963 [84:36:50<5:48:21,  7.75s/it]
 93%|█████████▎| 35267/37963 [84:36:58<5:43:54,  7.65s/it]
 93%|█████████▎| 35268/37963 [84:37:05<5:42:22,  7.62s/it]
 93%|█████████▎| 35269/37963 [84:37:13<5:41:22,  7.60s/it]
 93%|█████████▎| 35270/37963 [84:37:20<5:38:40,  7.55s/it]
                                                          
{'loss': '0.08185', 'grad_norm': '3.703', 'learning_rate': '2.63e-07', 'epoch': '0.9291'}

 93%|█████████▎| 35270/37963 [84:37:20<5:38:40,  7.55s/it]
 93%|█████████▎| 35271/37963 [84:37:28<5:39:31,  7.57s/it]
 93%|█████████▎| 35272/37963 [84:37:42<7:04:44,  9.47s/it]
 93%|█████████▎| 35273/37963 [84:37:49<6:38:34,  8.89s/it]
 93%|█████████▎| 35274/37963 [84:37:57<6:20:38,  8.49s/it]
 93%|█████████▎| 35275/37963 [84:38:04<6:06:52,  8.19s/it]
 93%|█████████▎| 35276/37963 [84:38:12<5:58:21,  8.00s/it]
 93%|█████████▎| 35277/37963 [84:38:19<5:51:03,  7.84s/it]
 93%|█████████▎| 35278/37963 [84:38:27<5:45:53,  7.73s/it]
 93%|█████████▎| 35279/37963 [84:38:41<7:11:09,  9.64s/it]
 93%|█████████▎| 35280/37963 [84:38:55<8:09:18, 10.94s/it]
                                                          
{'loss': '0.08443', 'grad_norm': '3.161', 'learning_rate': '2.61e-07', 'epoch': '0.9293'}

 93%|█████████▎| 35280/37963 [84:38:55<8:09:18, 10.94s/it]
 93%|█████████▎| 35281/37963 [84:39:02<7:24:09,  9.94s/it]
 93%|█████████▎| 35282/37963 [84:39:23<9:47:22, 13.15s/it]
 93%|█████████▎| 35283/37963 [84:39:31<8:32:55, 11.48s/it]
 93%|█████████▎| 35284/37963 [84:39:38<7:39:42, 10.30s/it]
 93%|█████████▎| 35285/37963 [84:39:46<7:02:22,  9.46s/it]
 93%|█████████▎| 35286/37963 [84:39:53<6:35:57,  8.87s/it]
 93%|█████████▎| 35287/37963 [84:40:01<6:15:40,  8.42s/it]
 93%|█████████▎| 35288/37963 [84:40:08<6:04:45,  8.18s/it]
 93%|█████████▎| 35289/37963 [84:40:16<5:55:35,  7.98s/it]
 93%|█████████▎| 35290/37963 [84:40:23<5:49:20,  7.84s/it]
                                                          
{'loss': '0.07588', 'grad_norm': '3.34', 'learning_rate': '2.591e-07', 'epoch': '0.9296'}

 93%|█████████▎| 35290/37963 [84:40:23<5:49:20,  7.84s/it]
 93%|█████████▎| 35291/37963 [84:40:31<5:45:23,  7.76s/it]
 93%|█████████▎| 35292/37963 [84:40:38<5:43:10,  7.71s/it]
 93%|█████████▎| 35293/37963 [84:40:46<5:42:58,  7.71s/it]
 93%|█████████▎| 35294/37963 [84:40:54<5:40:29,  7.65s/it]
 93%|█████████▎| 35295/37963 [84:41:08<7:05:53,  9.58s/it]
 93%|█████████▎| 35296/37963 [84:41:15<6:35:41,  8.90s/it]
 93%|█████████▎| 35297/37963 [84:41:22<6:16:13,  8.47s/it]
 93%|█████████▎| 35298/37963 [84:41:30<6:04:32,  8.21s/it]
 93%|█████████▎| 35299/37963 [84:41:37<5:54:47,  7.99s/it]
 93%|█████████▎| 35300/37963 [84:41:45<5:49:02,  7.86s/it]
                                                          
{'loss': '0.08127', 'grad_norm': '2.509', 'learning_rate': '2.572e-07', 'epoch': '0.9299'}

 93%|█████████▎| 35300/37963 [84:41:45<5:49:02,  7.86s/it]
 93%|█████████▎| 35301/37963 [84:41:53<5:43:13,  7.74s/it]
 93%|█████████▎| 35302/37963 [84:42:00<5:38:57,  7.64s/it]
 93%|█████████▎| 35303/37963 [84:42:07<5:37:08,  7.60s/it]
 93%|█████████▎| 35304/37963 [84:42:15<5:35:39,  7.57s/it]
 93%|█████████▎| 35305/37963 [84:42:29<7:00:28,  9.49s/it]
 93%|█████████▎| 35306/37963 [84:42:36<6:34:42,  8.91s/it]
 93%|█████████▎| 35307/37963 [84:42:50<7:41:03, 10.42s/it]
 93%|█████████▎| 35308/37963 [84:42:58<7:03:50,  9.58s/it]
 93%|█████████▎| 35309/37963 [84:43:06<6:36:16,  8.96s/it]
 93%|█████████▎| 35310/37963 [84:43:13<6:19:55,  8.59s/it]
                                                          
{'loss': '0.08036', 'grad_norm': '4.858', 'learning_rate': '2.552e-07', 'epoch': '0.9301'}

 93%|█████████▎| 35310/37963 [84:43:13<6:19:55,  8.59s/it]
 93%|█████████▎| 35311/37963 [84:43:21<6:05:10,  8.26s/it]
 93%|█████████▎| 35312/37963 [84:43:28<5:53:54,  8.01s/it]
 93%|█████████▎| 35313/37963 [84:43:36<5:49:20,  7.91s/it]
 93%|█████████▎| 35314/37963 [84:43:43<5:43:26,  7.78s/it]
 93%|█████████▎| 35315/37963 [84:43:51<5:40:43,  7.72s/it]
 93%|█████████▎| 35316/37963 [84:44:05<6:59:13,  9.50s/it]
 93%|█████████▎| 35317/37963 [84:44:12<6:33:39,  8.93s/it]
 93%|█████████▎| 35318/37963 [84:44:20<6:14:34,  8.50s/it]
 93%|█████████▎| 35319/37963 [84:44:27<6:01:04,  8.19s/it]
 93%|█████████▎| 35320/37963 [84:44:35<5:51:21,  7.98s/it]
                                                          
{'loss': '0.08482', 'grad_norm': '4.148', 'learning_rate': '2.533e-07', 'epoch': '0.9304'}

 93%|█████████▎| 35320/37963 [84:44:35<5:51:21,  7.98s/it]
 93%|█████████▎| 35321/37963 [84:44:42<5:43:34,  7.80s/it]
 93%|█████████▎| 35322/37963 [84:44:49<5:37:08,  7.66s/it]
 93%|█████████▎| 35323/37963 [84:44:57<5:33:24,  7.58s/it]
 93%|█████████▎| 35324/37963 [84:45:04<5:32:06,  7.55s/it]
 93%|█████████▎| 35325/37963 [84:45:12<5:32:22,  7.56s/it]
 93%|█████████▎| 35326/37963 [84:45:19<5:31:59,  7.55s/it]
 93%|█████████▎| 35327/37963 [84:45:34<7:00:07,  9.56s/it]
 93%|█████████▎| 35328/37963 [84:45:41<6:34:01,  8.97s/it]
 93%|█████████▎| 35329/37963 [84:45:49<6:15:09,  8.55s/it]
 93%|█████████▎| 35330/37963 [84:46:02<7:21:52, 10.07s/it]
                                                          
{'loss': '0.08122', 'grad_norm': '3.433', 'learning_rate': '2.514e-07', 'epoch': '0.9306'}

 93%|█████████▎| 35330/37963 [84:46:02<7:21:52, 10.07s/it]
 93%|█████████▎| 35331/37963 [84:46:10<6:48:03,  9.30s/it]
 93%|█████████▎| 35332/37963 [84:46:24<7:49:15, 10.70s/it]
 93%|█████████▎| 35333/37963 [84:46:31<7:07:57,  9.76s/it]
 93%|█████████▎| 35334/37963 [84:46:39<6:39:43,  9.12s/it]
 93%|█████████▎| 35335/37963 [84:46:46<6:17:02,  8.61s/it]
 93%|█████████▎| 35336/37963 [84:47:00<7:26:51, 10.21s/it]
 93%|█████████▎| 35337/37963 [84:47:08<6:52:04,  9.42s/it]
 93%|█████████▎| 35338/37963 [84:47:16<6:28:08,  8.87s/it]
 93%|█████████▎| 35339/37963 [84:47:23<6:10:25,  8.47s/it]
 93%|█████████▎| 35340/37963 [84:47:30<5:54:20,  8.11s/it]
                                                          
{'loss': '0.09168', 'grad_norm': '3.762', 'learning_rate': '2.495e-07', 'epoch': '0.9309'}

 93%|█████████▎| 35340/37963 [84:47:30<5:54:20,  8.11s/it]
 93%|█████████▎| 35341/37963 [84:47:38<5:47:20,  7.95s/it]
 93%|█████████▎| 35342/37963 [84:47:45<5:42:20,  7.84s/it]
 93%|█████████▎| 35343/37963 [84:47:53<5:37:14,  7.72s/it]
 93%|█████████▎| 35344/37963 [84:48:01<5:35:37,  7.69s/it]
 93%|█████████▎| 35345/37963 [84:48:08<5:34:45,  7.67s/it]
 93%|█████████▎| 35346/37963 [84:48:22<6:57:58,  9.58s/it]
 93%|█████████▎| 35347/37963 [84:48:30<6:34:12,  9.04s/it]
 93%|█████████▎| 35348/37963 [84:48:37<6:10:36,  8.50s/it]
 93%|█████████▎| 35349/37963 [84:48:45<5:56:13,  8.18s/it]
 93%|█████████▎| 35350/37963 [84:48:52<5:47:28,  7.98s/it]
                                                          
{'loss': '0.08055', 'grad_norm': '3.099', 'learning_rate': '2.476e-07', 'epoch': '0.9312'}

 93%|█████████▎| 35350/37963 [84:48:52<5:47:28,  7.98s/it]
 93%|█████████▎| 35351/37963 [84:49:00<5:42:09,  7.86s/it]
 93%|█████████▎| 35352/37963 [84:49:13<6:57:53,  9.60s/it]
 93%|█████████▎| 35353/37963 [84:49:21<6:31:19,  9.00s/it]
 93%|█████████▎| 35354/37963 [84:49:29<6:12:11,  8.56s/it]
 93%|█████████▎| 35355/37963 [84:49:36<5:58:56,  8.26s/it]
 93%|█████████▎| 35356/37963 [84:49:44<5:48:44,  8.03s/it]
 93%|█████████▎| 35357/37963 [84:49:58<7:05:10,  9.79s/it]
 93%|█████████▎| 35358/37963 [84:50:05<6:33:35,  9.07s/it]
 93%|█████████▎| 35359/37963 [84:50:12<6:11:18,  8.56s/it]
 93%|█████████▎| 35360/37963 [84:50:20<5:57:55,  8.25s/it]
                                                          
{'loss': '0.07812', 'grad_norm': '3.908', 'learning_rate': '2.458e-07', 'epoch': '0.9314'}

 93%|█████████▎| 35360/37963 [84:50:20<5:57:55,  8.25s/it]
 93%|█████████▎| 35361/37963 [84:50:28<5:52:03,  8.12s/it]
 93%|█████████▎| 35362/37963 [84:50:35<5:44:54,  7.96s/it]
 93%|█████████▎| 35363/37963 [84:50:43<5:40:32,  7.86s/it]
 93%|█████████▎| 35364/37963 [84:50:50<5:35:22,  7.74s/it]
 93%|█████████▎| 35365/37963 [84:50:58<5:32:07,  7.67s/it]
 93%|█████████▎| 35366/37963 [84:51:12<6:53:36,  9.56s/it]
 93%|█████████▎| 35367/37963 [84:51:19<6:30:01,  9.01s/it]
 93%|█████████▎| 35368/37963 [84:51:27<6:11:45,  8.60s/it]
 93%|█████████▎| 35369/37963 [84:51:35<5:57:19,  8.27s/it]
 93%|█████████▎| 35370/37963 [84:51:42<5:48:56,  8.07s/it]
                                                          
{'loss': '0.08746', 'grad_norm': '4.106', 'learning_rate': '2.439e-07', 'epoch': '0.9317'}

 93%|█████████▎| 35370/37963 [84:51:42<5:48:56,  8.07s/it]
 93%|█████████▎| 35371/37963 [84:51:50<5:43:20,  7.95s/it]
 93%|█████████▎| 35372/37963 [84:51:57<5:37:15,  7.81s/it]
 93%|█████████▎| 35373/37963 [84:52:05<5:33:46,  7.73s/it]
 93%|█████████▎| 35374/37963 [84:52:12<5:29:45,  7.64s/it]
 93%|█████████▎| 35375/37963 [84:52:20<5:23:44,  7.51s/it]
 93%|█████████▎| 35376/37963 [84:52:27<5:22:16,  7.47s/it]
 93%|█████████▎| 35377/37963 [84:52:41<6:44:33,  9.39s/it]
 93%|█████████▎| 35378/37963 [84:52:48<6:21:44,  8.86s/it]
 93%|█████████▎| 35379/37963 [84:52:56<6:04:11,  8.46s/it]
 93%|█████████▎| 35380/37963 [84:53:09<7:08:25,  9.95s/it]
                                                          
{'loss': '0.08088', 'grad_norm': '5.086', 'learning_rate': '2.42e-07', 'epoch': '0.932'}

 93%|█████████▎| 35380/37963 [84:53:09<7:08:25,  9.95s/it]
 93%|█████████▎| 35381/37963 [84:53:23<7:53:27, 11.00s/it]
 93%|█████████▎| 35382/37963 [84:53:31<7:10:28, 10.01s/it]
 93%|█████████▎| 35383/37963 [84:53:38<6:38:10,  9.26s/it]
 93%|█████████▎| 35384/37963 [84:53:46<6:16:29,  8.76s/it]
 93%|█████████▎| 35385/37963 [84:53:53<6:00:02,  8.38s/it]
 93%|█████████▎| 35386/37963 [84:54:01<5:47:29,  8.09s/it]
 93%|█████████▎| 35387/37963 [84:54:08<5:41:41,  7.96s/it]
 93%|█████████▎| 35388/37963 [84:54:15<5:30:59,  7.71s/it]
 93%|█████████▎| 35389/37963 [84:54:23<5:24:39,  7.57s/it]
 93%|█████████▎| 35390/37963 [84:54:36<6:41:00,  9.35s/it]
                                                          
{'loss': '0.08816', 'grad_norm': '4.522', 'learning_rate': '2.401e-07', 'epoch': '0.9322'}

 93%|█████████▎| 35390/37963 [84:54:36<6:41:00,  9.35s/it]
 93%|█████████▎| 35391/37963 [84:54:43<6:13:51,  8.72s/it]
 93%|█████████▎| 35392/37963 [84:54:51<5:59:08,  8.38s/it]
 93%|█████████▎| 35393/37963 [84:55:05<7:06:13,  9.95s/it]
 93%|█████████▎| 35394/37963 [84:55:12<6:33:15,  9.18s/it]
 93%|█████████▎| 35395/37963 [84:55:19<6:11:40,  8.68s/it]
 93%|█████████▎| 35396/37963 [84:55:27<5:54:36,  8.29s/it]
 93%|█████████▎| 35397/37963 [84:55:34<5:39:08,  7.93s/it]
 93%|█████████▎| 35398/37963 [84:55:41<5:34:17,  7.82s/it]
 93%|█████████▎| 35399/37963 [84:55:49<5:32:25,  7.78s/it]
 93%|█████████▎| 35400/37963 [84:56:03<6:52:38,  9.66s/it]
                                                          
{'loss': '0.08533', 'grad_norm': '3.075', 'learning_rate': '2.383e-07', 'epoch': '0.9325'}

 93%|█████████▎| 35400/37963 [84:56:03<6:52:38,  9.66s/it]
 93%|█████████▎| 35401/37963 [84:56:11<6:27:09,  9.07s/it]
 93%|█████████▎| 35402/37963 [84:56:18<6:08:31,  8.63s/it]
 93%|█████████▎| 35403/37963 [84:56:26<5:53:33,  8.29s/it]
 93%|█████████▎| 35404/37963 [84:56:33<5:42:20,  8.03s/it]
 93%|█████████▎| 35405/37963 [84:56:41<5:34:28,  7.85s/it]
 93%|█████████▎| 35406/37963 [84:56:55<6:57:57,  9.81s/it]
 93%|█████████▎| 35407/37963 [84:57:03<6:28:23,  9.12s/it]
 93%|█████████▎| 35408/37963 [84:57:10<6:09:18,  8.67s/it]
 93%|█████████▎| 35409/37963 [84:57:18<5:56:14,  8.37s/it]
 93%|█████████▎| 35410/37963 [84:57:25<5:44:56,  8.11s/it]
                                                          
{'loss': '0.08687', 'grad_norm': '3.914', 'learning_rate': '2.364e-07', 'epoch': '0.9328'}

 93%|█████████▎| 35410/37963 [84:57:25<5:44:56,  8.11s/it]
 93%|█████████▎| 35411/37963 [84:57:33<5:33:55,  7.85s/it]
 93%|█████████▎| 35412/37963 [84:57:47<6:50:40,  9.66s/it]
 93%|█████████▎| 35413/37963 [84:57:54<6:22:59,  9.01s/it]
 93%|█████████▎| 35414/37963 [84:58:02<6:03:21,  8.55s/it]
 93%|█████████▎| 35415/37963 [84:58:09<5:50:00,  8.24s/it]
 93%|█████████▎| 35416/37963 [84:58:17<5:39:46,  8.00s/it]
 93%|█████████▎| 35417/37963 [84:58:24<5:33:29,  7.86s/it]
 93%|█████████▎| 35418/37963 [84:58:32<5:29:58,  7.78s/it]
 93%|█████████▎| 35419/37963 [84:58:39<5:26:15,  7.69s/it]
 93%|█████████▎| 35420/37963 [84:58:47<5:24:53,  7.67s/it]
                                                          
{'loss': '0.08242', 'grad_norm': '3.331', 'learning_rate': '2.346e-07', 'epoch': '0.933'}

 93%|█████████▎| 35420/37963 [84:58:47<5:24:53,  7.67s/it]
 93%|█████████▎| 35421/37963 [84:58:54<5:21:11,  7.58s/it]
 93%|█████████▎| 35422/37963 [84:59:02<5:19:59,  7.56s/it]
 93%|█████████▎| 35423/37963 [84:59:09<5:20:43,  7.58s/it]
 93%|█████████▎| 35424/37963 [84:59:17<5:19:48,  7.56s/it]
 93%|█████████▎| 35425/37963 [84:59:24<5:18:13,  7.52s/it]
 93%|█████████▎| 35426/37963 [84:59:32<5:15:15,  7.46s/it]
 93%|█████████▎| 35427/37963 [84:59:39<5:16:44,  7.49s/it]
 93%|█████████▎| 35428/37963 [84:59:47<5:16:22,  7.49s/it]
 93%|█████████▎| 35429/37963 [84:59:54<5:15:09,  7.46s/it]
 93%|█████████▎| 35430/37963 [85:00:15<8:00:24, 11.38s/it]
                                                          
{'loss': '0.08786', 'grad_norm': '2.732', 'learning_rate': '2.328e-07', 'epoch': '0.9333'}

 93%|█████████▎| 35430/37963 [85:00:15<8:00:24, 11.38s/it]
 93%|█████████▎| 35431/37963 [85:00:29<8:35:08, 12.21s/it]
 93%|█████████▎| 35432/37963 [85:00:36<7:37:15, 10.84s/it]
 93%|█████████▎| 35433/37963 [85:00:44<6:54:27,  9.83s/it]
 93%|█████████▎| 35434/37963 [85:00:51<6:25:09,  9.14s/it]
 93%|█████████▎| 35435/37963 [85:00:59<6:05:37,  8.68s/it]
 93%|█████████▎| 35436/37963 [85:01:06<5:51:26,  8.34s/it]
 93%|█████████▎| 35437/37963 [85:01:14<5:38:34,  8.04s/it]
 93%|█████████▎| 35438/37963 [85:01:28<6:53:08,  9.82s/it]
 93%|█████████▎| 35439/37963 [85:01:35<6:23:50,  9.12s/it]
 93%|█████████▎| 35440/37963 [85:01:43<6:03:51,  8.65s/it]
                                                          
{'loss': '0.07431', 'grad_norm': '2.892', 'learning_rate': '2.309e-07', 'epoch': '0.9335'}

 93%|█████████▎| 35440/37963 [85:01:43<6:03:51,  8.65s/it]
 93%|█████████▎| 35441/37963 [85:01:50<5:49:38,  8.32s/it]
 93%|█████████▎| 35442/37963 [85:01:58<5:40:09,  8.10s/it]
 93%|█████████▎| 35443/37963 [85:02:12<6:50:42,  9.78s/it]
 93%|█████████▎| 35444/37963 [85:02:19<6:19:46,  9.05s/it]
 93%|█████████▎| 35445/37963 [85:02:27<6:02:15,  8.63s/it]
 93%|█████████▎| 35446/37963 [85:02:41<7:07:53, 10.20s/it]
 93%|█████████▎| 35447/37963 [85:02:48<6:34:18,  9.40s/it]
 93%|█████████▎| 35448/37963 [85:02:56<6:10:40,  8.84s/it]
 93%|█████████▎| 35449/37963 [85:03:03<5:51:32,  8.39s/it]
 93%|█████████▎| 35450/37963 [85:03:11<5:41:22,  8.15s/it]
                                                          
{'loss': '0.07027', 'grad_norm': '4.433', 'learning_rate': '2.291e-07', 'epoch': '0.9338'}

 93%|█████████▎| 35450/37963 [85:03:11<5:41:22,  8.15s/it]
 93%|█████████▎| 35451/37963 [85:03:18<5:33:55,  7.98s/it]
 93%|█████████▎| 35452/37963 [85:03:26<5:28:48,  7.86s/it]
 93%|█████████▎| 35453/37963 [85:03:33<5:20:26,  7.66s/it]
 93%|█████████▎| 35454/37963 [85:03:47<6:43:11,  9.64s/it]
 93%|█████████▎| 35455/37963 [85:03:55<6:18:41,  9.06s/it]
 93%|█████████▎| 35456/37963 [85:04:02<5:59:20,  8.60s/it]
 93%|█████████▎| 35457/37963 [85:04:10<5:44:56,  8.26s/it]
 93%|█████████▎| 35458/37963 [85:04:17<5:35:09,  8.03s/it]
 93%|█████████▎| 35459/37963 [85:04:25<5:29:47,  7.90s/it]
 93%|█████████▎| 35460/37963 [85:04:32<5:24:22,  7.78s/it]
                                                          
{'loss': '0.07311', 'grad_norm': '2.641', 'learning_rate': '2.273e-07', 'epoch': '0.9341'}

 93%|█████████▎| 35460/37963 [85:04:32<5:24:22,  7.78s/it]
 93%|█████████▎| 35461/37963 [85:04:40<5:22:38,  7.74s/it]
 93%|█████████▎| 35462/37963 [85:04:48<5:19:15,  7.66s/it]
 93%|█████████▎| 35463/37963 [85:04:55<5:17:27,  7.62s/it]
 93%|█████████▎| 35464/37963 [85:05:09<6:35:19,  9.49s/it]
 93%|█████████▎| 35465/37963 [85:05:17<6:12:59,  8.96s/it]
 93%|█████████▎| 35466/37963 [85:05:24<5:53:36,  8.50s/it]
 93%|█████████▎| 35467/37963 [85:05:31<5:38:35,  8.14s/it]
 93%|█████████▎| 35468/37963 [85:05:39<5:27:19,  7.87s/it]
 93%|█████████▎| 35469/37963 [85:05:46<5:24:50,  7.81s/it]
 93%|█████████▎| 35470/37963 [85:05:54<5:18:10,  7.66s/it]
                                                          
{'loss': '0.0815', 'grad_norm': '3.494', 'learning_rate': '2.255e-07', 'epoch': '0.9343'}

 93%|█████████▎| 35470/37963 [85:05:54<5:18:10,  7.66s/it]
 93%|█████████▎| 35471/37963 [85:06:01<5:13:32,  7.55s/it]
 93%|█████████▎| 35472/37963 [85:06:08<5:14:15,  7.57s/it]
 93%|█████████▎| 35473/37963 [85:06:16<5:14:23,  7.58s/it]
 93%|█████████▎| 35474/37963 [85:06:24<5:14:48,  7.59s/it]
 93%|█████████▎| 35475/37963 [85:06:31<5:14:17,  7.58s/it]
 93%|█████████▎| 35476/37963 [85:06:39<5:11:48,  7.52s/it]
 93%|█████████▎| 35477/37963 [85:06:46<5:11:37,  7.52s/it]
 93%|█████████▎| 35478/37963 [85:07:00<6:32:35,  9.48s/it]
 93%|█████████▎| 35479/37963 [85:07:08<6:08:09,  8.89s/it]
 93%|█████████▎| 35480/37963 [85:07:28<8:29:32, 12.31s/it]
                                                          
{'loss': '0.06931', 'grad_norm': '2.981', 'learning_rate': '2.237e-07', 'epoch': '0.9346'}

 93%|█████████▎| 35480/37963 [85:07:28<8:29:32, 12.31s/it]
 93%|█████████▎| 35481/37963 [85:07:36<7:31:56, 10.93s/it]
 93%|█████████▎| 35482/37963 [85:07:43<6:49:15,  9.90s/it]
 93%|█████████▎| 35483/37963 [85:07:51<6:17:29,  9.13s/it]
 93%|█████████▎| 35484/37963 [85:07:58<5:55:12,  8.60s/it]
 93%|█████████▎| 35485/37963 [85:08:12<6:59:13, 10.15s/it]
 93%|█████████▎| 35486/37963 [85:08:26<7:46:34, 11.30s/it]
 93%|█████████▎| 35487/37963 [85:08:33<6:58:15, 10.14s/it]
 93%|█████████▎| 35488/37963 [85:08:40<6:22:30,  9.27s/it]
 93%|█████████▎| 35489/37963 [85:08:48<6:00:15,  8.74s/it]
 93%|█████████▎| 35490/37963 [85:08:55<5:45:04,  8.37s/it]
                                                          
{'loss': '0.07243', 'grad_norm': '4.574', 'learning_rate': '2.219e-07', 'epoch': '0.9349'}

 93%|█████████▎| 35490/37963 [85:08:55<5:45:04,  8.37s/it]
 93%|█████████▎| 35491/37963 [85:09:03<5:33:47,  8.10s/it]
 93%|█████████▎| 35492/37963 [85:09:10<5:26:56,  7.94s/it]
 93%|█████████▎| 35493/37963 [85:09:18<5:18:13,  7.73s/it]
 93%|█████████▎| 35494/37963 [85:09:25<5:16:25,  7.69s/it]
 93%|█████████▎| 35495/37963 [85:09:33<5:14:18,  7.64s/it]
 94%|█████████▎| 35496/37963 [85:09:40<5:12:26,  7.60s/it]
 94%|█████████▎| 35497/37963 [85:09:48<5:11:31,  7.58s/it]
 94%|█████████▎| 35498/37963 [85:09:55<5:12:36,  7.61s/it]
 94%|█████████▎| 35499/37963 [85:10:09<6:29:43,  9.49s/it]
 94%|█████████▎| 35500/37963 [85:10:17<6:05:18,  8.90s/it]
                                                          
{'loss': '0.08422', 'grad_norm': '3.406', 'learning_rate': '2.201e-07', 'epoch': '0.9351'}

 94%|█████████▎| 35500/37963 [85:10:17<6:05:18,  8.90s/it]
 94%|█████████▎| 35501/37963 [85:10:24<5:49:12,  8.51s/it]
 94%|█████████▎| 35502/37963 [85:10:32<5:36:42,  8.21s/it]
 94%|█████████▎| 35503/37963 [85:10:40<5:31:12,  8.08s/it]
 94%|█████████▎| 35504/37963 [85:10:47<5:24:19,  7.91s/it]
 94%|█████████▎| 35505/37963 [85:10:55<5:21:22,  7.84s/it]
 94%|█████████▎| 35506/37963 [85:11:03<5:18:18,  7.77s/it]
 94%|█████████▎| 35507/37963 [85:11:10<5:15:13,  7.70s/it]
 94%|█████████▎| 35508/37963 [85:11:24<6:30:51,  9.55s/it]
 94%|█████████▎| 35509/37963 [85:11:32<6:06:06,  8.95s/it]
 94%|█████████▎| 35510/37963 [85:11:39<5:50:42,  8.58s/it]
                                                          
{'loss': '0.07627', 'grad_norm': '3.203', 'learning_rate': '2.184e-07', 'epoch': '0.9354'}

 94%|█████████▎| 35510/37963 [85:11:39<5:50:42,  8.58s/it]
 94%|█████████▎| 35511/37963 [85:11:47<5:37:07,  8.25s/it]
 94%|█████████▎| 35512/37963 [85:11:54<5:28:36,  8.04s/it]
 94%|█████████▎| 35513/37963 [85:12:02<5:24:07,  7.94s/it]
 94%|█████████▎| 35514/37963 [85:12:10<5:19:24,  7.83s/it]
 94%|█████████▎| 35515/37963 [85:12:17<5:15:46,  7.74s/it]
 94%|█████████▎| 35516/37963 [85:12:25<5:13:48,  7.69s/it]
 94%|█████████▎| 35517/37963 [85:12:32<5:11:23,  7.64s/it]
 94%|█████████▎| 35518/37963 [85:12:46<6:32:28,  9.63s/it]
 94%|█████████▎| 35519/37963 [85:12:54<6:07:16,  9.02s/it]
 94%|█████████▎| 35520/37963 [85:13:02<5:50:38,  8.61s/it]
                                                          
{'loss': '0.07938', 'grad_norm': '2.706', 'learning_rate': '2.166e-07', 'epoch': '0.9357'}

 94%|█████████▎| 35520/37963 [85:13:02<5:50:38,  8.61s/it]
 94%|█████████▎| 35521/37963 [85:13:09<5:37:51,  8.30s/it]
 94%|█████████▎| 35522/37963 [85:13:23<6:47:58, 10.03s/it]
 94%|█████████▎| 35523/37963 [85:13:31<6:17:38,  9.29s/it]
 94%|█████████▎| 35524/37963 [85:13:38<5:55:51,  8.75s/it]
 94%|█████████▎| 35525/37963 [85:13:46<5:41:42,  8.41s/it]
 94%|█████████▎| 35526/37963 [85:13:53<5:27:13,  8.06s/it]
 94%|█████████▎| 35527/37963 [85:14:01<5:18:05,  7.83s/it]
 94%|█████████▎| 35528/37963 [85:14:08<5:13:11,  7.72s/it]
 94%|█████████▎| 35529/37963 [85:14:22<6:30:18,  9.62s/it]
 94%|█████████▎| 35530/37963 [85:14:30<6:06:20,  9.03s/it]
                                                          
{'loss': '0.07192', 'grad_norm': '3.763', 'learning_rate': '2.148e-07', 'epoch': '0.9359'}

 94%|█████████▎| 35530/37963 [85:14:30<6:06:20,  9.03s/it]
 94%|█████████▎| 35531/37963 [85:14:44<7:11:35, 10.65s/it]
 94%|█████████▎| 35532/37963 [85:14:58<7:51:24, 11.63s/it]
 94%|█████████▎| 35533/37963 [85:15:06<7:01:36, 10.41s/it]
 94%|█████████▎| 35534/37963 [85:15:13<6:19:29,  9.37s/it]
 94%|█████████▎| 35535/37963 [85:15:20<5:56:22,  8.81s/it]
 94%|█████████▎| 35536/37963 [85:15:28<5:40:59,  8.43s/it]
 94%|█████████▎| 35537/37963 [85:15:35<5:26:29,  8.07s/it]
 94%|█████████▎| 35538/37963 [85:15:48<6:31:56,  9.70s/it]
 94%|█████████▎| 35539/37963 [85:15:56<6:08:00,  9.11s/it]
 94%|█████████▎| 35540/37963 [85:16:04<5:47:53,  8.61s/it]
                                                          
{'loss': '0.07903', 'grad_norm': '2.754', 'learning_rate': '2.131e-07', 'epoch': '0.9362'}

 94%|█████████▎| 35540/37963 [85:16:04<5:47:53,  8.61s/it]
 94%|█████████▎| 35541/37963 [85:16:11<5:34:56,  8.30s/it]
 94%|█████████▎| 35542/37963 [85:16:18<5:23:36,  8.02s/it]
 94%|█████████▎| 35543/37963 [85:16:26<5:17:03,  7.86s/it]
 94%|█████████▎| 35544/37963 [85:16:33<5:13:02,  7.76s/it]
 94%|█████████▎| 35545/37963 [85:16:41<5:09:17,  7.67s/it]
 94%|█████████▎| 35546/37963 [85:16:48<5:05:01,  7.57s/it]
 94%|█████████▎| 35547/37963 [85:16:56<5:01:35,  7.49s/it]
 94%|█████████▎| 35548/37963 [85:17:03<4:57:38,  7.39s/it]
 94%|█████████▎| 35549/37963 [85:17:17<6:15:06,  9.32s/it]
 94%|█████████▎| 35550/37963 [85:17:24<5:51:36,  8.74s/it]
                                                          
{'loss': '0.08154', 'grad_norm': '2.934', 'learning_rate': '2.113e-07', 'epoch': '0.9364'}

 94%|█████████▎| 35550/37963 [85:17:24<5:51:36,  8.74s/it]
 94%|█████████▎| 35551/37963 [85:17:32<5:38:37,  8.42s/it]
 94%|█████████▎| 35552/37963 [85:17:39<5:28:04,  8.16s/it]
 94%|█████████▎| 35553/37963 [85:17:47<5:21:23,  8.00s/it]
 94%|█████████▎| 35554/37963 [85:17:54<5:15:13,  7.85s/it]
 94%|█████████▎| 35555/37963 [85:18:02<5:11:06,  7.75s/it]
 94%|█████████▎| 35556/37963 [85:18:09<5:06:17,  7.63s/it]
 94%|█████████▎| 35557/37963 [85:18:17<5:06:01,  7.63s/it]
 94%|█████████▎| 35558/37963 [85:18:24<5:00:27,  7.50s/it]
 94%|█████████▎| 35559/37963 [85:18:32<5:01:28,  7.52s/it]
 94%|█████████▎| 35560/37963 [85:18:46<6:19:16,  9.47s/it]
                                                          
{'loss': '0.08886', 'grad_norm': '3.494', 'learning_rate': '2.096e-07', 'epoch': '0.9367'}

 94%|█████████▎| 35560/37963 [85:18:46<6:19:16,  9.47s/it]
 94%|█████████▎| 35561/37963 [85:18:53<5:54:36,  8.86s/it]
 94%|█████████▎| 35562/37963 [85:19:01<5:38:52,  8.47s/it]
 94%|█████████▎| 35563/37963 [85:19:08<5:27:21,  8.18s/it]
 94%|█████████▎| 35564/37963 [85:19:16<5:20:49,  8.02s/it]
 94%|█████████▎| 35565/37963 [85:19:30<6:30:54,  9.78s/it]
 94%|█████████▎| 35566/37963 [85:19:37<6:04:28,  9.12s/it]
 94%|█████████▎| 35567/37963 [85:19:51<7:02:31, 10.58s/it]
 94%|█████████▎| 35568/37963 [85:19:59<6:26:09,  9.67s/it]
 94%|█████████▎| 35569/37963 [85:20:06<5:57:52,  8.97s/it]
 94%|█████████▎| 35570/37963 [85:20:14<5:41:04,  8.55s/it]
                                                          
{'loss': '0.07723', 'grad_norm': '3.611', 'learning_rate': '2.078e-07', 'epoch': '0.937'}

 94%|█████████▎| 35570/37963 [85:20:14<5:41:04,  8.55s/it]
 94%|█████████▎| 35571/37963 [85:20:21<5:28:52,  8.25s/it]
 94%|█████████▎| 35572/37963 [85:20:29<5:21:52,  8.08s/it]
 94%|█████████▎| 35573/37963 [85:20:36<5:13:53,  7.88s/it]
 94%|█████████▎| 35574/37963 [85:20:44<5:08:05,  7.74s/it]
 94%|█████████▎| 35575/37963 [85:20:51<5:04:33,  7.65s/it]
 94%|█████████▎| 35576/37963 [85:21:05<6:22:00,  9.60s/it]
 94%|█████████▎| 35577/37963 [85:21:13<5:55:35,  8.94s/it]
 94%|█████████▎| 35578/37963 [85:21:20<5:37:23,  8.49s/it]
 94%|█████████▎| 35579/37963 [85:21:34<6:39:38, 10.06s/it]
 94%|█████████▎| 35580/37963 [85:21:41<6:09:40,  9.31s/it]
                                                          
{'loss': '0.08356', 'grad_norm': '3.82', 'learning_rate': '2.061e-07', 'epoch': '0.9372'}

 94%|█████████▎| 35580/37963 [85:21:41<6:09:40,  9.31s/it]
 94%|█████████▎| 35581/37963 [85:21:49<5:48:00,  8.77s/it]
 94%|█████████▎| 35582/37963 [85:21:56<5:33:17,  8.40s/it]
 94%|█████████▎| 35583/37963 [85:22:04<5:22:00,  8.12s/it]
 94%|█████████▎| 35584/37963 [85:22:18<6:33:24,  9.92s/it]
 94%|█████████▎| 35585/37963 [85:22:26<6:04:54,  9.21s/it]
 94%|█████████▎| 35586/37963 [85:22:33<5:43:54,  8.68s/it]
 94%|█████████▎| 35587/37963 [85:22:41<5:29:09,  8.31s/it]
 94%|█████████▎| 35588/37963 [85:22:55<6:36:49, 10.02s/it]
 94%|█████████▎| 35589/37963 [85:23:02<6:07:16,  9.28s/it]
 94%|█████████▎| 35590/37963 [85:23:10<5:47:55,  8.80s/it]
                                                          
{'loss': '0.08011', 'grad_norm': '3.542', 'learning_rate': '2.044e-07', 'epoch': '0.9375'}

 94%|█████████▎| 35590/37963 [85:23:10<5:47:55,  8.80s/it]
 94%|█████████▍| 35591/37963 [85:23:17<5:32:50,  8.42s/it]
 94%|█████████▍| 35592/37963 [85:23:25<5:20:21,  8.11s/it]
 94%|█████████▍| 35593/37963 [85:23:32<5:13:24,  7.93s/it]
 94%|█████████▍| 35594/37963 [85:23:40<5:10:03,  7.85s/it]
 94%|█████████▍| 35595/37963 [85:23:47<5:06:04,  7.76s/it]
 94%|█████████▍| 35596/37963 [85:24:01<6:16:15,  9.54s/it]
 94%|█████████▍| 35597/37963 [85:24:09<5:54:07,  8.98s/it]
 94%|█████████▍| 35598/37963 [85:24:16<5:36:18,  8.53s/it]
 94%|█████████▍| 35599/37963 [85:24:24<5:24:37,  8.24s/it]
 94%|█████████▍| 35600/37963 [85:24:31<5:15:57,  8.02s/it]
                                                          
{'loss': '0.07644', 'grad_norm': '3.264', 'learning_rate': '2.027e-07', 'epoch': '0.9378'}

 94%|█████████▍| 35600/37963 [85:24:31<5:15:57,  8.02s/it]
 94%|█████████▍| 35601/37963 [85:24:39<5:10:29,  7.89s/it]
 94%|█████████▍| 35602/37963 [85:24:46<5:05:38,  7.77s/it]
 94%|█████████▍| 35603/37963 [85:24:54<5:03:16,  7.71s/it]
 94%|█████████▍| 35604/37963 [85:25:02<5:01:31,  7.67s/it]
 94%|█████████▍| 35605/37963 [85:25:09<5:01:15,  7.67s/it]
 94%|█████████▍| 35606/37963 [85:25:17<5:00:37,  7.65s/it]
 94%|█████████▍| 35607/37963 [85:25:31<6:14:34,  9.54s/it]
 94%|█████████▍| 35608/37963 [85:25:38<5:52:01,  8.97s/it]
 94%|█████████▍| 35609/37963 [85:25:46<5:34:23,  8.52s/it]
 94%|█████████▍| 35610/37963 [85:26:00<6:37:12, 10.13s/it]
                                                          
{'loss': '0.07851', 'grad_norm': '3.383', 'learning_rate': '2.01e-07', 'epoch': '0.938'}

 94%|█████████▍| 35610/37963 [85:26:00<6:37:12, 10.13s/it]
 94%|█████████▍| 35611/37963 [85:26:07<6:06:32,  9.35s/it]
 94%|█████████▍| 35612/37963 [85:26:21<6:56:51, 10.64s/it]
 94%|█████████▍| 35613/37963 [85:26:29<6:20:27,  9.71s/it]
 94%|█████████▍| 35614/37963 [85:26:36<5:55:19,  9.08s/it]
 94%|█████████▍| 35615/37963 [85:26:44<5:36:45,  8.61s/it]
 94%|█████████▍| 35616/37963 [85:26:51<5:23:41,  8.28s/it]
 94%|█████████▍| 35617/37963 [85:26:59<5:14:06,  8.03s/it]
 94%|█████████▍| 35618/37963 [85:27:06<5:05:41,  7.82s/it]
 94%|█████████▍| 35619/37963 [85:27:13<5:02:08,  7.73s/it]
 94%|█████████▍| 35620/37963 [85:27:21<4:55:50,  7.58s/it]
                                                          
{'loss': '0.07692', 'grad_norm': '3.492', 'learning_rate': '1.993e-07', 'epoch': '0.9383'}

 94%|█████████▍| 35620/37963 [85:27:21<4:55:50,  7.58s/it]
 94%|█████████▍| 35621/37963 [85:27:28<4:56:44,  7.60s/it]
 94%|█████████▍| 35622/37963 [85:27:36<4:55:06,  7.56s/it]
 94%|█████████▍| 35623/37963 [85:27:43<4:51:34,  7.48s/it]
 94%|█████████▍| 35624/37963 [85:27:57<6:09:13,  9.47s/it]
 94%|█████████▍| 35625/37963 [85:28:05<5:46:31,  8.89s/it]
 94%|█████████▍| 35626/37963 [85:28:12<5:30:07,  8.48s/it]
 94%|█████████▍| 35627/37963 [85:28:20<5:18:47,  8.19s/it]
 94%|█████████▍| 35628/37963 [85:28:34<6:24:36,  9.88s/it]
 94%|█████████▍| 35629/37963 [85:28:41<5:55:41,  9.14s/it]
 94%|█████████▍| 35630/37963 [85:28:49<5:36:30,  8.65s/it]
                                                          
{'loss': '0.08235', 'grad_norm': '3.014', 'learning_rate': '1.976e-07', 'epoch': '0.9385'}

 94%|█████████▍| 35630/37963 [85:28:49<5:36:30,  8.65s/it]
 94%|█████████▍| 35631/37963 [85:28:56<5:22:37,  8.30s/it]
 94%|█████████▍| 35632/37963 [85:29:04<5:13:50,  8.08s/it]
 94%|█████████▍| 35633/37963 [85:29:11<5:07:36,  7.92s/it]
 94%|█████████▍| 35634/37963 [85:29:19<5:02:17,  7.79s/it]
 94%|█████████▍| 35635/37963 [85:29:39<7:34:17, 11.71s/it]
 94%|█████████▍| 35636/37963 [85:29:47<6:45:15, 10.45s/it]
 94%|█████████▍| 35637/37963 [85:29:54<6:11:01,  9.57s/it]
 94%|█████████▍| 35638/37963 [85:30:02<5:47:12,  8.96s/it]
 94%|█████████▍| 35639/37963 [85:30:10<5:30:41,  8.54s/it]
 94%|█████████▍| 35640/37963 [85:30:17<5:19:06,  8.24s/it]
                                                          
{'loss': '0.08025', 'grad_norm': '3.415', 'learning_rate': '1.959e-07', 'epoch': '0.9388'}

 94%|█████████▍| 35640/37963 [85:30:17<5:19:06,  8.24s/it]
 94%|█████████▍| 35641/37963 [85:30:25<5:11:01,  8.04s/it]
 94%|█████████▍| 35642/37963 [85:30:32<5:05:02,  7.89s/it]
 94%|█████████▍| 35643/37963 [85:30:40<5:00:35,  7.77s/it]
 94%|█████████▍| 35644/37963 [85:30:54<6:11:43,  9.62s/it]
 94%|█████████▍| 35645/37963 [85:31:01<5:44:47,  8.92s/it]
 94%|█████████▍| 35646/37963 [85:31:08<5:28:52,  8.52s/it]
 94%|█████████▍| 35647/37963 [85:31:16<5:15:05,  8.16s/it]
 94%|█████████▍| 35648/37963 [85:31:23<5:07:41,  7.97s/it]
 94%|█████████▍| 35649/37963 [85:31:31<5:02:17,  7.84s/it]
 94%|█████████▍| 35650/37963 [85:31:38<4:58:55,  7.75s/it]
                                                          
{'loss': '0.07812', 'grad_norm': '2.591', 'learning_rate': '1.942e-07', 'epoch': '0.9391'}

 94%|█████████▍| 35650/37963 [85:31:38<4:58:55,  7.75s/it]
 94%|█████████▍| 35651/37963 [85:31:46<4:57:44,  7.73s/it]
 94%|█████████▍| 35652/37963 [85:31:53<4:50:35,  7.54s/it]
 94%|█████████▍| 35653/37963 [85:32:01<4:50:39,  7.55s/it]
 94%|█████████▍| 35654/37963 [85:32:08<4:50:12,  7.54s/it]
 94%|█████████▍| 35655/37963 [85:32:16<4:50:01,  7.54s/it]
 94%|█████████▍| 35656/37963 [85:32:23<4:50:17,  7.55s/it]
 94%|█████████▍| 35657/37963 [85:32:31<4:48:13,  7.50s/it]
 94%|█████████▍| 35658/37963 [85:32:45<6:05:23,  9.51s/it]
 94%|█████████▍| 35659/37963 [85:32:53<5:45:00,  8.98s/it]
 94%|█████████▍| 35660/37963 [85:33:00<5:25:00,  8.47s/it]
                                                          
{'loss': '0.08383', 'grad_norm': '2.862', 'learning_rate': '1.926e-07', 'epoch': '0.9393'}

 94%|█████████▍| 35660/37963 [85:33:00<5:25:00,  8.47s/it]
 94%|█████████▍| 35661/37963 [85:33:14<6:28:07, 10.12s/it]
 94%|█████████▍| 35662/37963 [85:33:22<5:59:03,  9.36s/it]
 94%|█████████▍| 35663/37963 [85:33:36<6:51:10, 10.73s/it]
 94%|█████████▍| 35664/37963 [85:33:43<6:11:25,  9.69s/it]
 94%|█████████▍| 35665/37963 [85:33:50<5:44:02,  8.98s/it]
 94%|█████████▍| 35666/37963 [85:33:58<5:28:40,  8.59s/it]
 94%|█████████▍| 35667/37963 [85:34:05<5:17:52,  8.31s/it]
 94%|█████████▍| 35668/37963 [85:34:13<5:09:14,  8.08s/it]
 94%|█████████▍| 35669/37963 [85:34:21<5:02:55,  7.92s/it]
 94%|█████████▍| 35670/37963 [85:34:28<4:58:01,  7.80s/it]
                                                          
{'loss': '0.07189', 'grad_norm': '2.497', 'learning_rate': '1.909e-07', 'epoch': '0.9396'}

 94%|█████████▍| 35670/37963 [85:34:28<4:58:01,  7.80s/it]
 94%|█████████▍| 35671/37963 [85:34:36<4:55:32,  7.74s/it]
 94%|█████████▍| 35672/37963 [85:34:43<4:54:22,  7.71s/it]
 94%|█████████▍| 35673/37963 [85:34:51<4:51:22,  7.63s/it]
 94%|█████████▍| 35674/37963 [85:34:58<4:51:47,  7.65s/it]
 94%|█████████▍| 35675/37963 [85:35:13<6:06:32,  9.61s/it]
 94%|█████████▍| 35676/37963 [85:35:27<6:57:19, 10.95s/it]
 94%|█████████▍| 35677/37963 [85:35:34<6:15:46,  9.86s/it]
 94%|█████████▍| 35678/37963 [85:35:42<5:51:39,  9.23s/it]
 94%|█████████▍| 35679/37963 [85:35:49<5:31:45,  8.72s/it]
 94%|█████████▍| 35680/37963 [85:35:57<5:17:52,  8.35s/it]
                                                          
{'loss': '0.0832', 'grad_norm': '2.305', 'learning_rate': '1.892e-07', 'epoch': '0.9399'}

 94%|█████████▍| 35680/37963 [85:35:57<5:17:52,  8.35s/it]
 94%|█████████▍| 35681/37963 [85:36:04<5:08:14,  8.10s/it]
 94%|█████████▍| 35682/37963 [85:36:12<4:59:03,  7.87s/it]
 94%|█████████▍| 35683/37963 [85:36:26<6:07:28,  9.67s/it]
 94%|█████████▍| 35684/37963 [85:36:33<5:42:22,  9.01s/it]
 94%|█████████▍| 35685/37963 [85:36:41<5:25:28,  8.57s/it]
 94%|█████████▍| 35686/37963 [85:36:48<5:14:10,  8.28s/it]
 94%|█████████▍| 35687/37963 [85:37:02<6:18:08,  9.97s/it]
 94%|█████████▍| 35688/37963 [85:37:10<5:52:29,  9.30s/it]
 94%|█████████▍| 35689/37963 [85:37:17<5:29:11,  8.69s/it]
 94%|█████████▍| 35690/37963 [85:37:25<5:15:34,  8.33s/it]
                                                          
{'loss': '0.09425', 'grad_norm': '3.376', 'learning_rate': '1.876e-07', 'epoch': '0.9401'}

 94%|█████████▍| 35690/37963 [85:37:25<5:15:34,  8.33s/it]
 94%|█████████▍| 35691/37963 [85:37:32<5:06:33,  8.10s/it]
 94%|█████████▍| 35692/37963 [85:37:40<5:00:07,  7.93s/it]
 94%|█████████▍| 35693/37963 [85:37:47<4:55:08,  7.80s/it]
 94%|█████████▍| 35694/37963 [85:38:01<6:01:48,  9.57s/it]
 94%|█████████▍| 35695/37963 [85:38:08<5:37:28,  8.93s/it]
 94%|█████████▍| 35696/37963 [85:38:16<5:20:00,  8.47s/it]
 94%|█████████▍| 35697/37963 [85:38:23<5:09:15,  8.19s/it]
 94%|█████████▍| 35698/37963 [85:38:31<5:01:03,  7.98s/it]
 94%|█████████▍| 35699/37963 [85:38:38<4:56:34,  7.86s/it]
 94%|█████████▍| 35700/37963 [85:38:46<4:52:11,  7.75s/it]
                                                          
{'loss': '0.08879', 'grad_norm': '3.363', 'learning_rate': '1.86e-07', 'epoch': '0.9404'}

 94%|█████████▍| 35700/37963 [85:38:46<4:52:11,  7.75s/it]
 94%|█████████▍| 35701/37963 [85:38:53<4:47:42,  7.63s/it]
 94%|█████████▍| 35702/37963 [85:39:01<4:45:56,  7.59s/it]
 94%|█████████▍| 35703/37963 [85:39:08<4:45:15,  7.57s/it]
 94%|█████████▍| 35704/37963 [85:39:16<4:45:31,  7.58s/it]
 94%|█████████▍| 35705/37963 [85:39:23<4:45:03,  7.57s/it]
 94%|█████████▍| 35706/37963 [85:39:31<4:42:12,  7.50s/it]
 94%|█████████▍| 35707/37963 [85:39:51<7:11:04, 11.46s/it]
 94%|█████████▍| 35708/37963 [85:39:59<6:22:58, 10.19s/it]
 94%|█████████▍| 35709/37963 [85:40:06<5:52:42,  9.39s/it]
 94%|█████████▍| 35710/37963 [85:40:14<5:31:25,  8.83s/it]
                                                          
{'loss': '0.08985', 'grad_norm': '3.347', 'learning_rate': '1.843e-07', 'epoch': '0.9407'}

 94%|█████████▍| 35710/37963 [85:40:14<5:31:25,  8.83s/it]
 94%|█████████▍| 35711/37963 [85:40:21<5:16:25,  8.43s/it]
 94%|█████████▍| 35712/37963 [85:40:29<5:05:52,  8.15s/it]
 94%|█████████▍| 35713/37963 [85:40:36<5:00:25,  8.01s/it]
 94%|█████████▍| 35714/37963 [85:40:44<4:55:19,  7.88s/it]
 94%|█████████▍| 35715/37963 [85:40:58<6:08:26,  9.83s/it]
 94%|█████████▍| 35716/37963 [85:41:06<5:44:55,  9.21s/it]
 94%|█████████▍| 35717/37963 [85:41:14<5:26:29,  8.72s/it]
 94%|█████████▍| 35718/37963 [85:41:21<5:13:02,  8.37s/it]
 94%|█████████▍| 35719/37963 [85:41:29<5:03:49,  8.12s/it]
 94%|█████████▍| 35720/37963 [85:41:36<4:57:33,  7.96s/it]
                                                          
{'loss': '0.07685', 'grad_norm': '2.564', 'learning_rate': '1.827e-07', 'epoch': '0.9409'}

 94%|█████████▍| 35720/37963 [85:41:36<4:57:33,  7.96s/it]
 94%|█████████▍| 35721/37963 [85:41:50<6:04:54,  9.77s/it]
 94%|█████████▍| 35722/37963 [85:41:58<5:40:19,  9.11s/it]
 94%|█████████▍| 35723/37963 [85:42:05<5:22:14,  8.63s/it]
 94%|█████████▍| 35724/37963 [85:42:13<5:10:41,  8.33s/it]
 94%|█████████▍| 35725/37963 [85:42:20<5:01:20,  8.08s/it]
 94%|█████████▍| 35726/37963 [85:42:35<6:10:05,  9.93s/it]
 94%|█████████▍| 35727/37963 [85:42:42<5:44:51,  9.25s/it]
 94%|█████████▍| 35728/37963 [85:42:50<5:26:24,  8.76s/it]
 94%|█████████▍| 35729/37963 [85:43:04<6:24:30, 10.33s/it]
 94%|█████████▍| 35730/37963 [85:43:12<5:53:24,  9.50s/it]
                                                          
{'loss': '0.08705', 'grad_norm': '3.21', 'learning_rate': '1.811e-07', 'epoch': '0.9412'}

 94%|█████████▍| 35730/37963 [85:43:12<5:53:24,  9.50s/it]
 94%|█████████▍| 35731/37963 [85:43:19<5:30:46,  8.89s/it]
 94%|█████████▍| 35732/37963 [85:43:27<5:16:39,  8.52s/it]
 94%|█████████▍| 35733/37963 [85:43:34<5:03:59,  8.18s/it]
 94%|█████████▍| 35734/37963 [85:43:42<4:57:23,  8.01s/it]
 94%|█████████▍| 35735/37963 [85:43:49<4:52:43,  7.88s/it]
 94%|█████████▍| 35736/37963 [85:44:03<5:59:38,  9.69s/it]
 94%|█████████▍| 35737/37963 [85:44:11<5:35:27,  9.04s/it]
 94%|█████████▍| 35738/37963 [85:44:18<5:21:48,  8.68s/it]
 94%|█████████▍| 35739/37963 [85:44:26<5:08:31,  8.32s/it]
 94%|█████████▍| 35740/37963 [85:44:40<6:10:30, 10.00s/it]
                                                          
{'loss': '0.08498', 'grad_norm': '3.154', 'learning_rate': '1.795e-07', 'epoch': '0.9414'}

 94%|█████████▍| 35740/37963 [85:44:40<6:10:30, 10.00s/it]
 94%|█████████▍| 35741/37963 [85:44:47<5:38:48,  9.15s/it]
 94%|█████████▍| 35742/37963 [85:44:54<5:19:34,  8.63s/it]
 94%|█████████▍| 35743/37963 [85:45:02<5:07:40,  8.32s/it]
 94%|█████████▍| 35744/37963 [85:45:09<4:57:04,  8.03s/it]
 94%|█████████▍| 35745/37963 [85:45:17<4:51:12,  7.88s/it]
 94%|█████████▍| 35746/37963 [85:45:25<4:49:13,  7.83s/it]
 94%|█████████▍| 35747/37963 [85:45:32<4:46:03,  7.75s/it]
 94%|█████████▍| 35748/37963 [85:45:40<4:45:15,  7.73s/it]
 94%|█████████▍| 35749/37963 [85:45:47<4:39:24,  7.57s/it]
 94%|█████████▍| 35750/37963 [85:45:55<4:39:34,  7.58s/it]
                                                          
{'loss': '0.0886', 'grad_norm': '2.705', 'learning_rate': '1.779e-07', 'epoch': '0.9417'}

 94%|█████████▍| 35750/37963 [85:45:55<4:39:34,  7.58s/it]
 94%|█████████▍| 35751/37963 [85:46:02<4:38:49,  7.56s/it]
 94%|█████████▍| 35752/37963 [85:46:10<4:37:40,  7.54s/it]
 94%|█████████▍| 35753/37963 [85:46:17<4:38:21,  7.56s/it]
 94%|█████████▍| 35754/37963 [85:46:25<4:38:53,  7.57s/it]
 94%|█████████▍| 35755/37963 [85:46:39<5:49:10,  9.49s/it]
 94%|█████████▍| 35756/37963 [85:46:53<6:38:19, 10.83s/it]
 94%|█████████▍| 35757/37963 [85:47:00<6:02:22,  9.86s/it]
 94%|█████████▍| 35758/37963 [85:47:08<5:36:43,  9.16s/it]
 94%|█████████▍| 35759/37963 [85:47:16<5:19:08,  8.69s/it]
 94%|█████████▍| 35760/37963 [85:47:23<5:05:18,  8.32s/it]
                                                          
{'loss': '0.07893', 'grad_norm': '3.616', 'learning_rate': '1.763e-07', 'epoch': '0.942'}

 94%|█████████▍| 35760/37963 [85:47:23<5:05:18,  8.32s/it]
 94%|█████████▍| 35761/37963 [85:47:30<4:53:28,  8.00s/it]
 94%|█████████▍| 35762/37963 [85:47:38<4:48:27,  7.86s/it]
 94%|█████████▍| 35763/37963 [85:47:52<5:55:40,  9.70s/it]
 94%|█████████▍| 35764/37963 [85:47:59<5:31:25,  9.04s/it]
 94%|█████████▍| 35765/37963 [85:48:07<5:13:29,  8.56s/it]
 94%|█████████▍| 35766/37963 [85:48:14<5:02:44,  8.27s/it]
 94%|█████████▍| 35767/37963 [85:48:22<4:55:51,  8.08s/it]
 94%|█████████▍| 35768/37963 [85:48:36<6:01:31,  9.88s/it]
 94%|█████████▍| 35769/37963 [85:48:44<5:35:21,  9.17s/it]
 94%|█████████▍| 35770/37963 [85:48:51<5:17:19,  8.68s/it]
                                                          
{'loss': '0.06241', 'grad_norm': '2.896', 'learning_rate': '1.747e-07', 'epoch': '0.9422'}

 94%|█████████▍| 35770/37963 [85:48:51<5:17:19,  8.68s/it]
 94%|█████████▍| 35771/37963 [85:48:59<5:04:23,  8.33s/it]
 94%|█████████▍| 35772/37963 [85:49:12<6:04:21,  9.98s/it]
 94%|█████████▍| 35773/37963 [85:49:20<5:39:17,  9.30s/it]
 94%|█████████▍| 35774/37963 [85:49:35<6:35:14, 10.83s/it]
 94%|█████████▍| 35775/37963 [85:49:42<5:58:49,  9.84s/it]
 94%|█████████▍| 35776/37963 [85:49:49<5:32:07,  9.11s/it]
 94%|█████████▍| 35777/37963 [85:49:57<5:13:06,  8.59s/it]
 94%|█████████▍| 35778/37963 [85:50:04<5:01:57,  8.29s/it]
 94%|█████████▍| 35779/37963 [85:50:12<4:54:37,  8.09s/it]
 94%|█████████▍| 35780/37963 [85:50:20<4:49:05,  7.95s/it]
                                                          
{'loss': '0.08021', 'grad_norm': '4.018', 'learning_rate': '1.731e-07', 'epoch': '0.9425'}

 94%|█████████▍| 35780/37963 [85:50:20<4:49:05,  7.95s/it]
 94%|█████████▍| 35781/37963 [85:50:27<4:44:28,  7.82s/it]
 94%|█████████▍| 35782/37963 [85:50:35<4:41:22,  7.74s/it]
 94%|█████████▍| 35783/37963 [85:50:42<4:37:13,  7.63s/it]
 94%|█████████▍| 35784/37963 [85:50:50<4:35:50,  7.60s/it]
 94%|█████████▍| 35785/37963 [85:51:03<5:42:39,  9.44s/it]
 94%|█████████▍| 35786/37963 [85:51:11<5:24:18,  8.94s/it]
 94%|█████████▍| 35787/37963 [85:51:19<5:06:40,  8.46s/it]
 94%|█████████▍| 35788/37963 [85:51:26<4:56:26,  8.18s/it]
 94%|█████████▍| 35789/37963 [85:51:40<6:01:37,  9.98s/it]
 94%|█████████▍| 35790/37963 [85:51:48<5:35:44,  9.27s/it]
                                                          
{'loss': '0.086', 'grad_norm': '2.549', 'learning_rate': '1.715e-07', 'epoch': '0.9428'}

 94%|█████████▍| 35790/37963 [85:51:48<5:35:44,  9.27s/it]
 94%|█████████▍| 35791/37963 [85:51:55<5:15:52,  8.73s/it]
 94%|█████████▍| 35792/37963 [85:52:03<5:02:42,  8.37s/it]
 94%|█████████▍| 35793/37963 [85:52:10<4:53:47,  8.12s/it]
 94%|█████████▍| 35794/37963 [85:52:18<4:48:59,  7.99s/it]
 94%|█████████▍| 35795/37963 [85:52:26<4:43:11,  7.84s/it]
 94%|█████████▍| 35796/37963 [85:52:33<4:37:57,  7.70s/it]
 94%|█████████▍| 35797/37963 [85:52:40<4:36:00,  7.65s/it]
 94%|█████████▍| 35798/37963 [85:52:48<4:33:06,  7.57s/it]
 94%|█████████▍| 35799/37963 [85:52:55<4:32:43,  7.56s/it]
 94%|█████████▍| 35800/37963 [85:53:03<4:32:29,  7.56s/it]
                                                          
{'loss': '0.08263', 'grad_norm': '3.608', 'learning_rate': '1.699e-07', 'epoch': '0.943'}

 94%|█████████▍| 35800/37963 [85:53:03<4:32:29,  7.56s/it]
 94%|█████████▍| 35801/37963 [85:53:10<4:32:12,  7.55s/it]
 94%|█████████▍| 35802/37963 [85:53:18<4:30:27,  7.51s/it]
 94%|█████████▍| 35803/37963 [85:53:25<4:30:51,  7.52s/it]
 94%|█████████▍| 35804/37963 [85:53:33<4:32:00,  7.56s/it]
 94%|█████████▍| 35805/37963 [85:53:47<5:42:42,  9.53s/it]
 94%|█████████▍| 35806/37963 [85:53:55<5:20:48,  8.92s/it]
 94%|█████████▍| 35807/37963 [85:54:02<5:07:15,  8.55s/it]
 94%|█████████▍| 35808/37963 [85:54:10<4:55:31,  8.23s/it]
 94%|█████████▍| 35809/37963 [85:54:24<5:58:10,  9.98s/it]
 94%|█████████▍| 35810/37963 [85:54:31<5:31:57,  9.25s/it]
                                                          
{'loss': '0.07534', 'grad_norm': '3.493', 'learning_rate': '1.684e-07', 'epoch': '0.9433'}

 94%|█████████▍| 35810/37963 [85:54:31<5:31:57,  9.25s/it]
 94%|█████████▍| 35811/37963 [85:54:39<5:11:37,  8.69s/it]
 94%|█████████▍| 35812/37963 [85:54:46<4:59:19,  8.35s/it]
 94%|█████████▍| 35813/37963 [85:54:54<4:50:06,  8.10s/it]
 94%|█████████▍| 35814/37963 [85:55:01<4:43:48,  7.92s/it]
 94%|█████████▍| 35815/37963 [85:55:09<4:39:10,  7.80s/it]
 94%|█████████▍| 35816/37963 [85:55:16<4:36:16,  7.72s/it]
 94%|█████████▍| 35817/37963 [85:55:44<8:03:27, 13.52s/it]
 94%|█████████▍| 35818/37963 [85:55:51<7:01:18, 11.79s/it]
 94%|█████████▍| 35819/37963 [85:55:59<6:16:00, 10.52s/it]
 94%|█████████▍| 35820/37963 [85:56:13<6:54:10, 11.60s/it]
                                                          
{'loss': '0.08561', 'grad_norm': '2.847', 'learning_rate': '1.668e-07', 'epoch': '0.9436'}

 94%|█████████▍| 35820/37963 [85:56:13<6:54:10, 11.60s/it]
 94%|█████████▍| 35821/37963 [85:56:21<6:11:16, 10.40s/it]
 94%|█████████▍| 35822/37963 [85:56:28<5:40:21,  9.54s/it]
 94%|█████████▍| 35823/37963 [85:56:36<5:18:54,  8.94s/it]
 94%|█████████▍| 35824/37963 [85:56:43<5:06:00,  8.58s/it]
 94%|█████████▍| 35825/37963 [85:56:51<4:56:12,  8.31s/it]
 94%|█████████▍| 35826/37963 [85:56:58<4:44:05,  7.98s/it]
 94%|█████████▍| 35827/37963 [85:57:06<4:39:00,  7.84s/it]
 94%|█████████▍| 35828/37963 [85:57:13<4:34:27,  7.71s/it]
 94%|█████████▍| 35829/37963 [85:57:27<5:37:41,  9.49s/it]
 94%|█████████▍| 35830/37963 [85:57:34<5:14:44,  8.85s/it]
                                                          
{'loss': '0.08566', 'grad_norm': '3.96', 'learning_rate': '1.653e-07', 'epoch': '0.9438'}

 94%|█████████▍| 35830/37963 [85:57:34<5:14:44,  8.85s/it]
 94%|█████████▍| 35831/37963 [85:57:42<5:01:08,  8.48s/it]
 94%|█████████▍| 35832/37963 [85:57:49<4:50:35,  8.18s/it]
 94%|█████████▍| 35833/37963 [85:57:57<4:43:43,  7.99s/it]
 94%|█████████▍| 35834/37963 [85:58:04<4:35:52,  7.77s/it]
 94%|█████████▍| 35835/37963 [85:58:12<4:32:48,  7.69s/it]
 94%|█████████▍| 35836/37963 [85:58:19<4:31:18,  7.65s/it]
 94%|█████████▍| 35837/37963 [85:58:27<4:29:49,  7.61s/it]
 94%|█████████▍| 35838/37963 [85:58:34<4:28:32,  7.58s/it]
 94%|█████████▍| 35839/37963 [85:58:42<4:26:28,  7.53s/it]
 94%|█████████▍| 35840/37963 [85:58:55<5:32:53,  9.41s/it]
                                                          
{'loss': '0.09106', 'grad_norm': '3.305', 'learning_rate': '1.637e-07', 'epoch': '0.9441'}

 94%|█████████▍| 35840/37963 [85:58:55<5:32:53,  9.41s/it]
 94%|█████████▍| 35841/37963 [85:59:03<5:14:49,  8.90s/it]
 94%|█████████▍| 35842/37963 [85:59:11<4:59:20,  8.47s/it]
 94%|█████████▍| 35843/37963 [85:59:18<4:49:09,  8.18s/it]
 94%|█████████▍| 35844/37963 [85:59:26<4:43:21,  8.02s/it]
 94%|█████████▍| 35845/37963 [85:59:33<4:37:01,  7.85s/it]
 94%|█████████▍| 35846/37963 [85:59:41<4:33:43,  7.76s/it]
 94%|█████████▍| 35847/37963 [85:59:48<4:31:14,  7.69s/it]
 94%|█████████▍| 35848/37963 [85:59:56<4:28:36,  7.62s/it]
 94%|█████████▍| 35849/37963 [86:00:03<4:28:57,  7.63s/it]
 94%|█████████▍| 35850/37963 [86:00:11<4:27:22,  7.59s/it]
                                                          
{'loss': '0.07871', 'grad_norm': '3.013', 'learning_rate': '1.622e-07', 'epoch': '0.9443'}

 94%|█████████▍| 35850/37963 [86:00:11<4:27:22,  7.59s/it]
 94%|█████████▍| 35851/37963 [86:00:18<4:27:20,  7.59s/it]
 94%|█████████▍| 35852/37963 [86:00:26<4:26:28,  7.57s/it]
 94%|█████████▍| 35853/37963 [86:00:33<4:25:28,  7.55s/it]
 94%|█████████▍| 35854/37963 [86:00:41<4:26:23,  7.58s/it]
 94%|█████████▍| 35855/37963 [86:00:49<4:26:01,  7.57s/it]
 94%|█████████▍| 35856/37963 [86:01:03<5:35:05,  9.54s/it]
 94%|█████████▍| 35857/37963 [86:01:17<6:21:59, 10.88s/it]
 94%|█████████▍| 35858/37963 [86:01:24<5:46:45,  9.88s/it]
 94%|█████████▍| 35859/37963 [86:01:32<5:20:37,  9.14s/it]
 94%|█████████▍| 35860/37963 [86:01:39<5:03:55,  8.67s/it]
                                                          
{'loss': '0.0873', 'grad_norm': '2.826', 'learning_rate': '1.607e-07', 'epoch': '0.9446'}

 94%|█████████▍| 35860/37963 [86:01:39<5:03:55,  8.67s/it]
 94%|█████████▍| 35861/37963 [86:01:53<6:00:58, 10.30s/it]
 94%|█████████▍| 35862/37963 [86:02:01<5:32:18,  9.49s/it]
 94%|█████████▍| 35863/37963 [86:02:09<5:10:49,  8.88s/it]
 94%|█████████▍| 35864/37963 [86:02:22<6:03:37, 10.39s/it]
 94%|█████████▍| 35865/37963 [86:02:30<5:33:36,  9.54s/it]
 94%|█████████▍| 35866/37963 [86:02:38<5:12:11,  8.93s/it]
 94%|█████████▍| 35867/37963 [86:02:45<4:57:11,  8.51s/it]
 94%|█████████▍| 35868/37963 [86:02:53<4:46:27,  8.20s/it]
 94%|█████████▍| 35869/37963 [86:03:00<4:41:50,  8.08s/it]
 94%|█████████▍| 35870/37963 [86:03:08<4:36:13,  7.92s/it]
                                                          
{'loss': '0.09385', 'grad_norm': '3.977', 'learning_rate': '1.591e-07', 'epoch': '0.9449'}

 94%|█████████▍| 35870/37963 [86:03:08<4:36:13,  7.92s/it]
 94%|█████████▍| 35871/37963 [86:03:22<5:38:15,  9.70s/it]
 94%|█████████▍| 35872/37963 [86:03:29<5:15:31,  9.05s/it]
 94%|█████████▍| 35873/37963 [86:03:43<6:02:51, 10.42s/it]
 94%|█████████▍| 35874/37963 [86:03:50<5:33:32,  9.58s/it]
 94%|█████████▍| 35875/37963 [86:03:58<5:11:19,  8.95s/it]
 95%|█████████▍| 35876/37963 [86:04:06<4:56:44,  8.53s/it]
 95%|█████████▍| 35877/37963 [86:04:19<5:51:30, 10.11s/it]
 95%|█████████▍| 35878/37963 [86:04:27<5:26:09,  9.39s/it]
 95%|█████████▍| 35879/37963 [86:04:35<5:06:19,  8.82s/it]
 95%|█████████▍| 35880/37963 [86:04:42<4:52:36,  8.43s/it]
                                                          
{'loss': '0.0689', 'grad_norm': '2.725', 'learning_rate': '1.576e-07', 'epoch': '0.9451'}

 95%|█████████▍| 35880/37963 [86:04:42<4:52:36,  8.43s/it]
 95%|█████████▍| 35881/37963 [86:04:50<4:42:31,  8.14s/it]
 95%|█████████▍| 35882/37963 [86:04:57<4:37:10,  7.99s/it]
 95%|█████████▍| 35883/37963 [86:05:05<4:32:51,  7.87s/it]
 95%|█████████▍| 35884/37963 [86:05:12<4:29:31,  7.78s/it]
 95%|█████████▍| 35885/37963 [86:05:20<4:27:43,  7.73s/it]
 95%|█████████▍| 35886/37963 [86:05:28<4:26:21,  7.69s/it]
 95%|█████████▍| 35887/37963 [86:05:35<4:24:48,  7.65s/it]
 95%|█████████▍| 35888/37963 [86:05:42<4:21:36,  7.56s/it]
 95%|█████████▍| 35889/37963 [86:05:56<5:27:19,  9.47s/it]
 95%|█████████▍| 35890/37963 [86:06:04<5:06:15,  8.86s/it]
                                                          
{'loss': '0.07403', 'grad_norm': '2.634', 'learning_rate': '1.561e-07', 'epoch': '0.9454'}

 95%|█████████▍| 35890/37963 [86:06:04<5:06:15,  8.86s/it]
 95%|█████████▍| 35891/37963 [86:06:11<4:52:47,  8.48s/it]
 95%|█████████▍| 35892/37963 [86:06:19<4:39:14,  8.09s/it]
 95%|█████████▍| 35893/37963 [86:06:26<4:32:46,  7.91s/it]
 95%|█████████▍| 35894/37963 [86:06:34<4:29:20,  7.81s/it]
 95%|█████████▍| 35895/37963 [86:06:41<4:22:54,  7.63s/it]
 95%|█████████▍| 35896/37963 [86:06:48<4:22:23,  7.62s/it]
 95%|█████████▍| 35897/37963 [86:06:56<4:21:17,  7.59s/it]
 95%|█████████▍| 35898/37963 [86:07:03<4:19:21,  7.54s/it]
 95%|█████████▍| 35899/37963 [86:07:11<4:16:03,  7.44s/it]
 95%|█████████▍| 35900/37963 [86:07:24<5:22:28,  9.38s/it]
                                                          
{'loss': '0.07833', 'grad_norm': '3.768', 'learning_rate': '1.546e-07', 'epoch': '0.9457'}

 95%|█████████▍| 35900/37963 [86:07:24<5:22:28,  9.38s/it]
 95%|█████████▍| 35901/37963 [86:07:39<6:10:31, 10.78s/it]
 95%|█████████▍| 35902/37963 [86:07:46<5:36:39,  9.80s/it]
 95%|█████████▍| 35903/37963 [86:07:53<5:10:51,  9.05s/it]
 95%|█████████▍| 35904/37963 [86:08:01<4:55:03,  8.60s/it]
 95%|█████████▍| 35905/37963 [86:08:08<4:44:14,  8.29s/it]
 95%|█████████▍| 35906/37963 [86:08:16<4:35:23,  8.03s/it]
 95%|█████████▍| 35907/37963 [86:08:23<4:30:31,  7.89s/it]
 95%|█████████▍| 35908/37963 [86:08:31<4:27:45,  7.82s/it]
 95%|█████████▍| 35909/37963 [86:08:45<5:29:28,  9.62s/it]
 95%|█████████▍| 35910/37963 [86:08:52<5:07:41,  8.99s/it]
                                                          
{'loss': '0.07942', 'grad_norm': '3.599', 'learning_rate': '1.531e-07', 'epoch': '0.9459'}

 95%|█████████▍| 35910/37963 [86:08:52<5:07:41,  8.99s/it]
 95%|█████████▍| 35911/37963 [86:09:00<4:53:07,  8.57s/it]
 95%|█████████▍| 35912/37963 [86:09:08<4:41:40,  8.24s/it]
 95%|█████████▍| 35913/37963 [86:09:15<4:33:04,  7.99s/it]
 95%|█████████▍| 35914/37963 [86:09:22<4:27:45,  7.84s/it]
 95%|█████████▍| 35915/37963 [86:09:36<5:30:06,  9.67s/it]
 95%|█████████▍| 35916/37963 [86:09:44<5:07:59,  9.03s/it]
 95%|█████████▍| 35917/37963 [86:09:51<4:49:49,  8.50s/it]
 95%|█████████▍| 35918/37963 [86:09:59<4:39:45,  8.21s/it]
 95%|█████████▍| 35919/37963 [86:10:06<4:32:39,  8.00s/it]
 95%|█████████▍| 35920/37963 [86:10:14<4:27:57,  7.87s/it]
                                                          
{'loss': '0.08139', 'grad_norm': '2.192', 'learning_rate': '1.517e-07', 'epoch': '0.9462'}

 95%|█████████▍| 35920/37963 [86:10:14<4:27:57,  7.87s/it]
 95%|█████████▍| 35921/37963 [86:10:21<4:23:51,  7.75s/it]
 95%|█████████▍| 35922/37963 [86:10:29<4:20:47,  7.67s/it]
 95%|█████████▍| 35923/37963 [86:10:36<4:16:01,  7.53s/it]
 95%|█████████▍| 35924/37963 [86:10:50<5:23:14,  9.51s/it]
 95%|█████████▍| 35925/37963 [86:10:58<5:03:32,  8.94s/it]
 95%|█████████▍| 35926/37963 [86:11:18<7:02:45, 12.45s/it]
 95%|█████████▍| 35927/37963 [86:11:26<6:13:07, 11.00s/it]
 95%|█████████▍| 35928/37963 [86:11:33<5:37:45,  9.96s/it]
 95%|█████████▍| 35929/37963 [86:11:41<5:12:21,  9.21s/it]
 95%|█████████▍| 35930/37963 [86:11:48<4:55:00,  8.71s/it]
                                                          
{'loss': '0.07522', 'grad_norm': '2.247', 'learning_rate': '1.502e-07', 'epoch': '0.9465'}

 95%|█████████▍| 35930/37963 [86:11:48<4:55:00,  8.71s/it]
 95%|█████████▍| 35931/37963 [86:11:56<4:40:06,  8.27s/it]
 95%|█████████▍| 35932/37963 [86:12:03<4:31:47,  8.03s/it]
 95%|█████████▍| 35933/37963 [86:12:11<4:26:27,  7.88s/it]
 95%|█████████▍| 35934/37963 [86:12:24<5:26:06,  9.64s/it]
 95%|█████████▍| 35935/37963 [86:12:32<5:05:21,  9.03s/it]
 95%|█████████▍| 35936/37963 [86:12:40<4:50:02,  8.59s/it]
 95%|█████████▍| 35937/37963 [86:12:47<4:38:44,  8.26s/it]
 95%|█████████▍| 35938/37963 [86:12:55<4:32:17,  8.07s/it]
 95%|█████████▍| 35939/37963 [86:13:02<4:24:32,  7.84s/it]
 95%|█████████▍| 35940/37963 [86:13:10<4:23:01,  7.80s/it]
                                                          
{'loss': '0.08092', 'grad_norm': '3.51', 'learning_rate': '1.487e-07', 'epoch': '0.9467'}

 95%|█████████▍| 35940/37963 [86:13:10<4:23:01,  7.80s/it]
 95%|█████████▍| 35941/37963 [86:13:17<4:17:23,  7.64s/it]
 95%|█████████▍| 35942/37963 [86:13:24<4:14:23,  7.55s/it]
 95%|█████████▍| 35943/37963 [86:13:32<4:12:49,  7.51s/it]
 95%|█████████▍| 35944/37963 [86:13:39<4:14:02,  7.55s/it]
 95%|█████████▍| 35945/37963 [86:13:53<5:15:22,  9.38s/it]
 95%|█████████▍| 35946/37963 [86:14:01<4:59:46,  8.92s/it]
 95%|█████████▍| 35947/37963 [86:14:09<4:46:53,  8.54s/it]
 95%|█████████▍| 35948/37963 [86:14:16<4:37:36,  8.27s/it]
 95%|█████████▍| 35949/37963 [86:14:24<4:29:46,  8.04s/it]
 95%|█████████▍| 35950/37963 [86:14:31<4:22:38,  7.83s/it]
                                                          
{'loss': '0.08758', 'grad_norm': '4.801', 'learning_rate': '1.473e-07', 'epoch': '0.947'}

 95%|█████████▍| 35950/37963 [86:14:31<4:22:38,  7.83s/it]
 95%|█████████▍| 35951/37963 [86:14:39<4:19:31,  7.74s/it]
 95%|█████████▍| 35952/37963 [86:14:46<4:16:11,  7.64s/it]
 95%|█████████▍| 35953/37963 [86:15:00<5:20:10,  9.56s/it]
 95%|█████████▍| 35954/37963 [86:15:08<4:59:36,  8.95s/it]
 95%|█████████▍| 35955/37963 [86:15:21<5:49:30, 10.44s/it]
 95%|█████████▍| 35956/37963 [86:15:29<5:16:47,  9.47s/it]
 95%|█████████▍| 35957/37963 [86:15:36<4:57:26,  8.90s/it]
 95%|█████████▍| 35958/37963 [86:15:44<4:44:30,  8.51s/it]
 95%|█████████▍| 35959/37963 [86:15:51<4:33:59,  8.20s/it]
 95%|█████████▍| 35960/37963 [86:15:59<4:26:45,  7.99s/it]
                                                          
{'loss': '0.08625', 'grad_norm': '2.501', 'learning_rate': '1.458e-07', 'epoch': '0.9472'}

 95%|█████████▍| 35960/37963 [86:15:59<4:26:45,  7.99s/it]
 95%|█████████▍| 35961/37963 [86:16:06<4:21:06,  7.83s/it]
 95%|█████████▍| 35962/37963 [86:16:14<4:16:18,  7.69s/it]
 95%|█████████▍| 35963/37963 [86:16:21<4:12:50,  7.59s/it]
 95%|█████████▍| 35964/37963 [86:16:29<4:13:07,  7.60s/it]
 95%|█████████▍| 35965/37963 [86:16:36<4:11:44,  7.56s/it]
 95%|█████████▍| 35966/37963 [86:16:44<4:11:29,  7.56s/it]
 95%|█████████▍| 35967/37963 [86:16:51<4:08:55,  7.48s/it]
 95%|█████████▍| 35968/37963 [86:16:58<4:09:05,  7.49s/it]
 95%|█████████▍| 35969/37963 [86:17:12<5:10:38,  9.35s/it]
 95%|█████████▍| 35970/37963 [86:17:20<4:51:50,  8.79s/it]
                                                          
{'loss': '0.07045', 'grad_norm': '3.241', 'learning_rate': '1.443e-07', 'epoch': '0.9475'}

 95%|█████████▍| 35970/37963 [86:17:20<4:51:50,  8.79s/it]
 95%|█████████▍| 35971/37963 [86:17:27<4:39:37,  8.42s/it]
 95%|█████████▍| 35972/37963 [86:17:35<4:32:01,  8.20s/it]
 95%|█████████▍| 35973/37963 [86:17:42<4:26:21,  8.03s/it]
 95%|█████████▍| 35974/37963 [86:17:50<4:22:09,  7.91s/it]
 95%|█████████▍| 35975/37963 [86:18:04<5:23:29,  9.76s/it]
 95%|█████████▍| 35976/37963 [86:18:18<6:05:48, 11.05s/it]
 95%|█████████▍| 35977/37963 [86:18:26<5:32:03, 10.03s/it]
 95%|█████████▍| 35978/37963 [86:18:46<7:11:45, 13.05s/it]
 95%|█████████▍| 35979/37963 [86:18:53<6:16:16, 11.38s/it]
 95%|█████████▍| 35980/37963 [86:19:01<5:38:11, 10.23s/it]
                                                          
{'loss': '0.07894', 'grad_norm': '3.974', 'learning_rate': '1.429e-07', 'epoch': '0.9478'}

 95%|█████████▍| 35980/37963 [86:19:01<5:38:11, 10.23s/it]
 95%|█████████▍| 35981/37963 [86:19:09<5:12:19,  9.45s/it]
 95%|█████████▍| 35982/37963 [86:19:16<4:51:20,  8.82s/it]
 95%|█████████▍| 35983/37963 [86:19:23<4:34:51,  8.33s/it]
 95%|█████████▍| 35984/37963 [86:19:31<4:25:18,  8.04s/it]
 95%|█████████▍| 35985/37963 [86:19:38<4:18:58,  7.86s/it]
 95%|█████████▍| 35986/37963 [86:19:46<4:16:37,  7.79s/it]
 95%|█████████▍| 35987/37963 [86:19:53<4:12:08,  7.66s/it]
 95%|█████████▍| 35988/37963 [86:20:01<4:11:34,  7.64s/it]
 95%|█████████▍| 35989/37963 [86:20:08<4:10:20,  7.61s/it]
 95%|█████████▍| 35990/37963 [86:20:16<4:09:12,  7.58s/it]
                                                          
{'loss': '0.087', 'grad_norm': '3.845', 'learning_rate': '1.415e-07', 'epoch': '0.948'}

 95%|█████████▍| 35990/37963 [86:20:16<4:09:12,  7.58s/it]
 95%|█████████▍| 35991/37963 [86:20:23<4:09:14,  7.58s/it]
 95%|█████████▍| 35992/37963 [86:20:31<4:06:56,  7.52s/it]
 95%|█████████▍| 35993/37963 [86:20:45<5:10:33,  9.46s/it]
 95%|█████████▍| 35994/37963 [86:20:52<4:51:45,  8.89s/it]
 95%|█████████▍| 35995/37963 [86:21:00<4:38:50,  8.50s/it]
 95%|█████████▍| 35996/37963 [86:21:07<4:29:11,  8.21s/it]
 95%|█████████▍| 35997/37963 [86:21:21<5:26:48,  9.97s/it]
 95%|█████████▍| 35998/37963 [86:21:29<5:02:42,  9.24s/it]
 95%|█████████▍| 35999/37963 [86:21:37<4:47:12,  8.77s/it]
 95%|█████████▍| 36000/37963 [86:21:44<4:34:31,  8.39s/it]
                                                          
{'loss': '0.09324', 'grad_norm': '3.258', 'learning_rate': '1.4e-07', 'epoch': '0.9483'}

 95%|█████████▍| 36000/37963 [86:21:44<4:34:31,  8.39s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.80s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.80s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 95%|█████████▍| 36001/37963 [86:22:42<12:44:25, 23.38s/it]
 95%|█████████▍| 36002/37963 [86:22:50<10:12:06, 18.73s/it]
 95%|█████████▍| 36003/37963 [86:22:58<8:22:08, 15.37s/it] 
 95%|█████████▍| 36004/37963 [86:23:05<7:04:32, 13.00s/it]
 95%|█████████▍| 36005/37963 [86:23:13<6:11:26, 11.38s/it]
 95%|█████████▍| 36006/37963 [86:23:27<6:38:50, 12.23s/it]
 95%|█████████▍| 36007/37963 [86:23:35<5:53:12, 10.83s/it]
 95%|█████████▍| 36008/37963 [86:23:42<5:20:03,  9.82s/it]
 95%|█████████▍| 36009/37963 [86:23:50<4:58:01,  9.15s/it]
 95%|█████████▍| 36010/37963 [86:23:57<4:43:56,  8.72s/it]
                                                          
{'loss': '0.08394', 'grad_norm': '3.527', 'learning_rate': '1.386e-07', 'epoch': '0.9486'}

 95%|█████████▍| 36010/37963 [86:23:57<4:43:56,  8.72s/it]
 95%|█████████▍| 36011/37963 [86:24:05<4:31:46,  8.35s/it]
 95%|█████████▍| 36012/37963 [86:24:12<4:19:00,  7.97s/it]
 95%|█████████▍| 36013/37963 [86:24:20<4:14:34,  7.83s/it]
 95%|█████████▍| 36014/37963 [86:24:27<4:10:29,  7.71s/it]
 95%|█████████▍| 36015/37963 [86:24:34<4:08:02,  7.64s/it]
 95%|█████████▍| 36016/37963 [86:24:42<4:07:19,  7.62s/it]
 95%|█████████▍| 36017/37963 [86:24:50<4:06:01,  7.59s/it]
 95%|█████████▍| 36018/37963 [86:24:57<4:05:35,  7.58s/it]
 95%|█████████▍| 36019/37963 [86:25:05<4:05:03,  7.56s/it]
 95%|█████████▍| 36020/37963 [86:25:19<5:07:09,  9.49s/it]
                                                          
{'loss': '0.08104', 'grad_norm': '3.666', 'learning_rate': '1.372e-07', 'epoch': '0.9488'}

 95%|█████████▍| 36020/37963 [86:25:19<5:07:09,  9.49s/it]
 95%|█████████▍| 36021/37963 [86:25:26<4:47:59,  8.90s/it]
 95%|█████████▍| 36022/37963 [86:25:34<4:34:12,  8.48s/it]
 95%|█████████▍| 36023/37963 [86:25:54<6:31:24, 12.11s/it]
 95%|█████████▍| 36024/37963 [86:26:02<5:47:18, 10.75s/it]
 95%|█████████▍| 36025/37963 [86:26:09<5:15:51,  9.78s/it]
 95%|█████████▍| 36026/37963 [86:26:23<5:54:39, 10.99s/it]
 95%|█████████▍| 36027/37963 [86:26:37<6:24:02, 11.90s/it]
 95%|█████████▍| 36028/37963 [86:26:45<5:41:54, 10.60s/it]
 95%|█████████▍| 36029/37963 [86:26:52<5:12:04,  9.68s/it]
 95%|█████████▍| 36030/37963 [86:27:00<4:51:49,  9.06s/it]
                                                          
{'loss': '0.07734', 'grad_norm': '3.444', 'learning_rate': '1.358e-07', 'epoch': '0.9491'}

 95%|█████████▍| 36030/37963 [86:27:00<4:51:49,  9.06s/it]
 95%|█████████▍| 36031/37963 [86:27:08<4:38:53,  8.66s/it]
 95%|█████████▍| 36032/37963 [86:27:15<4:28:01,  8.33s/it]
 95%|█████████▍| 36033/37963 [86:27:23<4:20:39,  8.10s/it]
 95%|█████████▍| 36034/37963 [86:27:30<4:15:44,  7.95s/it]
 95%|█████████▍| 36035/37963 [86:27:38<4:13:33,  7.89s/it]
 95%|█████████▍| 36036/37963 [86:27:46<4:09:51,  7.78s/it]
 95%|█████████▍| 36037/37963 [86:27:59<5:06:36,  9.55s/it]
 95%|█████████▍| 36038/37963 [86:28:07<4:45:44,  8.91s/it]
 95%|█████████▍| 36039/37963 [86:28:14<4:30:36,  8.44s/it]
 95%|█████████▍| 36040/37963 [86:28:21<4:21:38,  8.16s/it]
                                                          
{'loss': '0.08757', 'grad_norm': '3.498', 'learning_rate': '1.344e-07', 'epoch': '0.9493'}

 95%|█████████▍| 36040/37963 [86:28:21<4:21:38,  8.16s/it]
 95%|█████████▍| 36041/37963 [86:28:29<4:14:55,  7.96s/it]
 95%|█████████▍| 36042/37963 [86:28:37<4:11:30,  7.86s/it]
 95%|█████████▍| 36043/37963 [86:28:44<4:08:49,  7.78s/it]
 95%|█████████▍| 36044/37963 [86:28:52<4:07:24,  7.74s/it]
 95%|█████████▍| 36045/37963 [86:28:59<4:05:22,  7.68s/it]
 95%|█████████▍| 36046/37963 [86:29:14<5:07:48,  9.63s/it]
 95%|█████████▍| 36047/37963 [86:29:21<4:47:03,  8.99s/it]
 95%|█████████▍| 36048/37963 [86:29:29<4:36:25,  8.66s/it]
 95%|█████████▍| 36049/37963 [86:29:36<4:23:37,  8.26s/it]
 95%|█████████▍| 36050/37963 [86:29:44<4:16:55,  8.06s/it]
                                                          
{'loss': '0.08822', 'grad_norm': '4.081', 'learning_rate': '1.33e-07', 'epoch': '0.9496'}

 95%|█████████▍| 36050/37963 [86:29:44<4:16:55,  8.06s/it]
 95%|█████████▍| 36051/37963 [86:29:51<4:11:29,  7.89s/it]
 95%|█████████▍| 36052/37963 [86:29:59<4:08:14,  7.79s/it]
 95%|█████████▍| 36053/37963 [86:30:06<4:05:54,  7.72s/it]
 95%|█████████▍| 36054/37963 [86:30:14<4:04:40,  7.69s/it]
 95%|█████████▍| 36055/37963 [86:30:22<4:02:57,  7.64s/it]
 95%|█████████▍| 36056/37963 [86:30:35<4:58:44,  9.40s/it]
 95%|█████████▍| 36057/37963 [86:30:43<4:41:11,  8.85s/it]
 95%|█████████▍| 36058/37963 [86:30:50<4:28:13,  8.45s/it]
 95%|█████████▍| 36059/37963 [86:30:58<4:19:55,  8.19s/it]
 95%|█████████▍| 36060/37963 [86:31:05<4:13:56,  8.01s/it]
                                                          
{'loss': '0.07265', 'grad_norm': '2.86', 'learning_rate': '1.316e-07', 'epoch': '0.9499'}

 95%|█████████▍| 36060/37963 [86:31:05<4:13:56,  8.01s/it]
 95%|█████████▍| 36061/37963 [86:31:13<4:09:19,  7.87s/it]
 95%|█████████▍| 36062/37963 [86:31:20<4:06:09,  7.77s/it]
 95%|█████████▍| 36063/37963 [86:31:28<4:01:46,  7.64s/it]
 95%|█████████▍| 36064/37963 [86:31:35<4:01:04,  7.62s/it]
 95%|█████████▌| 36065/37963 [86:31:43<4:00:18,  7.60s/it]
 95%|█████████▌| 36066/37963 [86:31:50<3:59:05,  7.56s/it]
 95%|█████████▌| 36067/37963 [86:32:04<4:59:11,  9.47s/it]
 95%|█████████▌| 36068/37963 [86:32:12<4:40:56,  8.90s/it]
 95%|█████████▌| 36069/37963 [86:32:25<5:24:00, 10.26s/it]
 95%|█████████▌| 36070/37963 [86:32:33<4:56:38,  9.40s/it]
                                                          
{'loss': '0.08227', 'grad_norm': '4.159', 'learning_rate': '1.303e-07', 'epoch': '0.9501'}

 95%|█████████▌| 36070/37963 [86:32:33<4:56:38,  9.40s/it]
 95%|█████████▌| 36071/37963 [86:32:47<5:40:05, 10.79s/it]
 95%|█████████▌| 36072/37963 [86:32:54<5:10:29,  9.85s/it]
 95%|█████████▌| 36073/37963 [86:33:08<5:49:58, 11.11s/it]
 95%|█████████▌| 36074/37963 [86:33:22<6:17:11, 11.98s/it]
 95%|█████████▌| 36075/37963 [86:33:30<5:34:55, 10.64s/it]
 95%|█████████▌| 36076/37963 [86:33:38<5:05:24,  9.71s/it]
 95%|█████████▌| 36077/37963 [86:33:45<4:45:19,  9.08s/it]
 95%|█████████▌| 36078/37963 [86:33:53<4:29:45,  8.59s/it]
 95%|█████████▌| 36079/37963 [86:34:00<4:20:39,  8.30s/it]
 95%|█████████▌| 36080/37963 [86:34:08<4:13:56,  8.09s/it]
                                                          
{'loss': '0.08082', 'grad_norm': '2.485', 'learning_rate': '1.289e-07', 'epoch': '0.9504'}

 95%|█████████▌| 36080/37963 [86:34:08<4:13:56,  8.09s/it]
 95%|█████████▌| 36081/37963 [86:34:15<4:06:31,  7.86s/it]
 95%|█████████▌| 36082/37963 [86:34:23<4:02:59,  7.75s/it]
 95%|█████████▌| 36083/37963 [86:34:30<4:00:18,  7.67s/it]
 95%|█████████▌| 36084/37963 [86:34:38<3:59:50,  7.66s/it]
 95%|█████████▌| 36085/37963 [86:34:45<3:59:06,  7.64s/it]
 95%|█████████▌| 36086/37963 [86:34:59<5:00:03,  9.59s/it]
 95%|█████████▌| 36087/37963 [86:35:07<4:40:19,  8.97s/it]
 95%|█████████▌| 36088/37963 [86:35:15<4:27:30,  8.56s/it]
 95%|█████████▌| 36089/37963 [86:35:29<5:18:06, 10.18s/it]
 95%|█████████▌| 36090/37963 [86:35:36<4:53:16,  9.39s/it]
                                                          
{'loss': '0.08315', 'grad_norm': '4.04', 'learning_rate': '1.275e-07', 'epoch': '0.9507'}

 95%|█████████▌| 36090/37963 [86:35:36<4:53:16,  9.39s/it]
 95%|█████████▌| 36091/37963 [86:35:44<4:35:01,  8.82s/it]
 95%|█████████▌| 36092/37963 [86:35:51<4:22:06,  8.41s/it]
 95%|█████████▌| 36093/37963 [86:35:58<4:08:27,  7.97s/it]
 95%|█████████▌| 36094/37963 [86:36:05<4:03:55,  7.83s/it]
 95%|█████████▌| 36095/37963 [86:36:13<4:00:51,  7.74s/it]
 95%|█████████▌| 36096/37963 [86:36:21<3:59:22,  7.69s/it]
 95%|█████████▌| 36097/37963 [86:36:28<3:56:42,  7.61s/it]
 95%|█████████▌| 36098/37963 [86:36:36<3:56:36,  7.61s/it]
 95%|█████████▌| 36099/37963 [86:36:43<3:55:38,  7.59s/it]
 95%|█████████▌| 36100/37963 [86:36:51<3:55:28,  7.58s/it]
                                                          
{'loss': '0.07791', 'grad_norm': '2.051', 'learning_rate': '1.262e-07', 'epoch': '0.9509'}

 95%|█████████▌| 36100/37963 [86:36:51<3:55:28,  7.58s/it]
 95%|█████████▌| 36101/37963 [86:36:58<3:55:12,  7.58s/it]
 95%|█████████▌| 36102/37963 [86:37:06<3:54:18,  7.55s/it]
 95%|█████████▌| 36103/37963 [86:37:13<3:52:42,  7.51s/it]
 95%|█████████▌| 36104/37963 [86:37:27<4:51:54,  9.42s/it]
 95%|█████████▌| 36105/37963 [86:37:34<4:32:53,  8.81s/it]
 95%|█████████▌| 36106/37963 [86:37:42<4:21:02,  8.43s/it]
 95%|█████████▌| 36107/37963 [86:37:50<4:13:20,  8.19s/it]
 95%|█████████▌| 36108/37963 [86:37:57<4:05:11,  7.93s/it]
 95%|█████████▌| 36109/37963 [86:38:05<4:01:35,  7.82s/it]
 95%|█████████▌| 36110/37963 [86:38:12<3:59:36,  7.76s/it]
                                                          
{'loss': '0.09084', 'grad_norm': '2.823', 'learning_rate': '1.248e-07', 'epoch': '0.9512'}

 95%|█████████▌| 36110/37963 [86:38:12<3:59:36,  7.76s/it]
 95%|█████████▌| 36111/37963 [86:38:19<3:55:50,  7.64s/it]
 95%|█████████▌| 36112/37963 [86:38:27<3:54:45,  7.61s/it]
 95%|█████████▌| 36113/37963 [86:38:34<3:52:15,  7.53s/it]
 95%|█████████▌| 36114/37963 [86:38:42<3:50:38,  7.48s/it]
 95%|█████████▌| 36115/37963 [86:38:49<3:51:03,  7.50s/it]
 95%|█████████▌| 36116/37963 [86:39:03<4:50:49,  9.45s/it]
 95%|█████████▌| 36117/37963 [86:39:11<4:33:46,  8.90s/it]
 95%|█████████▌| 36118/37963 [86:39:25<5:19:06, 10.38s/it]
 95%|█████████▌| 36119/37963 [86:39:32<4:52:31,  9.52s/it]
 95%|█████████▌| 36120/37963 [86:39:40<4:33:26,  8.90s/it]
                                                          
{'loss': '0.06501', 'grad_norm': '3.694', 'learning_rate': '1.235e-07', 'epoch': '0.9515'}

 95%|█████████▌| 36120/37963 [86:39:40<4:33:26,  8.90s/it]
 95%|█████████▌| 36121/37963 [86:39:53<5:16:04, 10.30s/it]
 95%|█████████▌| 36122/37963 [86:40:01<4:51:36,  9.50s/it]
 95%|█████████▌| 36123/37963 [86:40:15<5:33:15, 10.87s/it]
 95%|█████████▌| 36124/37963 [86:40:23<5:02:52,  9.88s/it]
 95%|█████████▌| 36125/37963 [86:40:36<5:40:08, 11.10s/it]
 95%|█████████▌| 36126/37963 [86:40:44<5:07:21, 10.04s/it]
 95%|█████████▌| 36127/37963 [86:40:52<4:44:34,  9.30s/it]
 95%|█████████▌| 36128/37963 [86:40:59<4:27:11,  8.74s/it]
 95%|█████████▌| 36129/37963 [86:41:06<4:15:11,  8.35s/it]
 95%|█████████▌| 36130/37963 [86:41:14<4:07:06,  8.09s/it]
                                                          
{'loss': '0.0865', 'grad_norm': '2.694', 'learning_rate': '1.222e-07', 'epoch': '0.9517'}

 95%|█████████▌| 36130/37963 [86:41:14<4:07:06,  8.09s/it]
 95%|█████████▌| 36131/37963 [86:41:21<4:01:27,  7.91s/it]
 95%|█████████▌| 36132/37963 [86:41:29<3:55:27,  7.72s/it]
 95%|█████████▌| 36133/37963 [86:41:36<3:54:31,  7.69s/it]
 95%|█████████▌| 36134/37963 [86:41:43<3:48:52,  7.51s/it]
 95%|█████████▌| 36135/37963 [86:41:51<3:48:41,  7.51s/it]
 95%|█████████▌| 36136/37963 [86:41:59<3:49:04,  7.52s/it]
 95%|█████████▌| 36137/37963 [86:42:06<3:49:23,  7.54s/it]
 95%|█████████▌| 36138/37963 [86:42:20<4:45:31,  9.39s/it]
 95%|█████████▌| 36139/37963 [86:42:34<5:27:10, 10.76s/it]
 95%|█████████▌| 36140/37963 [86:42:41<4:57:38,  9.80s/it]
                                                          
{'loss': '0.08072', 'grad_norm': '2.889', 'learning_rate': '1.208e-07', 'epoch': '0.952'}

 95%|█████████▌| 36140/37963 [86:42:41<4:57:38,  9.80s/it]
 95%|█████████▌| 36141/37963 [86:42:49<4:36:39,  9.11s/it]
 95%|█████████▌| 36142/37963 [86:42:56<4:20:15,  8.58s/it]
 95%|█████████▌| 36143/37963 [86:43:04<4:10:45,  8.27s/it]
 95%|█████████▌| 36144/37963 [86:43:11<4:03:56,  8.05s/it]
 95%|█████████▌| 36145/37963 [86:43:19<3:58:49,  7.88s/it]
 95%|█████████▌| 36146/37963 [86:43:26<3:55:33,  7.78s/it]
 95%|█████████▌| 36147/37963 [86:43:33<3:49:19,  7.58s/it]
 95%|█████████▌| 36148/37963 [86:43:41<3:48:31,  7.55s/it]
 95%|█████████▌| 36149/37963 [86:43:48<3:45:27,  7.46s/it]
 95%|█████████▌| 36150/37963 [86:43:56<3:47:05,  7.52s/it]
                                                          
{'loss': '0.07763', 'grad_norm': '2.567', 'learning_rate': '1.195e-07', 'epoch': '0.9522'}

 95%|█████████▌| 36150/37963 [86:43:56<3:47:05,  7.52s/it]
 95%|█████████▌| 36151/37963 [86:44:09<4:41:47,  9.33s/it]
 95%|█████████▌| 36152/37963 [86:44:17<4:27:17,  8.86s/it]
 95%|█████████▌| 36153/37963 [86:44:24<4:12:27,  8.37s/it]
 95%|█████████▌| 36154/37963 [86:44:32<4:05:17,  8.14s/it]
 95%|█████████▌| 36155/37963 [86:44:40<4:00:45,  7.99s/it]
 95%|█████████▌| 36156/37963 [86:44:47<3:54:32,  7.79s/it]
 95%|█████████▌| 36157/37963 [86:44:54<3:49:00,  7.61s/it]
 95%|█████████▌| 36158/37963 [86:45:01<3:46:01,  7.51s/it]
 95%|█████████▌| 36159/37963 [86:45:09<3:46:40,  7.54s/it]
 95%|█████████▌| 36160/37963 [86:45:16<3:44:07,  7.46s/it]
                                                          
{'loss': '0.0795', 'grad_norm': '3.341', 'learning_rate': '1.182e-07', 'epoch': '0.9525'}

 95%|█████████▌| 36160/37963 [86:45:16<3:44:07,  7.46s/it]
 95%|█████████▌| 36161/37963 [86:45:24<3:44:36,  7.48s/it]
 95%|█████████▌| 36162/37963 [86:45:31<3:42:42,  7.42s/it]
 95%|█████████▌| 36163/37963 [86:45:39<3:43:50,  7.46s/it]
 95%|█████████▌| 36164/37963 [86:45:46<3:44:36,  7.49s/it]
 95%|█████████▌| 36165/37963 [86:45:54<3:44:26,  7.49s/it]
 95%|█████████▌| 36166/37963 [86:46:08<4:42:06,  9.42s/it]
 95%|█████████▌| 36167/37963 [86:46:21<5:22:08, 10.76s/it]
 95%|█████████▌| 36168/37963 [86:46:35<5:48:49, 11.66s/it]
 95%|█████████▌| 36169/37963 [86:46:43<5:11:21, 10.41s/it]
 95%|█████████▌| 36170/37963 [86:46:57<5:43:27, 11.49s/it]
                                                          
{'loss': '0.07339', 'grad_norm': '2.933', 'learning_rate': '1.169e-07', 'epoch': '0.9528'}

 95%|█████████▌| 36170/37963 [86:46:57<5:43:27, 11.49s/it]
 95%|█████████▌| 36171/37963 [86:47:11<6:07:14, 12.30s/it]
 95%|█████████▌| 36172/37963 [86:47:19<5:26:31, 10.94s/it]
 95%|█████████▌| 36173/37963 [86:47:26<4:55:44,  9.91s/it]
 95%|█████████▌| 36174/37963 [86:47:34<4:34:00,  9.19s/it]
 95%|█████████▌| 36175/37963 [86:47:41<4:19:04,  8.69s/it]
 95%|█████████▌| 36176/37963 [86:47:49<4:08:29,  8.34s/it]
 95%|█████████▌| 36177/37963 [86:47:56<4:00:26,  8.08s/it]
 95%|█████████▌| 36178/37963 [86:48:04<3:54:35,  7.89s/it]
 95%|█████████▌| 36179/37963 [86:48:11<3:52:24,  7.82s/it]
 95%|█████████▌| 36180/37963 [86:48:19<3:50:11,  7.75s/it]
                                                          
{'loss': '0.08719', 'grad_norm': '3.898', 'learning_rate': '1.156e-07', 'epoch': '0.953'}

 95%|█████████▌| 36180/37963 [86:48:19<3:50:11,  7.75s/it]
 95%|█████████▌| 36181/37963 [86:48:26<3:48:13,  7.68s/it]
 95%|█████████▌| 36182/37963 [86:48:34<3:47:53,  7.68s/it]
 95%|█████████▌| 36183/37963 [86:48:42<3:47:15,  7.66s/it]
 95%|█████████▌| 36184/37963 [86:48:55<4:41:25,  9.49s/it]
 95%|█████████▌| 36185/37963 [86:49:03<4:23:50,  8.90s/it]
 95%|█████████▌| 36186/37963 [86:49:10<4:11:24,  8.49s/it]
 95%|█████████▌| 36187/37963 [86:49:18<4:02:24,  8.19s/it]
 95%|█████████▌| 36188/37963 [86:49:26<3:56:21,  7.99s/it]
 95%|█████████▌| 36189/37963 [86:49:33<3:52:25,  7.86s/it]
 95%|█████████▌| 36190/37963 [86:49:41<3:49:03,  7.75s/it]
                                                          
{'loss': '0.09118', 'grad_norm': '4.022', 'learning_rate': '1.143e-07', 'epoch': '0.9533'}

 95%|█████████▌| 36190/37963 [86:49:41<3:49:03,  7.75s/it]
 95%|█████████▌| 36191/37963 [86:49:48<3:47:58,  7.72s/it]
 95%|█████████▌| 36192/37963 [86:50:02<4:43:33,  9.61s/it]
 95%|█████████▌| 36193/37963 [86:50:10<4:25:10,  8.99s/it]
 95%|█████████▌| 36194/37963 [86:50:17<4:11:57,  8.55s/it]
 95%|█████████▌| 36195/37963 [86:50:25<4:03:21,  8.26s/it]
 95%|█████████▌| 36196/37963 [86:50:32<3:53:34,  7.93s/it]
 95%|█████████▌| 36197/37963 [86:50:40<3:50:50,  7.84s/it]
 95%|█████████▌| 36198/37963 [86:50:47<3:47:45,  7.74s/it]
 95%|█████████▌| 36199/37963 [86:51:01<4:41:32,  9.58s/it]
 95%|█████████▌| 36200/37963 [86:51:09<4:23:56,  8.98s/it]
                                                          
{'loss': '0.07696', 'grad_norm': '2.663', 'learning_rate': '1.13e-07', 'epoch': '0.9536'}

 95%|█████████▌| 36200/37963 [86:51:09<4:23:56,  8.98s/it]
 95%|█████████▌| 36201/37963 [86:51:16<4:11:13,  8.55s/it]
 95%|█████████▌| 36202/37963 [86:51:24<4:01:02,  8.21s/it]
 95%|█████████▌| 36203/37963 [86:51:31<3:56:42,  8.07s/it]
 95%|█████████▌| 36204/37963 [86:51:39<3:53:10,  7.95s/it]
 95%|█████████▌| 36205/37963 [86:51:47<3:49:39,  7.84s/it]
 95%|█████████▌| 36206/37963 [86:51:54<3:47:25,  7.77s/it]
 95%|█████████▌| 36207/37963 [86:52:02<3:46:24,  7.74s/it]
 95%|█████████▌| 36208/37963 [86:52:09<3:44:43,  7.68s/it]
 95%|█████████▌| 36209/37963 [86:52:17<3:43:30,  7.65s/it]
 95%|█████████▌| 36210/37963 [86:52:24<3:39:49,  7.52s/it]
                                                          
{'loss': '0.07791', 'grad_norm': '3.169', 'learning_rate': '1.118e-07', 'epoch': '0.9538'}

 95%|█████████▌| 36210/37963 [86:52:24<3:39:49,  7.52s/it]
 95%|█████████▌| 36211/37963 [86:52:32<3:38:13,  7.47s/it]
 95%|█████████▌| 36212/37963 [86:52:39<3:37:49,  7.46s/it]
 95%|█████████▌| 36213/37963 [86:52:53<4:34:38,  9.42s/it]
 95%|█████████▌| 36214/37963 [86:53:07<5:14:56, 10.80s/it]
 95%|█████████▌| 36215/37963 [86:53:15<4:46:30,  9.83s/it]
 95%|█████████▌| 36216/37963 [86:53:29<5:24:02, 11.13s/it]
 95%|█████████▌| 36217/37963 [86:53:36<4:52:38, 10.06s/it]
 95%|█████████▌| 36218/37963 [86:53:44<4:28:03,  9.22s/it]
 95%|█████████▌| 36219/37963 [86:53:51<4:12:19,  8.68s/it]
 95%|█████████▌| 36220/37963 [86:54:12<5:57:04, 12.29s/it]
                                                          
{'loss': '0.08268', 'grad_norm': '3.776', 'learning_rate': '1.105e-07', 'epoch': '0.9541'}

 95%|█████████▌| 36220/37963 [86:54:12<5:57:04, 12.29s/it]
 95%|█████████▌| 36221/37963 [86:54:19<5:14:48, 10.84s/it]
 95%|█████████▌| 36222/37963 [86:54:27<4:45:46,  9.85s/it]
 95%|█████████▌| 36223/37963 [86:54:34<4:25:05,  9.14s/it]
 95%|█████████▌| 36224/37963 [86:54:42<4:11:06,  8.66s/it]
 95%|█████████▌| 36225/37963 [86:54:49<4:01:50,  8.35s/it]
 95%|█████████▌| 36226/37963 [86:54:57<3:55:18,  8.13s/it]
 95%|█████████▌| 36227/37963 [86:55:05<3:50:20,  7.96s/it]
 95%|█████████▌| 36228/37963 [86:55:12<3:44:40,  7.77s/it]
 95%|█████████▌| 36229/37963 [86:55:19<3:40:25,  7.63s/it]
 95%|█████████▌| 36230/37963 [86:55:27<3:41:00,  7.65s/it]
                                                          
{'loss': '0.09512', 'grad_norm': '3.401', 'learning_rate': '1.092e-07', 'epoch': '0.9544'}

 95%|█████████▌| 36230/37963 [86:55:27<3:41:00,  7.65s/it]
 95%|█████████▌| 36231/37963 [86:55:41<4:35:28,  9.54s/it]
 95%|█████████▌| 36232/37963 [86:55:48<4:17:53,  8.94s/it]
 95%|█████████▌| 36233/37963 [86:55:56<4:05:29,  8.51s/it]
 95%|█████████▌| 36234/37963 [86:56:03<3:56:43,  8.21s/it]
 95%|█████████▌| 36235/37963 [86:56:11<3:50:06,  7.99s/it]
 95%|█████████▌| 36236/37963 [86:56:18<3:46:06,  7.86s/it]
 95%|█████████▌| 36237/37963 [86:56:26<3:41:57,  7.72s/it]
 95%|█████████▌| 36238/37963 [86:56:33<3:39:46,  7.64s/it]
 95%|█████████▌| 36239/37963 [86:56:47<4:34:56,  9.57s/it]
 95%|█████████▌| 36240/37963 [86:56:55<4:16:47,  8.94s/it]
                                                          
{'loss': '0.08307', 'grad_norm': '3.452', 'learning_rate': '1.08e-07', 'epoch': '0.9546'}

 95%|█████████▌| 36240/37963 [86:56:55<4:16:47,  8.94s/it]
 95%|█████████▌| 36241/37963 [86:57:02<4:04:40,  8.53s/it]
 95%|█████████▌| 36242/37963 [86:57:10<3:55:17,  8.20s/it]
 95%|█████████▌| 36243/37963 [86:57:17<3:49:10,  7.99s/it]
 95%|█████████▌| 36244/37963 [86:57:25<3:44:59,  7.85s/it]
 95%|█████████▌| 36245/37963 [86:57:39<4:35:06,  9.61s/it]
 95%|█████████▌| 36246/37963 [86:57:46<4:17:09,  8.99s/it]
 95%|█████████▌| 36247/37963 [86:57:54<4:05:18,  8.58s/it]
 95%|█████████▌| 36248/37963 [86:58:01<3:56:04,  8.26s/it]
 95%|█████████▌| 36249/37963 [86:58:09<3:49:24,  8.03s/it]
 95%|█████████▌| 36250/37963 [86:58:16<3:43:50,  7.84s/it]
                                                          
{'loss': '0.07481', 'grad_norm': '3.742', 'learning_rate': '1.067e-07', 'epoch': '0.9549'}

 95%|█████████▌| 36250/37963 [86:58:16<3:43:50,  7.84s/it]
 95%|█████████▌| 36251/37963 [86:58:23<3:38:30,  7.66s/it]
 95%|█████████▌| 36252/37963 [86:58:31<3:35:53,  7.57s/it]
 95%|█████████▌| 36253/37963 [86:58:38<3:35:38,  7.57s/it]
 95%|█████████▌| 36254/37963 [86:58:46<3:35:10,  7.55s/it]
 96%|█████████▌| 36255/37963 [86:58:53<3:34:56,  7.55s/it]
 96%|█████████▌| 36256/37963 [86:59:01<3:35:33,  7.58s/it]
 96%|█████████▌| 36257/37963 [86:59:09<3:36:01,  7.60s/it]
 96%|█████████▌| 36258/37963 [86:59:16<3:31:50,  7.45s/it]
 96%|█████████▌| 36259/37963 [86:59:29<4:25:06,  9.33s/it]
 96%|█████████▌| 36260/37963 [86:59:37<4:09:29,  8.79s/it]
                                                          
{'loss': '0.07703', 'grad_norm': '3.277', 'learning_rate': '1.055e-07', 'epoch': '0.9551'}

 96%|█████████▌| 36260/37963 [86:59:37<4:09:29,  8.79s/it]
 96%|█████████▌| 36261/37963 [86:59:51<4:52:02, 10.30s/it]
 96%|█████████▌| 36262/37963 [86:59:58<4:28:48,  9.48s/it]
 96%|█████████▌| 36263/37963 [87:00:12<5:02:48, 10.69s/it]
 96%|█████████▌| 36264/37963 [87:00:26<5:32:40, 11.75s/it]
 96%|█████████▌| 36265/37963 [87:00:34<4:57:20, 10.51s/it]
 96%|█████████▌| 36266/37963 [87:00:41<4:33:07,  9.66s/it]
 96%|█████████▌| 36267/37963 [87:00:49<4:15:31,  9.04s/it]
 96%|█████████▌| 36268/37963 [87:00:56<4:02:27,  8.58s/it]
 96%|█████████▌| 36269/37963 [87:01:04<3:54:38,  8.31s/it]
 96%|█████████▌| 36270/37963 [87:01:12<3:49:23,  8.13s/it]
                                                          
{'loss': '0.07548', 'grad_norm': '3.711', 'learning_rate': '1.043e-07', 'epoch': '0.9554'}

 96%|█████████▌| 36270/37963 [87:01:12<3:49:23,  8.13s/it]
 96%|█████████▌| 36271/37963 [87:01:19<3:44:19,  7.96s/it]
 96%|█████████▌| 36272/37963 [87:01:27<3:40:32,  7.83s/it]
 96%|█████████▌| 36273/37963 [87:01:35<3:38:26,  7.76s/it]
 96%|█████████▌| 36274/37963 [87:01:48<4:29:47,  9.58s/it]
 96%|█████████▌| 36275/37963 [87:01:56<4:11:20,  8.93s/it]
 96%|█████████▌| 36276/37963 [87:02:03<3:58:09,  8.47s/it]
 96%|█████████▌| 36277/37963 [87:02:10<3:47:17,  8.09s/it]
 96%|█████████▌| 36278/37963 [87:02:18<3:42:12,  7.91s/it]
 96%|█████████▌| 36279/37963 [87:02:32<4:34:03,  9.76s/it]
 96%|█████████▌| 36280/37963 [87:02:40<4:15:34,  9.11s/it]
                                                          
{'loss': '0.08897', 'grad_norm': '4.922', 'learning_rate': '1.03e-07', 'epoch': '0.9557'}

 96%|█████████▌| 36280/37963 [87:02:40<4:15:34,  9.11s/it]
 96%|█████████▌| 36281/37963 [87:02:47<4:00:21,  8.57s/it]
 96%|█████████▌| 36282/37963 [87:02:54<3:51:51,  8.28s/it]
 96%|█████████▌| 36283/37963 [87:03:02<3:45:29,  8.05s/it]
 96%|█████████▌| 36284/37963 [87:03:09<3:40:35,  7.88s/it]
 96%|█████████▌| 36285/37963 [87:03:17<3:38:18,  7.81s/it]
 96%|█████████▌| 36286/37963 [87:03:25<3:36:09,  7.73s/it]
 96%|█████████▌| 36287/37963 [87:03:32<3:35:15,  7.71s/it]
 96%|█████████▌| 36288/37963 [87:03:40<3:33:23,  7.64s/it]
 96%|█████████▌| 36289/37963 [87:03:47<3:33:11,  7.64s/it]
 96%|█████████▌| 36290/37963 [87:03:55<3:30:52,  7.56s/it]
                                                          
{'loss': '0.08302', 'grad_norm': '3.198', 'learning_rate': '1.018e-07', 'epoch': '0.9559'}

 96%|█████████▌| 36290/37963 [87:03:55<3:30:52,  7.56s/it]
 96%|█████████▌| 36291/37963 [87:04:02<3:30:36,  7.56s/it]
 96%|█████████▌| 36292/37963 [87:04:16<4:23:50,  9.47s/it]
 96%|█████████▌| 36293/37963 [87:04:30<5:00:01, 10.78s/it]
 96%|█████████▌| 36294/37963 [87:04:38<4:32:35,  9.80s/it]
 96%|█████████▌| 36295/37963 [87:04:45<4:13:01,  9.10s/it]
 96%|█████████▌| 36296/37963 [87:04:52<3:57:51,  8.56s/it]
 96%|█████████▌| 36297/37963 [87:05:00<3:48:41,  8.24s/it]
 96%|█████████▌| 36298/37963 [87:05:07<3:42:14,  8.01s/it]
 96%|█████████▌| 36299/37963 [87:05:15<3:38:22,  7.87s/it]
 96%|█████████▌| 36300/37963 [87:05:22<3:35:10,  7.76s/it]
                                                          
{'loss': '0.06564', 'grad_norm': '3.059', 'learning_rate': '1.006e-07', 'epoch': '0.9562'}

 96%|█████████▌| 36300/37963 [87:05:22<3:35:10,  7.76s/it]
 96%|█████████▌| 36301/37963 [87:05:30<3:33:06,  7.69s/it]
 96%|█████████▌| 36302/37963 [87:05:37<3:30:19,  7.60s/it]
 96%|█████████▌| 36303/37963 [87:05:45<3:29:12,  7.56s/it]
 96%|█████████▌| 36304/37963 [87:05:53<3:30:06,  7.60s/it]
 96%|█████████▌| 36305/37963 [87:06:00<3:29:06,  7.57s/it]
 96%|█████████▌| 36306/37963 [87:06:07<3:28:16,  7.54s/it]
 96%|█████████▌| 36307/37963 [87:06:15<3:28:44,  7.56s/it]
 96%|█████████▌| 36308/37963 [87:06:23<3:27:57,  7.54s/it]
 96%|█████████▌| 36309/37963 [87:06:30<3:27:34,  7.53s/it]
 96%|█████████▌| 36310/37963 [87:06:44<4:20:45,  9.46s/it]
                                                          
{'loss': '0.07115', 'grad_norm': '3.057', 'learning_rate': '9.939e-08', 'epoch': '0.9565'}

 96%|█████████▌| 36310/37963 [87:06:44<4:20:45,  9.46s/it]
 96%|█████████▌| 36311/37963 [87:06:58<4:57:46, 10.82s/it]
 96%|█████████▌| 36312/37963 [87:07:12<5:23:06, 11.74s/it]
 96%|█████████▌| 36313/37963 [87:07:20<4:48:53, 10.51s/it]
 96%|█████████▌| 36314/37963 [87:07:27<4:22:46,  9.56s/it]
 96%|█████████▌| 36315/37963 [87:07:41<4:58:32, 10.87s/it]
 96%|█████████▌| 36316/37963 [87:07:48<4:30:10,  9.84s/it]
 96%|█████████▌| 36317/37963 [87:07:56<4:10:50,  9.14s/it]
 96%|█████████▌| 36318/37963 [87:08:03<3:58:06,  8.68s/it]
 96%|█████████▌| 36319/37963 [87:08:11<3:48:13,  8.33s/it]
 96%|█████████▌| 36320/37963 [87:08:18<3:39:38,  8.02s/it]
                                                          
{'loss': '0.08368', 'grad_norm': '2.536', 'learning_rate': '9.82e-08', 'epoch': '0.9567'}

 96%|█████████▌| 36320/37963 [87:08:18<3:39:38,  8.02s/it]
 96%|█████████▌| 36321/37963 [87:08:26<3:34:06,  7.82s/it]
 96%|█████████▌| 36322/37963 [87:08:33<3:30:00,  7.68s/it]
 96%|█████████▌| 36323/37963 [87:08:47<4:22:53,  9.62s/it]
 96%|█████████▌| 36324/37963 [87:08:55<4:04:59,  8.97s/it]
 96%|█████████▌| 36325/37963 [87:09:02<3:53:10,  8.54s/it]
 96%|█████████▌| 36326/37963 [87:09:09<3:42:42,  8.16s/it]
 96%|█████████▌| 36327/37963 [87:09:17<3:38:25,  8.01s/it]
 96%|█████████▌| 36328/37963 [87:09:31<4:26:36,  9.78s/it]
 96%|█████████▌| 36329/37963 [87:09:38<4:08:14,  9.12s/it]
 96%|█████████▌| 36330/37963 [87:09:46<3:55:21,  8.65s/it]
                                                          
{'loss': '0.08381', 'grad_norm': '3.786', 'learning_rate': '9.701e-08', 'epoch': '0.957'}

 96%|█████████▌| 36330/37963 [87:09:46<3:55:21,  8.65s/it]
 96%|█████████▌| 36331/37963 [87:09:53<3:45:22,  8.29s/it]
 96%|█████████▌| 36332/37963 [87:10:01<3:39:22,  8.07s/it]
 96%|█████████▌| 36333/37963 [87:10:09<3:35:52,  7.95s/it]
 96%|█████████▌| 36334/37963 [87:10:16<3:30:07,  7.74s/it]
 96%|█████████▌| 36335/37963 [87:10:24<3:29:16,  7.71s/it]
 96%|█████████▌| 36336/37963 [87:10:31<3:25:43,  7.59s/it]
 96%|█████████▌| 36337/37963 [87:10:39<3:25:42,  7.59s/it]
 96%|█████████▌| 36338/37963 [87:10:46<3:25:53,  7.60s/it]
 96%|█████████▌| 36339/37963 [87:10:54<3:23:58,  7.54s/it]
 96%|█████████▌| 36340/37963 [87:11:01<3:21:54,  7.46s/it]
                                                          
{'loss': '0.07728', 'grad_norm': '2.392', 'learning_rate': '9.583e-08', 'epoch': '0.9573'}

 96%|█████████▌| 36340/37963 [87:11:01<3:21:54,  7.46s/it]
 96%|█████████▌| 36341/37963 [87:11:08<3:19:57,  7.40s/it]
 96%|█████████▌| 36342/37963 [87:11:16<3:21:39,  7.46s/it]
 96%|█████████▌| 36343/37963 [87:11:29<4:12:15,  9.34s/it]
 96%|█████████▌| 36344/37963 [87:11:37<3:55:37,  8.73s/it]
 96%|█████████▌| 36345/37963 [87:11:44<3:45:12,  8.35s/it]
 96%|█████████▌| 36346/37963 [87:11:52<3:37:04,  8.05s/it]
 96%|█████████▌| 36347/37963 [87:12:05<4:24:40,  9.83s/it]
 96%|█████████▌| 36348/37963 [87:12:13<4:06:27,  9.16s/it]
 96%|█████████▌| 36349/37963 [87:12:21<3:54:43,  8.73s/it]
 96%|█████████▌| 36350/37963 [87:12:28<3:44:34,  8.35s/it]
                                                          
{'loss': '0.0725', 'grad_norm': '2.379', 'learning_rate': '9.465e-08', 'epoch': '0.9575'}

 96%|█████████▌| 36350/37963 [87:12:28<3:44:34,  8.35s/it]
 96%|█████████▌| 36351/37963 [87:12:36<3:38:38,  8.14s/it]
 96%|█████████▌| 36352/37963 [87:12:43<3:33:30,  7.95s/it]
 96%|█████████▌| 36353/37963 [87:12:51<3:30:28,  7.84s/it]
 96%|█████████▌| 36354/37963 [87:12:58<3:24:52,  7.64s/it]
 96%|█████████▌| 36355/37963 [87:13:06<3:22:13,  7.55s/it]
 96%|█████████▌| 36356/37963 [87:13:13<3:21:22,  7.52s/it]
 96%|█████████▌| 36357/37963 [87:13:20<3:18:03,  7.40s/it]
 96%|█████████▌| 36358/37963 [87:13:34<4:08:14,  9.28s/it]
 96%|█████████▌| 36359/37963 [87:13:41<3:53:24,  8.73s/it]
 96%|█████████▌| 36360/37963 [87:13:49<3:42:09,  8.32s/it]
                                                          
{'loss': '0.08233', 'grad_norm': '2.888', 'learning_rate': '9.348e-08', 'epoch': '0.9578'}

 96%|█████████▌| 36360/37963 [87:13:49<3:42:09,  8.32s/it]
 96%|█████████▌| 36361/37963 [87:14:03<4:27:07, 10.00s/it]
 96%|█████████▌| 36362/37963 [87:14:17<5:01:54, 11.31s/it]
 96%|█████████▌| 36363/37963 [87:14:31<5:22:29, 12.09s/it]
 96%|█████████▌| 36364/37963 [87:14:38<4:43:50, 10.65s/it]
 96%|█████████▌| 36365/37963 [87:14:46<4:18:52,  9.72s/it]
 96%|█████████▌| 36366/37963 [87:14:53<3:59:54,  9.01s/it]
 96%|█████████▌| 36367/37963 [87:15:01<3:47:56,  8.57s/it]
 96%|█████████▌| 36368/37963 [87:15:08<3:38:32,  8.22s/it]
 96%|█████████▌| 36369/37963 [87:15:16<3:34:01,  8.06s/it]
 96%|█████████▌| 36370/37963 [87:15:30<4:20:27,  9.81s/it]
                                                          
{'loss': '0.08357', 'grad_norm': '3.552', 'learning_rate': '9.232e-08', 'epoch': '0.958'}

 96%|█████████▌| 36370/37963 [87:15:30<4:20:27,  9.81s/it]
 96%|█████████▌| 36371/37963 [87:15:37<4:02:03,  9.12s/it]
 96%|█████████▌| 36372/37963 [87:15:45<3:48:57,  8.63s/it]
 96%|█████████▌| 36373/37963 [87:15:52<3:39:46,  8.29s/it]
 96%|█████████▌| 36374/37963 [87:15:59<3:33:06,  8.05s/it]
 96%|█████████▌| 36375/37963 [87:16:07<3:29:38,  7.92s/it]
 96%|█████████▌| 36376/37963 [87:16:15<3:25:34,  7.77s/it]
 96%|█████████▌| 36377/37963 [87:16:22<3:22:30,  7.66s/it]
 96%|█████████▌| 36378/37963 [87:16:29<3:20:51,  7.60s/it]
 96%|█████████▌| 36379/37963 [87:16:37<3:19:54,  7.57s/it]
 96%|█████████▌| 36380/37963 [87:16:44<3:19:23,  7.56s/it]
                                                          
{'loss': '0.08718', 'grad_norm': '4.107', 'learning_rate': '9.117e-08', 'epoch': '0.9583'}

 96%|█████████▌| 36380/37963 [87:16:44<3:19:23,  7.56s/it]
 96%|█████████▌| 36381/37963 [87:16:59<4:11:02,  9.52s/it]
 96%|█████████▌| 36382/37963 [87:17:06<3:56:18,  8.97s/it]
 96%|█████████▌| 36383/37963 [87:17:14<3:45:42,  8.57s/it]
 96%|█████████▌| 36384/37963 [87:17:21<3:36:59,  8.25s/it]
 96%|█████████▌| 36385/37963 [87:17:29<3:31:19,  8.04s/it]
 96%|█████████▌| 36386/37963 [87:17:36<3:26:04,  7.84s/it]
 96%|█████████▌| 36387/37963 [87:17:44<3:22:24,  7.71s/it]
 96%|█████████▌| 36388/37963 [87:17:51<3:20:05,  7.62s/it]
 96%|█████████▌| 36389/37963 [87:17:59<3:19:35,  7.61s/it]
 96%|█████████▌| 36390/37963 [87:18:06<3:18:25,  7.57s/it]
                                                          
{'loss': '0.08247', 'grad_norm': '3.273', 'learning_rate': '9.003e-08', 'epoch': '0.9586'}

 96%|█████████▌| 36390/37963 [87:18:06<3:18:25,  7.57s/it]
 96%|█████████▌| 36391/37963 [87:18:14<3:17:57,  7.56s/it]
 96%|█████████▌| 36392/37963 [87:18:21<3:16:05,  7.49s/it]
 96%|█████████▌| 36393/37963 [87:18:29<3:16:10,  7.50s/it]
 96%|█████████▌| 36394/37963 [87:18:36<3:16:46,  7.52s/it]
 96%|█████████▌| 36395/37963 [87:18:44<3:16:40,  7.53s/it]
 96%|█████████▌| 36396/37963 [87:18:51<3:16:48,  7.54s/it]
 96%|█████████▌| 36397/37963 [87:19:12<4:56:41, 11.37s/it]
 96%|█████████▌| 36398/37963 [87:19:19<4:25:09, 10.17s/it]
 96%|█████████▌| 36399/37963 [87:19:26<4:04:20,  9.37s/it]
 96%|█████████▌| 36400/37963 [87:19:34<3:50:27,  8.85s/it]
                                                          
{'loss': '0.08613', 'grad_norm': '3.657', 'learning_rate': '8.889e-08', 'epoch': '0.9588'}

 96%|█████████▌| 36400/37963 [87:19:34<3:50:27,  8.85s/it]
 96%|█████████▌| 36401/37963 [87:19:42<3:40:14,  8.46s/it]
 96%|█████████▌| 36402/37963 [87:19:56<4:23:26, 10.13s/it]
 96%|█████████▌| 36403/37963 [87:20:03<4:03:52,  9.38s/it]
 96%|█████████▌| 36404/37963 [87:20:11<3:50:00,  8.85s/it]
 96%|█████████▌| 36405/37963 [87:20:18<3:39:24,  8.45s/it]
 96%|█████████▌| 36406/37963 [87:20:26<3:32:59,  8.21s/it]
 96%|█████████▌| 36407/37963 [87:20:40<4:16:29,  9.89s/it]
 96%|█████████▌| 36408/37963 [87:20:47<3:58:12,  9.19s/it]
 96%|█████████▌| 36409/37963 [87:21:01<4:33:04, 10.54s/it]
 96%|█████████▌| 36410/37963 [87:21:15<5:00:05, 11.59s/it]
                                                          
{'loss': '0.0748', 'grad_norm': '4.028', 'learning_rate': '8.776e-08', 'epoch': '0.9591'}

 96%|█████████▌| 36410/37963 [87:21:15<5:00:05, 11.59s/it]
 96%|█████████▌| 36411/37963 [87:21:23<4:28:14, 10.37s/it]
 96%|█████████▌| 36412/37963 [87:21:30<4:06:21,  9.53s/it]
 96%|█████████▌| 36413/37963 [87:21:38<3:49:17,  8.88s/it]
 96%|█████████▌| 36414/37963 [87:21:45<3:38:42,  8.47s/it]
 96%|█████████▌| 36415/37963 [87:21:53<3:31:06,  8.18s/it]
 96%|█████████▌| 36416/37963 [87:22:00<3:26:16,  8.00s/it]
 96%|█████████▌| 36417/37963 [87:22:08<3:21:53,  7.84s/it]
 96%|█████████▌| 36418/37963 [87:22:15<3:19:51,  7.76s/it]
 96%|█████████▌| 36419/37963 [87:22:23<3:18:42,  7.72s/it]
 96%|█████████▌| 36420/37963 [87:22:31<3:18:16,  7.71s/it]
                                                          
{'loss': '0.06935', 'grad_norm': '3.309', 'learning_rate': '8.663e-08', 'epoch': '0.9594'}

 96%|█████████▌| 36420/37963 [87:22:31<3:18:16,  7.71s/it]
 96%|█████████▌| 36421/37963 [87:22:44<4:03:33,  9.48s/it]
 96%|█████████▌| 36422/37963 [87:22:52<3:48:38,  8.90s/it]
 96%|█████████▌| 36423/37963 [87:22:59<3:38:42,  8.52s/it]
 96%|█████████▌| 36424/37963 [87:23:07<3:30:33,  8.21s/it]
 96%|█████████▌| 36425/37963 [87:23:14<3:25:03,  8.00s/it]
 96%|█████████▌| 36426/37963 [87:23:22<3:22:15,  7.90s/it]
 96%|█████████▌| 36427/37963 [87:23:29<3:19:19,  7.79s/it]
 96%|█████████▌| 36428/37963 [87:23:37<3:16:24,  7.68s/it]
 96%|█████████▌| 36429/37963 [87:23:44<3:15:24,  7.64s/it]
 96%|█████████▌| 36430/37963 [87:23:52<3:14:23,  7.61s/it]
                                                          
{'loss': '0.08226', 'grad_norm': '2.772', 'learning_rate': '8.551e-08', 'epoch': '0.9596'}

 96%|█████████▌| 36430/37963 [87:23:52<3:14:23,  7.61s/it]
 96%|█████████▌| 36431/37963 [87:24:00<3:13:35,  7.58s/it]
 96%|█████████▌| 36432/37963 [87:24:07<3:13:11,  7.57s/it]
 96%|█████████▌| 36433/37963 [87:24:14<3:10:10,  7.46s/it]
 96%|█████████▌| 36434/37963 [87:24:28<3:59:34,  9.40s/it]
 96%|█████████▌| 36435/37963 [87:24:36<3:46:00,  8.87s/it]
 96%|█████████▌| 36436/37963 [87:24:43<3:35:36,  8.47s/it]
 96%|█████████▌| 36437/37963 [87:24:51<3:27:58,  8.18s/it]
 96%|█████████▌| 36438/37963 [87:24:58<3:22:53,  7.98s/it]
 96%|█████████▌| 36439/37963 [87:25:06<3:20:11,  7.88s/it]
 96%|█████████▌| 36440/37963 [87:25:14<3:18:22,  7.82s/it]
                                                          
{'loss': '0.07654', 'grad_norm': '2.635', 'learning_rate': '8.44e-08', 'epoch': '0.9599'}

 96%|█████████▌| 36440/37963 [87:25:14<3:18:22,  7.82s/it]
 96%|█████████▌| 36441/37963 [87:25:28<4:05:24,  9.67s/it]
 96%|█████████▌| 36442/37963 [87:25:35<3:49:13,  9.04s/it]
 96%|█████████▌| 36443/37963 [87:25:43<3:37:56,  8.60s/it]
 96%|█████████▌| 36444/37963 [87:25:50<3:30:05,  8.30s/it]
 96%|█████████▌| 36445/37963 [87:25:58<3:24:05,  8.07s/it]
 96%|█████████▌| 36446/37963 [87:26:05<3:18:22,  7.85s/it]
 96%|█████████▌| 36447/37963 [87:26:13<3:16:39,  7.78s/it]
 96%|█████████▌| 36448/37963 [87:26:20<3:14:45,  7.71s/it]
 96%|█████████▌| 36449/37963 [87:26:41<4:51:04, 11.54s/it]
 96%|█████████▌| 36450/37963 [87:26:49<4:21:41, 10.38s/it]
                                                          
{'loss': '0.08441', 'grad_norm': '3.127', 'learning_rate': '8.33e-08', 'epoch': '0.9601'}

 96%|█████████▌| 36450/37963 [87:26:49<4:21:41, 10.38s/it]
 96%|█████████▌| 36451/37963 [87:26:56<3:59:57,  9.52s/it]
 96%|█████████▌| 36452/37963 [87:27:04<3:44:49,  8.93s/it]
 96%|█████████▌| 36453/37963 [87:27:18<4:22:42, 10.44s/it]
 96%|█████████▌| 36454/37963 [87:27:25<4:00:59,  9.58s/it]
 96%|█████████▌| 36455/37963 [87:27:33<3:46:13,  9.00s/it]
 96%|█████████▌| 36456/37963 [87:27:47<4:26:12, 10.60s/it]
 96%|█████████▌| 36457/37963 [87:27:55<4:03:29,  9.70s/it]
 96%|█████████▌| 36458/37963 [87:28:02<3:47:12,  9.06s/it]
 96%|█████████▌| 36459/37963 [87:28:16<4:23:59, 10.53s/it]
 96%|█████████▌| 36460/37963 [87:28:24<4:00:59,  9.62s/it]
                                                          
{'loss': '0.08434', 'grad_norm': '3.812', 'learning_rate': '8.221e-08', 'epoch': '0.9604'}

 96%|█████████▌| 36460/37963 [87:28:24<4:00:59,  9.62s/it]
 96%|█████████▌| 36461/37963 [87:28:31<3:45:53,  9.02s/it]
 96%|█████████▌| 36462/37963 [87:28:39<3:35:11,  8.60s/it]
 96%|█████████▌| 36463/37963 [87:28:47<3:26:52,  8.28s/it]
 96%|█████████▌| 36464/37963 [87:28:54<3:21:39,  8.07s/it]
 96%|█████████▌| 36465/37963 [87:29:02<3:17:39,  7.92s/it]
 96%|█████████▌| 36466/37963 [87:29:09<3:15:15,  7.83s/it]
 96%|█████████▌| 36467/37963 [87:29:17<3:13:01,  7.74s/it]
 96%|█████████▌| 36468/37963 [87:29:24<3:09:57,  7.62s/it]
 96%|█████████▌| 36469/37963 [87:29:32<3:09:19,  7.60s/it]
 96%|█████████▌| 36470/37963 [87:29:39<3:07:19,  7.53s/it]
                                                          
{'loss': '0.0727', 'grad_norm': '2.338', 'learning_rate': '8.112e-08', 'epoch': '0.9607'}

 96%|█████████▌| 36470/37963 [87:29:39<3:07:19,  7.53s/it]
 96%|█████████▌| 36471/37963 [87:29:47<3:07:32,  7.54s/it]
 96%|█████████▌| 36472/37963 [87:30:01<3:54:35,  9.44s/it]
 96%|█████████▌| 36473/37963 [87:30:08<3:40:08,  8.86s/it]
 96%|█████████▌| 36474/37963 [87:30:16<3:30:16,  8.47s/it]
 96%|█████████▌| 36475/37963 [87:30:23<3:23:13,  8.19s/it]
 96%|█████████▌| 36476/37963 [87:30:31<3:19:34,  8.05s/it]
 96%|█████████▌| 36477/37963 [87:30:39<3:17:04,  7.96s/it]
 96%|█████████▌| 36478/37963 [87:30:53<4:02:48,  9.81s/it]
 96%|█████████▌| 36479/37963 [87:31:00<3:45:12,  9.11s/it]
 96%|█████████▌| 36480/37963 [87:31:08<3:33:00,  8.62s/it]
                                                          
{'loss': '0.08831', 'grad_norm': '3.717', 'learning_rate': '8.004e-08', 'epoch': '0.9609'}

 96%|█████████▌| 36480/37963 [87:31:08<3:33:00,  8.62s/it]
 96%|█████████▌| 36481/37963 [87:31:15<3:24:15,  8.27s/it]
 96%|█████████▌| 36482/37963 [87:31:23<3:18:05,  8.03s/it]
 96%|█████████▌| 36483/37963 [87:31:30<3:13:15,  7.83s/it]
 96%|█████████▌| 36484/37963 [87:31:38<3:11:50,  7.78s/it]
 96%|█████████▌| 36485/37963 [87:31:52<3:57:50,  9.66s/it]
 96%|█████████▌| 36486/37963 [87:31:59<3:41:51,  9.01s/it]
 96%|█████████▌| 36487/37963 [87:32:07<3:31:15,  8.59s/it]
 96%|█████████▌| 36488/37963 [87:32:14<3:22:57,  8.26s/it]
 96%|█████████▌| 36489/37963 [87:32:22<3:18:33,  8.08s/it]
 96%|█████████▌| 36490/37963 [87:32:30<3:14:05,  7.91s/it]
                                                          
{'loss': '0.07795', 'grad_norm': '4.061', 'learning_rate': '7.896e-08', 'epoch': '0.9612'}

 96%|█████████▌| 36490/37963 [87:32:30<3:14:05,  7.91s/it]
 96%|█████████▌| 36491/37963 [87:32:37<3:11:33,  7.81s/it]
 96%|█████████▌| 36492/37963 [87:32:44<3:07:22,  7.64s/it]
 96%|█████████▌| 36493/37963 [87:32:52<3:07:18,  7.65s/it]
 96%|█████████▌| 36494/37963 [87:32:59<3:03:45,  7.51s/it]
 96%|█████████▌| 36495/37963 [87:33:07<3:03:36,  7.50s/it]
 96%|█████████▌| 36496/37963 [87:33:14<3:03:14,  7.49s/it]
 96%|█████████▌| 36497/37963 [87:33:21<3:00:40,  7.39s/it]
 96%|█████████▌| 36498/37963 [87:33:35<3:46:22,  9.27s/it]
 96%|█████████▌| 36499/37963 [87:33:42<3:32:23,  8.70s/it]
 96%|█████████▌| 36500/37963 [87:33:50<3:23:05,  8.33s/it]
                                                          
{'loss': '0.08123', 'grad_norm': '3.482', 'learning_rate': '7.79e-08', 'epoch': '0.9615'}

 96%|█████████▌| 36500/37963 [87:33:50<3:23:05,  8.33s/it]
 96%|█████████▌| 36501/37963 [87:34:04<4:04:34, 10.04s/it]
 96%|█████████▌| 36502/37963 [87:34:11<3:47:09,  9.33s/it]
 96%|█████████▌| 36503/37963 [87:34:19<3:32:46,  8.74s/it]
 96%|█████████▌| 36504/37963 [87:34:26<3:23:15,  8.36s/it]
 96%|█████████▌| 36505/37963 [87:34:40<4:02:35,  9.98s/it]
 96%|█████████▌| 36506/37963 [87:34:48<3:45:56,  9.30s/it]
 96%|█████████▌| 36507/37963 [87:34:55<3:32:14,  8.75s/it]
 96%|█████████▌| 36508/37963 [87:35:09<4:09:21, 10.28s/it]
 96%|█████████▌| 36509/37963 [87:35:17<3:49:09,  9.46s/it]
 96%|█████████▌| 36510/37963 [87:35:30<4:19:12, 10.70s/it]
                                                          
{'loss': '0.07629', 'grad_norm': '3.382', 'learning_rate': '7.684e-08', 'epoch': '0.9617'}

 96%|█████████▌| 36510/37963 [87:35:30<4:19:12, 10.70s/it]
 96%|█████████▌| 36511/37963 [87:35:38<3:56:04,  9.76s/it]
 96%|█████████▌| 36512/37963 [87:35:45<3:39:38,  9.08s/it]
 96%|█████████▌| 36513/37963 [87:35:53<3:30:08,  8.70s/it]
 96%|█████████▌| 36514/37963 [87:36:00<3:19:08,  8.25s/it]
 96%|█████████▌| 36515/37963 [87:36:08<3:13:27,  8.02s/it]
 96%|█████████▌| 36516/37963 [87:36:15<3:09:26,  7.86s/it]
 96%|█████████▌| 36517/37963 [87:36:29<3:52:22,  9.64s/it]
 96%|█████████▌| 36518/37963 [87:36:37<3:37:04,  9.01s/it]
 96%|█████████▌| 36519/37963 [87:36:44<3:26:51,  8.60s/it]
 96%|█████████▌| 36520/37963 [87:36:52<3:19:18,  8.29s/it]
                                                          
{'loss': '0.0767', 'grad_norm': '3.87', 'learning_rate': '7.579e-08', 'epoch': '0.962'}

 96%|█████████▌| 36520/37963 [87:36:52<3:19:18,  8.29s/it]
 96%|█████████▌| 36521/37963 [87:36:59<3:14:02,  8.07s/it]
 96%|█████████▌| 36522/37963 [87:37:07<3:10:13,  7.92s/it]
 96%|█████████▌| 36523/37963 [87:37:15<3:07:25,  7.81s/it]
 96%|█████████▌| 36524/37963 [87:37:22<3:05:00,  7.71s/it]
 96%|█████████▌| 36525/37963 [87:37:30<3:03:21,  7.65s/it]
 96%|█████████▌| 36526/37963 [87:37:37<3:00:51,  7.55s/it]
 96%|█████████▌| 36527/37963 [87:37:44<3:01:10,  7.57s/it]
 96%|█████████▌| 36528/37963 [87:37:52<3:00:42,  7.56s/it]
 96%|█████████▌| 36529/37963 [87:37:59<3:00:14,  7.54s/it]
 96%|█████████▌| 36530/37963 [87:38:07<2:58:56,  7.49s/it]
                                                          
{'loss': '0.07334', 'grad_norm': '3.347', 'learning_rate': '7.474e-08', 'epoch': '0.9623'}

 96%|█████████▌| 36530/37963 [87:38:07<2:58:56,  7.49s/it]
 96%|█████████▌| 36531/37963 [87:38:14<2:58:32,  7.48s/it]
 96%|█████████▌| 36532/37963 [87:38:28<3:45:01,  9.43s/it]
 96%|█████████▌| 36533/37963 [87:38:36<3:31:39,  8.88s/it]
 96%|█████████▌| 36534/37963 [87:38:44<3:22:35,  8.51s/it]
 96%|█████████▌| 36535/37963 [87:38:51<3:15:53,  8.23s/it]
 96%|█████████▌| 36536/37963 [87:38:59<3:11:30,  8.05s/it]
 96%|█████████▌| 36537/37963 [87:39:06<3:07:08,  7.87s/it]
 96%|█████████▌| 36538/37963 [87:39:14<3:05:41,  7.82s/it]
 96%|█████████▌| 36539/37963 [87:39:28<3:48:55,  9.65s/it]
 96%|█████████▋| 36540/37963 [87:39:35<3:34:00,  9.02s/it]
                                                          
{'loss': '0.07173', 'grad_norm': '3.742', 'learning_rate': '7.37e-08', 'epoch': '0.9625'}

 96%|█████████▋| 36540/37963 [87:39:35<3:34:00,  9.02s/it]
 96%|█████████▋| 36541/37963 [87:39:43<3:22:09,  8.53s/it]
 96%|█████████▋| 36542/37963 [87:39:50<3:13:49,  8.18s/it]
 96%|█████████▋| 36543/37963 [87:39:58<3:09:47,  8.02s/it]
 96%|█████████▋| 36544/37963 [87:40:05<3:03:09,  7.74s/it]
 96%|█████████▋| 36545/37963 [87:40:13<3:02:16,  7.71s/it]
 96%|█████████▋| 36546/37963 [87:40:20<3:00:43,  7.65s/it]
 96%|█████████▋| 36547/37963 [87:40:28<3:00:19,  7.64s/it]
 96%|█████████▋| 36548/37963 [87:40:35<2:58:25,  7.57s/it]
 96%|█████████▋| 36549/37963 [87:40:43<2:58:10,  7.56s/it]
 96%|█████████▋| 36550/37963 [87:40:50<2:54:26,  7.41s/it]
                                                          
{'loss': '0.06701', 'grad_norm': '2.142', 'learning_rate': '7.267e-08', 'epoch': '0.9628'}

 96%|█████████▋| 36550/37963 [87:40:50<2:54:26,  7.41s/it]
 96%|█████████▋| 36551/37963 [87:41:04<3:42:05,  9.44s/it]
 96%|█████████▋| 36552/37963 [87:41:18<4:14:01, 10.80s/it]
 96%|█████████▋| 36553/37963 [87:41:25<3:50:49,  9.82s/it]
 96%|█████████▋| 36554/37963 [87:41:39<4:19:27, 11.05s/it]
 96%|█████████▋| 36555/37963 [87:41:53<4:40:17, 11.94s/it]
 96%|█████████▋| 36556/37963 [87:42:01<4:09:19, 10.63s/it]
 96%|█████████▋| 36557/37963 [87:42:08<3:46:25,  9.66s/it]
 96%|█████████▋| 36558/37963 [87:42:16<3:31:18,  9.02s/it]
 96%|█████████▋| 36559/37963 [87:42:30<4:07:03, 10.56s/it]
 96%|█████████▋| 36560/37963 [87:42:38<3:46:28,  9.68s/it]
                                                          
{'loss': '0.08619', 'grad_norm': '2.711', 'learning_rate': '7.165e-08', 'epoch': '0.963'}

 96%|█████████▋| 36560/37963 [87:42:38<3:46:28,  9.68s/it]
 96%|█████████▋| 36561/37963 [87:42:45<3:32:03,  9.08s/it]
 96%|█████████▋| 36562/37963 [87:42:53<3:20:02,  8.57s/it]
 96%|█████████▋| 36563/37963 [87:43:00<3:12:34,  8.25s/it]
 96%|█████████▋| 36564/37963 [87:43:08<3:07:33,  8.04s/it]
 96%|█████████▋| 36565/37963 [87:43:15<3:03:14,  7.86s/it]
 96%|█████████▋| 36566/37963 [87:43:23<3:00:10,  7.74s/it]
 96%|█████████▋| 36567/37963 [87:43:30<2:57:28,  7.63s/it]
 96%|█████████▋| 36568/37963 [87:43:38<2:57:38,  7.64s/it]
 96%|█████████▋| 36569/37963 [87:43:45<2:56:50,  7.61s/it]
 96%|█████████▋| 36570/37963 [87:44:00<3:43:48,  9.64s/it]
                                                          
{'loss': '0.08566', 'grad_norm': '2.772', 'learning_rate': '7.064e-08', 'epoch': '0.9633'}

 96%|█████████▋| 36570/37963 [87:44:00<3:43:48,  9.64s/it]
 96%|█████████▋| 36571/37963 [87:44:07<3:28:56,  9.01s/it]
 96%|█████████▋| 36572/37963 [87:44:15<3:19:04,  8.59s/it]
 96%|█████████▋| 36573/37963 [87:44:22<3:11:34,  8.27s/it]
 96%|█████████▋| 36574/37963 [87:44:30<3:07:16,  8.09s/it]
 96%|█████████▋| 36575/37963 [87:44:37<3:01:47,  7.86s/it]
 96%|█████████▋| 36576/37963 [87:44:45<2:59:22,  7.76s/it]
 96%|█████████▋| 36577/37963 [87:44:52<2:57:25,  7.68s/it]
 96%|█████████▋| 36578/37963 [87:45:00<2:58:02,  7.71s/it]
 96%|█████████▋| 36579/37963 [87:45:08<2:56:35,  7.66s/it]
 96%|█████████▋| 36580/37963 [87:45:15<2:55:37,  7.62s/it]
                                                          
{'loss': '0.0809', 'grad_norm': '4.245', 'learning_rate': '6.963e-08', 'epoch': '0.9636'}

 96%|█████████▋| 36580/37963 [87:45:15<2:55:37,  7.62s/it]
 96%|█████████▋| 36581/37963 [87:45:22<2:53:39,  7.54s/it]
 96%|█████████▋| 36582/37963 [87:45:30<2:54:25,  7.58s/it]
 96%|█████████▋| 36583/37963 [87:45:44<3:37:58,  9.48s/it]
 96%|█████████▋| 36584/37963 [87:45:52<3:24:24,  8.89s/it]
 96%|█████████▋| 36585/37963 [87:45:59<3:13:45,  8.44s/it]
 96%|█████████▋| 36586/37963 [87:46:06<3:07:43,  8.18s/it]
 96%|█████████▋| 36587/37963 [87:46:14<3:03:28,  8.00s/it]
 96%|█████████▋| 36588/37963 [87:46:28<3:44:13,  9.78s/it]
 96%|█████████▋| 36589/37963 [87:46:36<3:29:07,  9.13s/it]
 96%|█████████▋| 36590/37963 [87:46:43<3:17:53,  8.65s/it]
                                                          
{'loss': '0.06846', 'grad_norm': '2.447', 'learning_rate': '6.863e-08', 'epoch': '0.9638'}

 96%|█████████▋| 36590/37963 [87:46:43<3:17:53,  8.65s/it]
 96%|█████████▋| 36591/37963 [87:46:51<3:10:37,  8.34s/it]
 96%|█████████▋| 36592/37963 [87:46:58<3:04:41,  8.08s/it]
 96%|█████████▋| 36593/37963 [87:47:06<3:00:00,  7.88s/it]
 96%|█████████▋| 36594/37963 [87:47:13<2:57:31,  7.78s/it]
 96%|█████████▋| 36595/37963 [87:47:21<2:56:30,  7.74s/it]
 96%|█████████▋| 36596/37963 [87:47:28<2:55:15,  7.69s/it]
 96%|█████████▋| 36597/37963 [87:47:36<2:52:31,  7.58s/it]
 96%|█████████▋| 36598/37963 [87:47:49<3:33:14,  9.37s/it]
 96%|█████████▋| 36599/37963 [87:48:03<4:05:19, 10.79s/it]
 96%|█████████▋| 36600/37963 [87:48:17<4:26:47, 11.74s/it]
                                                          
{'loss': '0.07386', 'grad_norm': '3.546', 'learning_rate': '6.763e-08', 'epoch': '0.9641'}

 96%|█████████▋| 36600/37963 [87:48:17<4:26:47, 11.74s/it]
 96%|█████████▋| 36601/37963 [87:48:25<3:57:30, 10.46s/it]
 96%|█████████▋| 36602/37963 [87:48:32<3:37:24,  9.58s/it]
 96%|█████████▋| 36603/37963 [87:48:40<3:22:44,  8.94s/it]
 96%|█████████▋| 36604/37963 [87:48:47<3:11:40,  8.46s/it]
 96%|█████████▋| 36605/37963 [87:48:55<3:05:04,  8.18s/it]
 96%|█████████▋| 36606/37963 [87:49:02<3:00:22,  7.98s/it]
 96%|█████████▋| 36607/37963 [87:49:23<4:24:12, 11.69s/it]
 96%|█████████▋| 36608/37963 [87:49:30<3:57:02, 10.50s/it]
 96%|█████████▋| 36609/37963 [87:49:38<3:35:23,  9.54s/it]
 96%|█████████▋| 36610/37963 [87:49:45<3:21:40,  8.94s/it]
                                                          
{'loss': '0.08909', 'grad_norm': '3.886', 'learning_rate': '6.664e-08', 'epoch': '0.9644'}

 96%|█████████▋| 36610/37963 [87:49:45<3:21:40,  8.94s/it]
 96%|█████████▋| 36611/37963 [87:49:53<3:12:48,  8.56s/it]
 96%|█████████▋| 36612/37963 [87:50:00<3:06:22,  8.28s/it]
 96%|█████████▋| 36613/37963 [87:50:08<3:01:02,  8.05s/it]
 96%|█████████▋| 36614/37963 [87:50:15<2:58:00,  7.92s/it]
 96%|█████████▋| 36615/37963 [87:50:23<2:56:14,  7.84s/it]
 96%|█████████▋| 36616/37963 [87:50:31<2:53:23,  7.72s/it]
 96%|█████████▋| 36617/37963 [87:50:38<2:50:17,  7.59s/it]
 96%|█████████▋| 36618/37963 [87:50:45<2:49:58,  7.58s/it]
 96%|█████████▋| 36619/37963 [87:50:53<2:50:46,  7.62s/it]
 96%|█████████▋| 36620/37963 [87:51:07<3:33:57,  9.56s/it]
                                                          
{'loss': '0.07814', 'grad_norm': '3.103', 'learning_rate': '6.566e-08', 'epoch': '0.9646'}

 96%|█████████▋| 36620/37963 [87:51:07<3:33:57,  9.56s/it]
 96%|█████████▋| 36621/37963 [87:51:15<3:20:38,  8.97s/it]
 96%|█████████▋| 36622/37963 [87:51:22<3:10:55,  8.54s/it]
 96%|█████████▋| 36623/37963 [87:51:30<3:03:00,  8.19s/it]
 96%|█████████▋| 36624/37963 [87:51:37<2:59:07,  8.03s/it]
 96%|█████████▋| 36625/37963 [87:51:45<2:54:07,  7.81s/it]
 96%|█████████▋| 36626/37963 [87:51:52<2:50:39,  7.66s/it]
 96%|█████████▋| 36627/37963 [87:52:06<3:33:43,  9.60s/it]
 96%|█████████▋| 36628/37963 [87:52:14<3:21:07,  9.04s/it]
 96%|█████████▋| 36629/37963 [87:52:21<3:10:48,  8.58s/it]
 96%|█████████▋| 36630/37963 [87:52:29<3:03:43,  8.27s/it]
                                                          
{'loss': '0.08741', 'grad_norm': '3.141', 'learning_rate': '6.469e-08', 'epoch': '0.9649'}

 96%|█████████▋| 36630/37963 [87:52:29<3:03:43,  8.27s/it]
 96%|█████████▋| 36631/37963 [87:52:37<2:59:15,  8.07s/it]
 96%|█████████▋| 36632/37963 [87:52:44<2:55:26,  7.91s/it]
 96%|█████████▋| 36633/37963 [87:52:52<2:52:48,  7.80s/it]
 96%|█████████▋| 36634/37963 [87:52:59<2:50:50,  7.71s/it]
 97%|█████████▋| 36635/37963 [87:53:07<2:50:02,  7.68s/it]
 97%|█████████▋| 36636/37963 [87:53:14<2:48:52,  7.64s/it]
 97%|█████████▋| 36637/37963 [87:53:22<2:48:11,  7.61s/it]
 97%|█████████▋| 36638/37963 [87:53:29<2:47:59,  7.61s/it]
 97%|█████████▋| 36639/37963 [87:53:37<2:48:36,  7.64s/it]
 97%|█████████▋| 36640/37963 [87:53:45<2:47:08,  7.58s/it]
                                                          
{'loss': '0.07841', 'grad_norm': '3.386', 'learning_rate': '6.373e-08', 'epoch': '0.9652'}

 97%|█████████▋| 36640/37963 [87:53:45<2:47:08,  7.58s/it]
 97%|█████████▋| 36641/37963 [87:53:52<2:46:24,  7.55s/it]
 97%|█████████▋| 36642/37963 [87:54:06<3:29:54,  9.53s/it]
 97%|█████████▋| 36643/37963 [87:54:14<3:16:40,  8.94s/it]
 97%|█████████▋| 36644/37963 [87:54:28<3:49:28, 10.44s/it]
 97%|█████████▋| 36645/37963 [87:54:35<3:27:52,  9.46s/it]
 97%|█████████▋| 36646/37963 [87:54:42<3:15:05,  8.89s/it]
 97%|█████████▋| 36647/37963 [87:54:50<3:04:49,  8.43s/it]
 97%|█████████▋| 36648/37963 [87:54:57<2:59:08,  8.17s/it]
 97%|█████████▋| 36649/37963 [87:55:05<2:55:36,  8.02s/it]
 97%|█████████▋| 36650/37963 [87:55:13<2:53:24,  7.92s/it]
                                                          
{'loss': '0.07032', 'grad_norm': '3.384', 'learning_rate': '6.277e-08', 'epoch': '0.9654'}

 97%|█████████▋| 36650/37963 [87:55:13<2:53:24,  7.92s/it]
 97%|█████████▋| 36651/37963 [87:55:20<2:50:56,  7.82s/it]
 97%|█████████▋| 36652/37963 [87:55:28<2:47:05,  7.65s/it]
 97%|█████████▋| 36653/37963 [87:55:41<3:26:01,  9.44s/it]
 97%|█████████▋| 36654/37963 [87:55:55<3:57:03, 10.87s/it]
 97%|█████████▋| 36655/37963 [87:56:03<3:35:10,  9.87s/it]
 97%|█████████▋| 36656/37963 [87:56:10<3:20:00,  9.18s/it]
 97%|█████████▋| 36657/37963 [87:56:18<3:08:56,  8.68s/it]
 97%|█████████▋| 36658/37963 [87:56:26<3:03:14,  8.42s/it]
 97%|█████████▋| 36659/37963 [87:56:40<3:40:08, 10.13s/it]
 97%|█████████▋| 36660/37963 [87:56:47<3:22:43,  9.34s/it]
                                                          
{'loss': '0.07728', 'grad_norm': '3.149', 'learning_rate': '6.182e-08', 'epoch': '0.9657'}

 97%|█████████▋| 36660/37963 [87:56:47<3:22:43,  9.34s/it]
 97%|█████████▋| 36661/37963 [87:56:55<3:10:26,  8.78s/it]
 97%|█████████▋| 36662/37963 [87:57:03<3:03:21,  8.46s/it]
 97%|█████████▋| 36663/37963 [87:57:10<2:56:56,  8.17s/it]
 97%|█████████▋| 36664/37963 [87:57:17<2:51:44,  7.93s/it]
 97%|█████████▋| 36665/37963 [87:57:25<2:47:14,  7.73s/it]
 97%|█████████▋| 36666/37963 [87:57:32<2:45:39,  7.66s/it]
 97%|█████████▋| 36667/37963 [87:57:40<2:45:24,  7.66s/it]
 97%|█████████▋| 36668/37963 [87:57:54<3:27:38,  9.62s/it]
 97%|█████████▋| 36669/37963 [87:58:02<3:15:17,  9.06s/it]
 97%|█████████▋| 36670/37963 [87:58:09<3:04:40,  8.57s/it]
                                                          
{'loss': '0.07458', 'grad_norm': '2.328', 'learning_rate': '6.087e-08', 'epoch': '0.9659'}

 97%|█████████▋| 36670/37963 [87:58:09<3:04:40,  8.57s/it]
 97%|█████████▋| 36671/37963 [87:58:17<2:58:34,  8.29s/it]
 97%|█████████▋| 36672/37963 [87:58:31<3:34:50,  9.98s/it]
 97%|█████████▋| 36673/37963 [87:58:38<3:17:42,  9.20s/it]
 97%|█████████▋| 36674/37963 [87:58:46<3:06:45,  8.69s/it]
 97%|█████████▋| 36675/37963 [87:58:53<2:59:24,  8.36s/it]
 97%|█████████▋| 36676/37963 [87:59:01<2:53:44,  8.10s/it]
 97%|█████████▋| 36677/37963 [87:59:08<2:48:46,  7.87s/it]
 97%|█████████▋| 36678/37963 [87:59:16<2:47:14,  7.81s/it]
 97%|█████████▋| 36679/37963 [87:59:23<2:44:54,  7.71s/it]
 97%|█████████▋| 36680/37963 [87:59:31<2:43:46,  7.66s/it]
                                                          
{'loss': '0.09627', 'grad_norm': '4.115', 'learning_rate': '5.994e-08', 'epoch': '0.9662'}

 97%|█████████▋| 36680/37963 [87:59:31<2:43:46,  7.66s/it]
 97%|█████████▋| 36681/37963 [87:59:38<2:40:57,  7.53s/it]
 97%|█████████▋| 36682/37963 [87:59:46<2:40:52,  7.54s/it]
 97%|█████████▋| 36683/37963 [87:59:53<2:40:41,  7.53s/it]
 97%|█████████▋| 36684/37963 [88:00:01<2:40:24,  7.53s/it]
 97%|█████████▋| 36685/37963 [88:00:08<2:41:35,  7.59s/it]
 97%|█████████▋| 36686/37963 [88:00:16<2:41:11,  7.57s/it]
 97%|█████████▋| 36687/37963 [88:00:23<2:40:31,  7.55s/it]
 97%|█████████▋| 36688/37963 [88:00:31<2:39:28,  7.50s/it]
 97%|█████████▋| 36689/37963 [88:00:38<2:40:42,  7.57s/it]
 97%|█████████▋| 36690/37963 [88:00:52<3:20:06,  9.43s/it]
                                                          
{'loss': '0.07983', 'grad_norm': '3.834', 'learning_rate': '5.901e-08', 'epoch': '0.9665'}

 97%|█████████▋| 36690/37963 [88:00:52<3:20:06,  9.43s/it]
 97%|█████████▋| 36691/37963 [88:01:00<3:06:54,  8.82s/it]
 97%|█████████▋| 36692/37963 [88:01:07<2:57:15,  8.37s/it]
 97%|█████████▋| 36693/37963 [88:01:15<2:52:33,  8.15s/it]
 97%|█████████▋| 36694/37963 [88:01:35<4:10:39, 11.85s/it]
 97%|█████████▋| 36695/37963 [88:01:43<3:43:20, 10.57s/it]
 97%|█████████▋| 36696/37963 [88:01:50<3:24:02,  9.66s/it]
 97%|█████████▋| 36697/37963 [88:01:58<3:10:58,  9.05s/it]
 97%|█████████▋| 36698/37963 [88:02:05<2:59:47,  8.53s/it]
 97%|█████████▋| 36699/37963 [88:02:13<2:54:15,  8.27s/it]
 97%|█████████▋| 36700/37963 [88:02:20<2:46:53,  7.93s/it]
                                                          
{'loss': '0.08434', 'grad_norm': '4.12', 'learning_rate': '5.809e-08', 'epoch': '0.9667'}

 97%|█████████▋| 36700/37963 [88:02:20<2:46:53,  7.93s/it]
 97%|█████████▋| 36701/37963 [88:02:34<3:23:54,  9.69s/it]
 97%|█████████▋| 36702/37963 [88:02:41<3:09:56,  9.04s/it]
 97%|█████████▋| 36703/37963 [88:02:55<3:39:52, 10.47s/it]
 97%|█████████▋| 36704/37963 [88:03:03<3:22:08,  9.63s/it]
 97%|█████████▋| 36705/37963 [88:03:17<3:49:50, 10.96s/it]
 97%|█████████▋| 36706/37963 [88:03:24<3:28:03,  9.93s/it]
 97%|█████████▋| 36707/37963 [88:03:32<3:13:30,  9.24s/it]
 97%|█████████▋| 36708/37963 [88:03:39<3:00:31,  8.63s/it]
 97%|█████████▋| 36709/37963 [88:03:47<2:53:34,  8.31s/it]
 97%|█████████▋| 36710/37963 [88:03:54<2:48:53,  8.09s/it]
                                                          
{'loss': '0.07823', 'grad_norm': '4.052', 'learning_rate': '5.717e-08', 'epoch': '0.967'}

 97%|█████████▋| 36710/37963 [88:03:54<2:48:53,  8.09s/it]
 97%|█████████▋| 36711/37963 [88:04:02<2:45:17,  7.92s/it]
 97%|█████████▋| 36712/37963 [88:04:09<2:42:40,  7.80s/it]
 97%|█████████▋| 36713/37963 [88:04:17<2:40:18,  7.69s/it]
 97%|█████████▋| 36714/37963 [88:04:24<2:39:50,  7.68s/it]
 97%|█████████▋| 36715/37963 [88:04:32<2:38:43,  7.63s/it]
 97%|█████████▋| 36716/37963 [88:04:39<2:36:42,  7.54s/it]
 97%|█████████▋| 36717/37963 [88:04:47<2:37:02,  7.56s/it]
 97%|█████████▋| 36718/37963 [88:04:54<2:36:30,  7.54s/it]
 97%|█████████▋| 36719/37963 [88:05:08<3:15:54,  9.45s/it]
 97%|█████████▋| 36720/37963 [88:05:22<3:44:59, 10.86s/it]
                                                          
{'loss': '0.08418', 'grad_norm': '3.346', 'learning_rate': '5.627e-08', 'epoch': '0.9673'}

 97%|█████████▋| 36720/37963 [88:05:22<3:44:59, 10.86s/it]
 97%|█████████▋| 36721/37963 [88:05:30<3:25:30,  9.93s/it]
 97%|█████████▋| 36722/37963 [88:05:38<3:10:24,  9.21s/it]
 97%|█████████▋| 36723/37963 [88:05:45<2:59:10,  8.67s/it]
 97%|█████████▋| 36724/37963 [88:05:53<2:51:12,  8.29s/it]
 97%|█████████▋| 36725/37963 [88:06:00<2:45:48,  8.04s/it]
 97%|█████████▋| 36726/37963 [88:06:08<2:43:06,  7.91s/it]
 97%|█████████▋| 36727/37963 [88:06:15<2:40:50,  7.81s/it]
 97%|█████████▋| 36728/37963 [88:06:23<2:38:48,  7.72s/it]
 97%|█████████▋| 36729/37963 [88:06:30<2:37:08,  7.64s/it]
 97%|█████████▋| 36730/37963 [88:06:38<2:36:14,  7.60s/it]
                                                          
{'loss': '0.07608', 'grad_norm': '3.251', 'learning_rate': '5.537e-08', 'epoch': '0.9675'}

 97%|█████████▋| 36730/37963 [88:06:38<2:36:14,  7.60s/it]
 97%|█████████▋| 36731/37963 [88:06:45<2:36:28,  7.62s/it]
 97%|█████████▋| 36732/37963 [88:06:53<2:35:52,  7.60s/it]
 97%|█████████▋| 36733/37963 [88:07:00<2:35:44,  7.60s/it]
 97%|█████████▋| 36734/37963 [88:07:08<2:35:09,  7.58s/it]
 97%|█████████▋| 36735/37963 [88:07:16<2:34:44,  7.56s/it]
 97%|█████████▋| 36736/37963 [88:07:23<2:35:28,  7.60s/it]
 97%|█████████▋| 36737/37963 [88:07:31<2:34:47,  7.58s/it]
 97%|█████████▋| 36738/37963 [88:07:38<2:32:39,  7.48s/it]
 97%|█████████▋| 36739/37963 [88:07:46<2:33:27,  7.52s/it]
 97%|█████████▋| 36740/37963 [88:07:53<2:32:42,  7.49s/it]
                                                          
{'loss': '0.07856', 'grad_norm': '3.66', 'learning_rate': '5.447e-08', 'epoch': '0.9678'}

 97%|█████████▋| 36740/37963 [88:07:53<2:32:42,  7.49s/it]
 97%|█████████▋| 36741/37963 [88:08:01<2:33:41,  7.55s/it]
 97%|█████████▋| 36742/37963 [88:08:21<3:51:49, 11.39s/it]
 97%|█████████▋| 36743/37963 [88:08:29<3:28:25, 10.25s/it]
 97%|█████████▋| 36744/37963 [88:08:42<3:48:16, 11.24s/it]
 97%|█████████▋| 36745/37963 [88:08:50<3:25:19, 10.11s/it]
 97%|█████████▋| 36746/37963 [88:08:57<3:07:53,  9.26s/it]
 97%|█████████▋| 36747/37963 [88:09:05<2:57:46,  8.77s/it]
 97%|█████████▋| 36748/37963 [88:09:18<3:28:37, 10.30s/it]
 97%|█████████▋| 36749/37963 [88:09:26<3:11:50,  9.48s/it]
 97%|█████████▋| 36750/37963 [88:09:34<2:59:52,  8.90s/it]
                                                          
{'loss': '0.06623', 'grad_norm': '3.315', 'learning_rate': '5.359e-08', 'epoch': '0.9681'}

 97%|█████████▋| 36750/37963 [88:09:34<2:59:52,  8.90s/it]
 97%|█████████▋| 36751/37963 [88:09:41<2:51:09,  8.47s/it]
 97%|█████████▋| 36752/37963 [88:09:49<2:44:59,  8.17s/it]
 97%|█████████▋| 36753/37963 [88:10:03<3:20:57,  9.97s/it]
 97%|█████████▋| 36754/37963 [88:10:17<3:45:45, 11.20s/it]
 97%|█████████▋| 36755/37963 [88:10:24<3:24:28, 10.16s/it]
 97%|█████████▋| 36756/37963 [88:10:32<3:09:14,  9.41s/it]
 97%|█████████▋| 36757/37963 [88:10:40<2:58:26,  8.88s/it]
 97%|█████████▋| 36758/37963 [88:10:47<2:50:46,  8.50s/it]
 97%|█████████▋| 36759/37963 [88:10:55<2:42:16,  8.09s/it]
 97%|█████████▋| 36760/37963 [88:11:02<2:37:40,  7.86s/it]
                                                          
{'loss': '0.0682', 'grad_norm': '2.777', 'learning_rate': '5.271e-08', 'epoch': '0.9683'}

 97%|█████████▋| 36760/37963 [88:11:02<2:37:40,  7.86s/it]
 97%|█████████▋| 36761/37963 [88:11:09<2:34:25,  7.71s/it]
 97%|█████████▋| 36762/37963 [88:11:17<2:33:13,  7.66s/it]
 97%|█████████▋| 36763/37963 [88:11:24<2:32:09,  7.61s/it]
 97%|█████████▋| 36764/37963 [88:11:32<2:31:42,  7.59s/it]
 97%|█████████▋| 36765/37963 [88:11:46<3:08:53,  9.46s/it]
 97%|█████████▋| 36766/37963 [88:11:53<2:56:58,  8.87s/it]
 97%|█████████▋| 36767/37963 [88:12:07<3:27:53, 10.43s/it]
 97%|█████████▋| 36768/37963 [88:12:15<3:10:58,  9.59s/it]
 97%|█████████▋| 36769/37963 [88:12:22<2:59:09,  9.00s/it]
 97%|█████████▋| 36770/37963 [88:12:30<2:50:36,  8.58s/it]
                                                          
{'loss': '0.07856', 'grad_norm': '3.154', 'learning_rate': '5.184e-08', 'epoch': '0.9686'}

 97%|█████████▋| 36770/37963 [88:12:30<2:50:36,  8.58s/it]
 97%|█████████▋| 36771/37963 [88:12:38<2:44:07,  8.26s/it]
 97%|█████████▋| 36772/37963 [88:12:45<2:39:51,  8.05s/it]
 97%|█████████▋| 36773/37963 [88:12:53<2:37:43,  7.95s/it]
 97%|█████████▋| 36774/37963 [88:13:01<2:36:39,  7.91s/it]
 97%|█████████▋| 36775/37963 [88:13:08<2:32:38,  7.71s/it]
 97%|█████████▋| 36776/37963 [88:13:15<2:30:58,  7.63s/it]
 97%|█████████▋| 36777/37963 [88:13:23<2:30:20,  7.61s/it]
 97%|█████████▋| 36778/37963 [88:13:30<2:29:27,  7.57s/it]
 97%|█████████▋| 36779/37963 [88:13:38<2:29:23,  7.57s/it]
 97%|█████████▋| 36780/37963 [88:13:45<2:28:45,  7.54s/it]
                                                          
{'loss': '0.08386', 'grad_norm': '3.667', 'learning_rate': '5.097e-08', 'epoch': '0.9688'}

 97%|█████████▋| 36780/37963 [88:13:45<2:28:45,  7.54s/it]
 97%|█████████▋| 36781/37963 [88:13:53<2:28:23,  7.53s/it]
 97%|█████████▋| 36782/37963 [88:14:00<2:27:21,  7.49s/it]
 97%|█████████▋| 36783/37963 [88:14:08<2:27:05,  7.48s/it]
 97%|█████████▋| 36784/37963 [88:14:15<2:27:04,  7.48s/it]
 97%|█████████▋| 36785/37963 [88:14:23<2:27:05,  7.49s/it]
 97%|█████████▋| 36786/37963 [88:14:30<2:26:55,  7.49s/it]
 97%|█████████▋| 36787/37963 [88:14:38<2:27:08,  7.51s/it]
 97%|█████████▋| 36788/37963 [88:14:52<3:05:38,  9.48s/it]
 97%|█████████▋| 36789/37963 [88:14:59<2:53:41,  8.88s/it]
 97%|█████████▋| 36790/37963 [88:15:07<2:46:14,  8.50s/it]
                                                          
{'loss': '0.07823', 'grad_norm': '3.966', 'learning_rate': '5.012e-08', 'epoch': '0.9691'}

 97%|█████████▋| 36790/37963 [88:15:07<2:46:14,  8.50s/it]
 97%|█████████▋| 36791/37963 [88:15:15<2:40:52,  8.24s/it]
 97%|█████████▋| 36792/37963 [88:15:22<2:36:41,  8.03s/it]
 97%|█████████▋| 36793/37963 [88:15:36<3:11:03,  9.80s/it]
 97%|█████████▋| 36794/37963 [88:15:44<2:57:52,  9.13s/it]
 97%|█████████▋| 36795/37963 [88:15:57<3:24:32, 10.51s/it]
 97%|█████████▋| 36796/37963 [88:16:11<3:44:34, 11.55s/it]
 97%|█████████▋| 36797/37963 [88:16:19<3:20:40, 10.33s/it]
 97%|█████████▋| 36798/37963 [88:16:26<3:04:03,  9.48s/it]
 97%|█████████▋| 36799/37963 [88:16:34<2:52:19,  8.88s/it]
 97%|█████████▋| 36800/37963 [88:16:41<2:44:45,  8.50s/it]
                                                          
{'loss': '0.07242', 'grad_norm': '3.734', 'learning_rate': '4.927e-08', 'epoch': '0.9694'}

 97%|█████████▋| 36800/37963 [88:16:41<2:44:45,  8.50s/it]
 97%|█████████▋| 36801/37963 [88:16:55<3:13:51, 10.01s/it]
 97%|█████████▋| 36802/37963 [88:17:09<3:36:43, 11.20s/it]
 97%|█████████▋| 36803/37963 [88:17:17<3:15:31, 10.11s/it]
 97%|█████████▋| 36804/37963 [88:17:24<3:00:52,  9.36s/it]
 97%|█████████▋| 36805/37963 [88:17:32<2:49:51,  8.80s/it]
 97%|█████████▋| 36806/37963 [88:17:39<2:42:21,  8.42s/it]
 97%|█████████▋| 36807/37963 [88:17:47<2:37:08,  8.16s/it]
 97%|█████████▋| 36808/37963 [88:17:54<2:32:00,  7.90s/it]
 97%|█████████▋| 36809/37963 [88:18:02<2:30:03,  7.80s/it]
 97%|█████████▋| 36810/37963 [88:18:09<2:28:18,  7.72s/it]
                                                          
{'loss': '0.07816', 'grad_norm': '3.711', 'learning_rate': '4.842e-08', 'epoch': '0.9696'}

 97%|█████████▋| 36810/37963 [88:18:09<2:28:18,  7.72s/it]
 97%|█████████▋| 36811/37963 [88:18:23<3:03:50,  9.57s/it]
 97%|█████████▋| 36812/37963 [88:18:30<2:51:22,  8.93s/it]
 97%|█████████▋| 36813/37963 [88:18:38<2:43:09,  8.51s/it]
 97%|█████████▋| 36814/37963 [88:18:45<2:37:12,  8.21s/it]
 97%|█████████▋| 36815/37963 [88:18:53<2:33:20,  8.01s/it]
 97%|█████████▋| 36816/37963 [88:19:00<2:29:18,  7.81s/it]
 97%|█████████▋| 36817/37963 [88:19:08<2:27:42,  7.73s/it]
 97%|█████████▋| 36818/37963 [88:19:22<3:02:29,  9.56s/it]
 97%|█████████▋| 36819/37963 [88:19:29<2:50:05,  8.92s/it]
 97%|█████████▋| 36820/37963 [88:19:37<2:41:41,  8.49s/it]
                                                          
{'loss': '0.08367', 'grad_norm': '2.42', 'learning_rate': '4.759e-08', 'epoch': '0.9699'}

 97%|█████████▋| 36820/37963 [88:19:37<2:41:41,  8.49s/it]
 97%|█████████▋| 36821/37963 [88:19:44<2:36:09,  8.20s/it]
 97%|█████████▋| 36822/37963 [88:19:52<2:32:24,  8.01s/it]
 97%|█████████▋| 36823/37963 [88:19:59<2:28:15,  7.80s/it]
 97%|█████████▋| 36824/37963 [88:20:06<2:25:27,  7.66s/it]
 97%|█████████▋| 36825/37963 [88:20:14<2:24:49,  7.64s/it]
 97%|█████████▋| 36826/37963 [88:20:22<2:24:04,  7.60s/it]
 97%|█████████▋| 36827/37963 [88:20:29<2:23:32,  7.58s/it]
 97%|█████████▋| 36828/37963 [88:20:37<2:23:03,  7.56s/it]
 97%|█████████▋| 36829/37963 [88:20:44<2:23:06,  7.57s/it]
 97%|█████████▋| 36830/37963 [88:20:52<2:23:01,  7.57s/it]
                                                          
{'loss': '0.08805', 'grad_norm': '3.185', 'learning_rate': '4.676e-08', 'epoch': '0.9702'}

 97%|█████████▋| 36830/37963 [88:20:52<2:23:01,  7.57s/it]
 97%|█████████▋| 36831/37963 [88:20:59<2:21:58,  7.52s/it]
 97%|█████████▋| 36832/37963 [88:21:07<2:21:40,  7.52s/it]
 97%|█████████▋| 36833/37963 [88:21:14<2:22:16,  7.55s/it]
 97%|█████████▋| 36834/37963 [88:21:22<2:20:38,  7.47s/it]
 97%|█████████▋| 36835/37963 [88:21:29<2:20:32,  7.48s/it]
 97%|█████████▋| 36836/37963 [88:21:37<2:21:24,  7.53s/it]
 97%|█████████▋| 36837/37963 [88:21:44<2:21:27,  7.54s/it]
 97%|█████████▋| 36838/37963 [88:21:52<2:21:15,  7.53s/it]
 97%|█████████▋| 36839/37963 [88:21:59<2:21:41,  7.56s/it]
 97%|█████████▋| 36840/37963 [88:22:13<2:57:18,  9.47s/it]
                                                          
{'loss': '0.08922', 'grad_norm': '4.672', 'learning_rate': '4.594e-08', 'epoch': '0.9704'}

 97%|█████████▋| 36840/37963 [88:22:13<2:57:18,  9.47s/it]
 97%|█████████▋| 36841/37963 [88:22:21<2:45:40,  8.86s/it]
 97%|█████████▋| 36842/37963 [88:22:34<3:11:42, 10.26s/it]
 97%|█████████▋| 36843/37963 [88:22:42<2:56:28,  9.45s/it]
 97%|█████████▋| 36844/37963 [88:22:49<2:44:12,  8.80s/it]
 97%|█████████▋| 36845/37963 [88:23:03<3:12:17, 10.32s/it]
 97%|█████████▋| 36846/37963 [88:23:11<2:56:44,  9.49s/it]
 97%|█████████▋| 36847/37963 [88:23:24<3:20:43, 10.79s/it]
 97%|█████████▋| 36848/37963 [88:23:32<3:01:16,  9.76s/it]
 97%|█████████▋| 36849/37963 [88:23:46<3:24:53, 11.04s/it]
 97%|█████████▋| 36850/37963 [88:23:53<3:05:50, 10.02s/it]
                                                          
{'loss': '0.1027', 'grad_norm': '3.386', 'learning_rate': '4.513e-08', 'epoch': '0.9707'}

 97%|█████████▋| 36850/37963 [88:23:53<3:05:50, 10.02s/it]
 97%|█████████▋| 36851/37963 [88:24:01<2:51:33,  9.26s/it]
 97%|█████████▋| 36852/37963 [88:24:15<3:18:13, 10.71s/it]
 97%|█████████▋| 36853/37963 [88:24:23<3:01:09,  9.79s/it]
 97%|█████████▋| 36854/37963 [88:24:30<2:49:31,  9.17s/it]
 97%|█████████▋| 36855/37963 [88:24:44<3:13:44, 10.49s/it]
 97%|█████████▋| 36856/37963 [88:24:52<2:58:03,  9.65s/it]
 97%|█████████▋| 36857/37963 [88:24:59<2:46:16,  9.02s/it]
 97%|█████████▋| 36858/37963 [88:25:07<2:38:00,  8.58s/it]
 97%|█████████▋| 36859/37963 [88:25:14<2:32:18,  8.28s/it]
 97%|█████████▋| 36860/37963 [88:25:22<2:27:22,  8.02s/it]
                                                          
{'loss': '0.07387', 'grad_norm': '2.523', 'learning_rate': '4.432e-08', 'epoch': '0.9709'}

 97%|█████████▋| 36860/37963 [88:25:22<2:27:22,  8.02s/it]
 97%|█████████▋| 36861/37963 [88:25:29<2:24:34,  7.87s/it]
 97%|█████████▋| 36862/37963 [88:25:43<2:56:11,  9.60s/it]
 97%|█████████▋| 36863/37963 [88:25:50<2:44:38,  8.98s/it]
 97%|█████████▋| 36864/37963 [88:25:58<2:35:21,  8.48s/it]
 97%|█████████▋| 36865/37963 [88:26:05<2:29:55,  8.19s/it]
 97%|█████████▋| 36866/37963 [88:26:13<2:27:28,  8.07s/it]
 97%|█████████▋| 36867/37963 [88:26:20<2:23:07,  7.84s/it]
 97%|█████████▋| 36868/37963 [88:26:28<2:20:01,  7.67s/it]
 97%|█████████▋| 36869/37963 [88:26:35<2:19:26,  7.65s/it]
 97%|█████████▋| 36870/37963 [88:26:43<2:18:10,  7.58s/it]
                                                          
{'loss': '0.07966', 'grad_norm': '3.436', 'learning_rate': '4.352e-08', 'epoch': '0.9712'}

 97%|█████████▋| 36870/37963 [88:26:43<2:18:10,  7.58s/it]
 97%|█████████▋| 36871/37963 [88:26:50<2:17:52,  7.58s/it]
 97%|█████████▋| 36872/37963 [88:26:58<2:17:50,  7.58s/it]
 97%|█████████▋| 36873/37963 [88:27:05<2:17:09,  7.55s/it]
 97%|█████████▋| 36874/37963 [88:27:13<2:17:13,  7.56s/it]
 97%|█████████▋| 36875/37963 [88:27:20<2:16:50,  7.55s/it]
 97%|█████████▋| 36876/37963 [88:27:28<2:16:04,  7.51s/it]
 97%|█████████▋| 36877/37963 [88:27:35<2:15:23,  7.48s/it]
 97%|█████████▋| 36878/37963 [88:27:43<2:15:56,  7.52s/it]
 97%|█████████▋| 36879/37963 [88:27:50<2:15:11,  7.48s/it]
 97%|█████████▋| 36880/37963 [88:27:58<2:15:45,  7.52s/it]
                                                          
{'loss': '0.06938', 'grad_norm': '3.827', 'learning_rate': '4.273e-08', 'epoch': '0.9715'}

 97%|█████████▋| 36880/37963 [88:27:58<2:15:45,  7.52s/it]
 97%|█████████▋| 36881/37963 [88:28:05<2:16:09,  7.55s/it]
 97%|█████████▋| 36882/37963 [88:28:13<2:16:09,  7.56s/it]
 97%|█████████▋| 36883/37963 [88:28:20<2:14:19,  7.46s/it]
 97%|█████████▋| 36884/37963 [88:28:28<2:14:48,  7.50s/it]
 97%|█████████▋| 36885/37963 [88:28:35<2:14:47,  7.50s/it]
 97%|█████████▋| 36886/37963 [88:28:43<2:13:08,  7.42s/it]
 97%|█████████▋| 36887/37963 [88:28:50<2:11:45,  7.35s/it]
 97%|█████████▋| 36888/37963 [88:29:04<2:47:04,  9.32s/it]
 97%|█████████▋| 36889/37963 [88:29:11<2:37:30,  8.80s/it]
 97%|█████████▋| 36890/37963 [88:29:19<2:29:45,  8.37s/it]
                                                          
{'loss': '0.08134', 'grad_norm': '3.34', 'learning_rate': '4.195e-08', 'epoch': '0.9717'}

 97%|█████████▋| 36890/37963 [88:29:19<2:29:45,  8.37s/it]
 97%|█████████▋| 36891/37963 [88:29:26<2:23:51,  8.05s/it]
 97%|█████████▋| 36892/37963 [88:29:40<2:55:58,  9.86s/it]
 97%|█████████▋| 36893/37963 [88:29:47<2:42:56,  9.14s/it]
 97%|█████████▋| 36894/37963 [88:30:01<3:08:31, 10.58s/it]
 97%|█████████▋| 36895/37963 [88:30:09<2:52:34,  9.70s/it]
 97%|█████████▋| 36896/37963 [88:30:23<3:15:49, 11.01s/it]
 97%|█████████▋| 36897/37963 [88:30:31<2:57:01,  9.96s/it]
 97%|█████████▋| 36898/37963 [88:30:38<2:43:52,  9.23s/it]
 97%|█████████▋| 36899/37963 [88:30:46<2:33:57,  8.68s/it]
 97%|█████████▋| 36900/37963 [88:31:06<3:38:15, 12.32s/it]
                                                          
{'loss': '0.07293', 'grad_norm': '3.37', 'learning_rate': '4.117e-08', 'epoch': '0.972'}

 97%|█████████▋| 36900/37963 [88:31:06<3:38:15, 12.32s/it]
 97%|█████████▋| 36901/37963 [88:31:14<3:13:16, 10.92s/it]
 97%|█████████▋| 36902/37963 [88:31:22<2:55:13,  9.91s/it]
 97%|█████████▋| 36903/37963 [88:31:29<2:42:49,  9.22s/it]
 97%|█████████▋| 36904/37963 [88:31:37<2:32:43,  8.65s/it]
 97%|█████████▋| 36905/37963 [88:31:44<2:26:45,  8.32s/it]
 97%|█████████▋| 36906/37963 [88:31:52<2:22:10,  8.07s/it]
 97%|█████████▋| 36907/37963 [88:31:59<2:18:15,  7.86s/it]
 97%|█████████▋| 36908/37963 [88:32:06<2:16:11,  7.75s/it]
 97%|█████████▋| 36909/37963 [88:32:14<2:15:42,  7.73s/it]
 97%|█████████▋| 36910/37963 [88:32:22<2:14:16,  7.65s/it]
                                                          
{'loss': '0.07658', 'grad_norm': '3.175', 'learning_rate': '4.04e-08', 'epoch': '0.9723'}

 97%|█████████▋| 36910/37963 [88:32:22<2:14:16,  7.65s/it]
 97%|█████████▋| 36911/37963 [88:32:29<2:14:21,  7.66s/it]
 97%|█████████▋| 36912/37963 [88:32:37<2:14:28,  7.68s/it]
 97%|█████████▋| 36913/37963 [88:32:44<2:12:33,  7.57s/it]
 97%|█████████▋| 36914/37963 [88:32:52<2:12:20,  7.57s/it]
 97%|█████████▋| 36915/37963 [88:33:05<2:43:29,  9.36s/it]
 97%|█████████▋| 36916/37963 [88:33:13<2:34:42,  8.87s/it]
 97%|█████████▋| 36917/37963 [88:33:21<2:27:11,  8.44s/it]
 97%|█████████▋| 36918/37963 [88:33:28<2:23:09,  8.22s/it]
 97%|█████████▋| 36919/37963 [88:33:36<2:20:07,  8.05s/it]
 97%|█████████▋| 36920/37963 [88:33:43<2:16:12,  7.84s/it]
                                                          
{'loss': '0.07404', 'grad_norm': '3.942', 'learning_rate': '3.964e-08', 'epoch': '0.9725'}

 97%|█████████▋| 36920/37963 [88:33:43<2:16:12,  7.84s/it]
 97%|█████████▋| 36921/37963 [88:33:51<2:14:46,  7.76s/it]
 97%|█████████▋| 36922/37963 [88:33:58<2:12:25,  7.63s/it]
 97%|█████████▋| 36923/37963 [88:34:06<2:11:46,  7.60s/it]
 97%|█████████▋| 36924/37963 [88:34:13<2:11:17,  7.58s/it]
 97%|█████████▋| 36925/37963 [88:34:21<2:11:21,  7.59s/it]
 97%|█████████▋| 36926/37963 [88:34:28<2:10:51,  7.57s/it]
 97%|█████████▋| 36927/37963 [88:34:36<2:09:01,  7.47s/it]
 97%|█████████▋| 36928/37963 [88:34:43<2:09:16,  7.49s/it]
 97%|█████████▋| 36929/37963 [88:34:51<2:09:30,  7.52s/it]
 97%|█████████▋| 36930/37963 [88:34:58<2:09:25,  7.52s/it]
                                                          
{'loss': '0.07882', 'grad_norm': '3.807', 'learning_rate': '3.888e-08', 'epoch': '0.9728'}

 97%|█████████▋| 36930/37963 [88:34:58<2:09:25,  7.52s/it]
 97%|█████████▋| 36931/37963 [88:35:06<2:09:46,  7.54s/it]
 97%|█████████▋| 36932/37963 [88:35:13<2:08:49,  7.50s/it]
 97%|█████████▋| 36933/37963 [88:35:21<2:08:48,  7.50s/it]
 97%|█████████▋| 36934/37963 [88:35:28<2:08:56,  7.52s/it]
 97%|█████████▋| 36935/37963 [88:35:35<2:06:53,  7.41s/it]
 97%|█████████▋| 36936/37963 [88:35:43<2:07:30,  7.45s/it]
 97%|█████████▋| 36937/37963 [88:35:51<2:08:22,  7.51s/it]
 97%|█████████▋| 36938/37963 [88:35:58<2:08:07,  7.50s/it]
 97%|█████████▋| 36939/37963 [88:36:06<2:08:16,  7.52s/it]
 97%|█████████▋| 36940/37963 [88:36:13<2:08:27,  7.53s/it]
                                                          
{'loss': '0.08952', 'grad_norm': '3.194', 'learning_rate': '3.814e-08', 'epoch': '0.9731'}

 97%|█████████▋| 36940/37963 [88:36:13<2:08:27,  7.53s/it]
 97%|█████████▋| 36941/37963 [88:36:21<2:08:59,  7.57s/it]
 97%|█████████▋| 36942/37963 [88:36:35<2:40:39,  9.44s/it]
 97%|█████████▋| 36943/37963 [88:36:48<3:02:26, 10.73s/it]
 97%|█████████▋| 36944/37963 [88:37:02<3:17:45, 11.64s/it]
 97%|█████████▋| 36945/37963 [88:37:16<3:28:01, 12.26s/it]
 97%|█████████▋| 36946/37963 [88:37:24<3:04:17, 10.87s/it]
 97%|█████████▋| 36947/37963 [88:37:31<2:46:32,  9.84s/it]
 97%|█████████▋| 36948/37963 [88:37:52<3:41:06, 13.07s/it]
 97%|█████████▋| 36949/37963 [88:38:06<3:46:32, 13.41s/it]
 97%|█████████▋| 36950/37963 [88:38:13<3:16:14, 11.62s/it]
                                                          
{'loss': '0.09244', 'grad_norm': '3.555', 'learning_rate': '3.739e-08', 'epoch': '0.9733'}

 97%|█████████▋| 36950/37963 [88:38:13<3:16:14, 11.62s/it]
 97%|█████████▋| 36951/37963 [88:38:21<2:55:10, 10.39s/it]
 97%|█████████▋| 36952/37963 [88:38:28<2:40:40,  9.54s/it]
 97%|█████████▋| 36953/37963 [88:38:36<2:30:38,  8.95s/it]
 97%|█████████▋| 36954/37963 [88:38:43<2:23:32,  8.54s/it]
 97%|█████████▋| 36955/37963 [88:38:51<2:18:21,  8.24s/it]
 97%|█████████▋| 36956/37963 [88:38:58<2:13:10,  7.94s/it]
 97%|█████████▋| 36957/37963 [88:39:06<2:11:07,  7.82s/it]
 97%|█████████▋| 36958/37963 [88:39:13<2:08:22,  7.66s/it]
 97%|█████████▋| 36959/37963 [88:39:21<2:07:48,  7.64s/it]
 97%|█████████▋| 36960/37963 [88:39:34<2:38:15,  9.47s/it]
                                                          
{'loss': '0.07997', 'grad_norm': '3.307', 'learning_rate': '3.666e-08', 'epoch': '0.9736'}

 97%|█████████▋| 36960/37963 [88:39:34<2:38:15,  9.47s/it]
 97%|█████████▋| 36961/37963 [88:39:42<2:26:59,  8.80s/it]
 97%|█████████▋| 36962/37963 [88:39:49<2:20:36,  8.43s/it]
 97%|█████████▋| 36963/37963 [88:39:57<2:16:23,  8.18s/it]
 97%|█████████▋| 36964/37963 [88:40:04<2:12:48,  7.98s/it]
 97%|█████████▋| 36965/37963 [88:40:12<2:10:26,  7.84s/it]
 97%|█████████▋| 36966/37963 [88:40:19<2:09:02,  7.77s/it]
 97%|█████████▋| 36967/37963 [88:40:27<2:08:07,  7.72s/it]
 97%|█████████▋| 36968/37963 [88:40:35<2:07:24,  7.68s/it]
 97%|█████████▋| 36969/37963 [88:40:42<2:06:29,  7.64s/it]
 97%|█████████▋| 36970/37963 [88:40:50<2:05:36,  7.59s/it]
                                                          
{'loss': '0.06359', 'grad_norm': '3.719', 'learning_rate': '3.594e-08', 'epoch': '0.9738'}

 97%|█████████▋| 36970/37963 [88:40:50<2:05:36,  7.59s/it]
 97%|█████████▋| 36971/37963 [88:40:57<2:05:21,  7.58s/it]
 97%|█████████▋| 36972/37963 [88:41:05<2:04:04,  7.51s/it]
 97%|█████████▋| 36973/37963 [88:41:12<2:04:04,  7.52s/it]
 97%|█████████▋| 36974/37963 [88:41:20<2:04:01,  7.52s/it]
 97%|█████████▋| 36975/37963 [88:41:27<2:04:22,  7.55s/it]
 97%|█████████▋| 36976/37963 [88:41:35<2:02:58,  7.48s/it]
 97%|█████████▋| 36977/37963 [88:41:42<2:02:17,  7.44s/it]
 97%|█████████▋| 36978/37963 [88:41:49<2:02:30,  7.46s/it]
 97%|█████████▋| 36979/37963 [88:41:57<2:01:35,  7.41s/it]
 97%|█████████▋| 36980/37963 [88:42:04<2:01:57,  7.44s/it]
                                                          
{'loss': '0.08577', 'grad_norm': '3.329', 'learning_rate': '3.522e-08', 'epoch': '0.9741'}

 97%|█████████▋| 36980/37963 [88:42:04<2:01:57,  7.44s/it]
 97%|█████████▋| 36981/37963 [88:42:12<2:01:20,  7.41s/it]
 97%|█████████▋| 36982/37963 [88:42:19<2:01:47,  7.45s/it]
 97%|█████████▋| 36983/37963 [88:42:27<2:02:07,  7.48s/it]
 97%|█████████▋| 36984/37963 [88:42:34<2:02:34,  7.51s/it]
 97%|█████████▋| 36985/37963 [88:42:42<2:02:28,  7.51s/it]
 97%|█████████▋| 36986/37963 [88:42:49<2:02:17,  7.51s/it]
 97%|█████████▋| 36987/37963 [88:42:57<2:01:36,  7.48s/it]
 97%|█████████▋| 36988/37963 [88:43:04<2:01:48,  7.50s/it]
 97%|█████████▋| 36989/37963 [88:43:18<2:32:24,  9.39s/it]
 97%|█████████▋| 36990/37963 [88:43:32<2:54:59, 10.79s/it]
                                                          
{'loss': '0.07685', 'grad_norm': '3.304', 'learning_rate': '3.45e-08', 'epoch': '0.9744'}

 97%|█████████▋| 36990/37963 [88:43:32<2:54:59, 10.79s/it]
 97%|█████████▋| 36991/37963 [88:43:40<2:38:55,  9.81s/it]
 97%|█████████▋| 36992/37963 [88:43:53<2:56:25, 10.90s/it]
 97%|█████████▋| 36993/37963 [88:44:07<3:11:20, 11.84s/it]
 97%|█████████▋| 36994/37963 [88:44:34<4:22:55, 16.28s/it]
 97%|█████████▋| 36995/37963 [88:44:41<3:40:31, 13.67s/it]
 97%|█████████▋| 36996/37963 [88:44:49<3:11:26, 11.88s/it]
 97%|█████████▋| 36997/37963 [88:44:57<2:50:51, 10.61s/it]
 97%|█████████▋| 36998/37963 [88:45:04<2:35:38,  9.68s/it]
 97%|█████████▋| 36999/37963 [88:45:12<2:25:07,  9.03s/it]
 97%|█████████▋| 37000/37963 [88:45:19<2:17:59,  8.60s/it]
                                                          
{'loss': '0.073', 'grad_norm': '2.176', 'learning_rate': '3.38e-08', 'epoch': '0.9746'}

 97%|█████████▋| 37000/37963 [88:45:19<2:17:59,  8.60s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
Writing model shards: 100%|██████████| 1/1 [00:08<00:00,  8.73s/it]
/home/dungpq6/Project/SpatialStack/src/qwen_vl/model/geometry_encoders/vggt_encoder.py:290: FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated. Please use `torch.amp.autocast('cuda', args...)` instead.
  with torch.cuda.amp.autocast(dtype=dtype):

 97%|█████████▋| 37001/37963 [88:46:17<6:14:46, 23.37s/it]
 97%|█████████▋| 37002/37963 [88:46:25<4:58:32, 18.64s/it]
 97%|█████████▋| 37003/37963 [88:46:32<4:03:23, 15.21s/it]
 97%|█████████▋| 37004/37963 [88:46:45<3:55:16, 14.72s/it]
 97%|█████████▋| 37005/37963 [88:46:53<3:20:42, 12.57s/it]
 97%|█████████▋| 37006/37963 [88:47:00<2:56:02, 11.04s/it]
 97%|█████████▋| 37007/37963 [88:47:08<2:38:47,  9.97s/it]
 97%|█████████▋| 37008/37963 [88:47:16<2:27:25,  9.26s/it]
 97%|█████████▋| 37009/37963 [88:47:23<2:19:29,  8.77s/it]
 97%|█████████▋| 37010/37963 [88:47:31<2:13:35,  8.41s/it]
                                                          
{'loss': '0.06716', 'grad_norm': '3.813', 'learning_rate': '3.31e-08', 'epoch': '0.9749'}

 97%|█████████▋| 37010/37963 [88:47:31<2:13:35,  8.41s/it]
 97%|█████████▋| 37011/37963 [88:47:38<2:08:54,  8.12s/it]
 97%|█████████▋| 37012/37963 [88:47:46<2:06:28,  7.98s/it]
 97%|█████████▋| 37013/37963 [88:47:53<2:04:26,  7.86s/it]
 98%|█████████▊| 37014/37963 [88:48:01<2:01:38,  7.69s/it]
 98%|█████████▊| 37015/37963 [88:48:08<2:00:10,  7.61s/it]
 98%|█████████▊| 37016/37963 [88:48:16<1:59:10,  7.55s/it]
 98%|█████████▊| 37017/37963 [88:48:23<1:58:58,  7.55s/it]
 98%|█████████▊| 37018/37963 [88:48:31<1:58:51,  7.55s/it]
 98%|█████████▊| 37019/37963 [88:48:38<1:58:39,  7.54s/it]
 98%|█████████▊| 37020/37963 [88:48:46<1:58:37,  7.55s/it]
                                                          
{'loss': '0.0747', 'grad_norm': '3.333', 'learning_rate': '3.241e-08', 'epoch': '0.9752'}

 98%|█████████▊| 37020/37963 [88:48:46<1:58:37,  7.55s/it]
 98%|█████████▊| 37021/37963 [88:48:53<1:57:53,  7.51s/it]
 98%|█████████▊| 37022/37963 [88:49:01<1:57:49,  7.51s/it]
 98%|█████████▊| 37023/37963 [88:49:08<1:57:51,  7.52s/it]
 98%|█████████▊| 37024/37963 [88:49:16<1:57:40,  7.52s/it]
 98%|█████████▊| 37025/37963 [88:49:23<1:57:23,  7.51s/it]
 98%|█████████▊| 37026/37963 [88:49:31<1:56:28,  7.46s/it]
 98%|█████████▊| 37027/37963 [88:49:38<1:55:38,  7.41s/it]
 98%|█████████▊| 37028/37963 [88:49:45<1:56:00,  7.44s/it]
 98%|█████████▊| 37029/37963 [88:49:53<1:56:27,  7.48s/it]
 98%|█████████▊| 37030/37963 [88:50:00<1:56:04,  7.46s/it]
                                                          
{'loss': '0.07709', 'grad_norm': '4.165', 'learning_rate': '3.173e-08', 'epoch': '0.9754'}

 98%|█████████▊| 37030/37963 [88:50:00<1:56:04,  7.46s/it]
 98%|█████████▊| 37031/37963 [88:50:08<1:56:00,  7.47s/it]
 98%|█████████▊| 37032/37963 [88:50:15<1:56:19,  7.50s/it]
 98%|█████████▊| 37033/37963 [88:50:23<1:56:29,  7.52s/it]
 98%|█████████▊| 37034/37963 [88:50:30<1:55:00,  7.43s/it]
 98%|█████████▊| 37035/37963 [88:50:44<2:24:44,  9.36s/it]
 98%|█████████▊| 37036/37963 [88:50:52<2:16:18,  8.82s/it]
 98%|█████████▊| 37037/37963 [88:50:59<2:09:51,  8.41s/it]
 98%|█████████▊| 37038/37963 [88:51:20<3:05:57, 12.06s/it]
 98%|█████████▊| 37039/37963 [88:51:33<3:12:57, 12.53s/it]
 98%|█████████▊| 37040/37963 [88:51:41<2:49:37, 11.03s/it]
                                                          
{'loss': '0.06657', 'grad_norm': '3.304', 'learning_rate': '3.105e-08', 'epoch': '0.9757'}

 98%|█████████▊| 37040/37963 [88:51:41<2:49:37, 11.03s/it]
 98%|█████████▊| 37041/37963 [88:51:48<2:33:43, 10.00s/it]
 98%|█████████▊| 37042/37963 [88:52:03<2:52:25, 11.23s/it]
 98%|█████████▊| 37043/37963 [88:52:17<3:05:22, 12.09s/it]
 98%|█████████▊| 37044/37963 [88:52:24<2:44:33, 10.74s/it]
 98%|█████████▊| 37045/37963 [88:52:32<2:29:45,  9.79s/it]
 98%|█████████▊| 37046/37963 [88:52:46<2:49:10, 11.07s/it]
 98%|█████████▊| 37047/37963 [88:52:53<2:32:30,  9.99s/it]
 98%|█████████▊| 37048/37963 [88:53:01<2:19:53,  9.17s/it]
 98%|█████████▊| 37049/37963 [88:53:08<2:12:18,  8.69s/it]
 98%|█████████▊| 37050/37963 [88:53:16<2:06:46,  8.33s/it]
                                                          
{'loss': '0.09405', 'grad_norm': '4.051', 'learning_rate': '3.039e-08', 'epoch': '0.976'}

 98%|█████████▊| 37050/37963 [88:53:16<2:06:46,  8.33s/it]
 98%|█████████▊| 37051/37963 [88:53:23<2:02:56,  8.09s/it]
 98%|█████████▊| 37052/37963 [88:53:31<2:00:30,  7.94s/it]
 98%|█████████▊| 37053/37963 [88:53:38<1:58:30,  7.81s/it]
 98%|█████████▊| 37054/37963 [88:53:46<1:57:29,  7.76s/it]
 98%|█████████▊| 37055/37963 [88:53:53<1:56:09,  7.68s/it]
 98%|█████████▊| 37056/37963 [88:54:01<1:55:28,  7.64s/it]
 98%|█████████▊| 37057/37963 [88:54:15<2:24:45,  9.59s/it]
 98%|█████████▊| 37058/37963 [88:54:23<2:15:34,  8.99s/it]
 98%|█████████▊| 37059/37963 [88:54:30<2:08:24,  8.52s/it]
 98%|█████████▊| 37060/37963 [88:54:38<2:03:47,  8.22s/it]
                                                          
{'loss': '0.08669', 'grad_norm': '3.547', 'learning_rate': '2.973e-08', 'epoch': '0.9762'}

 98%|█████████▊| 37060/37963 [88:54:38<2:03:47,  8.22s/it]
 98%|█████████▊| 37061/37963 [88:54:45<1:59:39,  7.96s/it]
 98%|█████████▊| 37062/37963 [88:54:52<1:57:22,  7.82s/it]
 98%|█████████▊| 37063/37963 [88:55:00<1:55:51,  7.72s/it]
 98%|█████████▊| 37064/37963 [88:55:07<1:54:48,  7.66s/it]
 98%|█████████▊| 37065/37963 [88:55:15<1:54:06,  7.62s/it]
 98%|█████████▊| 37066/37963 [88:55:23<1:53:55,  7.62s/it]
 98%|█████████▊| 37067/37963 [88:55:30<1:53:00,  7.57s/it]
 98%|█████████▊| 37068/37963 [88:55:38<1:52:38,  7.55s/it]
 98%|█████████▊| 37069/37963 [88:55:45<1:52:16,  7.54s/it]
 98%|█████████▊| 37070/37963 [88:55:53<1:52:13,  7.54s/it]
                                                          
{'loss': '0.1015', 'grad_norm': '3.616', 'learning_rate': '2.907e-08', 'epoch': '0.9765'}

 98%|█████████▊| 37070/37963 [88:55:53<1:52:13,  7.54s/it]
 98%|█████████▊| 37071/37963 [88:56:00<1:51:58,  7.53s/it]
 98%|█████████▊| 37072/37963 [88:56:07<1:50:41,  7.45s/it]
 98%|█████████▊| 37073/37963 [88:56:15<1:50:54,  7.48s/it]
 98%|█████████▊| 37074/37963 [88:56:22<1:51:07,  7.50s/it]
 98%|█████████▊| 37075/37963 [88:56:30<1:51:08,  7.51s/it]
 98%|█████████▊| 37076/37963 [88:56:37<1:50:49,  7.50s/it]
 98%|█████████▊| 37077/37963 [88:56:45<1:49:37,  7.42s/it]
 98%|█████████▊| 37078/37963 [88:56:52<1:48:50,  7.38s/it]
 98%|█████████▊| 37079/37963 [88:57:00<1:49:39,  7.44s/it]
 98%|█████████▊| 37080/37963 [88:57:07<1:49:11,  7.42s/it]
                                                          
{'loss': '0.07601', 'grad_norm': '2.96', 'learning_rate': '2.843e-08', 'epoch': '0.9767'}

 98%|█████████▊| 37080/37963 [88:57:07<1:49:11,  7.42s/it]
 98%|█████████▊| 37081/37963 [88:57:15<1:49:33,  7.45s/it]
 98%|█████████▊| 37082/37963 [88:57:22<1:49:48,  7.48s/it]
 98%|█████████▊| 37083/37963 [88:57:30<1:50:01,  7.50s/it]
 98%|█████████▊| 37084/37963 [88:57:37<1:50:17,  7.53s/it]
 98%|█████████▊| 37085/37963 [88:57:51<2:19:35,  9.54s/it]
 98%|█████████▊| 37086/37963 [88:57:59<2:10:31,  8.93s/it]
 98%|█████████▊| 37087/37963 [88:58:19<3:00:20, 12.35s/it]
 98%|█████████▊| 37088/37963 [88:58:27<2:39:07, 10.91s/it]
 98%|█████████▊| 37089/37963 [88:58:41<2:51:54, 11.80s/it]
 98%|█████████▊| 37090/37963 [88:58:48<2:32:57, 10.51s/it]
                                                          
{'loss': '0.08202', 'grad_norm': '3.646', 'learning_rate': '2.779e-08', 'epoch': '0.977'}

 98%|█████████▊| 37090/37963 [88:58:48<2:32:57, 10.51s/it]
 98%|█████████▊| 37091/37963 [88:58:56<2:19:59,  9.63s/it]
 98%|█████████▊| 37092/37963 [88:59:03<2:11:19,  9.05s/it]
 98%|█████████▊| 37093/37963 [88:59:24<3:02:04, 12.56s/it]
 98%|█████████▊| 37094/37963 [88:59:32<2:39:58, 11.04s/it]
 98%|█████████▊| 37095/37963 [88:59:39<2:25:24, 10.05s/it]
 98%|█████████▊| 37096/37963 [88:59:53<2:41:43, 11.19s/it]
 98%|█████████▊| 37097/37963 [89:00:01<2:25:25, 10.08s/it]
 98%|█████████▊| 37098/37963 [89:00:08<2:14:20,  9.32s/it]
 98%|█████████▊| 37099/37963 [89:00:16<2:06:56,  8.82s/it]
 98%|█████████▊| 37100/37963 [89:00:23<2:00:47,  8.40s/it]
                                                          
{'loss': '0.0645', 'grad_norm': '2.808', 'learning_rate': '2.715e-08', 'epoch': '0.9773'}

 98%|█████████▊| 37100/37963 [89:00:23<2:00:47,  8.40s/it]
 98%|█████████▊| 37101/37963 [89:00:31<1:56:59,  8.14s/it]
 98%|█████████▊| 37102/37963 [89:00:39<1:54:22,  7.97s/it]
 98%|█████████▊| 37103/37963 [89:00:46<1:52:25,  7.84s/it]
 98%|█████████▊| 37104/37963 [89:00:53<1:48:16,  7.56s/it]
 98%|█████████▊| 37105/37963 [89:01:00<1:47:53,  7.55s/it]
 98%|█████████▊| 37106/37963 [89:01:08<1:47:36,  7.53s/it]
 98%|█████████▊| 37107/37963 [89:01:15<1:46:47,  7.49s/it]
 98%|█████████▊| 37108/37963 [89:01:29<2:13:47,  9.39s/it]
 98%|█████████▊| 37109/37963 [89:01:37<2:05:52,  8.84s/it]
 98%|█████████▊| 37110/37963 [89:01:44<2:00:25,  8.47s/it]
                                                          
{'loss': '0.08578', 'grad_norm': '3.028', 'learning_rate': '2.653e-08', 'epoch': '0.9775'}

 98%|█████████▊| 37110/37963 [89:01:44<2:00:25,  8.47s/it]
 98%|█████████▊| 37111/37963 [89:01:52<1:56:33,  8.21s/it]
 98%|█████████▊| 37112/37963 [89:02:00<1:54:28,  8.07s/it]
 98%|█████████▊| 37113/37963 [89:02:07<1:50:27,  7.80s/it]
 98%|█████████▊| 37114/37963 [89:02:14<1:49:23,  7.73s/it]
 98%|█████████▊| 37115/37963 [89:02:22<1:48:20,  7.67s/it]
 98%|█████████▊| 37116/37963 [89:02:30<1:47:49,  7.64s/it]
 98%|█████████▊| 37117/37963 [89:02:37<1:46:42,  7.57s/it]
 98%|█████████▊| 37118/37963 [89:02:44<1:46:21,  7.55s/it]
 98%|█████████▊| 37119/37963 [89:02:52<1:45:53,  7.53s/it]
 98%|█████████▊| 37120/37963 [89:02:59<1:45:52,  7.54s/it]
                                                          
{'loss': '0.07528', 'grad_norm': '3.496', 'learning_rate': '2.591e-08', 'epoch': '0.9778'}

 98%|█████████▊| 37120/37963 [89:02:59<1:45:52,  7.54s/it]
 98%|█████████▊| 37121/37963 [89:03:07<1:45:39,  7.53s/it]
 98%|█████████▊| 37122/37963 [89:03:15<1:45:31,  7.53s/it]
 98%|█████████▊| 37123/37963 [89:03:22<1:46:15,  7.59s/it]
 98%|█████████▊| 37124/37963 [89:03:30<1:46:09,  7.59s/it]
 98%|█████████▊| 37125/37963 [89:03:37<1:45:57,  7.59s/it]
 98%|█████████▊| 37126/37963 [89:03:45<1:46:03,  7.60s/it]
 98%|█████████▊| 37127/37963 [89:03:53<1:46:14,  7.62s/it]
 98%|█████████▊| 37128/37963 [89:04:00<1:46:08,  7.63s/it]
 98%|█████████▊| 37129/37963 [89:04:08<1:46:09,  7.64s/it]
 98%|█████████▊| 37130/37963 [89:04:16<1:46:14,  7.65s/it]
                                                          
{'loss': '0.08502', 'grad_norm': '3.592', 'learning_rate': '2.53e-08', 'epoch': '0.9781'}

 98%|█████████▊| 37130/37963 [89:04:16<1:46:14,  7.65s/it]
 98%|█████████▊| 37131/37963 [89:04:23<1:45:39,  7.62s/it]
 98%|█████████▊| 37132/37963 [89:04:37<2:11:44,  9.51s/it]
 98%|█████████▊| 37133/37963 [89:04:45<2:03:23,  8.92s/it]
 98%|█████████▊| 37134/37963 [89:04:52<1:56:37,  8.44s/it]
 98%|█████████▊| 37135/37963 [89:05:00<1:52:48,  8.17s/it]
 98%|█████████▊| 37136/37963 [89:05:13<2:16:06,  9.87s/it]
 98%|█████████▊| 37137/37963 [89:05:27<2:32:29, 11.08s/it]
 98%|█████████▊| 37138/37963 [89:05:42<2:45:15, 12.02s/it]
 98%|█████████▊| 37139/37963 [89:05:56<2:53:35, 12.64s/it]
 98%|█████████▊| 37140/37963 [89:06:03<2:32:34, 11.12s/it]
                                                          
{'loss': '0.08198', 'grad_norm': '3.849', 'learning_rate': '2.47e-08', 'epoch': '0.9783'}

 98%|█████████▊| 37140/37963 [89:06:03<2:32:34, 11.12s/it]
 98%|█████████▊| 37141/37963 [89:06:11<2:17:20, 10.02s/it]
 98%|█████████▊| 37142/37963 [89:06:18<2:06:44,  9.26s/it]
 98%|█████████▊| 37143/37963 [89:06:26<1:59:01,  8.71s/it]
 98%|█████████▊| 37144/37963 [89:06:39<2:20:12, 10.27s/it]
 98%|█████████▊| 37145/37963 [89:06:47<2:09:25,  9.49s/it]
 98%|█████████▊| 37146/37963 [89:06:55<2:01:41,  8.94s/it]
 98%|█████████▊| 37147/37963 [89:07:02<1:55:44,  8.51s/it]
 98%|█████████▊| 37148/37963 [89:07:10<1:50:43,  8.15s/it]
 98%|█████████▊| 37149/37963 [89:07:17<1:46:47,  7.87s/it]
 98%|█████████▊| 37150/37963 [89:07:24<1:45:19,  7.77s/it]
                                                          
{'loss': '0.08647', 'grad_norm': '6.313', 'learning_rate': '2.41e-08', 'epoch': '0.9786'}

 98%|█████████▊| 37150/37963 [89:07:24<1:45:19,  7.77s/it]
 98%|█████████▊| 37151/37963 [89:07:32<1:44:18,  7.71s/it]
 98%|█████████▊| 37152/37963 [89:07:39<1:43:27,  7.65s/it]
 98%|█████████▊| 37153/37963 [89:07:47<1:43:20,  7.65s/it]
 98%|█████████▊| 37154/37963 [89:07:55<1:42:46,  7.62s/it]
 98%|█████████▊| 37155/37963 [89:08:02<1:42:21,  7.60s/it]
 98%|█████████▊| 37156/37963 [89:08:10<1:41:49,  7.57s/it]
 98%|█████████▊| 37157/37963 [89:08:17<1:41:04,  7.52s/it]
 98%|█████████▊| 37158/37963 [89:08:25<1:40:47,  7.51s/it]
 98%|█████████▊| 37159/37963 [89:08:32<1:41:42,  7.59s/it]
 98%|█████████▊| 37160/37963 [89:08:40<1:40:17,  7.49s/it]
                                                          
{'loss': '0.0838', 'grad_norm': '3.176', 'learning_rate': '2.352e-08', 'epoch': '0.9789'}

 98%|█████████▊| 37160/37963 [89:08:40<1:40:17,  7.49s/it]
 98%|█████████▊| 37161/37963 [89:08:54<2:06:59,  9.50s/it]
 98%|█████████▊| 37162/37963 [89:09:02<1:59:47,  8.97s/it]
 98%|█████████▊| 37163/37963 [89:09:09<1:53:46,  8.53s/it]
 98%|█████████▊| 37164/37963 [89:09:17<1:49:18,  8.21s/it]
 98%|█████████▊| 37165/37963 [89:09:24<1:46:45,  8.03s/it]
 98%|█████████▊| 37166/37963 [89:09:32<1:44:50,  7.89s/it]
 98%|█████████▊| 37167/37963 [89:09:39<1:43:05,  7.77s/it]
 98%|█████████▊| 37168/37963 [89:09:47<1:42:30,  7.74s/it]
 98%|█████████▊| 37169/37963 [89:09:55<1:42:00,  7.71s/it]
 98%|█████████▊| 37170/37963 [89:10:02<1:41:21,  7.67s/it]
                                                          
{'loss': '0.08169', 'grad_norm': '3.745', 'learning_rate': '2.293e-08', 'epoch': '0.9791'}

 98%|█████████▊| 37170/37963 [89:10:02<1:41:21,  7.67s/it]
 98%|█████████▊| 37171/37963 [89:10:10<1:40:52,  7.64s/it]
 98%|█████████▊| 37172/37963 [89:10:17<1:40:26,  7.62s/it]
 98%|█████████▊| 37173/37963 [89:10:25<1:40:30,  7.63s/it]
 98%|█████████▊| 37174/37963 [89:10:32<1:39:35,  7.57s/it]
 98%|█████████▊| 37175/37963 [89:10:40<1:39:07,  7.55s/it]
 98%|█████████▊| 37176/37963 [89:10:47<1:37:54,  7.46s/it]
 98%|█████████▊| 37177/37963 [89:10:55<1:38:20,  7.51s/it]
 98%|█████████▊| 37178/37963 [89:11:02<1:38:24,  7.52s/it]
 98%|█████████▊| 37179/37963 [89:11:16<2:02:51,  9.40s/it]
 98%|█████████▊| 37180/37963 [89:11:24<1:55:13,  8.83s/it]
                                                          
{'loss': '0.06524', 'grad_norm': '3.82', 'learning_rate': '2.236e-08', 'epoch': '0.9794'}

 98%|█████████▊| 37180/37963 [89:11:24<1:55:13,  8.83s/it]
 98%|█████████▊| 37181/37963 [89:11:37<2:15:04, 10.36s/it]
 98%|█████████▊| 37182/37963 [89:11:45<2:05:22,  9.63s/it]
 98%|█████████▊| 37183/37963 [89:11:59<2:21:38, 10.90s/it]
 98%|█████████▊| 37184/37963 [89:12:07<2:08:48,  9.92s/it]
 98%|█████████▊| 37185/37963 [89:12:14<1:59:27,  9.21s/it]
 98%|█████████▊| 37186/37963 [89:12:29<2:18:27, 10.69s/it]
 98%|█████████▊| 37187/37963 [89:12:43<2:31:20, 11.70s/it]
 98%|█████████▊| 37188/37963 [89:12:50<2:15:23, 10.48s/it]
 98%|█████████▊| 37189/37963 [89:13:04<2:28:07, 11.48s/it]
 98%|█████████▊| 37190/37963 [89:13:11<2:11:53, 10.24s/it]
                                                          
{'loss': '0.08161', 'grad_norm': '3.167', 'learning_rate': '2.179e-08', 'epoch': '0.9796'}

 98%|█████████▊| 37190/37963 [89:13:11<2:11:53, 10.24s/it]
 98%|█████████▊| 37191/37963 [89:13:19<2:01:01,  9.41s/it]
 98%|█████████▊| 37192/37963 [89:13:26<1:52:59,  8.79s/it]
 98%|█████████▊| 37193/37963 [89:13:34<1:48:02,  8.42s/it]
 98%|█████████▊| 37194/37963 [89:13:41<1:43:49,  8.10s/it]
 98%|█████████▊| 37195/37963 [89:13:49<1:41:36,  7.94s/it]
 98%|█████████▊| 37196/37963 [89:13:56<1:39:44,  7.80s/it]
 98%|█████████▊| 37197/37963 [89:14:10<2:01:39,  9.53s/it]
 98%|█████████▊| 37198/37963 [89:14:17<1:54:13,  8.96s/it]
 98%|█████████▊| 37199/37963 [89:14:25<1:48:59,  8.56s/it]
 98%|█████████▊| 37200/37963 [89:14:33<1:46:00,  8.34s/it]
                                                          
{'loss': '0.07711', 'grad_norm': '3.546', 'learning_rate': '2.123e-08', 'epoch': '0.9799'}

 98%|█████████▊| 37200/37963 [89:14:33<1:46:00,  8.34s/it]
 98%|█████████▊| 37201/37963 [89:14:40<1:42:50,  8.10s/it]
 98%|█████████▊| 37202/37963 [89:14:48<1:40:42,  7.94s/it]
 98%|█████████▊| 37203/37963 [89:14:55<1:38:53,  7.81s/it]
 98%|█████████▊| 37204/37963 [89:15:03<1:37:58,  7.75s/it]
 98%|█████████▊| 37205/37963 [89:15:11<1:36:50,  7.67s/it]
 98%|█████████▊| 37206/37963 [89:15:18<1:35:47,  7.59s/it]
 98%|█████████▊| 37207/37963 [89:15:26<1:35:59,  7.62s/it]
 98%|█████████▊| 37208/37963 [89:15:33<1:35:52,  7.62s/it]
 98%|█████████▊| 37209/37963 [89:15:41<1:36:00,  7.64s/it]
 98%|█████████▊| 37210/37963 [89:15:49<1:35:57,  7.65s/it]
                                                          
{'loss': '0.07528', 'grad_norm': '2.876', 'learning_rate': '2.068e-08', 'epoch': '0.9802'}

 98%|█████████▊| 37210/37963 [89:15:49<1:35:57,  7.65s/it]
 98%|█████████▊| 37211/37963 [89:15:56<1:35:37,  7.63s/it]
 98%|█████████▊| 37212/37963 [89:16:04<1:34:17,  7.53s/it]
 98%|█████████▊| 37213/37963 [89:16:11<1:34:21,  7.55s/it]
 98%|█████████▊| 37214/37963 [89:16:25<1:58:19,  9.48s/it]
 98%|█████████▊| 37215/37963 [89:16:33<1:50:37,  8.87s/it]
 98%|█████████▊| 37216/37963 [89:16:40<1:44:30,  8.39s/it]
 98%|█████████▊| 37217/37963 [89:16:47<1:40:36,  8.09s/it]
 98%|█████████▊| 37218/37963 [89:16:55<1:38:36,  7.94s/it]
 98%|█████████▊| 37219/37963 [89:17:02<1:37:16,  7.84s/it]
 98%|█████████▊| 37220/37963 [89:17:10<1:36:04,  7.76s/it]
                                                          
{'loss': '0.07721', 'grad_norm': '5.146', 'learning_rate': '2.014e-08', 'epoch': '0.9804'}

 98%|█████████▊| 37220/37963 [89:17:10<1:36:04,  7.76s/it]
 98%|█████████▊| 37221/37963 [89:17:17<1:35:03,  7.69s/it]
 98%|█████████▊| 37222/37963 [89:17:25<1:34:30,  7.65s/it]
 98%|█████████▊| 37223/37963 [89:17:33<1:34:41,  7.68s/it]
 98%|█████████▊| 37224/37963 [89:17:40<1:32:11,  7.49s/it]
 98%|█████████▊| 37225/37963 [89:17:47<1:32:41,  7.54s/it]
 98%|█████████▊| 37226/37963 [89:18:02<1:56:28,  9.48s/it]
 98%|█████████▊| 37227/37963 [89:18:09<1:49:20,  8.91s/it]
 98%|█████████▊| 37228/37963 [89:18:30<2:31:46, 12.39s/it]
 98%|█████████▊| 37229/37963 [89:18:37<2:13:38, 10.92s/it]
 98%|█████████▊| 37230/37963 [89:18:45<2:00:54,  9.90s/it]
                                                          
{'loss': '0.07621', 'grad_norm': '2.98', 'learning_rate': '1.96e-08', 'epoch': '0.9807'}

 98%|█████████▊| 37230/37963 [89:18:45<2:00:54,  9.90s/it]
 98%|█████████▊| 37231/37963 [89:18:52<1:51:07,  9.11s/it]
 98%|█████████▊| 37232/37963 [89:18:59<1:43:42,  8.51s/it]
 98%|█████████▊| 37233/37963 [89:19:07<1:40:01,  8.22s/it]
 98%|█████████▊| 37234/37963 [89:19:14<1:37:25,  8.02s/it]
 98%|█████████▊| 37235/37963 [89:19:35<2:23:17, 11.81s/it]
 98%|█████████▊| 37236/37963 [89:19:42<2:07:49, 10.55s/it]
 98%|█████████▊| 37237/37963 [89:19:56<2:20:02, 11.57s/it]
 98%|█████████▊| 37238/37963 [89:20:04<2:05:03, 10.35s/it]
 98%|█████████▊| 37239/37963 [89:20:11<1:55:12,  9.55s/it]
 98%|█████████▊| 37240/37963 [89:20:19<1:47:25,  8.91s/it]
                                                          
{'loss': '0.07584', 'grad_norm': '3.856', 'learning_rate': '1.907e-08', 'epoch': '0.981'}

 98%|█████████▊| 37240/37963 [89:20:19<1:47:25,  8.91s/it]
 98%|█████████▊| 37241/37963 [89:20:26<1:42:10,  8.49s/it]
 98%|█████████▊| 37242/37963 [89:20:34<1:38:50,  8.23s/it]
 98%|█████████▊| 37243/37963 [89:20:42<1:36:22,  8.03s/it]
 98%|█████████▊| 37244/37963 [89:20:49<1:33:26,  7.80s/it]
 98%|█████████▊| 37245/37963 [89:20:56<1:31:28,  7.64s/it]
 98%|█████████▊| 37246/37963 [89:21:04<1:30:55,  7.61s/it]
 98%|█████████▊| 37247/37963 [89:21:18<1:53:18,  9.49s/it]
 98%|█████████▊| 37248/37963 [89:21:25<1:45:21,  8.84s/it]
 98%|█████████▊| 37249/37963 [89:21:32<1:40:43,  8.46s/it]
 98%|█████████▊| 37250/37963 [89:21:40<1:37:03,  8.17s/it]
                                                          
{'loss': '0.07919', 'grad_norm': '2.392', 'learning_rate': '1.855e-08', 'epoch': '0.9812'}

 98%|█████████▊| 37250/37963 [89:21:40<1:37:03,  8.17s/it]
 98%|█████████▊| 37251/37963 [89:21:48<1:34:50,  7.99s/it]
 98%|█████████▊| 37252/37963 [89:21:55<1:32:27,  7.80s/it]
 98%|█████████▊| 37253/37963 [89:22:02<1:31:05,  7.70s/it]
 98%|█████████▊| 37254/37963 [89:22:10<1:29:28,  7.57s/it]
 98%|█████████▊| 37255/37963 [89:22:17<1:29:41,  7.60s/it]
 98%|█████████▊| 37256/37963 [89:22:25<1:29:10,  7.57s/it]
 98%|█████████▊| 37257/37963 [89:22:32<1:28:47,  7.55s/it]
 98%|█████████▊| 37258/37963 [89:22:40<1:29:09,  7.59s/it]
 98%|█████████▊| 37259/37963 [89:22:54<1:51:08,  9.47s/it]
 98%|█████████▊| 37260/37963 [89:23:01<1:44:02,  8.88s/it]
                                                          
{'loss': '0.08814', 'grad_norm': '4.404', 'learning_rate': '1.803e-08', 'epoch': '0.9815'}

 98%|█████████▊| 37260/37963 [89:23:01<1:44:02,  8.88s/it]
 98%|█████████▊| 37261/37963 [89:23:09<1:39:10,  8.48s/it]
 98%|█████████▊| 37262/37963 [89:23:16<1:35:48,  8.20s/it]
 98%|█████████▊| 37263/37963 [89:23:24<1:33:19,  8.00s/it]
 98%|█████████▊| 37264/37963 [89:23:32<1:31:37,  7.86s/it]
 98%|█████████▊| 37265/37963 [89:23:39<1:30:09,  7.75s/it]
 98%|█████████▊| 37266/37963 [89:23:47<1:29:20,  7.69s/it]
 98%|█████████▊| 37267/37963 [89:23:54<1:28:39,  7.64s/it]
 98%|█████████▊| 37268/37963 [89:24:02<1:27:50,  7.58s/it]
 98%|█████████▊| 37269/37963 [89:24:09<1:27:54,  7.60s/it]
 98%|█████████▊| 37270/37963 [89:24:17<1:27:58,  7.62s/it]
                                                          
{'loss': '0.07985', 'grad_norm': '2.632', 'learning_rate': '1.752e-08', 'epoch': '0.9817'}

 98%|█████████▊| 37270/37963 [89:24:17<1:27:58,  7.62s/it]
 98%|█████████▊| 37271/37963 [89:24:24<1:27:17,  7.57s/it]
 98%|█████████▊| 37272/37963 [89:24:32<1:26:39,  7.52s/it]
 98%|█████████▊| 37273/37963 [89:24:39<1:26:43,  7.54s/it]
 98%|█████████▊| 37274/37963 [89:24:47<1:26:21,  7.52s/it]
 98%|█████████▊| 37275/37963 [89:25:01<1:48:35,  9.47s/it]
 98%|█████████▊| 37276/37963 [89:25:08<1:42:28,  8.95s/it]
 98%|█████████▊| 37277/37963 [89:25:16<1:36:56,  8.48s/it]
 98%|█████████▊| 37278/37963 [89:25:23<1:33:39,  8.20s/it]
 98%|█████████▊| 37279/37963 [89:25:31<1:31:12,  8.00s/it]
 98%|█████████▊| 37280/37963 [89:25:45<1:51:50,  9.83s/it]
                                                          
{'loss': '0.09049', 'grad_norm': '4.001', 'learning_rate': '1.702e-08', 'epoch': '0.982'}

 98%|█████████▊| 37280/37963 [89:25:45<1:51:50,  9.83s/it]
 98%|█████████▊| 37281/37963 [89:25:52<1:43:03,  9.07s/it]
 98%|█████████▊| 37282/37963 [89:26:06<1:59:32, 10.53s/it]
 98%|█████████▊| 37283/37963 [89:26:20<2:09:30, 11.43s/it]
 98%|█████████▊| 37284/37963 [89:26:27<1:55:43, 10.23s/it]
 98%|█████████▊| 37285/37963 [89:26:35<1:46:37,  9.44s/it]
 98%|█████████▊| 37286/37963 [89:26:42<1:40:09,  8.88s/it]
 98%|█████████▊| 37287/37963 [89:27:03<2:19:13, 12.36s/it]
 98%|█████████▊| 37288/37963 [89:27:10<2:02:04, 10.85s/it]
 98%|█████████▊| 37289/37963 [89:27:18<1:50:52,  9.87s/it]
 98%|█████████▊| 37290/37963 [89:27:25<1:43:08,  9.19s/it]
                                                          
{'loss': '0.07974', 'grad_norm': '3.675', 'learning_rate': '1.653e-08', 'epoch': '0.9823'}

 98%|█████████▊| 37290/37963 [89:27:25<1:43:08,  9.19s/it]
 98%|█████████▊| 37291/37963 [89:27:33<1:37:42,  8.72s/it]
 98%|█████████▊| 37292/37963 [89:27:47<1:55:17, 10.31s/it]
 98%|█████████▊| 37293/37963 [89:27:54<1:45:28,  9.45s/it]
 98%|█████████▊| 37294/37963 [89:28:02<1:39:03,  8.88s/it]
 98%|█████████▊| 37295/37963 [89:28:10<1:34:42,  8.51s/it]
 98%|█████████▊| 37296/37963 [89:28:17<1:31:19,  8.22s/it]
 98%|█████████▊| 37297/37963 [89:28:25<1:28:14,  7.95s/it]
 98%|█████████▊| 37298/37963 [89:28:32<1:26:51,  7.84s/it]
 98%|█████████▊| 37299/37963 [89:28:40<1:25:48,  7.75s/it]
 98%|█████████▊| 37300/37963 [89:28:47<1:24:56,  7.69s/it]
                                                          
{'loss': '0.07941', 'grad_norm': '2.425', 'learning_rate': '1.604e-08', 'epoch': '0.9825'}

 98%|█████████▊| 37300/37963 [89:28:47<1:24:56,  7.69s/it]
 98%|█████████▊| 37301/37963 [89:28:55<1:24:23,  7.65s/it]
 98%|█████████▊| 37302/37963 [89:29:02<1:23:15,  7.56s/it]
 98%|█████████▊| 37303/37963 [89:29:16<1:43:53,  9.44s/it]
 98%|█████████▊| 37304/37963 [89:29:23<1:37:12,  8.85s/it]
 98%|█████████▊| 37305/37963 [89:29:31<1:32:31,  8.44s/it]
 98%|█████████▊| 37306/37963 [89:29:38<1:28:46,  8.11s/it]
 98%|█████████▊| 37307/37963 [89:29:46<1:27:08,  7.97s/it]
 98%|█████████▊| 37308/37963 [89:29:53<1:25:32,  7.84s/it]
 98%|█████████▊| 37309/37963 [89:30:01<1:24:19,  7.74s/it]
 98%|█████████▊| 37310/37963 [89:30:09<1:24:23,  7.75s/it]
                                                          
{'loss': '0.07474', 'grad_norm': '3.453', 'learning_rate': '1.556e-08', 'epoch': '0.9828'}

 98%|█████████▊| 37310/37963 [89:30:09<1:24:23,  7.75s/it]
 98%|█████████▊| 37311/37963 [89:30:16<1:22:58,  7.63s/it]
 98%|█████████▊| 37312/37963 [89:30:24<1:22:12,  7.58s/it]
 98%|█████████▊| 37313/37963 [89:30:31<1:21:57,  7.57s/it]
 98%|█████████▊| 37314/37963 [89:30:39<1:22:04,  7.59s/it]
 98%|█████████▊| 37315/37963 [89:30:46<1:21:54,  7.58s/it]
 98%|█████████▊| 37316/37963 [89:30:54<1:21:03,  7.52s/it]
 98%|█████████▊| 37317/37963 [89:31:01<1:21:12,  7.54s/it]
 98%|█████████▊| 37318/37963 [89:31:09<1:20:26,  7.48s/it]
 98%|█████████▊| 37319/37963 [89:31:16<1:20:26,  7.50s/it]
 98%|█████████▊| 37320/37963 [89:31:24<1:20:26,  7.51s/it]
                                                          
{'loss': '0.08623', 'grad_norm': '3.35', 'learning_rate': '1.509e-08', 'epoch': '0.9831'}

 98%|█████████▊| 37320/37963 [89:31:24<1:20:26,  7.51s/it]
 98%|█████████▊| 37321/37963 [89:31:31<1:20:01,  7.48s/it]
 98%|█████████▊| 37322/37963 [89:31:39<1:20:37,  7.55s/it]
 98%|█████████▊| 37323/37963 [89:31:53<1:41:35,  9.52s/it]
 98%|█████████▊| 37324/37963 [89:32:00<1:35:04,  8.93s/it]
 98%|█████████▊| 37325/37963 [89:32:08<1:30:48,  8.54s/it]
 98%|█████████▊| 37326/37963 [89:32:22<1:48:27, 10.22s/it]
 98%|█████████▊| 37327/37963 [89:32:30<1:40:45,  9.51s/it]
 98%|█████████▊| 37328/37963 [89:32:38<1:34:19,  8.91s/it]
 98%|█████████▊| 37329/37963 [89:32:52<1:50:17, 10.44s/it]
 98%|█████████▊| 37330/37963 [89:32:59<1:41:09,  9.59s/it]
                                                          
{'loss': '0.07761', 'grad_norm': '3.767', 'learning_rate': '1.462e-08', 'epoch': '0.9833'}

 98%|█████████▊| 37330/37963 [89:32:59<1:41:09,  9.59s/it]
 98%|█████████▊| 37331/37963 [89:33:07<1:34:11,  8.94s/it]
 98%|█████████▊| 37332/37963 [89:33:20<1:49:16, 10.39s/it]
 98%|█████████▊| 37333/37963 [89:33:28<1:39:57,  9.52s/it]
 98%|█████████▊| 37334/37963 [89:33:42<1:53:42, 10.85s/it]
 98%|█████████▊| 37335/37963 [89:33:49<1:43:17,  9.87s/it]
 98%|█████████▊| 37336/37963 [89:34:03<1:55:59, 11.10s/it]
 98%|█████████▊| 37337/37963 [89:34:11<1:45:06, 10.07s/it]
 98%|█████████▊| 37338/37963 [89:34:19<1:37:02,  9.32s/it]
 98%|█████████▊| 37339/37963 [89:34:26<1:31:25,  8.79s/it]
 98%|█████████▊| 37340/37963 [89:34:40<1:47:34, 10.36s/it]
                                                          
{'loss': '0.06715', 'grad_norm': '2.579', 'learning_rate': '1.417e-08', 'epoch': '0.9836'}

 98%|█████████▊| 37340/37963 [89:34:40<1:47:34, 10.36s/it]
 98%|█████████▊| 37341/37963 [89:34:48<1:38:24,  9.49s/it]
 98%|█████████▊| 37342/37963 [89:34:55<1:31:17,  8.82s/it]
 98%|█████████▊| 37343/37963 [89:35:03<1:27:29,  8.47s/it]
 98%|█████████▊| 37344/37963 [89:35:10<1:25:05,  8.25s/it]
 98%|█████████▊| 37345/37963 [89:35:18<1:23:25,  8.10s/it]
 98%|█████████▊| 37346/37963 [89:35:25<1:21:12,  7.90s/it]
 98%|█████████▊| 37347/37963 [89:35:33<1:20:29,  7.84s/it]
 98%|█████████▊| 37348/37963 [89:35:41<1:19:40,  7.77s/it]
 98%|█████████▊| 37349/37963 [89:35:48<1:18:45,  7.70s/it]
 98%|█████████▊| 37350/37963 [89:35:56<1:18:12,  7.65s/it]
                                                          
{'loss': '0.08106', 'grad_norm': '2.898', 'learning_rate': '1.372e-08', 'epoch': '0.9839'}

 98%|█████████▊| 37350/37963 [89:35:56<1:18:12,  7.65s/it]
 98%|█████████▊| 37351/37963 [89:36:10<1:37:48,  9.59s/it]
 98%|█████████▊| 37352/37963 [89:36:17<1:31:20,  8.97s/it]
 98%|█████████▊| 37353/37963 [89:36:25<1:26:09,  8.47s/it]
 98%|█████████▊| 37354/37963 [89:36:33<1:23:42,  8.25s/it]
 98%|█████████▊| 37355/37963 [89:36:40<1:21:39,  8.06s/it]
 98%|█████████▊| 37356/37963 [89:36:48<1:19:52,  7.89s/it]
 98%|█████████▊| 37357/37963 [89:36:55<1:19:27,  7.87s/it]
 98%|█████████▊| 37358/37963 [89:37:03<1:17:19,  7.67s/it]
 98%|█████████▊| 37359/37963 [89:37:10<1:16:43,  7.62s/it]
 98%|█████████▊| 37360/37963 [89:37:18<1:16:02,  7.57s/it]
                                                          
{'loss': '0.07536', 'grad_norm': '3.289', 'learning_rate': '1.327e-08', 'epoch': '0.9841'}

 98%|█████████▊| 37360/37963 [89:37:18<1:16:02,  7.57s/it]
 98%|█████████▊| 37361/37963 [89:37:25<1:15:49,  7.56s/it]
 98%|█████████▊| 37362/37963 [89:37:33<1:15:37,  7.55s/it]
 98%|█████████▊| 37363/37963 [89:37:40<1:15:34,  7.56s/it]
 98%|█████████▊| 37364/37963 [89:37:48<1:15:26,  7.56s/it]
 98%|█████████▊| 37365/37963 [89:37:55<1:15:17,  7.55s/it]
 98%|█████████▊| 37366/37963 [89:38:03<1:15:37,  7.60s/it]
 98%|█████████▊| 37367/37963 [89:38:10<1:14:34,  7.51s/it]
 98%|█████████▊| 37368/37963 [89:38:18<1:15:11,  7.58s/it]
 98%|█████████▊| 37369/37963 [89:38:32<1:34:22,  9.53s/it]
 98%|█████████▊| 37370/37963 [89:38:40<1:28:33,  8.96s/it]
                                                          
{'loss': '0.07019', 'grad_norm': '3.153', 'learning_rate': '1.284e-08', 'epoch': '0.9844'}

 98%|█████████▊| 37370/37963 [89:38:40<1:28:33,  8.96s/it]
 98%|█████████▊| 37371/37963 [89:38:47<1:24:12,  8.53s/it]
 98%|█████████▊| 37372/37963 [89:39:01<1:39:20, 10.08s/it]
 98%|█████████▊| 37373/37963 [89:39:09<1:31:31,  9.31s/it]
 98%|█████████▊| 37374/37963 [89:39:16<1:26:07,  8.77s/it]
 98%|█████████▊| 37375/37963 [89:39:24<1:22:36,  8.43s/it]
 98%|█████████▊| 37376/37963 [89:39:31<1:19:54,  8.17s/it]
 98%|█████████▊| 37377/37963 [89:39:39<1:17:58,  7.98s/it]
 98%|█████████▊| 37378/37963 [89:39:53<1:34:58,  9.74s/it]
 98%|█████████▊| 37379/37963 [89:40:00<1:28:23,  9.08s/it]
 98%|█████████▊| 37380/37963 [89:40:14<1:42:22, 10.54s/it]
                                                          
{'loss': '0.07575', 'grad_norm': '3.066', 'learning_rate': '1.241e-08', 'epoch': '0.9846'}

 98%|█████████▊| 37380/37963 [89:40:14<1:42:22, 10.54s/it]
 98%|█████████▊| 37381/37963 [89:40:28<1:52:12, 11.57s/it]
 98%|█████████▊| 37382/37963 [89:40:36<1:40:08, 10.34s/it]
 98%|█████████▊| 37383/37963 [89:40:43<1:31:59,  9.52s/it]
 98%|█████████▊| 37384/37963 [89:40:51<1:25:57,  8.91s/it]
 98%|█████████▊| 37385/37963 [89:40:58<1:21:45,  8.49s/it]
 98%|█████████▊| 37386/37963 [89:41:12<1:37:21, 10.12s/it]
 98%|█████████▊| 37387/37963 [89:41:20<1:29:41,  9.34s/it]
 98%|█████████▊| 37388/37963 [89:41:27<1:24:42,  8.84s/it]
 98%|█████████▊| 37389/37963 [89:41:35<1:21:10,  8.48s/it]
 98%|█████████▊| 37390/37963 [89:41:42<1:17:45,  8.14s/it]
                                                          
{'loss': '0.08591', 'grad_norm': '3.669', 'learning_rate': '1.199e-08', 'epoch': '0.9849'}

 98%|█████████▊| 37390/37963 [89:41:42<1:17:45,  8.14s/it]
 98%|█████████▊| 37391/37963 [89:41:50<1:16:11,  7.99s/it]
 98%|█████████▊| 37392/37963 [89:41:57<1:13:47,  7.75s/it]
 98%|█████████▊| 37393/37963 [89:42:05<1:13:05,  7.69s/it]
 99%|█████████▊| 37394/37963 [89:42:19<1:31:07,  9.61s/it]
 99%|█████████▊| 37395/37963 [89:42:26<1:25:21,  9.02s/it]
 99%|█████████▊| 37396/37963 [89:42:34<1:21:17,  8.60s/it]
 99%|█████████▊| 37397/37963 [89:42:42<1:18:04,  8.28s/it]
 99%|█████████▊| 37398/37963 [89:42:49<1:15:33,  8.02s/it]
 99%|█████████▊| 37399/37963 [89:42:56<1:13:19,  7.80s/it]
 99%|█████████▊| 37400/37963 [89:43:10<1:31:06,  9.71s/it]
                                                          
{'loss': '0.0882', 'grad_norm': '3.75', 'learning_rate': '1.157e-08', 'epoch': '0.9852'}

 99%|█████████▊| 37400/37963 [89:43:10<1:31:06,  9.71s/it]
 99%|█████████▊| 37401/37963 [89:43:18<1:24:47,  9.05s/it]
 99%|█████████▊| 37402/37963 [89:43:25<1:20:06,  8.57s/it]
 99%|█████████▊| 37403/37963 [89:43:33<1:16:49,  8.23s/it]
 99%|█████████▊| 37404/37963 [89:43:40<1:14:33,  8.00s/it]
 99%|█████████▊| 37405/37963 [89:43:48<1:12:51,  7.83s/it]
 99%|█████████▊| 37406/37963 [89:43:55<1:11:57,  7.75s/it]
 99%|█████████▊| 37407/37963 [89:44:03<1:10:58,  7.66s/it]
 99%|█████████▊| 37408/37963 [89:44:10<1:10:40,  7.64s/it]
 99%|█████████▊| 37409/37963 [89:44:18<1:10:14,  7.61s/it]
 99%|█████████▊| 37410/37963 [89:44:25<1:09:56,  7.59s/it]
                                                          
{'loss': '0.07559', 'grad_norm': '3.149', 'learning_rate': '1.117e-08', 'epoch': '0.9854'}

 99%|█████████▊| 37410/37963 [89:44:25<1:09:56,  7.59s/it]
 99%|█████████▊| 37411/37963 [89:44:33<1:09:38,  7.57s/it]
 99%|█████████▊| 37412/37963 [89:44:40<1:08:55,  7.51s/it]
 99%|█████████▊| 37413/37963 [89:44:48<1:09:04,  7.54s/it]
 99%|█████████▊| 37414/37963 [89:44:55<1:09:01,  7.54s/it]
 99%|█████████▊| 37415/37963 [89:45:03<1:08:33,  7.51s/it]
 99%|█████████▊| 37416/37963 [89:45:10<1:08:44,  7.54s/it]
 99%|█████████▊| 37417/37963 [89:45:18<1:08:38,  7.54s/it]
 99%|█████████▊| 37418/37963 [89:45:26<1:08:38,  7.56s/it]
 99%|█████████▊| 37419/37963 [89:45:46<1:43:04, 11.37s/it]
 99%|█████████▊| 37420/37963 [89:45:53<1:31:41, 10.13s/it]
                                                          
{'loss': '0.07819', 'grad_norm': '3.208', 'learning_rate': '1.077e-08', 'epoch': '0.9857'}

 99%|█████████▊| 37420/37963 [89:45:53<1:31:41, 10.13s/it]
 99%|█████████▊| 37421/37963 [89:46:01<1:24:34,  9.36s/it]
 99%|█████████▊| 37422/37963 [89:46:08<1:19:43,  8.84s/it]
 99%|█████████▊| 37423/37963 [89:46:16<1:16:20,  8.48s/it]
 99%|█████████▊| 37424/37963 [89:46:30<1:30:55, 10.12s/it]
 99%|█████████▊| 37425/37963 [89:46:37<1:23:53,  9.36s/it]
 99%|█████████▊| 37426/37963 [89:46:52<1:36:49, 10.82s/it]
 99%|█████████▊| 37427/37963 [89:46:59<1:27:22,  9.78s/it]
 99%|█████████▊| 37428/37963 [89:47:12<1:36:48, 10.86s/it]
 99%|█████████▊| 37429/37963 [89:47:20<1:27:50,  9.87s/it]
 99%|█████████▊| 37430/37963 [89:47:28<1:21:29,  9.17s/it]
                                                          
{'loss': '0.0714', 'grad_norm': '3.694', 'learning_rate': '1.038e-08', 'epoch': '0.986'}

 99%|█████████▊| 37430/37963 [89:47:28<1:21:29,  9.17s/it]
 99%|█████████▊| 37431/37963 [89:47:35<1:16:56,  8.68s/it]
 99%|█████████▊| 37432/37963 [89:47:43<1:14:08,  8.38s/it]
 99%|█████████▊| 37433/37963 [89:47:50<1:11:04,  8.05s/it]
 99%|█████████▊| 37434/37963 [89:47:58<1:09:44,  7.91s/it]
 99%|█████████▊| 37435/37963 [89:48:05<1:08:34,  7.79s/it]
 99%|█████████▊| 37436/37963 [89:48:13<1:08:01,  7.75s/it]
 99%|█████████▊| 37437/37963 [89:48:27<1:25:00,  9.70s/it]
 99%|█████████▊| 37438/37963 [89:48:34<1:18:52,  9.01s/it]
 99%|█████████▊| 37439/37963 [89:48:42<1:14:54,  8.58s/it]
 99%|█████████▊| 37440/37963 [89:48:49<1:11:50,  8.24s/it]
                                                          
{'loss': '0.07837', 'grad_norm': '5.059', 'learning_rate': '9.991e-09', 'epoch': '0.9862'}

 99%|█████████▊| 37440/37963 [89:48:49<1:11:50,  8.24s/it]
 99%|█████████▊| 37441/37963 [89:48:57<1:09:58,  8.04s/it]
 99%|█████████▊| 37442/37963 [89:49:05<1:08:30,  7.89s/it]
 99%|█████████▊| 37443/37963 [89:49:19<1:24:12,  9.72s/it]
 99%|█████████▊| 37444/37963 [89:49:26<1:18:29,  9.07s/it]
 99%|█████████▊| 37445/37963 [89:49:34<1:14:37,  8.64s/it]
 99%|█████████▊| 37446/37963 [89:49:41<1:11:34,  8.31s/it]
 99%|█████████▊| 37447/37963 [89:49:49<1:08:59,  8.02s/it]
 99%|█████████▊| 37448/37963 [89:50:03<1:25:00,  9.90s/it]
 99%|█████████▊| 37449/37963 [89:50:11<1:18:58,  9.22s/it]
 99%|█████████▊| 37450/37963 [89:50:18<1:14:28,  8.71s/it]
                                                          
{'loss': '0.08149', 'grad_norm': '3.422', 'learning_rate': '9.613e-09', 'epoch': '0.9865'}

 99%|█████████▊| 37450/37963 [89:50:18<1:14:28,  8.71s/it]
 99%|█████████▊| 37451/37963 [89:50:26<1:11:16,  8.35s/it]
 99%|█████████▊| 37452/37963 [89:50:33<1:09:07,  8.12s/it]
 99%|█████████▊| 37453/37963 [89:50:41<1:07:49,  7.98s/it]
 99%|█████████▊| 37454/37963 [89:50:48<1:06:38,  7.86s/it]
 99%|█████████▊| 37455/37963 [89:50:56<1:04:48,  7.65s/it]
 99%|█████████▊| 37456/37963 [89:51:03<1:04:30,  7.63s/it]
 99%|█████████▊| 37457/37963 [89:51:11<1:04:17,  7.62s/it]
 99%|█████████▊| 37458/37963 [89:51:18<1:03:46,  7.58s/it]
 99%|█████████▊| 37459/37963 [89:51:26<1:03:34,  7.57s/it]
 99%|█████████▊| 37460/37963 [89:51:33<1:03:19,  7.55s/it]
                                                          
{'loss': '0.07915', 'grad_norm': '3.916', 'learning_rate': '9.243e-09', 'epoch': '0.9868'}

 99%|█████████▊| 37460/37963 [89:51:33<1:03:19,  7.55s/it]
 99%|█████████▊| 37461/37963 [89:51:41<1:03:17,  7.56s/it]
 99%|█████████▊| 37462/37963 [89:51:48<1:02:48,  7.52s/it]
 99%|█████████▊| 37463/37963 [89:51:56<1:02:22,  7.48s/it]
 99%|█████████▊| 37464/37963 [89:52:03<1:02:23,  7.50s/it]
 99%|█████████▊| 37465/37963 [89:52:11<1:02:38,  7.55s/it]
 99%|█████████▊| 37466/37963 [89:52:18<1:02:28,  7.54s/it]
 99%|█████████▊| 37467/37963 [89:52:26<1:02:36,  7.57s/it]
 99%|█████████▊| 37468/37963 [89:52:40<1:18:48,  9.55s/it]
 99%|█████████▊| 37469/37963 [89:52:48<1:13:33,  8.93s/it]
 99%|█████████▊| 37470/37963 [89:52:55<1:10:00,  8.52s/it]
                                                          
{'loss': '0.08923', 'grad_norm': '3.561', 'learning_rate': '8.88e-09', 'epoch': '0.987'}

 99%|█████████▊| 37470/37963 [89:52:55<1:10:00,  8.52s/it]
 99%|█████████▊| 37471/37963 [89:53:09<1:23:04, 10.13s/it]
 99%|█████████▊| 37472/37963 [89:53:17<1:16:54,  9.40s/it]
 99%|█████████▊| 37473/37963 [89:53:31<1:27:31, 10.72s/it]
 99%|█████████▊| 37474/37963 [89:53:38<1:19:44,  9.78s/it]
 99%|█████████▊| 37475/37963 [89:53:46<1:14:00,  9.10s/it]
 99%|█████████▊| 37476/37963 [89:54:00<1:25:11, 10.50s/it]
 99%|█████████▊| 37477/37963 [89:54:14<1:33:34, 11.55s/it]
 99%|█████████▊| 37478/37963 [89:54:21<1:22:54, 10.26s/it]
 99%|█████████▊| 37479/37963 [89:54:28<1:16:03,  9.43s/it]
 99%|█████████▊| 37480/37963 [89:54:36<1:10:58,  8.82s/it]
                                                          
{'loss': '0.07198', 'grad_norm': '2.708', 'learning_rate': '8.524e-09', 'epoch': '0.9873'}

 99%|█████████▊| 37480/37963 [89:54:36<1:10:58,  8.82s/it]
 99%|█████████▊| 37481/37963 [89:54:43<1:07:56,  8.46s/it]
 99%|█████████▊| 37482/37963 [89:54:51<1:05:22,  8.16s/it]
 99%|█████████▊| 37483/37963 [89:54:58<1:03:43,  7.97s/it]
 99%|█████████▊| 37484/37963 [89:55:12<1:17:52,  9.75s/it]
 99%|█████████▊| 37485/37963 [89:55:20<1:12:42,  9.13s/it]
 99%|█████████▊| 37486/37963 [89:55:27<1:08:08,  8.57s/it]
 99%|█████████▊| 37487/37963 [89:55:41<1:21:20, 10.25s/it]
 99%|█████████▊| 37488/37963 [89:55:49<1:14:41,  9.44s/it]
 99%|█████████▉| 37489/37963 [89:55:56<1:10:05,  8.87s/it]
 99%|█████████▉| 37490/37963 [89:56:04<1:06:31,  8.44s/it]
                                                          
{'loss': '0.07063', 'grad_norm': '2.79', 'learning_rate': '8.175e-09', 'epoch': '0.9875'}

 99%|█████████▉| 37490/37963 [89:56:04<1:06:31,  8.44s/it]
 99%|█████████▉| 37491/37963 [89:56:12<1:04:34,  8.21s/it]
 99%|█████████▉| 37492/37963 [89:56:19<1:02:07,  7.91s/it]
 99%|█████████▉| 37493/37963 [89:56:26<1:01:02,  7.79s/it]
 99%|█████████▉| 37494/37963 [89:56:34<1:00:06,  7.69s/it]
 99%|█████████▉| 37495/37963 [89:56:48<1:14:25,  9.54s/it]
 99%|█████████▉| 37496/37963 [89:56:55<1:09:15,  8.90s/it]
 99%|█████████▉| 37497/37963 [89:57:03<1:06:07,  8.51s/it]
 99%|█████████▉| 37498/37963 [89:57:10<1:03:40,  8.22s/it]
 99%|█████████▉| 37499/37963 [89:57:18<1:02:17,  8.06s/it]
 99%|█████████▉| 37500/37963 [89:57:25<1:00:12,  7.80s/it]
                                                          
{'loss': '0.08506', 'grad_norm': '3.433', 'learning_rate': '7.834e-09', 'epoch': '0.9878'}

 99%|█████████▉| 37500/37963 [89:57:25<1:00:12,  7.80s/it]
 99%|█████████▉| 37501/37963 [89:57:33<59:34,  7.74s/it]  
 99%|█████████▉| 37502/37963 [89:57:40<58:26,  7.61s/it]
 99%|█████████▉| 37503/37963 [89:57:47<58:11,  7.59s/it]
 99%|█████████▉| 37504/37963 [89:57:55<58:04,  7.59s/it]
 99%|█████████▉| 37505/37963 [89:58:03<58:08,  7.62s/it]
 99%|█████████▉| 37506/37963 [89:58:10<57:47,  7.59s/it]
 99%|█████████▉| 37507/37963 [89:58:18<57:29,  7.57s/it]
 99%|█████████▉| 37508/37963 [89:58:25<57:03,  7.52s/it]
 99%|█████████▉| 37509/37963 [89:58:33<57:02,  7.54s/it]
 99%|█████████▉| 37510/37963 [89:58:40<57:17,  7.59s/it]
                                                        
{'loss': '0.0849', 'grad_norm': '3.336', 'learning_rate': '7.5e-09', 'epoch': '0.9881'}

 99%|█████████▉| 37510/37963 [89:58:40<57:17,  7.59s/it]
 99%|█████████▉| 37511/37963 [89:58:48<56:55,  7.56s/it]
 99%|█████████▉| 37512/37963 [89:58:55<56:25,  7.51s/it]
 99%|█████████▉| 37513/37963 [89:59:03<56:15,  7.50s/it]
 99%|█████████▉| 37514/37963 [89:59:10<55:26,  7.41s/it]
 99%|█████████▉| 37515/37963 [89:59:18<55:45,  7.47s/it]
 99%|█████████▉| 37516/37963 [89:59:31<1:09:44,  9.36s/it]
 99%|█████████▉| 37517/37963 [89:59:39<1:05:26,  8.80s/it]
 99%|█████████▉| 37518/37963 [89:59:46<1:02:22,  8.41s/it]
 99%|█████████▉| 37519/37963 [89:59:54<1:00:17,  8.15s/it]
 99%|█████████▉| 37520/37963 [90:00:01<58:51,  7.97s/it]  
                                                        
{'loss': '0.07899', 'grad_norm': '3.632', 'learning_rate': '7.173e-09', 'epoch': '0.9883'}

 99%|█████████▉| 37520/37963 [90:00:01<58:51,  7.97s/it]
 99%|█████████▉| 37521/37963 [90:00:09<57:56,  7.86s/it]
 99%|█████████▉| 37522/37963 [90:00:23<1:11:01,  9.66s/it]
 99%|█████████▉| 37523/37963 [90:00:44<1:35:36, 13.04s/it]
 99%|█████████▉| 37524/37963 [90:00:51<1:23:16, 11.38s/it]
 99%|█████████▉| 37525/37963 [90:00:59<1:14:40, 10.23s/it]
 99%|█████████▉| 37526/37963 [90:01:06<1:08:17,  9.38s/it]
 99%|█████████▉| 37527/37963 [90:01:14<1:04:04,  8.82s/it]
 99%|█████████▉| 37528/37963 [90:01:21<1:01:02,  8.42s/it]
 99%|█████████▉| 37529/37963 [90:01:29<59:07,  8.17s/it]  
 99%|█████████▉| 37530/37963 [90:01:36<57:15,  7.93s/it]
                                                        
{'loss': '0.08515', 'grad_norm': '3.855', 'learning_rate': '6.854e-09', 'epoch': '0.9886'}

 99%|█████████▉| 37530/37963 [90:01:36<57:15,  7.93s/it]
 99%|█████████▉| 37531/37963 [90:01:50<1:10:14,  9.76s/it]
 99%|█████████▉| 37532/37963 [90:02:05<1:20:03, 11.15s/it]
 99%|█████████▉| 37533/37963 [90:02:12<1:12:10, 10.07s/it]
 99%|█████████▉| 37534/37963 [90:02:20<1:06:18,  9.27s/it]
 99%|█████████▉| 37535/37963 [90:02:27<1:02:39,  8.79s/it]
 99%|█████████▉| 37536/37963 [90:02:34<59:03,  8.30s/it]  
 99%|█████████▉| 37537/37963 [90:02:42<57:29,  8.10s/it]
 99%|█████████▉| 37538/37963 [90:02:56<1:08:56,  9.73s/it]
 99%|█████████▉| 37539/37963 [90:03:03<1:04:19,  9.10s/it]
 99%|█████████▉| 37540/37963 [90:03:11<1:00:19,  8.56s/it]
                                                          
{'loss': '0.07812', 'grad_norm': '2.606', 'learning_rate': '6.542e-09', 'epoch': '0.9889'}

 99%|█████████▉| 37540/37963 [90:03:11<1:00:19,  8.56s/it]
 99%|█████████▉| 37541/37963 [90:03:18<57:47,  8.22s/it]  
 99%|█████████▉| 37542/37963 [90:03:26<56:21,  8.03s/it]
 99%|█████████▉| 37543/37963 [90:03:39<1:08:16,  9.75s/it]
 99%|█████████▉| 37544/37963 [90:03:47<1:03:34,  9.10s/it]
 99%|█████████▉| 37545/37963 [90:03:54<59:50,  8.59s/it]  
 99%|█████████▉| 37546/37963 [90:04:02<57:33,  8.28s/it]
 99%|█████████▉| 37547/37963 [90:04:09<55:48,  8.05s/it]
 99%|█████████▉| 37548/37963 [90:04:17<54:34,  7.89s/it]
 99%|█████████▉| 37549/37963 [90:04:24<53:02,  7.69s/it]
 99%|█████████▉| 37550/37963 [90:04:32<52:31,  7.63s/it]
                                                        
{'loss': '0.07582', 'grad_norm': '3.389', 'learning_rate': '6.237e-09', 'epoch': '0.9891'}

 99%|█████████▉| 37550/37963 [90:04:32<52:31,  7.63s/it]
 99%|█████████▉| 37551/37963 [90:04:39<51:58,  7.57s/it]
 99%|█████████▉| 37552/37963 [90:04:46<51:15,  7.48s/it]
 99%|█████████▉| 37553/37963 [90:04:54<51:19,  7.51s/it]
 99%|█████████▉| 37554/37963 [90:05:02<51:27,  7.55s/it]
 99%|█████████▉| 37555/37963 [90:05:09<51:26,  7.57s/it]
 99%|█████████▉| 37556/37963 [90:05:17<51:07,  7.54s/it]
 99%|█████████▉| 37557/37963 [90:05:24<51:09,  7.56s/it]
 99%|█████████▉| 37558/37963 [90:05:32<50:56,  7.55s/it]
 99%|█████████▉| 37559/37963 [90:05:39<50:58,  7.57s/it]
 99%|█████████▉| 37560/37963 [90:05:47<50:43,  7.55s/it]
                                                        
{'loss': '0.07648', 'grad_norm': '3.736', 'learning_rate': '5.939e-09', 'epoch': '0.9894'}

 99%|█████████▉| 37560/37963 [90:05:47<50:43,  7.55s/it]
 99%|█████████▉| 37561/37963 [90:05:54<49:45,  7.43s/it]
 99%|█████████▉| 37562/37963 [90:06:02<50:06,  7.50s/it]
 99%|█████████▉| 37563/37963 [90:06:09<50:24,  7.56s/it]
 99%|█████████▉| 37564/37963 [90:06:17<49:53,  7.50s/it]
 99%|█████████▉| 37565/37963 [90:06:31<1:02:42,  9.45s/it]
 99%|█████████▉| 37566/37963 [90:06:45<1:11:11, 10.76s/it]
 99%|█████████▉| 37567/37963 [90:06:52<1:04:37,  9.79s/it]
 99%|█████████▉| 37568/37963 [90:07:06<1:12:35, 11.03s/it]
 99%|█████████▉| 37569/37963 [90:07:14<1:05:53, 10.03s/it]
 99%|█████████▉| 37570/37963 [90:07:21<1:00:51,  9.29s/it]
                                                          
{'loss': '0.07667', 'grad_norm': '4.252', 'learning_rate': '5.649e-09', 'epoch': '0.9897'}

 99%|█████████▉| 37570/37963 [90:07:21<1:00:51,  9.29s/it]
 99%|█████████▉| 37571/37963 [90:07:35<1:09:56, 10.71s/it]
 99%|█████████▉| 37572/37963 [90:07:43<1:03:43,  9.78s/it]
 99%|█████████▉| 37573/37963 [90:07:50<58:50,  9.05s/it]  
 99%|█████████▉| 37574/37963 [90:07:58<55:29,  8.56s/it]
 99%|█████████▉| 37575/37963 [90:08:05<53:29,  8.27s/it]
 99%|█████████▉| 37576/37963 [90:08:13<51:52,  8.04s/it]
 99%|█████████▉| 37577/37963 [90:08:20<50:51,  7.90s/it]
 99%|█████████▉| 37578/37963 [90:08:28<50:10,  7.82s/it]
 99%|█████████▉| 37579/37963 [90:08:35<49:05,  7.67s/it]
 99%|█████████▉| 37580/37963 [90:08:49<1:01:11,  9.59s/it]
                                                          
{'loss': '0.0719', 'grad_norm': '3.736', 'learning_rate': '5.366e-09', 'epoch': '0.9899'}

 99%|█████████▉| 37580/37963 [90:08:49<1:01:11,  9.59s/it]
 99%|█████████▉| 37581/37963 [90:08:57<56:49,  8.93s/it]  
 99%|█████████▉| 37582/37963 [90:09:04<54:12,  8.54s/it]
 99%|█████████▉| 37583/37963 [90:09:12<52:07,  8.23s/it]
 99%|█████████▉| 37584/37963 [90:09:19<50:33,  8.00s/it]
 99%|█████████▉| 37585/37963 [90:09:33<1:01:43,  9.80s/it]
 99%|█████████▉| 37586/37963 [90:09:47<1:08:59, 10.98s/it]
 99%|█████████▉| 37587/37963 [90:09:54<1:01:43,  9.85s/it]
 99%|█████████▉| 37588/37963 [90:10:02<57:18,  9.17s/it]  
 99%|█████████▉| 37589/37963 [90:10:09<53:50,  8.64s/it]
 99%|█████████▉| 37590/37963 [90:10:17<51:44,  8.32s/it]
                                                        
{'loss': '0.08348', 'grad_norm': '2.452', 'learning_rate': '5.09e-09', 'epoch': '0.9902'}

 99%|█████████▉| 37590/37963 [90:10:17<51:44,  8.32s/it]
 99%|█████████▉| 37591/37963 [90:10:24<50:06,  8.08s/it]
 99%|█████████▉| 37592/37963 [90:10:38<1:00:32,  9.79s/it]
 99%|█████████▉| 37593/37963 [90:10:46<56:34,  9.17s/it]  
 99%|█████████▉| 37594/37963 [90:10:54<53:48,  8.75s/it]
 99%|█████████▉| 37595/37963 [90:11:01<51:22,  8.38s/it]
 99%|█████████▉| 37596/37963 [90:11:09<49:47,  8.14s/it]
 99%|█████████▉| 37597/37963 [90:11:16<48:42,  7.98s/it]
 99%|█████████▉| 37598/37963 [90:11:24<47:43,  7.85s/it]
 99%|█████████▉| 37599/37963 [90:11:31<47:00,  7.75s/it]
 99%|█████████▉| 37600/37963 [90:11:39<46:33,  7.70s/it]
                                                        
{'loss': '0.08442', 'grad_norm': '3.589', 'learning_rate': '4.821e-09', 'epoch': '0.9904'}

 99%|█████████▉| 37600/37963 [90:11:39<46:33,  7.70s/it]
 99%|█████████▉| 37601/37963 [90:11:46<45:56,  7.61s/it]
 99%|█████████▉| 37602/37963 [90:11:54<45:47,  7.61s/it]
 99%|█████████▉| 37603/37963 [90:12:02<45:32,  7.59s/it]
 99%|█████████▉| 37604/37963 [90:12:09<45:15,  7.57s/it]
 99%|█████████▉| 37605/37963 [90:12:17<45:03,  7.55s/it]
 99%|█████████▉| 37606/37963 [90:12:24<44:26,  7.47s/it]
 99%|█████████▉| 37607/37963 [90:12:31<44:00,  7.42s/it]
 99%|█████████▉| 37608/37963 [90:12:39<44:12,  7.47s/it]
 99%|█████████▉| 37609/37963 [90:12:46<44:07,  7.48s/it]
 99%|█████████▉| 37610/37963 [90:12:54<43:45,  7.44s/it]
                                                        
{'loss': '0.07338', 'grad_norm': '2.989', 'learning_rate': '4.56e-09', 'epoch': '0.9907'}

 99%|█████████▉| 37610/37963 [90:12:54<43:45,  7.44s/it]
 99%|█████████▉| 37611/37963 [90:13:01<43:47,  7.46s/it]
 99%|█████████▉| 37612/37963 [90:13:15<55:41,  9.52s/it]
 99%|█████████▉| 37613/37963 [90:13:23<52:12,  8.95s/it]
 99%|█████████▉| 37614/37963 [90:13:31<50:02,  8.60s/it]
 99%|█████████▉| 37615/37963 [90:13:38<47:36,  8.21s/it]
 99%|█████████▉| 37616/37963 [90:13:46<46:15,  8.00s/it]
 99%|█████████▉| 37617/37963 [90:13:53<45:20,  7.86s/it]
 99%|█████████▉| 37618/37963 [90:14:01<44:40,  7.77s/it]
 99%|█████████▉| 37619/37963 [90:14:15<55:06,  9.61s/it]
 99%|█████████▉| 37620/37963 [90:14:28<1:02:13, 10.88s/it]
                                                          
{'loss': '0.07046', 'grad_norm': '3.631', 'learning_rate': '4.306e-09', 'epoch': '0.991'}

 99%|█████████▉| 37620/37963 [90:14:28<1:02:13, 10.88s/it]
 99%|█████████▉| 37621/37963 [90:14:36<56:06,  9.84s/it]  
 99%|█████████▉| 37622/37963 [90:14:50<1:02:48, 11.05s/it]
 99%|█████████▉| 37623/37963 [90:14:57<56:57, 10.05s/it]  
 99%|█████████▉| 37624/37963 [90:15:05<52:34,  9.30s/it]
 99%|█████████▉| 37625/37963 [90:15:12<48:54,  8.68s/it]
 99%|█████████▉| 37626/37963 [90:15:20<46:56,  8.36s/it]
 99%|█████████▉| 37627/37963 [90:15:27<45:28,  8.12s/it]
 99%|█████████▉| 37628/37963 [90:15:35<44:19,  7.94s/it]
 99%|█████████▉| 37629/37963 [90:15:43<43:36,  7.83s/it]
 99%|█████████▉| 37630/37963 [90:15:50<42:51,  7.72s/it]
                                                        
{'loss': '0.07008', 'grad_norm': '3.255', 'learning_rate': '4.059e-09', 'epoch': '0.9912'}

 99%|█████████▉| 37630/37963 [90:15:50<42:51,  7.72s/it]
 99%|█████████▉| 37631/37963 [90:15:58<42:34,  7.70s/it]
 99%|█████████▉| 37632/37963 [90:16:05<41:51,  7.59s/it]
 99%|█████████▉| 37633/37963 [90:16:19<51:49,  9.42s/it]
 99%|█████████▉| 37634/37963 [90:16:26<48:56,  8.93s/it]
 99%|█████████▉| 37635/37963 [90:16:41<57:24, 10.50s/it]
 99%|█████████▉| 37636/37963 [90:16:48<52:26,  9.62s/it]
 99%|█████████▉| 37637/37963 [90:16:56<49:00,  9.02s/it]
 99%|█████████▉| 37638/37963 [90:17:03<46:20,  8.55s/it]
 99%|█████████▉| 37639/37963 [90:17:24<1:05:24, 12.11s/it]
 99%|█████████▉| 37640/37963 [90:17:31<58:06, 10.79s/it]  
                                                        
{'loss': '0.0808', 'grad_norm': '4.049', 'learning_rate': '3.82e-09', 'epoch': '0.9915'}

 99%|█████████▉| 37640/37963 [90:17:31<58:06, 10.79s/it]
 99%|█████████▉| 37641/37963 [90:17:39<52:36,  9.80s/it]
 99%|█████████▉| 37642/37963 [90:17:46<48:49,  9.13s/it]
 99%|█████████▉| 37643/37963 [90:17:54<46:02,  8.63s/it]
 99%|█████████▉| 37644/37963 [90:18:02<44:14,  8.32s/it]
 99%|█████████▉| 37645/37963 [90:18:09<42:29,  8.02s/it]
 99%|█████████▉| 37646/37963 [90:18:16<41:38,  7.88s/it]
 99%|█████████▉| 37647/37963 [90:18:24<40:54,  7.77s/it]
 99%|█████████▉| 37648/37963 [90:18:31<40:24,  7.70s/it]
 99%|█████████▉| 37649/37963 [90:18:39<40:11,  7.68s/it]
 99%|█████████▉| 37650/37963 [90:18:46<39:31,  7.58s/it]
                                                        
{'loss': '0.07504', 'grad_norm': '4.926', 'learning_rate': '3.588e-09', 'epoch': '0.9918'}

 99%|█████████▉| 37650/37963 [90:18:46<39:31,  7.58s/it]
 99%|█████████▉| 37651/37963 [90:18:54<39:15,  7.55s/it]
 99%|█████████▉| 37652/37963 [90:19:01<39:04,  7.54s/it]
 99%|█████████▉| 37653/37963 [90:19:09<39:12,  7.59s/it]
 99%|█████████▉| 37654/37963 [90:19:17<39:00,  7.58s/it]
 99%|█████████▉| 37655/37963 [90:19:24<38:50,  7.57s/it]
 99%|█████████▉| 37656/37963 [90:19:38<48:50,  9.55s/it]
 99%|█████████▉| 37657/37963 [90:19:46<45:57,  9.01s/it]
 99%|█████████▉| 37658/37963 [90:19:54<43:38,  8.58s/it]
 99%|█████████▉| 37659/37963 [90:20:01<41:53,  8.27s/it]
 99%|█████████▉| 37660/37963 [90:20:09<40:40,  8.05s/it]
                                                        
{'loss': '0.06813', 'grad_norm': '3.228', 'learning_rate': '3.363e-09', 'epoch': '0.992'}

 99%|█████████▉| 37660/37963 [90:20:09<40:40,  8.05s/it]
 99%|█████████▉| 37661/37963 [90:20:16<39:29,  7.85s/it]
 99%|█████████▉| 37662/37963 [90:20:23<38:31,  7.68s/it]
 99%|█████████▉| 37663/37963 [90:20:31<38:08,  7.63s/it]
 99%|█████████▉| 37664/37963 [90:20:38<37:39,  7.56s/it]
 99%|█████████▉| 37665/37963 [90:20:46<37:19,  7.51s/it]
 99%|█████████▉| 37666/37963 [90:20:53<37:14,  7.52s/it]
 99%|█████████▉| 37667/37963 [90:21:07<46:50,  9.50s/it]
 99%|█████████▉| 37668/37963 [90:21:15<43:51,  8.92s/it]
 99%|█████████▉| 37669/37963 [90:21:23<41:42,  8.51s/it]
 99%|█████████▉| 37670/37963 [90:21:30<40:12,  8.23s/it]
                                                        
{'loss': '0.09148', 'grad_norm': '3.171', 'learning_rate': '3.145e-09', 'epoch': '0.9923'}

 99%|█████████▉| 37670/37963 [90:21:30<40:12,  8.23s/it]
 99%|█████████▉| 37671/37963 [90:21:44<48:35,  9.99s/it]
 99%|█████████▉| 37672/37963 [90:21:52<44:56,  9.27s/it]
 99%|█████████▉| 37673/37963 [90:21:59<42:13,  8.74s/it]
 99%|█████████▉| 37674/37963 [90:22:07<40:17,  8.37s/it]
 99%|█████████▉| 37675/37963 [90:22:14<39:09,  8.16s/it]
 99%|█████████▉| 37676/37963 [90:22:22<38:05,  7.96s/it]
 99%|█████████▉| 37677/37963 [90:22:36<47:12,  9.90s/it]
 99%|█████████▉| 37678/37963 [90:22:50<52:57, 11.15s/it]
 99%|█████████▉| 37679/37963 [90:22:58<47:35, 10.05s/it]
 99%|█████████▉| 37680/37963 [90:23:05<43:39,  9.26s/it]
                                                        
{'loss': '0.08093', 'grad_norm': '2.75', 'learning_rate': '2.935e-09', 'epoch': '0.9925'}

 99%|█████████▉| 37680/37963 [90:23:05<43:39,  9.26s/it]
 99%|█████████▉| 37681/37963 [90:23:20<50:37, 10.77s/it]
 99%|█████████▉| 37682/37963 [90:23:27<45:58,  9.82s/it]
 99%|█████████▉| 37683/37963 [90:23:35<42:40,  9.14s/it]
 99%|█████████▉| 37684/37963 [90:23:42<40:04,  8.62s/it]
 99%|█████████▉| 37685/37963 [90:23:50<38:32,  8.32s/it]
 99%|█████████▉| 37686/37963 [90:23:57<37:19,  8.09s/it]
 99%|█████████▉| 37687/37963 [90:24:05<36:23,  7.91s/it]
 99%|█████████▉| 37688/37963 [90:24:19<44:38,  9.74s/it]
 99%|█████████▉| 37689/37963 [90:24:26<41:30,  9.09s/it]
 99%|█████████▉| 37690/37963 [90:24:34<39:23,  8.66s/it]
                                                        
{'loss': '0.06879', 'grad_norm': '2.512', 'learning_rate': '2.732e-09', 'epoch': '0.9928'}

 99%|█████████▉| 37690/37963 [90:24:34<39:23,  8.66s/it]
 99%|█████████▉| 37691/37963 [90:24:42<37:36,  8.29s/it]
 99%|█████████▉| 37692/37963 [90:24:49<36:31,  8.09s/it]
 99%|█████████▉| 37693/37963 [90:25:03<43:53,  9.75s/it]
 99%|█████████▉| 37694/37963 [90:25:10<40:30,  9.04s/it]
 99%|█████████▉| 37695/37963 [90:25:18<38:19,  8.58s/it]
 99%|█████████▉| 37696/37963 [90:25:25<36:47,  8.27s/it]
 99%|█████████▉| 37697/37963 [90:25:33<35:50,  8.08s/it]
 99%|█████████▉| 37698/37963 [90:25:40<34:59,  7.92s/it]
 99%|█████████▉| 37699/37963 [90:25:48<34:23,  7.82s/it]
 99%|█████████▉| 37700/37963 [90:25:56<34:00,  7.76s/it]
                                                        
{'loss': '0.08903', 'grad_norm': '4.17', 'learning_rate': '2.536e-09', 'epoch': '0.9931'}

 99%|█████████▉| 37700/37963 [90:25:56<34:00,  7.76s/it]
 99%|█████████▉| 37701/37963 [90:26:03<33:24,  7.65s/it]
 99%|█████████▉| 37702/37963 [90:26:11<33:13,  7.64s/it]
 99%|█████████▉| 37703/37963 [90:26:18<32:46,  7.56s/it]
 99%|█████████▉| 37704/37963 [90:26:25<32:08,  7.44s/it]
 99%|█████████▉| 37705/37963 [90:26:33<32:13,  7.49s/it]
 99%|█████████▉| 37706/37963 [90:26:40<32:02,  7.48s/it]
 99%|█████████▉| 37707/37963 [90:26:48<31:47,  7.45s/it]
 99%|█████████▉| 37708/37963 [90:26:55<31:43,  7.47s/it]
 99%|█████████▉| 37709/37963 [90:27:09<39:25,  9.31s/it]
 99%|█████████▉| 37710/37963 [90:27:16<36:56,  8.76s/it]
                                                        
{'loss': '0.07276', 'grad_norm': '4.538', 'learning_rate': '2.348e-09', 'epoch': '0.9933'}

 99%|█████████▉| 37710/37963 [90:27:16<36:56,  8.76s/it]
 99%|█████████▉| 37711/37963 [90:27:24<35:24,  8.43s/it]
 99%|█████████▉| 37712/37963 [90:27:31<33:49,  8.09s/it]
 99%|█████████▉| 37713/37963 [90:27:39<33:03,  7.93s/it]
 99%|█████████▉| 37714/37963 [90:27:46<32:22,  7.80s/it]
 99%|█████████▉| 37715/37963 [90:27:54<31:36,  7.65s/it]
 99%|█████████▉| 37716/37963 [90:28:01<31:15,  7.59s/it]
 99%|█████████▉| 37717/37963 [90:28:15<38:56,  9.50s/it]
 99%|█████████▉| 37718/37963 [90:28:23<36:25,  8.92s/it]
 99%|█████████▉| 37719/37963 [90:28:30<34:31,  8.49s/it]
 99%|█████████▉| 37720/37963 [90:28:38<33:15,  8.21s/it]
                                                        
{'loss': '0.07513', 'grad_norm': '2.988', 'learning_rate': '2.167e-09', 'epoch': '0.9936'}

 99%|█████████▉| 37720/37963 [90:28:38<33:15,  8.21s/it]
 99%|█████████▉| 37721/37963 [90:28:58<47:59, 11.90s/it]
 99%|█████████▉| 37722/37963 [90:29:05<42:24, 10.56s/it]
 99%|█████████▉| 37723/37963 [90:29:13<38:28,  9.62s/it]
 99%|█████████▉| 37724/37963 [90:29:20<35:38,  8.95s/it]
 99%|█████████▉| 37725/37963 [90:29:41<49:26, 12.46s/it]
 99%|█████████▉| 37726/37963 [90:29:49<43:25, 10.99s/it]
 99%|█████████▉| 37727/37963 [90:29:56<39:03,  9.93s/it]
 99%|█████████▉| 37728/37963 [90:30:03<36:03,  9.20s/it]
 99%|█████████▉| 37729/37963 [90:30:11<34:03,  8.73s/it]
 99%|█████████▉| 37730/37963 [90:30:19<32:43,  8.43s/it]
                                                        
{'loss': '0.07532', 'grad_norm': '4.08', 'learning_rate': '1.993e-09', 'epoch': '0.9939'}

 99%|█████████▉| 37730/37963 [90:30:19<32:43,  8.43s/it]
 99%|█████████▉| 37731/37963 [90:30:27<31:44,  8.21s/it]
 99%|█████████▉| 37732/37963 [90:30:34<30:34,  7.94s/it]
 99%|█████████▉| 37733/37963 [90:30:41<30:03,  7.84s/it]
 99%|█████████▉| 37734/37963 [90:30:49<29:41,  7.78s/it]
 99%|█████████▉| 37735/37963 [90:30:57<29:31,  7.77s/it]
 99%|█████████▉| 37736/37963 [90:31:04<28:53,  7.64s/it]
 99%|█████████▉| 37737/37963 [90:31:24<43:04, 11.44s/it]
 99%|█████████▉| 37738/37963 [90:31:32<38:34, 10.29s/it]
 99%|█████████▉| 37739/37963 [90:31:40<35:21,  9.47s/it]
 99%|█████████▉| 37740/37963 [90:31:47<33:05,  8.90s/it]
                                                        
{'loss': '0.07474', 'grad_norm': '2.67', 'learning_rate': '1.826e-09', 'epoch': '0.9941'}

 99%|█████████▉| 37740/37963 [90:31:47<33:05,  8.90s/it]
 99%|█████████▉| 37741/37963 [90:31:55<31:28,  8.51s/it]
 99%|█████████▉| 37742/37963 [90:32:02<30:13,  8.21s/it]
 99%|█████████▉| 37743/37963 [90:32:10<29:31,  8.05s/it]
 99%|█████████▉| 37744/37963 [90:32:18<28:55,  7.92s/it]
 99%|█████████▉| 37745/37963 [90:32:25<28:22,  7.81s/it]
 99%|█████████▉| 37746/37963 [90:32:33<27:56,  7.73s/it]
 99%|█████████▉| 37747/37963 [90:32:40<27:37,  7.68s/it]
 99%|█████████▉| 37748/37963 [90:32:48<27:33,  7.69s/it]
 99%|█████████▉| 37749/37963 [90:32:55<27:04,  7.59s/it]
 99%|█████████▉| 37750/37963 [90:33:03<26:54,  7.58s/it]
                                                        
{'loss': '0.07621', 'grad_norm': '3.602', 'learning_rate': '1.667e-09', 'epoch': '0.9944'}

 99%|█████████▉| 37750/37963 [90:33:03<26:54,  7.58s/it]
 99%|█████████▉| 37751/37963 [90:33:10<26:44,  7.57s/it]
 99%|█████████▉| 37752/37963 [90:33:18<26:41,  7.59s/it]
 99%|█████████▉| 37753/37963 [90:33:26<26:39,  7.62s/it]
 99%|█████████▉| 37754/37963 [90:33:33<26:24,  7.58s/it]
 99%|█████████▉| 37755/37963 [90:33:41<26:17,  7.58s/it]
 99%|█████████▉| 37756/37963 [90:33:48<25:55,  7.51s/it]
 99%|█████████▉| 37757/37963 [90:33:56<25:57,  7.56s/it]
 99%|█████████▉| 37758/37963 [90:34:10<32:06,  9.40s/it]
 99%|█████████▉| 37759/37963 [90:34:17<30:02,  8.84s/it]
 99%|█████████▉| 37760/37963 [90:34:25<28:44,  8.50s/it]
                                                        
{'loss': '0.08367', 'grad_norm': '4.39', 'learning_rate': '1.514e-09', 'epoch': '0.9947'}

 99%|█████████▉| 37760/37963 [90:34:25<28:44,  8.50s/it]
 99%|█████████▉| 37761/37963 [90:34:32<27:37,  8.21s/it]
 99%|█████████▉| 37762/37963 [90:34:40<26:50,  8.01s/it]
 99%|█████████▉| 37763/37963 [90:34:47<26:05,  7.83s/it]
 99%|█████████▉| 37764/37963 [90:34:55<25:43,  7.76s/it]
 99%|█████████▉| 37765/37963 [90:35:09<31:45,  9.63s/it]
 99%|█████████▉| 37766/37963 [90:35:16<29:38,  9.03s/it]
 99%|█████████▉| 37767/37963 [90:35:24<28:00,  8.57s/it]
 99%|█████████▉| 37768/37963 [90:35:38<32:52, 10.12s/it]
 99%|█████████▉| 37769/37963 [90:35:45<30:07,  9.32s/it]
 99%|█████████▉| 37770/37963 [90:35:52<28:02,  8.72s/it]
                                                        
{'loss': '0.09297', 'grad_norm': '2.632', 'learning_rate': '1.37e-09', 'epoch': '0.9949'}

 99%|█████████▉| 37770/37963 [90:35:52<28:02,  8.72s/it]
 99%|█████████▉| 37771/37963 [90:36:07<33:02, 10.32s/it]
 99%|█████████▉| 37772/37963 [90:36:21<36:26, 11.45s/it]
 99%|█████████▉| 37773/37963 [90:36:28<32:29, 10.26s/it]
100%|█████████▉| 37774/37963 [90:36:42<35:52, 11.39s/it]
100%|█████████▉| 37775/37963 [90:36:50<32:09, 10.27s/it]
100%|█████████▉| 37776/37963 [90:36:57<29:32,  9.48s/it]
100%|█████████▉| 37777/37963 [90:37:05<27:33,  8.89s/it]
100%|█████████▉| 37778/37963 [90:37:12<26:08,  8.48s/it]
100%|█████████▉| 37779/37963 [90:37:20<25:08,  8.20s/it]
100%|█████████▉| 37780/37963 [90:37:28<24:27,  8.02s/it]
                                                        
{'loss': '0.07984', 'grad_norm': '3.66', 'learning_rate': '1.232e-09', 'epoch': '0.9952'}

100%|█████████▉| 37780/37963 [90:37:28<24:27,  8.02s/it]
100%|█████████▉| 37781/37963 [90:37:35<23:44,  7.82s/it]
100%|█████████▉| 37782/37963 [90:37:43<23:28,  7.78s/it]
100%|█████████▉| 37783/37963 [90:37:50<23:13,  7.74s/it]
100%|█████████▉| 37784/37963 [90:37:58<22:57,  7.70s/it]
100%|█████████▉| 37785/37963 [90:38:05<22:26,  7.56s/it]
100%|█████████▉| 37786/37963 [90:38:19<28:03,  9.51s/it]
100%|█████████▉| 37787/37963 [90:38:27<26:09,  8.92s/it]
100%|█████████▉| 37788/37963 [90:38:34<24:47,  8.50s/it]
100%|█████████▉| 37789/37963 [90:38:42<23:52,  8.23s/it]
100%|█████████▉| 37790/37963 [90:38:56<28:35,  9.92s/it]
                                                        
{'loss': '0.07853', 'grad_norm': '2.516', 'learning_rate': '1.102e-09', 'epoch': '0.9954'}

100%|█████████▉| 37790/37963 [90:38:56<28:35,  9.92s/it]
100%|█████████▉| 37791/37963 [90:39:03<26:21,  9.20s/it]
100%|█████████▉| 37792/37963 [90:39:11<24:55,  8.74s/it]
100%|█████████▉| 37793/37963 [90:39:18<23:43,  8.37s/it]
100%|█████████▉| 37794/37963 [90:39:26<22:54,  8.13s/it]
100%|█████████▉| 37795/37963 [90:39:34<22:14,  7.95s/it]
100%|█████████▉| 37796/37963 [90:39:41<21:41,  7.79s/it]
100%|█████████▉| 37797/37963 [90:39:49<21:23,  7.73s/it]
100%|█████████▉| 37798/37963 [90:39:56<21:03,  7.66s/it]
100%|█████████▉| 37799/37963 [90:40:04<20:48,  7.61s/it]
100%|█████████▉| 37800/37963 [90:40:11<20:20,  7.49s/it]
                                                        
{'loss': '0.07186', 'grad_norm': '2.361', 'learning_rate': '9.788e-10', 'epoch': '0.9957'}

100%|█████████▉| 37800/37963 [90:40:11<20:20,  7.49s/it]
100%|█████████▉| 37801/37963 [90:40:18<20:15,  7.50s/it]
100%|█████████▉| 37802/37963 [90:40:32<25:22,  9.46s/it]
100%|█████████▉| 37803/37963 [90:40:40<23:42,  8.89s/it]
100%|█████████▉| 37804/37963 [90:40:47<22:27,  8.48s/it]
100%|█████████▉| 37805/37963 [90:40:55<21:33,  8.19s/it]
100%|█████████▉| 37806/37963 [90:41:02<20:50,  7.96s/it]
100%|█████████▉| 37807/37963 [90:41:10<20:24,  7.85s/it]
100%|█████████▉| 37808/37963 [90:41:17<19:47,  7.66s/it]
100%|█████████▉| 37809/37963 [90:41:25<19:40,  7.67s/it]
100%|█████████▉| 37810/37963 [90:41:32<19:29,  7.64s/it]
                                                        
{'loss': '0.08578', 'grad_norm': '3.23', 'learning_rate': '8.631e-10', 'epoch': '0.996'}

100%|█████████▉| 37810/37963 [90:41:32<19:29,  7.64s/it]
100%|█████████▉| 37811/37963 [90:41:40<19:19,  7.63s/it]
100%|█████████▉| 37812/37963 [90:41:54<23:42,  9.42s/it]
100%|█████████▉| 37813/37963 [90:42:08<26:57, 10.78s/it]
100%|█████████▉| 37814/37963 [90:42:15<24:19,  9.80s/it]
100%|█████████▉| 37815/37963 [90:42:23<22:27,  9.11s/it]
100%|█████████▉| 37816/37963 [90:42:30<21:10,  8.64s/it]
100%|█████████▉| 37817/37963 [90:42:38<20:15,  8.33s/it]
100%|█████████▉| 37818/37963 [90:42:45<19:30,  8.08s/it]
100%|█████████▉| 37819/37963 [90:42:52<18:50,  7.85s/it]
100%|█████████▉| 37820/37963 [90:43:07<23:08,  9.71s/it]
                                                        
{'loss': '0.08046', 'grad_norm': '3.563', 'learning_rate': '7.546e-10', 'epoch': '0.9962'}

100%|█████████▉| 37820/37963 [90:43:07<23:08,  9.71s/it]
100%|█████████▉| 37821/37963 [90:43:14<21:14,  8.97s/it]
100%|█████████▉| 37822/37963 [90:43:21<20:03,  8.53s/it]
100%|█████████▉| 37823/37963 [90:43:41<28:00, 12.00s/it]
100%|█████████▉| 37824/37963 [90:43:49<24:35, 10.62s/it]
100%|█████████▉| 37825/37963 [90:43:56<22:17,  9.69s/it]
100%|█████████▉| 37826/37963 [90:44:04<20:42,  9.07s/it]
100%|█████████▉| 37827/37963 [90:44:11<19:31,  8.62s/it]
100%|█████████▉| 37828/37963 [90:44:19<18:39,  8.29s/it]
100%|█████████▉| 37829/37963 [90:44:27<18:01,  8.07s/it]
100%|█████████▉| 37830/37963 [90:44:34<17:37,  7.95s/it]
                                                        
{'loss': '0.07467', 'grad_norm': '3.209', 'learning_rate': '6.535e-10', 'epoch': '0.9965'}

100%|█████████▉| 37830/37963 [90:44:34<17:37,  7.95s/it]
100%|█████████▉| 37831/37963 [90:44:42<17:13,  7.83s/it]
100%|█████████▉| 37832/37963 [90:44:49<16:53,  7.73s/it]
100%|█████████▉| 37833/37963 [90:44:57<16:29,  7.61s/it]
100%|█████████▉| 37834/37963 [90:45:17<24:36, 11.44s/it]
100%|█████████▉| 37835/37963 [90:45:25<22:01, 10.33s/it]
100%|█████████▉| 37836/37963 [90:45:32<19:53,  9.40s/it]
100%|█████████▉| 37837/37963 [90:45:40<18:36,  8.86s/it]
100%|█████████▉| 37838/37963 [90:45:47<17:37,  8.46s/it]
100%|█████████▉| 37839/37963 [90:45:55<16:52,  8.17s/it]
100%|█████████▉| 37840/37963 [90:46:02<16:19,  7.96s/it]
                                                        
{'loss': '0.09296', 'grad_norm': '3.044', 'learning_rate': '5.596e-10', 'epoch': '0.9968'}

100%|█████████▉| 37840/37963 [90:46:02<16:19,  7.96s/it]
100%|█████████▉| 37841/37963 [90:46:09<15:45,  7.75s/it]
100%|█████████▉| 37842/37963 [90:46:17<15:31,  7.70s/it]
100%|█████████▉| 37843/37963 [90:46:24<15:18,  7.65s/it]
100%|█████████▉| 37844/37963 [90:46:32<15:02,  7.58s/it]
100%|█████████▉| 37845/37963 [90:46:39<14:56,  7.59s/it]
100%|█████████▉| 37846/37963 [90:46:47<14:47,  7.59s/it]
100%|█████████▉| 37847/37963 [90:46:55<14:39,  7.58s/it]
100%|█████████▉| 37848/37963 [90:47:02<14:29,  7.56s/it]
100%|█████████▉| 37849/37963 [90:47:10<14:21,  7.56s/it]
100%|█████████▉| 37850/37963 [90:47:24<17:46,  9.44s/it]
                                                        
{'loss': '0.0684', 'grad_norm': '3.946', 'learning_rate': '4.729e-10', 'epoch': '0.997'}

100%|█████████▉| 37850/37963 [90:47:24<17:46,  9.44s/it]
100%|█████████▉| 37851/37963 [90:47:31<16:35,  8.89s/it]
100%|█████████▉| 37852/37963 [90:47:39<15:46,  8.53s/it]
100%|█████████▉| 37853/37963 [90:47:46<15:00,  8.19s/it]
100%|█████████▉| 37854/37963 [90:47:54<14:33,  8.01s/it]
100%|█████████▉| 37855/37963 [90:48:01<14:09,  7.87s/it]
100%|█████████▉| 37856/37963 [90:48:09<13:52,  7.78s/it]
100%|█████████▉| 37857/37963 [90:48:17<13:39,  7.74s/it]
100%|█████████▉| 37858/37963 [90:48:24<13:20,  7.63s/it]
100%|█████████▉| 37859/37963 [90:48:31<13:02,  7.52s/it]
100%|█████████▉| 37860/37963 [90:48:45<16:15,  9.47s/it]
                                                        
{'loss': '0.08171', 'grad_norm': '3.763', 'learning_rate': '3.936e-10', 'epoch': '0.9973'}

100%|█████████▉| 37860/37963 [90:48:45<16:15,  9.47s/it]
100%|█████████▉| 37861/37963 [90:48:53<15:10,  8.92s/it]
100%|█████████▉| 37862/37963 [90:49:00<14:19,  8.51s/it]
100%|█████████▉| 37863/37963 [90:49:08<13:41,  8.21s/it]
100%|█████████▉| 37864/37963 [90:49:15<13:13,  8.02s/it]
100%|█████████▉| 37865/37963 [90:49:23<12:50,  7.86s/it]
100%|█████████▉| 37866/37963 [90:49:37<15:38,  9.67s/it]
100%|█████████▉| 37867/37963 [90:49:44<14:29,  9.05s/it]
100%|█████████▉| 37868/37963 [90:49:52<13:38,  8.61s/it]
100%|█████████▉| 37869/37963 [90:50:00<13:02,  8.32s/it]
100%|█████████▉| 37870/37963 [90:50:07<12:32,  8.09s/it]
                                                        
{'loss': '0.08173', 'grad_norm': '3.563', 'learning_rate': '3.216e-10', 'epoch': '0.9976'}

100%|█████████▉| 37870/37963 [90:50:07<12:32,  8.09s/it]
100%|█████████▉| 37871/37963 [90:50:15<12:12,  7.96s/it]
100%|█████████▉| 37872/37963 [90:50:22<11:52,  7.83s/it]
100%|█████████▉| 37873/37963 [90:50:30<11:37,  7.75s/it]
100%|█████████▉| 37874/37963 [90:50:38<11:23,  7.68s/it]
100%|█████████▉| 37875/37963 [90:50:45<11:14,  7.66s/it]
100%|█████████▉| 37876/37963 [90:51:05<16:35, 11.44s/it]
100%|█████████▉| 37877/37963 [90:51:13<14:42, 10.26s/it]
100%|█████████▉| 37878/37963 [90:51:20<13:16,  9.37s/it]
100%|█████████▉| 37879/37963 [90:51:28<12:19,  8.80s/it]
100%|█████████▉| 37880/37963 [90:51:35<11:38,  8.41s/it]
                                                        
{'loss': '0.09118', 'grad_norm': '2.934', 'learning_rate': '2.568e-10', 'epoch': '0.9978'}

100%|█████████▉| 37880/37963 [90:51:35<11:38,  8.41s/it]
100%|█████████▉| 37881/37963 [90:51:43<11:12,  8.20s/it]
100%|█████████▉| 37882/37963 [90:51:51<10:54,  8.08s/it]
100%|█████████▉| 37883/37963 [90:52:05<13:10,  9.88s/it]
100%|█████████▉| 37884/37963 [90:52:13<12:11,  9.26s/it]
100%|█████████▉| 37885/37963 [90:52:20<11:23,  8.77s/it]
100%|█████████▉| 37886/37963 [90:52:28<10:49,  8.43s/it]
100%|█████████▉| 37887/37963 [90:52:42<12:46, 10.08s/it]
100%|█████████▉| 37888/37963 [90:52:49<11:42,  9.36s/it]
100%|█████████▉| 37889/37963 [90:52:57<10:48,  8.76s/it]
100%|█████████▉| 37890/37963 [90:53:04<10:11,  8.38s/it]
                                                        
{'loss': '0.0859', 'grad_norm': '3.404', 'learning_rate': '1.993e-10', 'epoch': '0.9981'}

100%|█████████▉| 37890/37963 [90:53:04<10:11,  8.38s/it]
100%|█████████▉| 37891/37963 [90:53:12<09:44,  8.12s/it]
100%|█████████▉| 37892/37963 [90:53:19<09:24,  7.95s/it]
100%|█████████▉| 37893/37963 [90:53:27<09:09,  7.85s/it]
100%|█████████▉| 37894/37963 [90:53:35<08:55,  7.75s/it]
100%|█████████▉| 37895/37963 [90:53:42<08:42,  7.68s/it]
100%|█████████▉| 37896/37963 [90:53:50<08:30,  7.63s/it]
100%|█████████▉| 37897/37963 [90:53:57<08:18,  7.55s/it]
100%|█████████▉| 37898/37963 [90:54:11<10:15,  9.47s/it]
100%|█████████▉| 37899/37963 [90:54:18<09:28,  8.89s/it]
100%|█████████▉| 37900/37963 [90:54:26<08:55,  8.50s/it]
                                                        
{'loss': '0.0766', 'grad_norm': '4.057', 'learning_rate': '1.491e-10', 'epoch': '0.9983'}

100%|█████████▉| 37900/37963 [90:54:26<08:55,  8.50s/it]
100%|█████████▉| 37901/37963 [90:54:34<08:28,  8.20s/it]
100%|█████████▉| 37902/37963 [90:54:41<08:10,  8.03s/it]
100%|█████████▉| 37903/37963 [90:54:49<07:53,  7.89s/it]
100%|█████████▉| 37904/37963 [90:55:03<09:31,  9.69s/it]
100%|█████████▉| 37905/37963 [90:55:10<08:43,  9.03s/it]
100%|█████████▉| 37906/37963 [90:55:17<08:05,  8.52s/it]
100%|█████████▉| 37907/37963 [90:55:25<07:41,  8.24s/it]
100%|█████████▉| 37908/37963 [90:55:33<07:21,  8.02s/it]
100%|█████████▉| 37909/37963 [90:55:40<07:07,  7.91s/it]
100%|█████████▉| 37910/37963 [90:55:48<06:55,  7.83s/it]
                                                        
{'loss': '0.07671', 'grad_norm': '3.784', 'learning_rate': '1.061e-10', 'epoch': '0.9986'}

100%|█████████▉| 37910/37963 [90:55:48<06:55,  7.83s/it]
100%|█████████▉| 37911/37963 [90:55:56<06:45,  7.79s/it]
100%|█████████▉| 37912/37963 [90:56:03<06:30,  7.65s/it]
100%|█████████▉| 37913/37963 [90:56:10<06:22,  7.65s/it]
100%|█████████▉| 37914/37963 [90:56:18<06:13,  7.61s/it]
100%|█████████▉| 37915/37963 [90:56:25<06:00,  7.52s/it]
100%|█████████▉| 37916/37963 [90:56:39<07:25,  9.47s/it]
100%|█████████▉| 37917/37963 [90:56:47<06:51,  8.94s/it]
100%|█████████▉| 37918/37963 [90:57:01<07:46, 10.36s/it]
100%|█████████▉| 37919/37963 [90:57:08<07:00,  9.55s/it]
100%|█████████▉| 37920/37963 [90:57:16<06:24,  8.95s/it]
                                                        
{'loss': '0.07231', 'grad_norm': '2.64', 'learning_rate': '7.046e-11', 'epoch': '0.9989'}

100%|█████████▉| 37920/37963 [90:57:16<06:24,  8.95s/it]
100%|█████████▉| 37921/37963 [90:57:23<05:56,  8.49s/it]
100%|█████████▉| 37922/37963 [90:57:31<05:36,  8.20s/it]
100%|█████████▉| 37923/37963 [90:57:38<05:20,  8.01s/it]
100%|█████████▉| 37924/37963 [90:57:46<05:06,  7.86s/it]
100%|█████████▉| 37925/37963 [90:57:53<04:55,  7.76s/it]
100%|█████████▉| 37926/37963 [90:58:01<04:46,  7.74s/it]
100%|█████████▉| 37927/37963 [90:58:15<05:42,  9.51s/it]
100%|█████████▉| 37928/37963 [90:58:22<05:12,  8.94s/it]
100%|█████████▉| 37929/37963 [90:58:36<05:53, 10.41s/it]
100%|█████████▉| 37930/37963 [90:58:44<05:14,  9.54s/it]
                                                        
{'loss': '0.07276', 'grad_norm': '2.534', 'learning_rate': '4.207e-11', 'epoch': '0.9991'}

100%|█████████▉| 37930/37963 [90:58:44<05:14,  9.54s/it]
100%|█████████▉| 37931/37963 [90:58:51<04:42,  8.82s/it]
100%|█████████▉| 37932/37963 [90:58:58<04:21,  8.44s/it]
100%|█████████▉| 37933/37963 [90:59:06<04:04,  8.16s/it]
100%|█████████▉| 37934/37963 [90:59:14<03:52,  8.00s/it]
100%|█████████▉| 37935/37963 [90:59:21<03:39,  7.82s/it]
100%|█████████▉| 37936/37963 [90:59:29<03:29,  7.75s/it]
100%|█████████▉| 37937/37963 [90:59:42<04:09,  9.58s/it]
100%|█████████▉| 37938/37963 [90:59:50<03:43,  8.95s/it]
100%|█████████▉| 37939/37963 [90:59:57<03:24,  8.52s/it]
100%|█████████▉| 37940/37963 [91:00:05<03:08,  8.21s/it]
                                                        
{'loss': '0.074', 'grad_norm': '3.459', 'learning_rate': '2.096e-11', 'epoch': '0.9994'}

100%|█████████▉| 37940/37963 [91:00:05<03:08,  8.21s/it]
100%|█████████▉| 37941/37963 [91:00:12<02:54,  7.94s/it]
100%|█████████▉| 37942/37963 [91:00:20<02:43,  7.80s/it]
100%|█████████▉| 37943/37963 [91:00:27<02:34,  7.75s/it]
100%|█████████▉| 37944/37963 [91:00:35<02:25,  7.67s/it]
100%|█████████▉| 37945/37963 [91:00:43<02:18,  7.70s/it]
100%|█████████▉| 37946/37963 [91:00:50<02:09,  7.64s/it]
100%|█████████▉| 37947/37963 [91:01:04<02:32,  9.53s/it]
100%|█████████▉| 37948/37963 [91:01:11<02:13,  8.88s/it]
100%|█████████▉| 37949/37963 [91:01:19<01:58,  8.48s/it]
100%|█████████▉| 37950/37963 [91:01:26<01:46,  8.18s/it]
                                                        
{'loss': '0.07712', 'grad_norm': '2.706', 'learning_rate': '7.133e-12', 'epoch': '0.9997'}

100%|█████████▉| 37950/37963 [91:01:26<01:46,  8.18s/it]
100%|█████████▉| 37951/37963 [91:01:34<01:36,  8.02s/it]
100%|█████████▉| 37952/37963 [91:01:42<01:27,  7.92s/it]
100%|█████████▉| 37953/37963 [91:01:56<01:37,  9.71s/it]
100%|█████████▉| 37954/37963 [91:02:03<01:21,  9.09s/it]
100%|█████████▉| 37955/37963 [91:02:11<01:08,  8.61s/it]
100%|█████████▉| 37956/37963 [91:02:18<00:58,  8.31s/it]
100%|█████████▉| 37957/37963 [91:02:26<00:48,  8.09s/it]
100%|█████████▉| 37958/37963 [91:02:33<00:39,  7.84s/it]
100%|█████████▉| 37959/37963 [91:02:41<00:30,  7.73s/it]
100%|█████████▉| 37960/37963 [91:02:48<00:23,  7.67s/it]
                                                        
{'loss': '0.07713', 'grad_norm': '3.695', 'learning_rate': '5.823e-13', 'epoch': '0.9999'}

100%|█████████▉| 37960/37963 [91:02:48<00:23,  7.67s/it]
100%|█████████▉| 37961/37963 [91:02:56<00:15,  7.58s/it]
100%|█████████▉| 37962/37963 [91:03:02<00:07,  7.38s/it]
100%|██████████| 37963/37963 [91:03:12<00:00,  8.06s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]

Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.08s/it]
Writing model shards: 100%|██████████| 1/1 [00:09<00:00,  9.08s/it]

                                                        
{'train_runtime': '3.278e+05', 'train_samples_per_second': '7.411', 'train_steps_per_second': '0.116', 'train_loss': '0.1405', 'epoch': '1'}

100%|██████████| 37963/37963 [91:04:02<00:00,  8.06s/it]
100%|██████████| 37963/37963 [91:04:02<00:00,  8.64s/it]

Writing model shards:   0%|          | 0/1 [00:00<?, ?it/s]
Writing model shards: 100%|██████████| 1/1 [00:16<00:00, 16.41s/it]
Writing model shards: 100%|██████████| 1/1 [00:16<00:00, 16.41s/it]
[rank0]:[W709 23:57:56.268732482 ProcessGroupNCCL.cpp:1476] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())